JP2018011850A - Moving image recording device, moving image distribution method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily edit a game video image.SOLUTION: A play moving image mediating server 12e receives first player moving image data including game video image data of a video image displayed following execution of a game, and control data related to the game video image data based on occurrence time of an execution situation according to the execution situation of a game, and generates second play moving image data of a video image obtained by editing a form for displaying a game video image based on the game video image data according to control data included in the first play moving image data.SELECTED DRAWING: Figure 12

Description

  The present invention relates to a moving image recording apparatus, a moving image generation method, and a program.

  In recent years, game machines installed at game centers and amusement facilities, or personal computers and game machines used in the home, can play games with other players connected via a network, in addition to running games in a stand-alone manner. Playing games has become commonplace.

  Conventionally, a system that allows a third party who does not participate in a battle game played on a network to be watched is also considered (see, for example, Patent Document 1). In a conventional watching system, a watching server is provided on a network, and data transmitted / received between a plurality of terminals is transmitted to the watching game by the watching server, thereby processing due to an increase in watching games of the fighting game. Eliminates the drop in speed.

JP 2001-170360 A

  In the prior art, the watching server holds data acquired from each game terminal as log data, and when the spectator accesses to watch the game, transmits the stored log data to the spectator's terminal. Just do it. For this reason, the spectator only saw the same video as the game video reproduced based on the log data, that is, the game video viewed by the players participating in the game. In order to display a video for the spectator different from the game video viewed by the player on the spectator's terminal, special processing for creating the video for the spectator is required. The work burden may increase. In particular, when an editing operation or the like by a producer is necessary for creating a video, it becomes difficult to make it possible to watch a battle game in real time.

  The present invention has been made in view of the above-described circumstances, and an object thereof is to provide a moving image recording apparatus, a moving image generating method, and a program capable of simplifying editing of a game image.

  In order to solve the above-described problems, the moving image recording apparatus of the present invention has the game video data of the game video displayed as the game is executed and the generation time of the execution status according to the game execution status. Receiving means for receiving first play video data including control data associated with the game video data, and based on the game video data in accordance with the control data contained in the first play video data And generating means for generating second play moving image data of the edited video.

  According to the present invention, it is possible to provide a moving image recording apparatus, a moving image generating method, and a program that can simplify editing of game video.

The block diagram which shows the structure of the moving image delivery system in this embodiment. The block diagram which shows an example of a structure of the store system in this embodiment. The block diagram which shows an example of a structure of the shop server in this embodiment. The block diagram which shows the structure of the game device in this embodiment. The block diagram which shows the structure of the game device in this embodiment, and a moving image output device. The figure which shows the frame pattern setting data prepared for the video processing (video processing program) in this embodiment. The figure which shows an example of the frame pattern (video reproduction frame) in this embodiment. The figure which shows an example of the data format of the play moving image data in this embodiment. The figure which shows an example of the execution condition (event) of the various games which the control data in this embodiment show. The figure which shows an example of the other data format of the 1st play moving image data format in this embodiment. The figure which shows an example of the 2nd play moving image data format which is the data format which edited the video data of the some image | video in this embodiment into one video data. The block diagram which shows the structure of the play moving image mediation server in this embodiment. The figure which shows notionally the storage format of the play moving image data of the play moving image mediation server in this embodiment. The figure which shows notionally the data format of the delivery setting data of the play moving image mediation server in this embodiment. The block diagram which shows the structure of the studio system in this embodiment. The flowchart shown about operation | movement of the game device in this embodiment. The flowchart for demonstrating the operation | movement of the play moving image setting process in this embodiment. The flowchart which shows an example of the delivery (1st delivery method, 2nd delivery method) by the data center in this embodiment. The flowchart which shows an example of the delivery of the play moving image data by the 3rd delivery method by the play moving image mediation server in this embodiment. The flowchart which shows an example of the moving image reproduction process in this embodiment. The figure for demonstrating the moving image reproduction process in this embodiment.

Embodiments of the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a moving image distribution system in the present embodiment. The video distribution system shown in FIG. 1 is a system that can more effectively use a play video representing the state of a game executed in a game device in a store system 10 provided in a game center or an amusement facility. . The moving image distribution system includes a plurality of store systems 10 (10-1, 10-2,..., 10-n), a data center 12, a studio system 14, a moving image distribution server 16, an electronic device 18 and the like existing throughout the country, Each is connected to each other via a network 2 such as the Internet. The store system 10 includes at least one game device.

  In the video distribution system according to the present embodiment, the play video includes, in addition to the game video displayed on the screen when the game is executed on the game device and the game sound output when the game is executed, other video shot through the camera when the game is executed. Includes audio input through video and microphone. For example, the video shot when the game is executed includes a video shot of the state of the player who plays the game in the game operation (the whole body, face, upper body, hands and feet operating the game, etc.), and is executed on the game device. The video includes a video of the surrounding audience watching the game, a video (still image) file (for example, a commercial video, a production video, etc.) recorded in advance separately from the execution of the game. The sound input at the time of game execution includes sound generated by the player, sound around the game device (including the audience), sound generated by a person other than the player, such as commentary on the game situation, It includes sound (for example, sound effects, BGM (back ground music)) by a separately recorded audio file.

  Furthermore, control data used for display control of the play video is included in the video (game video, photographed video) included in the play video. The control data is, for example, data indicating the execution status of various games, and is stored in association with video data based on the occurrence time of the execution status of various games. The game execution status includes, for example, determination of game start / end, occurrence of various events according to input commands, game win / loss, event success / failure, and the like based on game content. In addition, the game execution status, such as the action and sound of the player playing the game, the action and sound of the spectator watching the game, etc., occurs with the execution of the game but is not directly related to the game contents including.

  The play video data (play video data) includes a first play video data format that is a data format that can individually process video data of a plurality of videos, and one video by editing video data of a plurality of videos. There is a second play video data format of data format. The control data included in the play video data is, for example, edited to display the video by editing the play video data in the first play video data format by the video processing (video processing program) for displaying / editing the video data, or for the first play This can be used when the play video data in the video data format is changed to the second play video data format. For example, the video processing program automatically changes the video to be displayed on the screen, changes the frame pattern indicating the display mode of the video on the screen, and automatically adds editing effects according to the control data. Run it.

  The store system 10 is provided in a game center or an amusement facility, and includes at least one game device. The store system 10 can store play video data of a game executed on the game device, and can distribute or output the data to the outside. In the distribution of play moving image data, if play moving image data is generated during the execution of the game, it is immediately output to the outside. The distribution destination of play moving image data includes a data center 12 (play moving image mediation server 12e), a studio system 14, a moving image distribution server 16, and the like. In the output of play video data, when there is an output request for stored play video data, the play video data is output (copied) to a designated output destination. As an output destination of play moving image data, a recording medium such as a USB memory or a portable electronic device can be targeted in the store system 10.

  The game device provided in the store system 10 stores, for example, a game program of a plurality of games distributed from the data center 12 (authentication / distribution server 12a), and executes any game selected by the player's operation. Can do. In addition, the game device can execute a battle game with another game device in the same store or another game device provided in another store system 10.

  The data center 12 is a server group for managing the distribution of games and video data executed in a plurality of store systems 10, for example, an authentication / distribution server 12a, a ranking server 12b, a billing / storage server 12c, and a matching server 12d. The play moving image mediation server 12e is included.

  The authentication / distribution server 12a performs an authentication process on the identification data (card ID recorded on the card) presented by the player using the game device of the store system 10. The authentication / distribution server 12a distributes a program, data, and the like for executing the game selected by the player to the game device on which the identification data (card ID) is presented.

  The ranking server 12b aggregates the game results of the games executed in all the game devices of the store system 10, and generates ranking data for each identification data (card ID) authenticated by the authentication / distribution server 12a. The ranking server 12b generates ranking data for each of a plurality of games that can be executed on the game device. The ranking server 12b can distribute the ranking data to, for example, a game device or an electronic device (personal computer, smartphone, etc.) used by the player.

  The billing / storage server 12c generates a bill when the game is executed in the game device of the store system 10, and records the bill amount for each store system 10, for example.

  When the game executed in the game device of the store system 10 is a battle game, the matching server 12d matches a player (identified by a card ID) that is in a battle waiting state. For example, the matching server 12d performs an inter-store battle that executes a battle game between game devices of different store systems 10 and an in-store battle that executes a battle game between other game devices in the same store system 10. Perform matching according to each. In the case of a store-to-store match, the matching server 12d matches a player by one of the matching methods of (a) rank matching, (b) friend matching, and (c) store matching, for example, according to a designation from the player. be able to.

  (A) Rank matching allows a player to specify a rank (or numerical value such as a rank, a point, etc.) set based on the game result for each player (card ID), and this designated rank (a rank, a point) Etc.) are matched with other players waiting for a match. (B) In the friend matching, matching is performed only with an opponent designated by the player. (C) In store matching, matching is performed with an opponent who is waiting for a battle in a game device installed in a designated store (store system 10). The matching server 12d notifies the execution of the battle game to a plurality of game devices used by the players matched as the opponent. The game device notified of the execution of the battle game from the matching server 12d executes the game while transmitting and receiving data and the like necessary for the battle game.

  The play moving image mediation server 12e receives and records the play moving image data distributed from the store system 10, and distributes it to the studio system 14, the moving image distribution server 16, the electronic device 18, or the like. The play video mediation server 12e is a first data format delivery method that delivers play video data (first play video data format) received from the store system 10 as it is, and a plurality of play video data included in the play video data received from the store system 10 It is possible to execute a second data format distribution method that edits the video data (or audio data) and generates and distributes play moving image data (second play moving image data format) for distribution.

  The studio system 14 is a system for generating moving image content (broadcast program) for Internet broadcasting and the like and distributing it through the network 2. The studio system 14 distributes moving image content such as the actual state of a game executed on the game device based on play moving image data distributed from the store system 10 or the data center 12 (play moving image mediation server 12e), for example. In particular, the studio system 14 edits game images displayed on a plurality of game devices, images taken of commentators or spectators in the studio, etc., when a battle game is executed between the plurality of game devices. Can be combined to generate video content.

  The video distribution server 16 is a server that establishes a video sharing site (video posting site) on the Internet, for example, records a video posted (uploaded) by a user, and responds to a request from the user via the network 2 (Internet). Deliver video via. The moving image distribution server 16 receives posts of play moving image data including game images distributed from the data center 12 (play moving image mediation server 12e) or the store system 10, and distributes the same as other general moving images. For example, the moving image distribution server 16 can store the posted play moving image data and distribute it in response to an access request through the network 2 or can distribute the posted play moving image data in real time.

  The electronic device 18 is, for example, a device owned by a player who plays a game in the game device of the store system 10. The electronic device 18 is a device having a communication function, such as a personal computer (PC), a tablet PC, a smartphone, a mobile phone, and a game machine. The electronic device 18 can receive and browse the moving image distributed from the studio system 14 and the moving image distribution server 16 through the network 2.

FIG. 2 is a block diagram showing an example of the configuration of the store system 10 in the present embodiment.
As shown in FIG. 2, the store system 10 is connected to the network 2 through a router 20. The router 20 is connected to the router 20 through the hub 21, a plurality of game devices 26 (26-1, 26-2,..., 26 -m), a video output device 28, and the like. The store server 24, the plurality of game devices 26 (26-1, 26-2,..., 26-m), and the moving image output device 28 are connected to each other via a network such as a LAN (Local Area Network).

  The store server 24 has a function for managing a plurality of game devices 26 installed in the store. For example, the store server 24 executes setting or changing of a function for storing (recording) / output / distributing play video data of a game executed in each of the plurality of game devices 26. Further, the store server 24 can store (record) / output / distribute play moving image data including a game video of a game executed on the game device 26 instead of the game device 26, for example. The store server 24 also has a function of copying (outputting) the stored play video data to a recording medium such as a USB memory owned by the player or a portable electronic device.

  The game device 26 is a device that executes a game in accordance with a player's input operation. For example, the game device 26 stores game programs of a plurality of games distributed from the data center 12 (authentication / distribution server 12a), and executes any game selected by the operation of the player. In addition, the game device 26 is a stand-alone solo play by one player, an in-store play that plays against another player of the other game device 26 in the same store, or an inter-store play that plays against the game device 26 of another store. You can run the game. Further, the game device 26 has a function of storing (recording) / output / distributing game play video data in accordance with the setting by the store server 24. The game device 26 has a function of copying (outputting) the stored play video data to a recording medium such as a USB memory owned by the player or a portable electronic device.

  The moving image output device 28 has a function of storing (recording) / output / distributing play moving image data of a game executed on the game device 26 instead of the game device 26. The video output device 28 inputs various data for generating play video data from peripheral devices such as the game device 26, camera, microphone, etc., and plays video data to be stored (recorded) / output / distributed. Generate.

FIG. 3 is a block diagram illustrating an example of the configuration of the store server 24 in the present embodiment.
As shown in FIG. 3, the store server 24 includes a processor 24a, a memory 24b, a storage device 24c, a display unit 24d, an input unit 24e, a communication unit 24f, a media I / F 24g, and a card reader 24j.

  The processor 24a executes various processes such as overall control of the store server 24, management of data stored in the storage device 24c, control of the game device 26, and the like based on programs and data stored in the memory 24b.

  The memory 24b stores various programs executed by the processor 24a, temporary data executed by various processes, and the like. The program stored in the memory 24b includes a basic program (OS (Operating System)), an authentication process for the card ID read by the card reader 24j, and a plurality of programs executed in accordance with the operation of the store manager. A setting processing program for performing setting processing regarding recording / distribution / output of play moving image data in the game device 26 and the moving image output device 28, and processing (including video processing) regarding recording / distribution / output of play moving image data in the store server 24. A moving image processing program to be executed is included. In the setting process, for example, presence / absence of storage (recording) of play video data, presence / absence of distribution of play video data, distribution destination of play video data, presence / absence of real time distribution of play video data, output of play video data (storage medium) Recording / distribution / output of play video data such as the presence / absence of copying), the data format of the play video data to be recorded / distributed / output (first play video data format, second play video data format), etc. Record the setting data for control.

  The storage device 24c stores various programs and data. The storage device 24c stores, in addition to the play moving image data of the game executed by the game device 26, setting data indicating setting contents by the setting process. The storage device 24 c can also store a plurality of game programs distributed from the data center 12. In the storage device 24c, when playing video data output from a plurality of game devices 26 is stored, it is stored in association with the card ID read from the card presented by the player. Further, not only the card ID but also other identification information for identifying the play video data may be stored in association with each other. The other identification information can be, for example, information (for example, an alphanumeric string or a code image) generated by the game device 26 every time the game is executed (each time play video data is generated).

  The display unit 24d displays a screen corresponding to the processing by the processor 24a on a display such as an LCD (Liquid Crystal Display).

  The input unit 24e inputs data and instructions according to various processes by the processor 24a through an input device such as a keyboard or a mouse.

  The communication unit 24f controls communication via the network 2 under the control of the processor 24a.

  The media I / F 24g is an interface for transmitting / receiving data to / from an external recording medium (USB memory or the like) or an electronic device. The media I / F 24g includes, for example, a connector that electrically connects a recording medium and an electronic device, and a communication unit that controls proximity wireless communication.

  The card reader 24j reads identification data (card ID) recorded on a card issued in advance to the player, for example, by proximity wireless communication.

  FIG. 4 is a block diagram showing a configuration of the game device 26-1 in the present embodiment. Game device 26-1 shows the example of composition which provided the function which creates play animation data in the device main part.

  As shown in FIG. 4, the game device 26-1 includes a processor 26-1a, a memory 26-1b, a storage device 26-1c, a display unit 26-1d, an input unit 26-1e, a communication unit 26-1f, and a media I. / F26-1g, input I / F26-1h, card reader 26-1j, cameras 26c1, 26c2, 26c3, and microphones 26m1, 26m2.

  The processor 26-1a executes various processes such as overall control of the game apparatus 26-1 based on programs and data stored in the memory 26-1b. The processor 26-1a executes game processing based on the game program of the game selected by the player's operation. Further, the processor 26-1a executes processing related to recording / distribution / output of play moving image data including game video and game sound generated along with execution of the game processing based on the moving image processing program.

  The memory 26-1b stores various programs executed by the processor 26-1a, temporary data executed by various processes, and the like. The program stored in the memory 26-1b is selected by an operation of a player, an authentication processing program for performing an authentication process on the card ID read by the card reader 26-1j, in addition to a basic program (OS (Operating System)) A game program for executing game processing of the played game, a moving image processing program for executing processing (including video processing) regarding recording / distribution / output of play moving image data accompanying execution of the game processing, and the like.

  The storage device 26-1c stores various programs and data. The storage device 26-1c stores programs corresponding to a plurality of different games (titles) distributed from the data center 12 (authentication / distribution server 12a), and the game programs selected by the operation of the player are stored. It is read to the memory 26-1b. In addition, the storage device 26-1c stores setting data indicating setting contents by setting processing by the store server 24, game play moving image data, and the like. The play video data is stored in association with the card ID (and other identification information issued for each game) read by the card reader 26-1j. Although the setting data is set by the setting process in the store server 24, it may be set by the setting process in each game device 26.

  The display unit 26-1d displays a screen corresponding to the processing by the processor 26-1a on a display such as an LCD (Liquid Crystal Display).

  The input unit 26-1e inputs data and instructions corresponding to various processes by the processor 26-1a through an input device such as a joystick, a button, a game-specific input device, or a touch panel.

  The communication unit 26-1f controls communication via the network 2 under the control of the processor 26-1a.

  The media I / F 26-1g is an interface for transmitting / receiving data to / from an external recording medium (USB memory or the like) or an electronic device. The media I / F 26-1g includes, for example, a connector that electrically connects a recording medium and an electronic device, and a communication unit that controls proximity wireless communication.

  The input I / F 26-1h is an interface for inputting data from an external device. Examples of the external device include a plurality of cameras 26c1, 26c2, and 26c3 and a plurality of microphones 26m1 and 26m2.

  The card reader 26-1j reads the card ID recorded on a card issued in advance to the player, for example, by proximity wireless communication. Note that by providing a card reader / writer (electronic money unit), data transmission / reception for payment of a play fee may be performed with a card used as electronic money.

  The cameras 26c1, 26c2, and 26c3 take images. For example, the camera 26c1 inputs an image of a player operating the input device, the camera 26c2 inputs an image including the player's face, and the camera 26c3 inputs an image of the audience. Used for.

  The microphones 26m1 and 26m2 input sound. For example, the microphone 26m1 is used to input a player's voice, and the microphone 26m2 is used to input sounds around the game device 26-1 including the audience.

  FIG. 5 is a block diagram showing configurations of the game device 26-2 and the moving image output device 28 in the present embodiment. The game device 26-2 does not have a function of recording play video data, and is configured as a game-only machine. The game device 26-2 is used alone without being connected to the video output device 28 when recording / distribution / output of play video is unnecessary. When recording / distribution / output of a play video is required, the video output device 28 is connected.

  As shown in FIG. 5, the game device 26-2 includes a processor 26-2a, a memory 26-2b, a storage device 26-2c, a display unit 26-2d, an input unit 26-2e, a communication unit 26-2f, and an input I. / F26-2h and card reader 26-2j. 4 with the same name as the game device 26-1 is not described in detail because it has the same function as the game device 26-1.

  Since game device 26-2 does not execute processing relating to recording / distribution / output of play moving image data, a program for this processing is not stored. Further, the game device 26-2 displays the card ID read by the card reader 26-2j and the display unit 26-2d as the game is executed in order to record / distribute / output the play video data in the video output device 28. The video data of the game video to be played and the audio data at the time of game execution are output to the video output device 28. Further, the processor 26-2a outputs data indicating the game execution status to the video output device 28 in accordance with the execution of the game program. The data indicating the game execution status includes, for example, data indicating the start / end of the game, the occurrence of various events according to the input command, the determination of the game win / loss, the success / failure of the event, and the like.

  As shown in FIG. 5, the moving image output device 28 includes a processor 28a, a memory 28b, a storage device 28c, a communication unit 28f, an input I / F 28h, and a media I / F 28g.

  Based on the program and data stored in the memory 28b, the processor 28a performs overall control of the video output device 28, processing related to recording / distribution / output of play video data associated with execution of game processing, and storage in the storage device 28c. Various processes such as management of data to be executed are executed.

  The memory 28b stores various programs executed by the processor 28a, temporary data executed by various processes, and the like. The program stored in the memory 28b includes a basic program (OS (Operating System)) and processing related to recording / distribution / output of play moving image data accompanying execution of game processing in the game device 26-2 (including video processing). ) Is included.

  The storage device 28c stores various programs and data. The storage device 28c stores, in addition to play video data of the game executed by the game device 26-2, setting data indicating setting contents by setting processing by the store server 24, and the like. The play video data is stored in association with the card ID (and other identification information) read by the card reader 26-2j of the game apparatus 26-2.

  The communication unit 28f controls communication via the network 2 under the control of the processor 28a.

  The input I / F 28h is connected to cameras 29c1, 29c2, and 29c3 for inputting video used for creating a play video, and microphones 29m1 and 29m2 for inputting sound. FIG. 5 shows an example in which three cameras 29c1, 29c2, 29c3 and two microphones 29m1, 29m2 are connected to the input I / F 28h. However, any number of cameras and microphones can be connected to each of them. it can.

  The media I / F 28g is an interface for transmitting / receiving data to / from an external recording medium (USB memory or the like) or an electronic device. The media I / F 28g includes, for example, a connector that electrically connects a recording medium and an electronic device, and a communication unit that controls proximity wireless communication.

  The video output device 28 can be connected to a game device 26-2 that does not have a function of recording play video data, and can execute recording / distribution / output of the play video. For example, the moving image output device 28 is used by being connected to the game device 26-2 when recording / distribution of the play moving image of the battle game executed in the specific game device 26-2 is necessary. In FIG. 2, one moving image output device 28 is shown, but an arbitrary number of moving image output devices 28 can be installed as necessary.

  The store system 10 can distribute / output play video data from the store server 24, the game device 26, or the video output device 28, and each can be distributed / output from any one or more. It can be operated. Further, in each of the store server 24, the game device 26, and the video output device 28, a first data format distribution method for distributing play video data (first play video data format) as it is, and play video data in the first play video data format. The second data format distribution method can be used in which a plurality of video data (or audio data) included in the video data is edited to generate and distribute play video data (second play video data format) for distribution. Which one (at least one) of the first data format distribution method and the second data format distribution method is used may be set in advance in each device, or may be determined by the manager of the store system 10 or the operation of the player. It may be set accordingly.

  Next, the form which displays the play animation delivered / output in the animation delivery system in this embodiment is demonstrated. In the video processing (video processing program), video is displayed according to a frame pattern indicating a mode for displaying video on the screen based on the play video data in the first play video data format. In the video processing (video processing program), the play video data in the first play video data format can be edited (converted) into the second play video data format for displaying a screen corresponding to the frame pattern.

  FIG. 6 shows frame pattern setting data prepared for video processing (video processing program) in the present embodiment. As shown in FIG. 6, in the frame pattern setting data, different frame patterns 1, 2,..., X are set in association with a plurality of frame numbers (numbers).

FIG. 7 shows an example of a frame pattern (moving image playback frame) in the present embodiment.
FIG. 7A shows an example of a frame pattern in which one screen is equally divided into four to display four videos (1, 2, 3, 4). Since the frame pattern shown in FIG. 7A equally divides the screen into four, for example, when playing video is displayed at 4K resolution, four images can be displayed at 2K resolution (high vision). The frame pattern shown in FIG. 7B shows an example in which one video area is enlarged and a plurality of (for example, six) video areas are reduced. In FIG. 7B, by increasing the number of areas, for example, even if the game video output from the game device 26 and the three videos shot by the camera are always displayed, the other two videos (for example, , Commercial video, production video, video synthesized in the studio, etc.) can be displayed simultaneously. In the frame pattern shown in FIG. 7B, the main video (for example, game video) can be enlarged and displayed, and the other video (for example, video of players, spectators, etc.) can be reduced and displayed. The frame pattern shown in FIG. 7C shows an example in which only one video is selected and displayed. In the frame pattern shown in FIG. 7D, in addition to one enlarged area and two reduced areas for displaying a video, an image or text other than the video (for example, a commercial image, a commentary text, etc.) is displayed. An example in which an area to be displayed is provided is shown.

  Note that the frame patterns shown in FIGS. 7A to 7D are examples, and patterns of other forms can be used. Also, the video displayed in each area of the frame pattern is not fixed, and can be switched according to, for example, control data added to the video data. Moreover, while displaying one play moving image, it is also possible to switch a frame pattern according to control data, for example, or to change the size and shape of a specific area in a frame pattern dynamically.

  FIG. 8 is a diagram showing an example of the data format of play video data in the present embodiment. FIG. 8 shows an example of a first play moving image data format that is a data format capable of individually processing a plurality of video data.

  For example, the game device 26 generates a game video (video data 1) and game sound (audio data 1) as the game is executed. Further, the game apparatus 26, for example, a video (video data 2) obtained by photographing a hand operating the player's input device with the camera 26c1, a video (video data 3) obtained by photographing the figure including the player's face with the camera 26c2. The video (video data 4) which image | photographed the state of the audience by 26c3 is input. Furthermore, the game device 26 inputs the player's voice through the microphone 26m1, inputs the sound around the game device 26-1 including the audience through the microphone 26m2, and mixes to generate the voice data 2. Note that the audio data input from each of the microphones 26m1 and 26m2 may be independent data without being mixed.

  Furthermore, the game device 26 generates control data indicating the execution status (event) of various games. The control data includes, for each event, data indicating, for example, the occurrence time of various game execution statuses, images to be associated, and game execution statuses (events, etc.).

  FIG. 9 is a diagram illustrating an example of execution states (events) of various games indicated by the control data in the present embodiment.

  For example, as an event before the game starts, there is reading of a card ID by the card readers 26-1j and 26-2j. When a video (video data 3) taken by the player from the start of the game is input by the camera 26c2, control data corresponding to the card ID reading event is generated in association with the video data 3.

  Further, as events that occur while the game is being executed on the game device 26, for example, game start / end, occurrence of various events according to the input command (1, 2,...), Game win / loss and event success / failure. and so on. When the event described above occurs, the game program outputs data indicating the event that has occurred. Control data is generated in accordance with each event that occurs along with the execution of the game, and is associated with the game video (video data 1) generated with the execution of the game.

  Also, an event can be generated by detecting a predetermined action of the player based on video data from the cameras 26c1 and 26c2 that photograph the player. For example, a predetermined action (raising an arm, moving a head greatly, a smile, etc.) using an existing image recognition process based on a video (video data 3) obtained by photographing a figure including the face of a player by the camera 26c2. , Etc.). When a predetermined operation is detected, control data associated with the video data 3 is generated. If an event is detected based on the video (video data 2) captured by the camera 26c1, control data associated with the video data 2 is generated in the same manner.

  Further, it is also possible to detect the occurrence of a predetermined sound based on the sound data from the microphone 26m1 that inputs the player's sound, and to generate the event. For example, when a sound having a volume equal to or higher than a predetermined set value is input (for example, the player shouts), it is detected that a predetermined word is uttered by a voice recognition process for the input voice. When the generation of a predetermined sound is detected, control data associated with the audio data is generated.

  Similarly, the occurrence of an event is detected based on video data from the camera 26c3 that captures the audience, or audio data from the microphone 26m2 that inputs sound around the game device 26-1 including the audience. Control data corresponding to each can be generated.

  In this way, the game execution status, such as the action and sound of the player playing the game, the action and sound of the spectator watching the game, etc. that occur with the execution of the game but are not directly related to the game content Control data corresponding to each occurrence can be generated and stored in association with video data or audio data.

  In the above description, the case where play video data is generated in the game device 26 has been described. Similarly, the video output device 28 also includes a plurality of video data 1-4, audio data 1-2, and control data. Play video data can be generated based on the original.

  The video output device 28 inputs video data 1 and audio data 1 associated with execution of the game process in the game device 26-2 from the game device 26-2, and inputs video data 2 to 4 from the cameras 29c1, 29c2, and 29c3. Then, audio data is input from the microphones 29m1 and 29m2, respectively. As described above, the moving image output device 28 detects the occurrence of an event based on the input video data and audio data, and generates control data corresponding to the occurrence of each event. In addition, the video output device 28 can receive the card ID read by the card reader 26-2j from the game device 26-2, and can detect an event of reading the card ID.

  FIG. 10 is a diagram illustrating an example of another data format of the first play moving image data format in the present embodiment. In the first play moving image data format shown in FIG. 8, control data is generated separately from the video data and the audio data, but in the data format shown in FIG. 10, the control data is included in the video data.

  For example, the game video (video data 1) generated in the game device 26 is controlled together with the video data generated at the timing when the event occurs according to the event generated while the game is executed as described above. Store the data. For example, the control data can be stored as extension data in the data format of the video data. Since the extended data is associated with the video data generated in time series, the data indicating the video to be associated with the time is not required as in the control data shown in FIG. That is, it is sufficient to store only data indicating the game execution status (events, etc.). Similarly, when an event corresponding to each of the video data 2 to 4 input by the cameras 26c1 to 26c3 occurs, the control data is stored together with the video data input at that timing.

  As described above, since the first play moving image data format is a data format in which a plurality of video data can be individually processed, for example, in the studio system 14, the plurality of video data is individually processed and appropriately combined and edited. To display the video. At this time, in the video processing (video processing program), the frame pattern is automatically switched based on the control data associated with the video data and the event occurrence time, regardless of the editing operation by human operation. You can edit the video. For example, it is possible to switch the video to be displayed, change the shape or size of the area in which the video is displayed.

  FIG. 11 shows an example of a second play moving image data format, which is a data format in which video data of a plurality of videos in the present embodiment is edited into one video data. The second play moving image data format is used when, for example, a video edited by combining a plurality of video data is delivered / output as it is.

  The video data shown in FIG. 11A is obtained by editing video data 1 generated by the game apparatus 26 shown in FIG. 8A and video data 2 to 4 input from the cameras 1 to 3 by video processing. This is the video data created. Moreover, the audio data shown in FIG. 11B is audio data obtained by mixing the audio data 1 shown in FIG. 8B and the audio data 2 shown in FIG. The control data shown in FIG. 11C is generated according to the execution status (event) of various games detected based on the video data 1 to 4 and the audio data 1 to 3. The control data includes data indicating the occurrence time of various game execution statuses and game execution statuses (events, etc.) for one event.

  The video data in the second play video data format is associated based on the video data and the event occurrence time by video processing (video processing program), as in the case of editing the first play video data format described above. It can be generated by video editing such as switching the frame pattern automatically based on the control data.

Next, the play moving image mediation server 12e in this embodiment will be described.
FIG. 12 is a block diagram showing a configuration of the play video mediation server 12e in the present embodiment. As shown in FIG. 12, the play video mediation server 12e includes a processor 30a, a memory 30b, a storage device 30c, and a communication unit 30f.

  Based on the programs and data stored in the memory 30b, the processor 30a controls the entire play video mediation server 12e, receives play video data transmitted from the store system 10, and plays video stored in the storage device 30c. Various processes such as data management, video processing for video editing of play video data, and control of transmission (distribution) of play video data are executed.

  The memory 30b stores various programs executed by the processor 30a, temporary data executed by various processes, and the like. The program stored in the memory 30b includes a basic program (OS (Operating System)), a moving image storage / distribution processing program for executing moving image storage / distribution processing for transmitting and receiving play moving image data, and video for play moving image data. A video processing program for executing video processing to be edited is included. In the moving image storage / distribution process, for example, a first moving method that receives play moving image data from the store system 10 and distributes it in real time to, for example, the studio system 14 or the moving image distribution server 16, and the play moving image stored in the storage device 30c. A second distribution method for distributing (posting) data to the video distribution server 16 or the like at a predetermined timing, or distribution of play video data to the video distribution server 16 or the electronic device 18 in response to a request from the electronic device 18 or the like. There is a third distribution method.

  The storage device 30c stores various programs and data. The storage device 30c stores play moving image data received from the store system 10, distribution setting data indicating a distribution destination (recording destination) of the play moving image data, and the like.

  The communication unit 30f controls communication via the network 2 under the control of the processor 30a.

  FIG. 13 is a diagram conceptually showing a storage format of play video data of the play video mediation server 12e in the present embodiment. As shown in FIG. 13, in the play moving image mediation server 12e, the play moving image data received from the store system 10 and the card ID (and other identification information issued for each game) received together with the play moving image data are used. It is stored in association.

  In the third distribution method, the play moving image mediation server 12e extracts and requests play moving image data corresponding to the card ID specified by the electronic device 18, for example, when a play moving image data distribution request is received from the electronic device 18. Deliver to the original.

  FIG. 14 is a diagram conceptually showing the data format of the delivery setting data of the play video mediation server 12e in the present embodiment. As shown in FIG. 14, in the play moving image mediation server 12e, the play moving image recording indicating the distribution destination (play moving image recording destination) of the play moving image data in association with the card ID received from the store system 10 as distribution setting data. The previous data is stored.

  For example, a player who executes a game in the game device 26 of the store system 10 registers the card ID and the play moving image recording destination data in the play moving image mediation server 12e in advance, so that the store system 10 (the store server 24 or the game device). 26) can be distributed to the play moving image recording destination (for example, the studio system 14, the moving image distribution server 16, and the electronic device 18) indicated by the play moving image recording destination data. .

  Furthermore, the frame number (number) of the frame pattern used for editing the play video data can be preset as the distribution setting data in association with the card ID. For example, when the play video data is distributed from the store system 10 to the play video mediation server 12e by the first data format distribution method, the play video mediation is performed using the frame pattern indicated by the frame number set as the distribution setting data. After the first play moving image data is edited in the second play moving image data format in the server 12e, it can be distributed to the studio system 14, the moving image distribution server 16, and the electronic device 18, for example.

  Further, additional data can be preset as distribution setting data in association with the card ID. The setting data includes video and presentation effects added to the play video data distributed from the store system 10 (the store server 24 or the game device 26) to the play video mediation server 12e, and a video (still image) added to the play video data. This is data indicating a moving image (still image) file or the like. By setting additional data, the play video data distributed from the store system 10 can be edited such as adding a production effect to the video, or a video (still image) file (for example, a commercial video) Play video data after editing to add a production video or the like can be distributed to the studio system 14, the video distribution server 16, and the electronic device 18, for example.

  The distribution setting data can be set in the play video mediation server 12e through the network 2 by, for example, an operation in the store system 10 (the store server 24 or the game device 26) and a player operation on the electronic device 18. Further, it can be set directly by the operation of the administrator of the data center 12 (play moving image mediation server 12e).

  FIG. 15 is a block diagram showing the configuration of the studio system 14 in the present embodiment. The studio system 14 is a system that can produce a program distributed through the network 2, for example. In the studio system 14, the game play video data executed in the store system 10 is used, and the game play video and video (sound) shot in the studio are transmitted from the program viewer through the network 2. For example, a program that broadcasts the actual situation of the game is produced in combination with data (for example, chat text data, post data to a simple blog, etc.). In particular, the studio system 14 combines a video that broadcasts a battle game executed between a plurality of store systems 10 (game devices 26) with a video that combines play video data distributed from each of the plurality of store systems 10. You can create and add video and audio of commentators and spectators in the studio and broadcast (network distribution).

  As shown in FIG. 15, the studio system 14 includes a processor 32a, a memory 32b, a storage device 32c, a display unit 32d, an input unit 32e, a communication unit 32f, an input I / F 32h, cameras 32c1, 32c2, 32c3, and a microphone 32m1, 32m2.

  The processor 32a executes various processes such as overall control of the studio system 14 based on programs and data stored in the memory 32b. The processor 32a executes broadcast program production / distribution processing using play moving image data in accordance with an operation of a program production staff in the studio or the control data of the play moving image data.

  The memory 32b stores various programs executed by the processor 32a, temporary data executed by various processes, and the like. The program stored in the memory 32b includes a basic program (OS (Operating System)), a program production / distribution processing program for program production / distribution processing, and processing related to recording / distribution / output of play video data. A moving image processing program is included. The moving image processing program includes a video processing program for executing video processing for editing video for play moving image data.

  The storage device 32c stores various programs and data. The storage device 32c stores play moving image data, distribution program data, and the like received from the store system 10 or the data center 12 (play moving image mediation server 12e).

  The display unit 32d displays a screen corresponding to the processing by the processor 32a on a display such as an LCD (Liquid Crystal Display).

  The input unit 32e inputs data and instructions corresponding to various processes by the processor 32a through an input device such as a keyboard, a button, or a touch panel.

  The communication unit 32f controls communication via the network 2 under the control of the processor 32a.

  The input I / F 32h is an interface for inputting data from an external device installed in a studio or the like. Examples of the external device include a plurality of cameras 32c1, 32c2, and 32c3 and a plurality of microphones 32m1 and 32m2. An arbitrary number of cameras and microphones can be provided.

  The cameras 32c1, 32c2, and 32c3 are used, for example, to input video images of commentators or spectators in the studio, for example.

  The microphones 32m1 and 32m2 are used, for example, for inputting voices of commentators and spectators in the studio, for example.

  The studio system 14 basically generates play video data in the second play video data format as program data for program distribution by video processing on the play video data received from the store system 10 or the play video mediation server 12e. The data is distributed by the second data format distribution method. Note that by using the first data format distribution method, it is also possible to individually distribute a plurality of video data and audio data included in play video data.

Next, the operation of the moving image distribution system in this embodiment will be described.
First, the operation of the game device 26-1 in the present embodiment will be described with reference to the flowchart shown in FIG. Note that other game devices 26 having the same functions as the game device 26-1 operate in the same manner, and the description thereof is omitted.

  When the power is turned on, the game device 26-1 (processor 26-1a) displays a game selection screen in which one of a plurality of game titles can be selected. When any game title is selected by the player operating the input device, the game device 26 sets the selected game title and starts the corresponding game program (step A1).

  When the coin-insertion is detected, or the deposit from the electronic money is detected (step A2, YES), the game device 26-1 displays, for example, “touch the card on the reader by the display unit 26-1d. A card authentication screen including a message such as “Please” is displayed to display a player authentication card authentication screen (step A3). Here, the card ID recorded on the card is read by the card reader 26-1j by the operation of the player.

  After the card authentication screen is displayed, for example, when the card reader 26-1j does not read the card even after a certain period of time has elapsed (step A4, none), the game device 26-1 has the advantage of using the card. A screen for explanation is displayed on the player (step A5). After that, when it is detected that a charge necessary for starting use of the game or payment from electronic money is detected (step A6, present), the game device 26-1 executes a mode setting process for setting the game mode. .

  On the other hand, if the card ID is read by the card reader 26-1j before the game device 26-1 detects coin insertion or payment from electronic money (step A2, none), is the card usable? Perform authentication processing. When the game device 26-1 is authenticated as a usable card (Yes in Step A7), the game device 26-1 transmits the card ID to the authentication / distribution server 12a of the data center 12, and the player corresponding to the card ID Confirm registration.

  The authentication / distribution server 12a determines whether or not player data corresponding to the card ID received from the game device 26 is recorded. If the player data corresponding to the card ID is not recorded, the authentication / distribution server 12a notifies the game device 26 that it is a new player, and if the player data corresponding to the card ID is recorded, Player management data including data relating to the corresponding player is transmitted to the game device 26.

  When the game apparatus 26-1 is notified that the game apparatus 26-1 is a new player from the authentication / distribution server 12a (step A9, none), for example, “This card is an unregistered card in this game apparatus. A new player registration screen including the message “Do you want to do it?” Is displayed to prompt registration of a player name, for example. Here, when the execution of new registration is instructed, the game device 26-1 displays an operation screen for player registration, and registers data related to the player such as a player name by the operation of the player. The game device 26-1 transmits the card ID read from the new card and data such as the player name input by the player operation to the authentication / distribution server 12a for recording.

  On the other hand, when the game apparatus 26-1 receives the player management data from the authentication / distribution server 12a, that is, when the player has already been registered (step A9, present), the data related to the player (included in the player management data) ( (Player information) is displayed on a display, for example (step A11). For example, the player information includes a player name, a custom image, a level and title, an acquired item, a player result, and setting contents of a play video setting process (described later) included in the player management data. In the play video setting process, various information for recording the play video is set.

  Note that in the game device 26-1 of the present embodiment, two players can simultaneously execute a game. After the card ID is read by the card reader 26-1j (Yes at Step A7), the game device 26-1 again uses the card ID (No at Step A6) before the credit is established (No at Step A6). When “difference from the previous time” is read (step A8, Yes), a two-player mode in which two players simultaneously participate in the game is set (step A12). When the two-player mode is set, the game device 26-1 displays player information corresponding to each card ID.

  When the credit condition is satisfied (Yes at Step A6), the game device 26-1 displays a mode selection screen for selecting the game mode on the display (Step A13). The game modes that can be selected on the mode selection screen include, for example, a normal mode in which a game is executed only on the game device 26-1 and a battle mode. The battle mode is a mode in which a player who plays at the same time on another game device 26 plays a battle, and an inter-store battle in which a battle game is executed between the game devices 26 of different store systems 10 and the same store system 10. There is an in-store battle where a battle game is executed with another game device 26. When the store-to-store battle is designated by the player, the player is further made to select a matching method of rank matching, friend matching, or store matching.

  Furthermore, in the game device 26-1 in the present embodiment, it is possible to specify whether or not to record a play video on the mode selection screen by a player operation.

  When the game device 26-1 is designated to record the play video (step A14, Yes), the game device 26-1 performs a play video setting process for performing various settings relating to the recording of the play video. In the play moving image setting process, the play moving image data recording destination (distribution destination) and data for controlling the generation of the play moving image data can be set by the operation of the player when the game is executed.

FIG. 17 is a flowchart for explaining the operation of the play video setting process in the present embodiment.
First, the game device 26-1 determines whether or not the card ID of the card presented by the player has been authenticated, and the player information received from the authentication / distribution server 12a includes the setting content of the play video setting process. Here, the game device 26-1 determines that the card ID has not been authenticated, or if the card ID has already been authenticated but the setting information of the play video setting process is not included in the player information (step B1, No). ), A setting screen for setting various information for recording the play video is displayed.

  First, the recording destination of the play video data is set according to the player's instruction (step B4). As the recording destination of play moving image data, for example, in-store recording (game device 26-1 or store server 24), data center recording to be recorded in the data center 12 (play moving image mediating server 12e), and moving image site posting are assumed. .

  Also, the frame pattern of the screen for displaying the play video is set according to the player's instruction. For example, a plurality of frame patterns (see FIG. 7) are displayed and any one is selected by the player. In addition, when the player can change the number of cameras 26c1, 26c2, 26c3 and microphones 26m1, 26m2 used and the shooting (sound recording) target, either one may be selected in accordance with the player's instruction ( Step B5).

  The game device 26-1 transmits the setting content set (or changed) in the play video setting process to the play video mediation server 12e, and stores it in association with the card ID. The setting content stored in the play moving image mediation server 12e can be read and used when a game is played on any game device 26 next time.

  In this way, when the setting of various information for recording the play video is completed, the game device 26-1 transmits data indicating the setting contents in association with the card ID to the play video mediation server 12e. The play moving image mediation server 12e stores the card ID and the setting content in association with each other.

  If the card ID has been authenticated and the setting information of the play video setting process is included in the player information (step B1, Yes), the game device 26-1 has been set based on the setting contents. The play video recording destination and the selected frame pattern are displayed (step B2). If there is no change in the setting content (step B3, No), the game device 26-1 ends the play moving image setting process.

  On the other hand, when there is a change in the setting contents (step B3, No), as described above, the game device 26-1 sets the recording destination of the play video and the frame pattern according to the instruction from the player ( Steps B4 to B6), the play video setting process is terminated.

  In addition, in the setting data for controlling recording / distribution / output of play video data, when the distribution destination of play video data is set, this setting content is set for the play video set by the play video setting process. It may be set as an initial value (default) of the recording destination. In the play video setting process, the above-described setting process may be executed.

  When the play video setting process ends, the game device 26-1 starts recording the play video (step A16). That is, recording of the video imaged by the cameras 26c1, 26c2, and 26c3 and recording of sound input from the microphones 26m1 and 26m2 are started. In addition, when game processing is started by the game device 26-1, recording of play moving image data (video, audio) accompanying execution of the game processing is executed.

  Furthermore, when the battle mode is selected on the mode selection screen (step A17, Yes), the game device 26-1 executes a player matching process for setting an opponent to battle (step A18). In the player matching process, when an in-store match is designated by the player, for example, the game device 26 that is first instructed to execute the in-store match play becomes the host player among a plurality of game devices 26 in the store, and other games are played. Recruit opponents (guests) for the device 26. If there is no battle request within a predetermined time, it is determined that the battle game cannot be executed, and the mode selection screen is displayed again. The store server 24 may receive a match request from each game device 26 in the store and execute the matching process.

  In the player matching process, when a match between stores is designated by the player, the matching server 12d is requested to match the opponent by a matching method (rank matching, friend matching, store matching) designated by the player.

  The matching server 12d executes matching according to the designated matching method when the match of the opponent is requested from the game device 26. For example, when rank matching is designated, the matching server 12d allows the player to designate the rank of the player as an opponent (or a numerical value such as a rank, point, etc.), and this designated rank (stage, point, etc.) Match with other matching players waiting for a match. In addition, when the friend matching is designated, the matching server 12d causes the player to designate an opponent (for example, a player name, a card ID, etc.), and performs matching only when a match request is made from the opponent designated by the player. Do. Further, when store matching is designated, the matching server 12d causes the player to designate a specific store (store system 10) (for example, from the store list), and waits for a match in the game device 26 installed in the designated store. Match with an opponent in a state.

  The matching server 12d notifies the execution of the battle game to the plurality of game devices 26 used by the players matched as the opponent.

  When the matching process is completed (step A19, Yes), the game device 26-1 starts the game process. In the case of a match between stores, the game device 26-1 starts the game process when the matching server 12d notifies the execution of the battle game, and the game device 26-1 as the opponent notified from the matching server 12d. , P2P (peer-to-peer) executes game processing while transmitting and receiving data and the like necessary for the execution of the battle game.

  Note that the game device 26-1 starts the game process without performing the matching process (steps A19 and A20) when the game in the normal mode is instructed by the player (step A17, No).

  The game device 26-1 starts the game process, thereby displaying the game video on the display and executing the game while outputting the game sound from a speaker or the like. The game device 26-1 generates and records play moving image data including a game video and game sound generated in accordance with the setting process (setting data) and the setting content of the play moving image setting process. To do. That is, the game device 26-1 records game video data (including sound data) of the game video, and controls the control data according to the game execution status as game video data based on the occurrence time of the execution status. It records in association with each other and generates play moving image data including game video data and control data. The game device 26-1 distributes / outputs the generated play moving image data to the play moving image recording destination (or the distribution destination indicated by the setting data) set by the play moving image setting process. The generation of play video data is omitted as it is executed as described with reference to FIG. 8, FIG. 10, or FIG.

  For example, if the setting data is set to deliver play video data in real time, the game device 26-1 plays the play video recording destination until the game processing is completed (No in step A22). The moving image data is distributed (step A21). For example, when the game content executed in the game device 26-1 is used in real time in a program produced by the studio system 14, or is distributed in real time from the moving image distribution server 16, real time is executed during execution of the game process. To play video data.

  The play video data may be distributed to the studio system 14 or the video distribution server 16 via the play video mediation server 12e, or directly from the store system 10 (the store server 24 or the game device 26-1). You may make it deliver to the studio system 14 or the moving image delivery server 16. FIG.

  For example, when distributing the play moving image data to the studio system 14, the game device 26-1 distributes the play moving image data in the first play moving image data format so that the play moving image data can be edited in the studio, for example. On the other hand, when posting to the video distribution server 16, the game device 26-1 distributes the play video data in the edited second play video data format so that the play video can be distributed from the electronic device 18 as it is. Since the processing for generating the play video data in the second play video data format is heavy, when delivering in real time, it is delivered to the video delivery server 16 via the play video mediation server 12e. That is, the play video mediation server 12e receives play video data from the game device 26-1 in the first play video data format, and uses the control data included in the play video data to play video in the second play video data format. Data is generated and distributed to the moving image distribution server 16.

  When the game process is completed (step A22, Yes), the game device 26-1 stops recording the play video data (step A23). And game device 26-1 records or distributes play animation data according to the setting contents of setting data (Step A24).

  For example, if the setting data is set to be recorded in the game device 26-1 or the store server 24 (or both), the game device 26-1 records play video data in association with the card ID. The play moving image data stored in the game device 26-1 or the store server 24 can be output (copied) to a recording medium such as a USB memory owned by the player or a portable electronic device, and taken home by the player.

  Further, in the setting data, when the play video data is not set in real time but in the studio system 14 or the video distribution server 16, the game device 26-1 is directly connected to the studio system 14 or the video distribution server 16. Or distributed to the studio system 14 or the moving image distribution server 16 via the play moving image mediation server 12e.

  The setting contents such as the destination of the play moving image data and the data format of the play moving image data described above are merely examples, and the setting contents can be arbitrarily changed by the player or the system administrator. In the above description, the game apparatus 26-1 is described as an example. However, the game apparatus 26-2 and the moving image output apparatus 28 operate in cooperation, whereby the above-described game apparatus 26-1. The same processing is executed. In other words, the game device 26-2 outputs various data necessary for generating play video data to the video output device 28, and the video output device 28 performs processing for recording / distributing / outputting the play video data. Let

  In this way, in the store system 10 (game device 26, video output device 28), the control data generated in accordance with the game execution status is based on the occurrence time of the execution status as the player executes the game. Play video data associated with game video data can be generated and recorded / distributed / output. The recording / delivery destination of play video data, the data format, the frame pattern used when editing the play video data, etc. can be set in the setting process or the play video setting process, and the play video data (including game video) Recording / distribution / output according to the purpose of use is possible. For this reason, play animation data (a game animation is included) can be used more effectively.

Next, operation | movement of the play moving image mediation server 12e in this embodiment is demonstrated.
The play moving image mediation server 12e receives and stores the play moving image data from the store system 10 by executing the moving image storage / distribution process, and the first to third distribution methods according to the preset setting contents. Play video data can be distributed by any method.

  In the first distribution method, for example, play moving image data is received from the store system 10 and distributed in real time to, for example, the studio system 14 or the moving image distribution server 16. In the second distribution method, the stored play moving image data is distributed (posted) to the moving image distribution server 16 or the like at a predetermined timing (for example, a predetermined time, a date specified by a player, a system administrator, or the like). )

  FIG. 18 is a flowchart showing an example of distribution (first distribution method, second distribution method) by the data center 12 in the present embodiment. FIG. 18 shows an example in which play moving image data of a battle game executed with a plurality of game devices 26 is distributed. Here, it is assumed that a battle game is executed between the game apparatuses A and B.

  Matching games of the game devices A and B are matched by the matching server 12d. The play moving image mediation server 12e receives the information specifying the game devices A and B that play the battle game from the matching server 12d (step C1). For example, the play video mediation server 12e uses the card ID read in each of them as information for identifying the game devices A and B, the store system 10 in which the game devices A and B are installed, information unique to the game device, or the game device. Identification information issued for each game executed in A and B can be used.

  When the battle game is executed in the game devices A and B, as described above, play video data is generated in each of the game devices A and B, and transmitted to the play video mediation server 12e. The play moving image mediation server 12e receives the play moving image data A and B from the game devices A and B, respectively (step C2), and stores the play moving image data A and B in association with each other. That is, the play video mediation server 12e uses the play video data generated by the battle game based on the card ID (or identification information, information unique to the game device, etc.) added to each of the play video data A and B. Identify and associate.

  When the real-time distribution is not designated (step C3, No), the play video mediation server 12e stores the play video data A and B in association with each other until the game on the game devices A and B ends. deep. The play video data stored here is distributed at a predetermined timing, for example, by the second distribution method.

  On the other hand, when real-time distribution is specified (step C4, Yes), the play video mediation server 12e generates play video data for distribution (step C5), and a pre-specified distribution destination (for example, a studio system). 14 or the moving image distribution server 16) (first distribution method) (step C6). The play moving image mediation server 12e generates play moving image data for distribution from the play moving image data A and B received from the game devices A and B, respectively, until the game on the game devices A and B is finished, and sequentially distributes them. Transmit first (steps C2 to C7).

  For example, when distributing to the studio system 14, the play video mediation server 12 e uses the first play video data as the play video data for distribution so that the play video data can be edited in the studio system 14. The play video data in the format is distributed as it is (first data format distribution method).

  Further, for example, when distributing to the video distribution server 16, the play video mediation server 12e edits and distributes a plurality of video data (or audio data) included in the play video data in the first play video data format. Play video data (second play video data format) is generated and distributed (second data format distribution method). Note that it is possible to arbitrarily set which data format is used for distribution. A method for generating play video data in the second play video data format will be described in a video playback process (FIG. 20) described later.

  In the example described above, an example of a battle game in which one player battles is described. However, when a battle game is executed between a plurality of players and a plurality of players, a plurality of players are mixed. It is also possible to target battle games that battle each other. The play moving image mediation server 12e receives the play moving image data from the game device 26 in which each player participating in the competitive game plays a game, stores it in association with each other, and performs the first distribution method or the first as described above. It can be distributed by two distribution methods.

  FIG. 19 is a flowchart showing an example of the distribution of play video data by the third distribution method by the play video mediation server 12e in the present embodiment.

  When a player plays a game on the game device 26, for example, the player sets the play moving image data to be distributed (stored) to the play moving image mediation server 12e. Thereby, as described above, the play video data of the game executed by the player is stored in the play video mediation server 12e in association with the card ID presented by the player (or identification information, information unique to the game device, etc.). .

  After that, the player accesses the play moving image mediation server 12e using the electronic device 18 at home or at any place, and transmits a play moving image data distribution request.

  When the play moving image mediation server 12e receives the distribution request from the electronic device 18 (step D1, Yes), as information for specifying play moving image data to be further distributed, for example, a card ID (and further presented at the time of game execution) Other identification information such as an alphanumeric string or a code image) is transmitted from the electronic device 18.

  The play video mediation server 12e receives the card ID (and other identification information) from the electronic device 18 (step D4), and identifies the play video data stored in association with the card ID (other identification information). (Step D3). The play moving image mediation server 12e transmits the play moving image data corresponding to the card ID to the distribution request source electronic device 18 (third distribution method) (step D4).

  In this way, by receiving the play video data via the play video mediation server 12e, the second play in which a plurality of video data (or audio data) included in the play video data in the first play video data format is edited. Play video data in the video data format can be received by the electronic device 18 at any timing desired by the player.

  Thus, in the video distribution system according to the present embodiment, the play video data including the game video of the game executed in the game device 26 is not only acquired by the game device 26 and the store server 24 in the store system 10, but also the data center 12. (Play animation mediation server 12e), studio system 14, animation distribution server 16, etc. can be distributed. Therefore, the game image can be used more effectively. Further, since the play video data can be distributed in a data format (first play video data format, second play video data format) according to the purpose of use at the distribution destination of the play video data, the game video can be effectively used. Can be efficient. In particular, in the play video data, the control data generated according to the game execution status is recorded in association with the game video data based on the occurrence time of the execution status, so video editing using the control data, etc. Is possible. For example, in the studio system 14, the video can be reproduced by editing the video using the control data of the play video data.

  Next, the moving image reproduction process executed by the studio system 14 of this embodiment will be described. FIG. 20 is a flowchart showing an example of the moving image playback process in the present embodiment. In the video playback process, for the play video data in the first play video data format received from the store system 10 or the play video mediation server 12e, video editing (display mode) is performed using control data by video processing (video processing program). Change) to generate program broadcast program data (play moving image data) in the second play moving image data format and reproduce the moving image. The studio system 14 automatically executes change of a video playback frame of a program video, switching of a video to be displayed, and the like not only by operation of a studio program production staff but also by control of a program based on control data. Can do.

  Here, for example, it is assumed that an image of a program that is live in a competitive game by two game devices A and B is generated and broadcast (network distribution) through the network 2. The studio system 14 combines the play video data received from each of the game devices A and B with the video (audio) and video (image) of the commentator and audience photographed in the studio, Produce programs that broadcast the actual conditions of The video of the program can also be created using other data such as data transmitted from the viewers of the program through the network 2 (such as chat text data, data posted to a simple blog, etc.).

  In the studio system 14, in order to create a video for a program, a moving image playback frame definition that defines the configuration of the video for the program is set (step E1). In the video playback frame definition, for example, a video playback frame (frame pattern) for displaying video on the screen, data for specifying video to be displayed in each frame in the frame pattern, and frame change according to control data included in the play video data And data indicating a change in video to be displayed.

  When the studio system 14 starts moving image reproduction (program production / distribution processing) (step E2), it switches to the initial moving image reproduction frame set in the moving image reproduction frame definition (step E3), and the video corresponding to each frame is displayed. Display (step E4).

  FIG. 21A shows a display example of video using an initial moving image playback frame. FIG. 21A shows an example of a frame pattern in which one screen is equally divided into four. For example, a display form before the battle game is started is defined. The video data (A2) (FIG. 8C) of the game apparatus A is displayed in the frame F11, and the video data (B2) (FIG. 8C) of the game apparatus B is displayed in the frame F12. Is shown. That is, an image obtained by shooting the players of the game apparatuses A and B before the battle game is started is displayed. Also, in the frame F13, for example, a video (S1) taken of a spectator in a studio, video data (A4) of the game device A (FIG. 8 (e)), and video (B4) of the game device B (FIG. 8 ( e)) is switched and displayed. A frame F14 indicates that a commercial video (C1) is displayed.

  FIG. 21B shows a display example of a video using another initial moving image playback frame. FIG. 21B shows an example of a frame pattern in which a plurality of small frames F22, F23, and F24 are provided in the main frame F21 as the entire screen, and as in FIG. The display form before the battle game is started is defined. In the frame F21, video data (A2) (B2) obtained by shooting the players of the game apparatuses A and B, video data (A4) and (B4) (FIG. 8 (e)) taken by the audience of the game apparatuses A and B, Alternatively, it indicates that any one of the images (S2) and (S3) taken by two commentators in the studio is switched and displayed. The frames F22 and F23 indicate that different commercial videos (C2) and (C3) are displayed. In the frame F24, for example, it is shown that a video (S1) taken of a spectator in a studio is displayed.

  When the occurrence of an event is detected from the control data of the play video data received from the game devices A and B (step E5, Yes), the studio system 14 responds to the control data (event) according to the video playback frame definition. Switching to the moving image playback frame (step E6). Further, according to the moving image playback frame definition, the video to be displayed in each frame of the switched moving image playback frame is switched as necessary.

  For example, when the control data indicating the start of the game is detected, the studio system 14 switches the moving image playback frame shown in FIG. 21A to the moving image playback frame for the battle game shown in FIG. FIG. 21 (c) enlarges one frame F31 to be a main frame, and displays game images (A1) and (B1) of the game apparatuses A and B. If the game video in the battle game is the same (third-party perspective) on the game devices A and B, one of the game videos (A1) and (B1) may be displayed. If the game images displayed on the game devices A and B are different (for example, a player viewpoint), the game images can be switched according to the game situation (occurrence of an event). For example, the game video (A1) of the game device A is displayed in the case of the attack turn of the player of the game device A, and the game video (B1) of the game device B is displayed in the case of the attack turn of the player of the game device B. To do.

  In addition, images (A2) and (B2) taken by the players of the game apparatuses A and B are displayed on the frames F32 and F33, respectively, and the hands of the players of the game apparatuses A and B are taken on the frames F34 and F35, respectively. Images (A3) and (B3) are displayed. That is, by displaying the game video and displaying the state of the player and the video at hand, it is possible to easily grasp the execution status of the battle game. The frame F36 displays a video (S1) taken of the audience in the studio.

  FIG. 21E shows a display example of a video using a moving image playback frame when another event occurs. For example, an example is shown in which there is control data indicating that the player of the game apparatus A has performed a special action (such as movement or utterance) set in advance. In this case, a video (A2) obtained by shooting the player of the game apparatus A is displayed in the frame F51 of the main frame in accordance with the control data (event). In addition, the game video (A1) is displayed in the frame F52 that has been taken by the player of the game apparatus A until then. Note that the frames F53, F54, and F55 continue to display the same video as the frames F33, F34, and F35 shown in FIG.

  FIG. 21G shows a display example of a video using a moving image playback frame when another event occurs. For example, an example in which there is control data indicating that the player of the game apparatus A has won the battle game is shown. In this case, in accordance with the control data (event), a game video (A1) at the end of the battle of the game apparatus A, that is, a video representing the battle win is displayed on the frame F71 of the main frame. The frames F72, F73, and F76 continue to display the same video as the frames F32, F33, and F37 shown in FIG. In the frames F74 and F75, since it is not necessary to display the video at the player's hand because the battle has ended, for example, different commercial videos (C4) and (C5) are displayed.

  In this way, it is possible to change the moving image playback frame and dynamically change the video displayed in the frame according to the game execution status included in the play moving image data and indicated by the control data.

  FIGS. 21C, 21E, and 21G show examples of moving image playback frames in which the screen is divided into tiles (the frames do not overlap), but are shown in FIGS. In this manner, a moving image playback frame that is changed so that the frame overlaps with another frame can be used.

  FIG. 21 (d) shows an example of a moving image playback frame during a battle game. In the moving image playback frame shown in FIG. 21D, the frame F41 for displaying the game video (A1) of the game apparatus A and the frame F42 for displaying the game video (B1) of the game apparatus B are overlapped. In frames F43 and F44, images (A2) and (B2) taken by the players of the game apparatuses A and B are displayed, respectively.

  Here, for example, when there is control data indicating that a special event has occurred in the game apparatus A, the frame F61 for displaying the game video (A1) of the game apparatus A is enlarged as shown in FIG. Thus, the frames are overlapped with the other frames F62, F63, and F64. Note that the images displayed on F61, F62, F63, and F64 continue to display the same images as the frames F41, F42, F43, and F44 shown in FIG.

  FIG. 21 (h) shows an example where there is control data indicating that the player of the game apparatus A has won the battle game, for example. In this case, according to the control data (event), the entire screen is set as the frame F81 of the main frame, and a game video (A1) at the end of the battle of the game apparatus A, that is, a video representing the battle win is displayed. In addition, a video (A2) taken by the player is displayed in a frame F82 that overlaps (overlaps) the frame F81.

  Thus, by changing the shape of the frame according to the game execution status indicated by the control data, it is possible to display a program video that can be expected to have various effects.

  In the above description, the shape of the video playback frame and the video to be displayed in the frame are switched according to the game execution status (event) indicated by the control data included in the play video data. It can also be controlled according to the operation by the staff. When the program production staff performs a switching operation of a frame and a switching operation of a video displayed in the frame (Yes in step E7), the studio system 14 executes switching of a moving image reproduction frame in accordance with this switching operation ( Step E8).

  The studio system 14 repeatedly executes the above-described processing (steps E4 to E9) until the moving image reproduction is finished (step E9, Yes).

  In this way, the studio system 14 performs video editing (change of the display form) using the control data included in the play video data by video processing (video processing program), and plays in the second play video data format. Movie data can be generated and played back. Therefore, it is possible to significantly reduce the operation burden on the studio program production staff, and to generate program broadcast program data (play movie data) and reproduce the movie (network distribution). In particular, it is effective when distributing the actual situation of a game executed on the game device 26 in real time.

  In the above description, the shape of the moving image playback frame and the switching of the video displayed in the frame are taken as an example. However, the switching of the audio output is also executed in conjunction with the switching of the video. In addition, in accordance with the timing indicated by the control data in the play video data, a sound not included in the play video data, for example, a sound effect such as a jingle prepared in advance, or a pre-prepared image such as a superimpose ( Editing can be added, such as adding text (including text) to the video.

  In the above description, the control data associated with the game video (video data 1 shown in FIG. 8A) is mainly taken as an example, but other video data (for example, the player and the audience were photographed). It is also possible to edit a moving image by using control data associated with video) and other audio data (for example, audio of players and spectators). In this case, for example, if the data to be controlled according to the control data is set in the video playback frame definition, such as switching the video according to the control data associated with the audio data, the video, audio, and other data Any video (commercial, etc.) may be used.

  Furthermore, in the example described above, a case where a one-on-one battle game is played between the game devices A and B is taken as an example. However, in a group battle game, a plurality of (three or more) game devices 26 are used. Play moving image data including game videos from the respective user viewpoints is transmitted. In such a case, based on the control data included in any play video data, the video and sound may be selected according to the game execution status to create a video.

  As described above, a method of editing video using control data based on play video data in the first play video data format and generating play video data in the second play video data format is In the system 10 (the store server 24, the game device 26) and the play moving image mediation server 12e, it can be executed in the same manner.

  Further, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  In addition, the method described in the embodiment is, for example, a magnetic disk (flexible disk, hard disk, etc.), optical disk (CD-ROM, DVD, MO, Blu-ray) as a program (software means) that can be executed by a computer. (Registered trademark), etc.), semiconductor memory (ROM, RAM, flash memory, etc.), etc., and can also be transmitted and distributed by communication media. The program stored on the medium side also includes a setting program that configures in the computer software means (including not only the execution program but also a table and data structure) that is executed by the computer. A computer that implements the present apparatus reads the program recorded on the recording medium, constructs software means by a setting program in some cases, and executes the above-described processing by controlling the operation by the software means. The recording medium referred to in this specification is not limited to distribution, but includes a storage medium such as a magnetic disk or a semiconductor memory provided in a computer or a device connected via a network.

  2 ... Network, 10 (10-1, 10-2, ..., 10-n) ... Store system, 12 ... Data center, 12a ... Authentication / distribution server, 12b ... Ranking server, 12c ... Billing / storage server, 12d ... Matching server, 12e ... Play video mediation server, 14 ... Studio system, 16 ... Video distribution server, 18 ... Electronic equipment, 24 ... Store server, 24a ... Processor, 24b ... Memory, 24c ... Storage device, 24d ... Display unit, 24e ... input unit, 24f ... communication unit, 24g ... media I / F, 24j ... card reader, 26 (26-1, 26-2, ..., 26-m) ... game device, 28 ... moving image output device.

Claims (7)

Game video data of a game video displayed as the game is executed, and control data associated with the game video data based on the occurrence time of the execution status according to the game execution status Receiving means for receiving play video data;
A moving image having generation means for generating second play moving image data of a video in which a form for displaying the game video is edited based on the game video data according to the control data included in the first play moving image data Recording device.   The moving image recording apparatus according to claim 1, wherein the control data indicates an event that occurs while the game is executed. Setting means for setting a definition indicating editing contents according to the game execution status indicated by the control data;
The moving image recording apparatus according to claim 1, wherein the generation unit performs editing in accordance with the contents of the definition corresponding to the control data detected from the first play moving image data.   4. The moving image recording apparatus according to claim 3, wherein the definition sets a frame pattern indicating a form for displaying an image on a screen. The play video data includes other video data different from the game video data,
4. The moving image according to claim 3, wherein in the definition, data specifying a video to be displayed in each frame in a frame pattern indicating a mode of displaying a video on a screen is set according to the control data. Recording device. Game video data of a game video displayed as the game is executed, and control data associated with the game video data based on the occurrence time of the execution status according to the game execution status Receive play video data,
A moving image generating method for generating second play moving image data of a video obtained by editing a form in which the game video is displayed based on the game video data in accordance with the control data included in the first play moving image data. Computer
Game video data of a game video displayed as the game is executed, and control data associated with the game video data based on the occurrence time of the execution status according to the game execution status Receiving means for receiving play video data;
According to the control data included in the first play moving image data, to function as a generation unit that generates second play moving image data of a video that is an edited form of displaying the game video based on the game video data. Program.