JP7123520B2 - MOVIE RECORDING DEVICE, MOVIE GENERATION METHOD, AND PROGRAM - Google Patents

Description

The present invention relates to a moving image recording device, a moving image generating method, and a program.

In recent years, game machines installed in game arcades and amusement facilities, personal computers and dedicated game machines used in homes, in addition to running games standalone, have become capable of playing against opponents connected via a network. Playing games has become commonplace.

Further, conventionally, a system has been conceived in which a third person who does not participate in the game can watch a competitive game played on a network (see, for example, Patent Document 1). In a conventional spectator system, a spectator server is provided on the network, and data sent and received between a plurality of terminal devices is transmitted to the spectators watching the game by the spectator server. Eliminates slowdown.

Japanese Patent Application Laid-Open No. 2001-170360

In the conventional technology, the spectator server retains data acquired from each game terminal as log data, and when a spectator accesses the game to watch the game, the retained log data is transmitted to the spectator's terminal. Just do it. For this reason, the spectators merely watched the game video reproduced based on the log data, that is, the same video as the game video viewed by the players participating in the game. In order to display an image for spectators that is different from the game image that the player sees on the spectator's terminal, special processing is required to create the image for spectators. Work load may increase. In particular, if editing operations or the like are required by the creator to create the video, it becomes difficult to allow viewing of the competitive game in real time.

SUMMARY OF THE INVENTION The present invention has been made in view of the circumstances described above, and an object of the present invention is to provide a moving image recording device, a moving image generating method, and a program that enable easy editing of game images.

In order to solve the above-described problems, the moving image recording apparatus of the present invention provides game image data corresponding to each of a plurality of game images displayed as the game is executed, and a plurality of game images generated as the game is executed. Simultaneously displaying one of the plurality of game images on a screen which is changed according to the occurrence of the execution situation, which is associated with the game image data based on the occurrence time of the execution situation, according to the execution situation. or any one of the plurality of game images and at least one of other images different from the game images taken through a camera during execution of the game or images in a file recorded in advance separately from the execution of the game. and control data corresponding to any one of a plurality of different frame patterns provided with a plurality of areas for individually displaying a plurality of images, showing a second form of displaying one of the images. and a setting means for presetting a frame pattern indicating a mode of displaying an image on the screen according to the execution status of the game indicated by the control data, which is used for editing the first play video data. and, when the control data detected from the first play video data received by the receiving means indicates the first mode, any one of the plurality of game videos based on the game video data A first video edited to be individually displayed in areas of a first frame pattern corresponding to the control data indicating the first form set in advance, or the control data indicating the second form. In this case, one of the plurality of game images based on the game image data and an image corresponding to data different from the game image and stored in advance separately from the execution of the game are set in advance. Generating means for generating second play moving image data of a second video edited so as to be individually displayed in areas of a second frame pattern different from the first frame pattern corresponding to the control data indicating the second form. and

According to the present invention, it is possible to provide a moving image recording device, a moving image generating method, and a program that can simplify editing of game images.

1 is a block diagram showing the configuration of a video distribution system according to this embodiment; FIG. 1 is a block diagram showing an example of the configuration of a store system according to this embodiment; FIG. The block diagram which shows an example of a structure of the store server in this embodiment. 1 is a block diagram showing the configuration of a game device according to this embodiment; FIG. 1 is a block diagram showing the configurations of a game device and a video output device in this embodiment; FIG. FIG. 4 is a diagram showing frame pattern setting data prepared for video processing (video processing program) according to the present embodiment; FIG. 4 is a diagram showing an example of a frame pattern (video playback frames) according to the embodiment; The figure which shows an example of the data format of the play animation data in this embodiment. FIG. 4 is a diagram showing an example of various game execution states (events) indicated by control data according to the present embodiment; The figure which shows an example of the other data format of the 1st play animation data format in this embodiment. The figure which shows an example of a 2nd play moving image data format which is a data format which edited the video data of several videos|videos in this embodiment, and was made into one video data. The block diagram which shows the structure of the play animation mediation server in this embodiment. The figure which shows notionally the storage format of the play animation data of the play animation mediation server in this embodiment. The figure which shows notionally the data format of the delivery setting data of the play animation mediation server in this embodiment. 1 is a block diagram showing the configuration of a studio system according to this embodiment; FIG. 4 is a flowchart showing the operation of the game device according to the embodiment; 4 is a flowchart for explaining the operation of play video setting processing according to the present embodiment; 4 is a flow chart showing an example of distribution (first distribution method, second distribution method) by a data center according to the present embodiment; The flowchart which shows an example of the distribution of the play animation data by the 3rd distribution method by the play animation mediation server in this embodiment. 4 is a flowchart showing an example of video playback processing according to the embodiment; FIG. 4 is a diagram for explaining moving image reproduction processing according to the embodiment;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing the configuration of a video distribution system according to this embodiment. The moving picture distribution system shown in FIG. 1 is a system that can more effectively utilize play moving pictures showing the state of a game executed on a game device in a store system 10 provided in a game arcade or amusement facility. . The video distribution system includes a plurality of store systems 10 (10-1, 10-2, . Each is connected to each other via a network 2 such as the Internet. The store system 10 includes at least one game device.

In the video distribution system of this embodiment, in addition to the game video displayed on the screen when the game is executed and the game sound output when the game is executed on the game device, the video of the play includes other images captured through the camera during the game execution. Includes video and audio input through a microphone. Other images captured during game execution include, for example, images of the player playing the game (whole body, face, upper body, hands and feet operating the game, etc.) during game operation, and images captured on the game device. Including video footage of the surrounding audience watching the game, video (still image) files previously recorded separately from the execution of the game (e.g., commercial video, production video, etc.). Voices input during game execution include voices uttered by the players, sounds around the game device (including spectators), voices uttered by people other than the players such as commentary on the game situation, and pre-game execution. It includes sounds (for example, sound effects, BGM (background music)) and the like from separately recorded audio files.

Furthermore, the video (game video, shot video) included in the play video includes control data used for display control of the play video. The control data is, for example, data indicating the execution status of various games, and is stored in association with the video data based on the occurrence time of the execution status of the various games. The game execution status includes, for example, the start/end of the game based on the contents of the game, the occurrence of various events in response to input commands, the victory/loss of the game, the success/failure of the event, and the like. In addition, the game execution status includes the actions and sounds of the players playing the game, the actions and sounds of the spectators watching the game, and other things that occur during the execution of the game but are not directly related to the content of the game. including.

In addition, the play video data (play video data) is divided into the first play video data format, which is a data format that allows the video data of multiple videos to be processed individually, and the video data of multiple videos to be edited into one video. There is a second play video data format of data format. The control data included in the play moving image data is, for example, edited by editing the play moving image data in the first play moving image data format and displaying the first play moving image data by image processing (image processing program) for displaying/editing the image data. It can be used when changing the play moving image data in the moving image data format to the second play moving image data format. For example, the image processing program automatically performs editing such as changing the image to be displayed on the screen, changing the frame pattern indicating the form of displaying the image on the screen, and adding dramatic effects to the image according to the control data. execute

The store system 10 is installed in a game center or an amusement facility, and includes at least one game device. The arcade system 10 can store play video data of a game executed on a game device, and distribute or output it to the outside. In distribution of play animation data, when play animation data is produced|generated during execution of a game, it will output outside immediately. Destinations of the play video data include the data center 12 (play video mediation server 12e), the studio system 14, the video distribution server 16, and the like. In the output of the play moving image data, when there is an output request for the stored play moving image data, it is output (copied) to the designated output destination. As an output destination of the play video data, a recording medium such as a USB memory or a portable electronic device can be targeted inside the store system 10 .

The game device provided in the arcade system 10 stores game programs of a plurality of games distributed from, for example, the data center 12 (authentication/distribution server 12a), and executes one of the games selected by the player's operation. can be done. Also, the game device can execute a competitive game with another game device in the same store or another game device provided in another store system 10 .

The data center 12 is a group of servers for managing distribution of games and video data executed in a plurality of store systems 10. For example, an authentication/distribution server 12a, a ranking server 12b, a billing/storage server 12c, and a matching server 12d. , including the play animation mediation server 12e.

The authentication/distribution server 12a performs an authentication process on the identification data (card ID recorded on the card) presented by the player using the game device of the arcade system 10. FIG. The authentication/distribution server 12a also distributes programs, data, etc. for executing the game selected by the player to the game device to which the identification data (card ID) is presented.

The ranking server 12b aggregates the game results of the games executed by the game machines of all the arcade systems 10, and generates ranking data for each identification data (card ID) authenticated by the authentication/distribution server 12a. The ranking server 12b generates ranking data for each of a plurality of games executable on the game device. The ranking server 12b can distribute ranking data to, for example, a game device or an electronic device (personal computer, smart phone, etc.) used by a player.

The billing/storage server 12c generates billing when a game is executed on the game device of the store system 10, and records the billing amount for each store system 10, for example.

The matching server 12d matches a player (identified by a card ID) who is waiting for a match when the game executed on the game device of the arcade system 10 is a match game. For example, the matching server 12d can perform inter-store competition in which a competition game is executed between game devices of different arcade systems 10, and in-store competition in which a competition game is executed between other game devices within the same arcade system 10. Perform matching accordingly. The matching server 12d matches the players by one of (a) rank matching, (b) friend matching, and (c) store matching in the case of a match between stores, for example, according to the player's designation. be able to.

(a) In rank matching, each player (card ID) is allowed to specify a rank (or a numerical value such as a rank or points) set based on the game results, and the specified rank (rank or points) is specified by the player. etc.) are matched with other players waiting for a match. (b) In friend matching, matching is performed only with opponents specified by the player. (c) Shop matching matches with an opponent who is waiting for a match on a game device installed at a specified shop (shop system 10). The matching server 12d notifies each of the plurality of game devices used by the players matched as opponents of execution of the competition game. The game devices notified of execution of the competitive game from the matching server 12d execute the game while mutually transmitting and receiving data necessary for execution of the competitive game.

The play video intermediation server 12e receives and records the play video data distributed from the store system 10, and distributes it to the studio system 14, the video distribution server 16, or the electronic device 18 or the like. The play video intermediation server 12e distributes the play video data (first play video data format) received from the shop system 10 as it is. It is possible to execute a second data format distribution method of editing the video data (or audio data) of and generating and distributing play video data (second play video data format) for distribution.

The studio system 14 is a system for generating moving image contents (broadcast programs) for Internet broadcasting and the like and distributing them through the network 2 . The studio system 14 distributes moving image content such as live commentary of the game being executed on the game device based on play moving image data distributed from the store system 10 or the data center 12 (play moving image mediating server 12e), for example. In particular, the studio system 14 edits the game images displayed on the plurality of game devices and the images of the commentators and spectators in the studio when a competitive game is executed between the plurality of game devices. video content can be generated by combining

The moving image distribution server 16 is a server that establishes, for example, a moving image sharing site (moving image posting site) on the Internet. Distribute videos via The moving image distribution server 16 receives posted play moving image data including game images distributed from the data center 12 (play moving image mediating server 12e) or the store system 10, and distributes the data in the same manner as other general moving images. For example, the video distribution server 16 can store the posted play video data and distribute it in response to an access request through the network 2, or can distribute the posted play video data in real time.

The electronic device 18 is, for example, a device owned by a player who plays a game on the game device of the arcade system 10 . The electronic device 18 is, for example, a device having a communication function such as a personal computer (PC), tablet PC, smart phone, mobile phone, or game machine. The electronic device 18 can receive and view moving images distributed from the studio system 14 and the moving image distribution server 16 through the network 2 .

FIG. 2 is a block diagram showing an example of the configuration of the store system 10 according to this embodiment.
As shown in FIG. 2, store system 10 is connected to network 2 through router 20 . A shop server 24, a plurality of game devices 26 (26-1, 26-2, . The store server 24, a plurality of game devices 26 (26-1, 26-2, . . . , 26-m), and the video output device 28 are interconnected via a network such as a LAN (Local Area Network).

The shop server 24 has a function for managing a plurality of game devices 26 installed in the shop. For example, the arcade server 24 sets and changes functions for storing (recording), outputting, and distributing play video data of games executed on each of the plurality of game devices 26 . In place of the game device 26, the arcade server 24 can store (record)/output/distribute play video data including game video of a game executed on the game device 26, for example. The shop server 24 also has a function of copying (outputting) the stored play video data to a recording medium such as a USB memory owned by the player or a portable electronic device.

The game device 26 is a device that executes a game in accordance with player's input operations. The game device 26 stores, for example, game programs of a plurality of games distributed from the data center 12 (authentication/distribution server 12a), and executes one of the games selected by the player's operation. In addition, the game devices 26 can be played by a single player in stand-alone solo play, in-store battle play against players of other game devices 26 in the same store, and inter-store battle play against game devices 26 in other stores. can run the game. In addition, the game device 26 has a function of storing (recording)/outputting/distributing game play video data in accordance with settings made by the arcade server 24 . The game device 26 has a function of copying (outputting) the stored play video data to a recording medium such as a USB memory owned by the player or a portable electronic device.

The moving image output device 28 has a function of storing (recording)/outputting/delivering play moving image data of a game executed on the game device 26 instead of the game device 26 . The video output device 28 inputs various data for generating play video data from peripheral devices such as the game device 26, cameras, and microphones, and stores (records)/outputs/distributes play video data. Generate.

FIG. 3 is a block diagram showing an example of the configuration of the shop server 24 in this embodiment.
As shown in FIG. 3, the store server 24 has a processor 24a, a memory 24b, a storage device 24c, a display section 24d, an input section 24e, a communication section 24f, a media I/F 24g, and a card reader 24j.

The processor 24a executes various processes such as overall control of the store server 24, management of data stored in the storage device 24c, and control of the game device 26 based on programs and data stored in the memory 24b.

The memory 24b stores various programs executed by the processor 24a, temporary data executed by various processes, and the like. The programs stored in the memory 24b include a basic program (OS (Operating System)), an authentication process for the card ID read by the card reader 24j, and a plurality of programs executed according to the operation of the manager of the store. A setting processing program for setting processing related to recording/distribution/output of play video data in the game device 26 and video output device 28, and processing (including video processing) related to recording/distribution/output of play video data in the store server 24 Contains the video processing program to run. In the setting process, for example, whether or not play video data is stored (recorded), whether or not play video data is distributed, the destination of play video data, whether or not play video data is distributed in real time, output of play video data (storage medium etc.), data format of play video data to be recorded/distributed/output (1st play video data format, 2nd play video data format), etc. Record setting data for control.

The storage device 24c stores various programs, data, and the like. The storage device 24c stores play moving image data of the game executed by the game device 26, setting data indicating setting contents by the setting process, and the like. The storage device 24c can also store a plurality of game programs distributed from the data center 12. FIG. In the storage device 24c, when play video data output from a plurality of game devices 26 is stored, it is stored in association with the card ID read from the card presented by the player. In addition to the card ID, it may be stored in association with other identification information for identifying play moving image data. Other identification information can be information (for example, an alphanumeric string, a code image, etc.) generated by the game device 26, for example, each time the game is executed (every time play video data is generated).

The display unit 24d displays a screen according to the processing by the processor 24a on a display such as an LCD (Liquid Crystal Display).

The input unit 24e inputs data and instructions according to various processes by the processor 24a through input devices such as a keyboard and a mouse.

The communication unit 24f controls communication via the network 2 under the control of the processor 24a.

The media I/F 24g is an interface for transmitting and receiving data to and from an external recording medium (such as a USB memory) or an electronic device. The media I/F 24g includes, for example, a connector for electrically connecting recording media and electronic equipment, and a communication unit for controlling close proximity wireless communication.

The card reader 24j reads identification data (card ID) recorded in advance on a card issued to the player, for example, by close proximity wireless communication.

FIG. 4 is a block diagram showing the configuration of the game device 26-1 in this embodiment. A game device 26-1 shows a configuration example in which the device body is provided with a function of creating play video data.

As shown in FIG. 4, the game device 26-1 includes a processor 26-1a, a memory 26-1b, a storage device 26-1c, a display unit 26-1d, an input unit 26-1e, a communication unit 26-1f, media I /F 26-1g, input I/F 26-1h, card reader 26-1j, cameras 26c1, 26c2, 26c3, and microphones 26m1, 26m2.

The processor 26-1a executes various processes such as overall control of the game device 26-1 based on programs and data stored in the memory 26-1b. The processor 26-1a executes game processing based on the game program of the game selected by the player's operation. In addition, the processor 26-1a executes processing related to recording/distribution/output of play moving image data including game images and game sounds generated along with the execution of the game processing, based on the moving image processing program.

The memory 26-1b stores various programs executed by the processor 26-1a, temporary data executed by various processes, and the like. The programs stored in the memory 26-1b include a basic program (OS (Operating System)), an authentication processing program for authenticating the card ID read by the card reader 26-1j, and an authentication processing program that is selected by the operation of the player. A video processing program for executing processing (including video processing) related to recording/distribution/output of play video data associated with execution of game processing, and the like.

The storage device 26-1c stores various programs and data. The storage device 26-1c stores programs corresponding to a plurality of different games (titles) distributed from the data center 12 (authentication/distribution server 12a). It is read out to the memory 26-1b. Further, the storage device 26-1c stores setting data indicating setting contents by the setting processing by the store server 24, game play moving image data, and the like. The play animation data is stored in association with the card ID read by the card reader 26-1j (and other identification information issued for each game). The setting data is set by setting processing in the store server 24 , but may be set by setting processing in each game device 26 .

The display unit 26-1d displays a screen according to the processing by the processor 26-1a on a display such as an LCD (Liquid Crystal Display).

The input unit 26-1e inputs data and instructions corresponding to various types of processing by the processor 26-1a through input devices such as joysticks, buttons, input devices dedicated to games, and touch panels.

The communication unit 26-1f controls communication via the network 2 under the control of the processor 26-1a.

The media I/F 26-1g is an interface for transmitting/receiving data to/from an external recording medium (such as a USB memory) or an electronic device. The media I/F 26-1g includes, for example, a connector for electrically connecting recording media and electronic equipment, and a communication unit for controlling close proximity wireless communication.

The input I/F 26-1h is an interface for inputting data from an external device. The external devices include, for example, multiple cameras 26c1, 26c2, 26c3 and multiple microphones 26m1, 26m2.

The card reader 26-1j reads the card ID recorded on the card issued to the player in advance, for example, by close proximity wireless communication. A card reader/writer (electronic money unit) may be provided to enable data transmission/reception for payment of play fees with a card used as electronic money.

The cameras 26c1, 26c2, and 26c3 shoot images. For example, the camera 26c1 inputs an image of the player operating the input device, the camera 26c2 an image of the player including his face, and the camera 26c3 an image of the audience. used for

Microphones 26m1 and 26m2 input voice. For example, the microphone 26m1 is used to input the player's voice, and the microphone 26m2 is used to input the ambient sound of the game device 26-1 including the audience.

FIG. 5 is a block diagram showing the configurations of the game device 26-2 and the video output device 28 in this embodiment. The game device 26-2 does not have a function of recording play moving image data, and is configured as a dedicated game machine. The game device 26-2 is used alone without being connected to the video output device 28 when recording/distribution/output of play videos is unnecessary. A video output device 28 is connected when recording/distribution/output of play videos is required.

As shown in FIG. 5, the game device 26-2 includes a processor 26-2a, a memory 26-2b, a storage device 26-2c, a display unit 26-2d, an input unit 26-2e, a communication unit 26-2f, an input I /F 26-2h has a card reader 26-2j. It should be noted that the portions having the same names as those of the game device 26-1 shown in FIG. 4 have the same functions as those of the game device 26-1, and detailed description thereof will be omitted.

Since game device 26-2 does not execute processing related to recording/distribution/output of play video data, no program for this processing is stored. In order to record/distribute/output play video data in the video output device 28, the game device 26-2 displays the card ID read by the card reader 26-2j on the display unit 26-2d as the game is executed. The video data of the game video played and the audio data during game execution are output to the video output device 28 . In addition, the processor 26-2a outputs data indicating the execution status of the game to the video output device 28 as the game program is executed. The data indicating the execution status of the game includes, for example, data indicating the start/end of the game, the occurrence of various events in response to input commands, the determination of victory or defeat of the game, success/failure of the event, and the like.

As shown in FIG. 5, the video output device 28 has a processor 28a, a memory 28b, a storage device 28c, a communication section 28f, an input I/F 28h, and a media I/F 28g.

Based on the programs and data stored in the memory 28b, the processor 28a performs overall control of the video output device 28, processing related to recording/distribution/output of play video data associated with execution of game processing, and storage in the storage device 28c. Executes various processes such as management of data to be processed.

The memory 28b stores various programs executed by the processor 28a, temporary data executed by various processes, and the like. The programs stored in the memory 28b include a basic program (OS (Operating System)), and processing (including video processing) related to recording/distribution/output of play video data associated with execution of game processing in the game device 26-2. ) is included.

The storage device 28c stores various programs and data. The storage device 28c stores, in addition to the video play data of the game executed by the game device 26-2, setting data indicating the setting contents by the setting processing by the shop server 24, and the like. The play moving image data is stored in association with the card ID (and other identification information) read by the card reader 26-2j of the game device 26-2.

The communication unit 28f controls communication via the network 2 under the control of the processor 28a.

The input I/F 28h is connected to cameras 29c1, 29c2, 29c3 for inputting video images used for creating play animations, and microphones 29m1, 29m2 for inputting audio. Although FIG. 5 shows an example in which three cameras 29c1, 29c2, 29c3 and two microphones 29m1, 29m2 are connected to the input I/F 28h, any number of cameras and microphones can be connected. can.

The media I/F 28g is an interface for transmitting/receiving data to/from an external recording medium (such as a USB memory) or an electronic device. The media I/F 28g includes, for example, a connector for electrically connecting recording media and electronic equipment, and a communication unit for controlling close proximity wireless communication.

The moving image output device 28 can be connected to the game device 26-2, which does not have the function of recording play moving image data, to record/distribute/output the play moving image. For example, the video output device 28 is used by connecting to a specific game device 26-2 when it is necessary to record/distribute the play video of a competitive game executed on the specific game device 26-2. Although one moving image output device 28 is shown in FIG. 2, any number of moving image output devices 28 can be installed as required.

In the shop system 10, play video data can be distributed/output from the shop server 24, the game device 26, or the video output device 28, and each of them can be distributed/output from one or more of them. can be operated. In addition, in each of the store server 24, the game device 26, and the video output device 28, a first data format distribution method of distributing play video data (first play video data format) as it is, play video data in the first play video data format It is possible to use a second data format distribution method that edits a plurality of video data (or audio data) contained in to generate and distribute play video data (second play video data format) for distribution. Which of the first data format distribution method and the second data format distribution method (at least one of them) is to be used may be set in advance in each device, or may be determined by the operation of the manager of the store system 10 or the player. It may be set accordingly.

Next, a form of displaying play moving images distributed/output in the moving image distribution system according to the present embodiment will be described. In the video processing (video processing program), based on the play video data in the first play video data format, the video is displayed in accordance with the frame pattern indicating the mode of displaying the video on the screen. Further, in the video processing (video processing program), the play video data in the first play video data format can be edited (converted) into the second play video data format for displaying a screen according to the frame pattern.

FIG. 6 shows frame pattern setting data prepared for video processing (video processing program) in this embodiment. As shown in FIG. 6, in the frame pattern setting data, different frame patterns 1, 2, . . . , x are set in association with a plurality of frame numbers.

FIG. 7 shows an example of a frame pattern (video playback frames) in this embodiment.
FIG. 7(a) shows an example of a frame pattern in which one screen is equally divided into four and four images (1, 2, 3, 4) are displayed. In the frame pattern shown in FIG. 7(a), the screen is evenly divided into four, so when displaying a play video with 4K resolution, for example, each of the four videos can be displayed with 2K resolution (high-definition). The frame pattern shown in FIG. 7B shows an example in which one video area is enlarged and a plurality of video areas (for example, six) are reduced. In FIG. 7B, by increasing the number of areas, for example, even if the game image output from the game device 26 and the three images captured by the camera are always displayed, the other two images (for example, , commercial images, production images, images synthesized in a studio, etc.) can be displayed at the same time. In the frame pattern shown in FIG. 7(b), it is possible to enlarge and display a main image (for example, game image) and reduce and display other images (for example, images of players, spectators, etc.). The frame pattern shown in FIG. 7(c) shows an example in which only one video is selected and displayed. The frame pattern shown in FIG. 7(d) includes one enlarged area and two reduced areas for displaying images, as well as images and texts other than images (for example, images for commercials, explanatory texts, etc.). An example in which a display area is provided is shown.

Note that the frame patterns shown in FIGS. 7A to 7D are only examples, and other forms of patterns can be used. Also, the image displayed in each area of the frame pattern is not fixed, and can be switched according to control data added to the image data, for example. Also, while displaying one play video, it is possible to switch the frame pattern according to control data, or dynamically change the size and shape of a specific area in the frame pattern.

FIG. 8 is a diagram showing an example of the data format of play video data in this embodiment. FIG. 8 shows an example of the first play video data format, which is a data format that allows individual processing of a plurality of video data.

For example, the game device 26 generates game video (video data 1) and game audio (audio data 1) as the game is executed. The game device 26 also captures, for example, an image (image data 2) of the player's hand operating the input device with the camera 26c1, an image (image data 3) of the player's appearance including the face with the camera 26c2, a camera 26c3 inputs the image (image data 4) of the appearance of the audience. Furthermore, the game device 26 receives the voice of the player through the microphone 26m1 and the surrounding sounds of the game device 26-1 including the spectators through the microphone 26m2 and mixes them to generate voice data 2. FIG. Note that the audio data input from the microphones 26m1 and 26m2 may be independent data without being mixed.

Furthermore, the game device 26 generates control data indicating the execution status (event) of various games. The control data includes, for one event, data indicating, for example, the occurrence time of various game execution situations, images to be associated, and game execution situations (events, etc.).

FIG. 9 is a diagram showing an example of various game execution states (events) indicated by control data in this embodiment.

For example, as an event before the start of the game, card IDs are read by the card readers 26-1j and 26-2j. When an image (image data 3) of the player captured by the camera 26c2 before the start of the game is input, control data is generated in association with the image data 3 according to the event of reading the card ID.

Events that occur while the game is being executed on the game device 26 include, for example, game start/end, occurrence of various events in response to input commands (1, 2, . . . ), victory or defeat of the game, success/failure of events and so on. The game program outputs data indicating the event that has occurred when the event described above occurs. Control data is generated according to each event that occurs with the execution of the game, and is associated with the game image (image data 1) that is generated with the execution of the game.

Further, it is also possible to detect a predetermined action of the player based on the image data from the cameras 26c1 and 26c2 for photographing the player and generate an event. For example, based on the image (video data 3) of the player's face including the face captured by the camera 26c2, existing image recognition processing is used to perform a predetermined action (raise the arm, move the head greatly, smile, etc.). specific facial expressions, etc.). Control data to be associated with the video data 3 is generated when a predetermined motion is detected. When an event is detected based on the image (image data 2) captured by the camera 26c1, control data associated with the image data 2 is similarly generated.

It is also possible to detect the occurrence of a predetermined sound based on voice data from the microphone 26m1 for inputting the player's voice, and use it as the occurrence of an event. For example, when a sound with a volume higher than a predetermined set value is input (for example, a player shouts), the utterance of a predetermined word is detected by voice recognition processing of the input voice. Control data is generated to be associated with the audio data when the occurrence of the predetermined sound is detected.

Similarly, the occurrence of an event is detected based on the video data from the camera 26c3 that captures the spectator, or the audio data from the microphone 26m2 that inputs the surrounding sound of the game device 26-1 including the spectator. Control data corresponding to each can be generated.

In this way, the game execution status includes the actions and sounds of the players playing the game, the actions and sounds of the spectators watching the game, and the like, which occur during the execution of the game but are not directly related to the content of the game. , and control data corresponding to each occurrence can be generated and stored in association with video data or audio data.

In the above description, the game device 26 generates play video data, but the video output device 28 also generates a plurality of video data 1 to 4, audio data 1 to 2, and control data. Play video data can be generated based on this.

The moving image output device 28 receives from the game device 26-2 video data 1 and audio data 1 associated with execution of game processing in the game device 26-2, and also receives video data 2 to 4 from the cameras 29c1, 29c2, and 29c3. Then, voice data are input from the microphones 29m1 and 29m2, respectively. Then, as described above, the moving image output device 28 detects the occurrence of an event based on the input video data and audio data, and generates control data corresponding to the occurrence of each event. In addition, the moving image output device 28 can receive the card ID read by the card reader 26-2j from the game device 26-2 and detect a card ID reading event.

FIG. 10 is a diagram showing an example of another data format of the first play video data format in this embodiment. In the first play moving image data format shown in FIG. 8, control data is generated separately from video data and audio data, but in the data format shown in FIG. 10, control data is included in video data.

For example, the game image (image data 1) generated by the game device 26 is controlled in accordance with the event that occurs while the game is being executed, together with the image data generated at the timing when the event occurs. Store data. For example, the control data can be stored as extension data in the data format of the video data. Since the extended data is associated with the video data generated in time series, there is no need for the data indicating the video to be associated with the time, unlike the control data shown in FIG. 8(g). That is, it is sufficient to store only data indicating the game execution status (events, etc.). Similarly, when an event corresponding to each of video data 2 to 4 input by the cameras 26c1 to 26c3 occurs, control data is stored together with the video data input at that timing.

Thus, since the first play video data format is a data format in which a plurality of pieces of video data can be individually processed, for example, in the studio system 14, a plurality of pieces of video data are individually processed and edited as appropriate by combining them. to display the image. At this time, in the video processing (video processing program), based on the control data associated with the video data and the event occurrence time, the frame pattern etc. are automatically switched without depending on the editing operation by human operation. You can edit videos such as For example, it is possible to switch the image to be displayed, and change the shape and size of the area in which the image is displayed.

FIG. 11 shows an example of the second play video data format, which is a data format in which video data of a plurality of videos are edited into one video data in this embodiment. The second play video data format is used, for example, when a video edited by combining a plurality of video data is distributed/output as it is.

The video data shown in FIG. 11(a) is obtained by editing the video data 1 generated by the game device 26 shown in FIG. 8(a) and the video data 2 to 4 input from the cameras 1 to 3 by video processing. This is video data created by The audio data shown in FIG. 11(b) is audio data obtained by mixing the audio data 1 shown in FIG. 8(b) and the audio data 2 shown in FIG. 8(F). The control data shown in FIG. 11(c) is generated according to various game execution states (events) detected based on the video data 1-4 and the audio data 1-3. The control data includes data indicating occurrence times of various game execution states and game execution states (events, etc.) for one event.

The video data in the second play video data format is associated with the video data based on the event occurrence time by video processing (video processing program), as in the case of editing the first play video data format described above. It can be generated by video editing such as automatic switching of frame patterns based on control data.

Next, the play moving image mediation server 12e in this embodiment will be described.
FIG. 12 is a block diagram showing the configuration of the play video mediation server 12e in this embodiment. As shown in FIG. 12, the play animation mediation server 12e has a processor 30a, a memory 30b, a storage device 30c, and a communication section 30f.

Based on the programs and data stored in the memory 30b, the processor 30a controls the overall play video mediation server 12e, receives play video data transmitted from the store system 10, and processes play videos stored in the storage device 30c. It executes various processes such as data management, video processing for video editing of play video data, and control of transmission (distribution) of play video data.

The memory 30b stores various programs executed by the processor 30a, temporary data executed by various processes, and the like. The programs stored in the memory 30b include a basic program (OS (Operating System)), a video storage/distribution processing program for executing video storage/distribution processing for transmitting and receiving play video data, and a video for play video data. A video processing program for executing video processing to be edited is included. In the video storage/distribution process, for example, the play video data is received from the store system 10 and distributed to, for example, the studio system 14 or the video distribution server 16 in real time. A second distribution method of distributing (posting) data to the video distribution server 16 or the like at a predetermined timing, or distributing play video data to the video distribution server 16 or the electronic device 18, for example, in response to a request from the electronic device 18 or the like. There is a third distribution method that

The storage device 30c stores various programs, data, and the like. The storage device 30c stores play video data received from the store system 10, distribution setting data indicating a distribution destination (recording destination) of the play video data, and the like.

The communication unit 30f controls communication via the network 2 under the control of the processor 30a.

FIG. 13 is a diagram conceptually showing the storage format of the play moving image data of the play moving image mediation server 12e in this embodiment. As shown in FIG. 13 , in the play video mediation server 12e, the play video data received from the shop system 10 is treated as a card ID (and other identification information issued for each game) received together with the play video data. They are stored in association with each other.

In the third distribution method, for example, when a request for distribution of play video data is received from the electronic device 18, the play video mediation server 12e extracts the play video data corresponding to the card ID specified by the electronic device 18 and requests the play video data. Deliver to origin.

FIG. 14 is a diagram conceptually showing the data format of the distribution setting data of the play moving image mediation server 12e in this embodiment. As shown in FIG. 14, in the play video intermediation server 12e, as the distribution setting data, the play video record indicating the distribution destination (play video recording destination) of the play video data is associated with the card ID received from the store system 10. Prior data is stored.

For example, a player who executes a game on the game device 26 of the store system 10 registers the card ID and the play video recording destination data in the play video mediation server 12e in advance, so that the store system 10 (the store server 24 or the game device) 26), the play video data distributed to the play video mediation server 12e can be distributed to the play video recording destination (for example, studio system 14, video distribution server 16, electronic device 18) indicated by the play video recording destination data. .

Furthermore, as distribution setting data, it is possible to preset a frame No. (number) of a frame pattern used for editing play moving image data in association with the card ID. For example, when the play video data is distributed to the play video mediation server 12e by the first data format distribution method from the store system 10, the frame pattern indicated by the frame number set as the distribution setting data is used to perform the play video mediation. After editing the first play video data into the second play video data format in the server 12e, it can be distributed to the studio system 14, the video distribution server 16, and the electronic device 18, for example.

Furthermore, as delivery setting data, additional data can be set in advance in association with the card ID. The setting data includes images and production effects added to play video data distributed from the store system 10 (store server 24 or game device 26) to the play video mediation server 12e, and videos (still images) added to the play video data. This is data indicating a moving image (still image) file, etc. By setting the additional data, it is possible to edit the play video data distributed from the store system 10, such as adding a production effect to the video, or to create video (for example, commercial video) by video (still image) file. , production video, etc.) can be distributed to the studio system 14, the video distribution server 16, and the electronic device 18, for example.

Note that the delivery setting data can be set in the play video mediation server 12e through the network 2 by, for example, an operation in the store system 10 (store server 24 or game device 26) or a player's operation on the electronic device 18. Furthermore, it can be set directly by the operation of the administrator of the data center 12 (play animation mediation server 12e).

FIG. 15 is a block diagram showing the configuration of the studio system 14 in this embodiment. The studio system 14 is, for example, a system capable of producing programs to be distributed over the network 2 . The studio system 14 utilizes the play video data of the game executed in the shop system 10, the game play video and the video (sound) shot in the studio, and furthermore, the program transmitted from the viewer etc. through the network 2. For example, a program that broadcasts the actual state of a game is produced by combining data (for example, text data of chat, data posted to a simple blog, etc.). In particular, the studio system 14 broadcasts a program that broadcasts a competitive game executed between a plurality of store systems 10 (game devices 26), and a video that combines play video data distributed from each of the plurality of store systems 10. It is possible to generate, add video and audio of the commentator and audience in the studio, and broadcast (network distribution).

As shown in FIG. 15, the studio system 14 includes a processor 32a, a memory 32b, a storage device 32c, a display unit 32d, an input unit 32e, a communication unit 32f, an input I/F 32h, cameras 32c1, 32c2, 32c3, and microphones 32m1, It has 32m2.

The processor 32a executes various processes such as overall control of the studio system 14 based on the programs and data stored in the memory 32b. The processor 32a executes program production/distribution processing for broadcasting using the play moving image data according to the operation of the program production staff of the studio or the control data of the play moving image data.

The memory 32b stores various programs executed by the processor 32a, temporary data executed by various processes, and the like. The programs stored in the memory 32b include a basic program (OS (Operating System)), a program production/distribution processing program for program production/distribution processing, and processing related to recording/distribution/output of play video data. This includes video processing programs that The video processing program includes a video processing program for executing video processing for video editing of play video data.

The storage device 32c stores various programs and data. The storage device 32c stores play video data received from the store system 10 or the data center 12 (play video intermediation server 12e), program data for distribution, and the like.

The display unit 32d displays a screen according to the processing by the processor 32a on a display such as an LCD (Liquid Crystal Display).

The input unit 32e inputs data and instructions corresponding to various processes by the processor 32a through an input device such as a keyboard, buttons, and touch panel.

The communication unit 32f controls communication via the network 2 under the control of the processor 32a.

The input I/F 32h is an interface for inputting data from an external device installed in a studio or the like. The external devices include, for example, multiple cameras 32c1, 32c2, 32c3 and multiple microphones 32m1, 32m2. Any number of cameras and microphones can be provided.

The cameras 32c1, 32c2, and 32c3 are used to input, for example, images of commentators, spectators, and the like in the studio.

The microphones 32m1 and 32m2 are used, for example, to input the voices of commentators, spectators, etc. in the studio.

The studio system 14 basically performs video processing on the play video data received from the store system 10 or the play video mediation server 12e to generate play video data in the second play video data format as program data for program distribution. , is distributed by the second data format distribution method. By using the first data format distribution method, it is also possible to individually distribute a plurality of video data and audio data included in the play moving image data.

Next, the operation of the video distribution system according to this embodiment will be described.
First, the operation of the game device 26-1 in this embodiment will be described with reference to the flowchart shown in FIG. It should be noted that other game devices 26 having functions equivalent to those of the game device 26-1 operate in the same manner, and description thereof is omitted.

When the game device 26-1 (processor 26-1a) is powered on, it displays a game selection screen on which one of a plurality of game titles can be selected. When any game title is selected by the player's operation on the input device, the game device 26 sets the selected game title and starts the corresponding game program (step A1).

When the game device 26-1 detects that a coin has been inserted or that payment from electronic money has been detected (step A2, Yes), for example, the display unit 26-1d displays "Please touch the card to the reader. A card authentication screen containing a message such as "please" is displayed to display an authentication screen for a player identification card (step A3). Here, the card ID recorded on the card is read by the card reader 26-1j by the operation of the player.

After the card authentication screen is displayed, if the card reader 26-1j does not read the card even after a certain period of time has passed (step A4, none), the game device 26-1 does not recognize the advantage of using the card. A screen for explaining to the player is displayed (step A5). After that, when the charge required to start using the game is inserted or payment from electronic money is detected (step A6, Yes), the game device 26-1 executes mode setting processing for setting the game mode. .

On the other hand, the game device 26-1 determines whether the card is usable when the card ID is read by the card reader 26-1j before coin insertion or electronic money payment is detected (step A2, none). Authenticate. When the game device 26-1 is authenticated as a usable card (Yes in step A7), the game device 26-1 transmits the card ID to the authentication/distribution server 12a of the data center 12, and the player corresponding to this card ID Confirm registration.

The authentication/distribution server 12a determines whether player data corresponding to the card ID received from the game device 26 is recorded. If the player data corresponding to the card ID is not recorded, the authentication/distribution server 12a notifies the game device 26 that the player is a new player, and if the player data corresponding to the card ID is recorded, Player management data including data about the player in question is transmitted to the game device 26 .

When the authentication/distribution server 12a notifies the game device 26-1 that the player is a new player (step A9, none), the game device 26-1, for example, reads, "This card is not registered in this game device. Start new registration." Do you want to do this?" is displayed to prompt the player to register, for example, a player name. Here, when execution of new registration is instructed, the game device 26-1 displays an operation screen for player registration, and registers data related to the player, such as the player name, by the player's operation. The game device 26-1 transmits the card ID read from the new card and data such as the player name input by the player's operation to the authentication/distribution server 12a for recording.

On the other hand, when the game device 26-1 receives the player management data from the authentication/distribution server 12a, that is, when the player is already registered (step A9, Yes), the data regarding the player included in the player management data ( player information) is displayed on, for example, a display (step A11). For example, the player information includes the player name, custom image, level and title, acquired items, player achievements, setting contents of play animation setting processing (to be described later), etc. included in the player management data. In the play animation setting process, various information for recording the play animation is set.

It should be noted that the game device 26-1 of this embodiment allows two players to play the game at the same time. After the card ID is read by the card reader 26-1j (step A7, Yes) and before credit is established (step A6, No), the game device 26-1 reads the card ID ( different from last time) is read (step A8, Yes), a two-player mode in which two players participate in the game at the same time is set (step A12). When the two-player mode is set, the game device 26-1 displays player information corresponding to each card ID.

When the credit condition is met (step A6, yes), the game device 26-1 causes the display to display a mode selection screen for selecting a game mode (step A13). Game modes that can be selected on the mode selection screen include, for example, a normal mode in which the game is executed only on the game device 26-1, and a battle mode. The battle mode is a mode in which players play against other game devices 26 at the same time. There is an in-store competition in which a competitive game is executed with another game device 26. - 特許庁When the player designates a match between stores, the player is made to select a matching method from among rank matching, friend matching, and store matching.

Furthermore, in the game device 26-1 according to the present embodiment, the player can specify whether or not to record the play animation on the mode selection screen.

When the game device 26-1 is instructed to record a play moving image (step A14, Yes), the game device 26-1 executes a play moving image setting process for making various settings related to recording the play moving image. In the play video setting process, the player can set the recording destination (distribution destination) of the play video data and data for controlling the generation of the play video data by the player's operation during game execution.

FIG. 17 is a flowchart for explaining the operation of play animation setting processing in this embodiment.
First, the game device 26-1 determines whether the card ID of the card presented by the player has been authenticated, and whether the player information received from the authentication/distribution server 12a includes the setting contents of the play animation setting process. Here, if the card ID has not been authenticated, or if the card ID has been authenticated but the player information does not include the setting content of the play animation setting process (step B1, No ), to display a setting screen for setting various information for recording play videos.

First, the recording destination of the play moving image data is set according to the player's instruction (step B4). It is assumed that the recording destinations of play video data include, for example, in-store records (game device 26-1 or shop server 24), data center records recorded in the data center 12 (play video intermediation server 12e), and video site postings. .

Also, the frame pattern of the screen displaying the play moving image is set according to the player's instruction. For example, a plurality of frame patterns (see FIG. 7) are displayed to allow the player to select one. If the number of cameras 26c1, 26c2, 26c3 and microphones 26m1, 26m2 to be used and the objects to be photographed (recorded) can be changed by the player, any one of them may be selected according to the instruction of the player ( Step B5).

The game device 26-1 transmits the setting contents set (or changed) in the play animation setting process to the play animation intermediation server 12e, and stores them in association with the card ID. The setting contents stored in the play moving image mediation server 12e can be read out and used when playing a game on any of the game devices 26 next time.

In this way, when the setting of various information for recording the play moving image is completed, the game device 26-1 transmits data indicating the setting contents in association with the card ID to the play moving image mediation server 12e. The play animation intermediation server 12e associates and stores the card ID and the setting contents.

If the card ID has been authenticated and the player information includes the settings for the play video setting process (step B1, Yes), the game device 26-1 has already been set based on the settings. and the selected frame pattern are displayed (step B2). If there is no change in the setting content (step B3, No), the game device 26-1 ends the play animation setting process.

On the other hand, if there is a change in the setting content (step B3, No), the game device 26-1 sets the recording destination of the play moving image and the frame pattern according to the instruction from the player, as described above ( Steps B4 to B6), the play animation setting process is terminated.

In addition, in the setting data for controlling the recording/distribution/output of play video data, if the distribution destination of play video data is set, this setting content is set by the play video setting process. It may be set as an initial value (default) of the recording destination. Also, in the play animation setting process, the setting process described above may be executed.

When the play animation setting process ends, the game device 26-1 starts recording the play animation (step A16). In other words, recording of images captured by the cameras 26c1, 26c2 and 26c3 and recording of sounds input from the microphones 26m1 and 26m2 are started. Further, when the game processing is started by the game device 26-1, recording of play moving image data (video, audio) accompanying the execution of the game processing is executed.

Further, when the battle mode is selected on the mode selection screen (step A17, Yes), the game device 26-1 executes player matching processing for setting a battle opponent (step A18). In the player matching process, when an in-store competition play is specified by the player, for example, the game device 26 that is first instructed to execute the in-store competition play among the plurality of game devices 26 in the store becomes the host player, and other games are played. An opponent (guest) is recruited for the device 26 . If there is no competition request within a predetermined fixed time, it is determined that the competition game cannot be executed, and the mode selection screen is displayed again. Note that the shop server 24 may receive the battle request from each game device 26 in the shop and execute the matching process.

Also, in the player matching process, when the player designates a match between stores, the matching server 12d is requested to match the opponent by the matching method (rank matching, friend matching, store matching) designated by the player.

The matching server 12d executes matching according to the specified matching method when the game device 26 requests matching of an opponent. For example, when rank matching is specified, the matching server 12d allows the player to specify the rank (or a numerical value such as a rank or points) of a player to be an opponent, and determines whether the specified rank (rank, points, etc.) is Match other matching players waiting for a match. Further, when friend matching is designated, the matching server 12d allows the player to designate an opponent (for example, player name, card ID, etc.), and performs matching only when the opponent designated by the player requests a battle. conduct. When store matching is specified, the matching server 12d allows the player to specify a specific store (store system 10) (for example, from a list of stores), and waits for a match at the game device 26 installed at the specified store. Match with the opponent in the state.

The matching server 12d notifies each of the plurality of game devices 26 used by the players matched as opponents of execution of the competition game.

When the matching process is completed (step A19, Yes), the game device 26-1 starts the game process. In the case of a match between stores, the game device 26-1 starts game processing when notified by the matching server 12d of the execution of the match game, and communicates with the game device 26 as an opponent notified by the matching server 12d. , and P2P (peer-to-peer) to execute the game processing while mutually transmitting and receiving data necessary for execution of the competitive game.

If the player instructs the game in the normal mode (step A17, No), the game device 26-1 starts the game process without performing the matching process (steps A19, A20).

By starting the game processing, the game device 26-1 displays the game image on the display and executes the game while outputting the game sound from the speaker or the like. The game device 26-1 generates and records play moving image data including game images and game sounds generated along with the execution of the game processing according to the setting contents of the setting processing (setting data) and the play moving image setting processing. do. That is, the game device 26-1 records the game video data (including sound data) of the game video, and stores the control data according to the execution status of the game as the game video data based on the time of occurrence of the execution status. The data are recorded in association with each other to generate play video data including game video data and control data. The game device 26-1 distributes/outputs the generated play video data to the recording destination of the play video set by the play video setting process (or the distribution destination indicated by the setting data). It should be noted that the play animation data is generated as described above with reference to FIG. 8, FIG. 10, or FIG. 10, and description thereof will be omitted.

For example, if the setting data is set to distribute the play moving image data in real time, the game device 26-1 keeps the play moving image recording destination until the game processing ends (step A22, No). The video data is distributed (step A21). For example, when the contents of a game executed by the game device 26-1 are used in real time in a program produced by the studio system 14, or when distributed from the video distribution server 16 in real time, real-time Distribute play video data with.

The play video data may be distributed to the studio system 14 or the video distribution server 16 via the play video intermediation server 12e, or directly from the shop system 10 (shop server 24 or game device 26-1). It may be distributed to the studio system 14 or the video distribution server 16 .

For example, when distributing the play video data to the studio system 14, the game device 26-1 distributes the play video data in the first play video data format so that the play video data can be edited in the studio. On the other hand, when posting to the video distribution server 16, the game device 26-1 distributes the play video data in the edited second play video data format so that the play video can be distributed from the electronic device 18 as it is. Since the process of generating the play moving image data in the second play moving image data format has a large load, in the case of real-time distribution, it is distributed to the moving image distribution server 16 via the play moving image mediation server 12e. That is, the play video mediation server 12e receives the play video data in the first play video data format from the game device 26-1, and utilizes the control data included in the play video data to generate the play video in the second play video data format. Data is generated and distributed to the video distribution server 16. - 特許庁

When the game process is completed (step A22, Yes), the game device 26-1 stops recording play moving image data (step A23). Then, the game device 26-1 records or distributes the play moving image data according to the setting contents of the setting data (step A24).

For example, in the setting data, if the game device 26-1 or the arcade server 24 (or both) is set to record, the game device 26-1 causes the play video data to be recorded in association with the card ID. The play video data stored in the game device 26-1 or store server 24 can be output (copied) to a recording medium such as a USB memory owned by the player or a portable electronic device, and the player can take it home.

Further, in the setting data, if the game play video data is set to the studio system 14 or the video distribution server 16 instead of real-time, the game device 26-1 is directly transmitted to the studio system 14 or the video distribution server 16. Alternatively, it distributes to the studio system 14 or the moving picture distribution server 16 via the play moving picture intermediation server 12e.

It should be noted that the setting contents such as the distribution destination of the play moving image data and the data format of the play moving image data described above are only examples, and the setting contents can be arbitrarily changed by the player or the administrator of the system. In the above description, the game device 26-1 is used as an example. Executes the same processing as That is, the game device 26-2 outputs various data necessary for generating play video data to the video output device 28, and the video output device 28 executes processing for recording/distributing/outputting the play video data. Let

In this manner, in the arcade system 10 (the game device 26 and the moving image output device 28), as the player executes the game, the control data generated according to the game execution status is generated based on the time when the execution status occurs. can generate and record/distribute/output play video data associated with game video data. You can set the recording/distribution destination, data format, frame pattern used when editing play video data, etc. in the setting process and play video setting process. It becomes possible to record/distribute/output according to the purpose of use. For this reason, it is possible to more effectively use play video data (including game videos).

Next, the operation of the play moving image mediation server 12e in this embodiment will be described.
By executing the video storage/distribution process, the play video mediation server 12e receives and stores the play video data from the store system 10, and selects one of the first to third distribution methods according to the preset setting contents. Play animation data can be distributed by any method.

In the first distribution method, for example, play video data is received from the store system 10 and distributed to, for example, the studio system 14 or the video distribution server 16 in real time. In the second distribution method, the stored play video data is distributed (posted) to the video distribution server 16 or the like at a predetermined timing (for example, a predetermined time, a date and time designated by the player, system administrator, etc.). )do.

FIG. 18 is a flowchart showing an example of distribution (first distribution method, second distribution method) by the data center 12 in this embodiment. FIG. 18 exemplifies the case of distributing play video data of a competitive game executed between a plurality of game devices 26 . Here, it is assumed that game devices A and B are playing a competitive game.

The battle games of the game devices A and B are matched by the matching server 12d. The play moving image mediation server 12e receives information specifying the game devices A and B that play the competitive game from the matching server 12d (step C1). For example, the play video intermediary server 12e uses the card ID read by each of the game devices A and B as the information specifying the game devices A and B, the store system 10 in which the game devices A and B are installed and the game device specific information, or the game device Identification information issued for each game executed in A and B can be used.

When the game machines A and B execute the competitive game, the game machines A and B respectively generate play video data and transmit the play video data to the play video mediation server 12e, as described above. The play video mediation server 12e receives the play video data A and B from the game machines A and B, respectively (step C2), and stores the play video data A and B in association with each other. That is, the play video mediating server 12e converts the play video data generated by the competitive game based on the card IDs (or identification information, information specific to the game device, etc.) added to each of the play video data A and B. Identify and match.

If real-time delivery is not specified (step C3, No), the play video mediation server 12e associates and stores the play video data A and B until the games on the game machines A and B are finished. back. The play moving image data stored here is distributed at a predetermined timing by, for example, the second distribution method.

On the other hand, if real-time distribution is specified (step C4, Yes), the play video mediation server 12e generates play video data for distribution (step C5), and distributes it to a pre-specified distribution destination (for example, a studio system 14 or moving picture distribution server 16) (first distribution method) (step C6). The play video mediating server 12e generates play video data for distribution from the play video data A and B respectively received from the game devices A and B until the game on the game devices A and B is completed, and distributes the play video data sequentially. Send first (steps C2 to C7).

For example, in the case of distribution to the studio system 14, the play video mediation server 12e, so that the play video data can be edited in the studio system 14, as the play video data for distribution, the first play video data Format play video data is distributed as it is (first data format distribution method).

Further, for example, when distributing to the video distribution server 16, the play video intermediation server 12e edits and distributes a plurality of video data (or audio data) included in the play video data in the first play video data format. Generate and distribute play video data (second play video data format) for (second data format distribution method). In addition, it is possible to arbitrarily set which data format is used for distribution. A method of generating play video data in the second play video data format will be described in the video reproduction process (FIG. 20) described later.

In the above example, the example of the competitive game in which one player competes against each other is explained. It is also possible to target a battle game or the like in which two players fight each other. The play video intermediation server 12e receives the play video data from the game devices 26 on which the respective players participating in the competitive game play the game, stores the data in association with each other, and distributes the data by the first delivery method or the first delivery method in the same manner as described above. 2 distribution method.

FIG. 19 is a flow chart showing an example of distribution of play video data by the third distribution method by the play video mediation server 12e in this embodiment.

When playing a game on the game device 26, the player makes a setting to distribute (store) play video data to, for example, the play video mediation server 12e. As a result, as described above, the play video data of the game executed by the player is stored in the play video intermediary server 12e in association with the card ID (or identification information, information unique to the game device, etc.) presented by the player. .

After that, the player accesses the play video intermediation server 12e using the electronic device 18 at home or any other place, and transmits a request for distribution of the play video data.

When the play video mediating server 12e receives the distribution request from the electronic device 18 (step D1, Yes), the play video mediation server 12e, as information for specifying the play video data to be distributed, for example, the card ID presented at the time of game execution (further other identifying information such as an alphanumeric string or a code image) is sent from the electronic device 18.

The play video mediation server 12e receives the card ID (further identification information) from the electronic device 18 (step D4), and identifies play video data stored in association with the card ID (other identification information). (Step D3). The play moving image mediation server 12e transmits the play moving image data corresponding to the card ID to the electronic device 18 that requested the distribution (third distribution method) (step D4).

In this way, by receiving the play video data via the play video mediation server 12e, a plurality of video data (or audio data) included in the play video data in the first play video data format are edited to form a second play. Play animation data in the form of animation data can be received by the electronic device 18 at any timing desired by the player.

Thus, in the moving image distribution system of the present embodiment, play moving image data including a game image of a game executed on the game device 26 is not only acquired by the game device 26 and the store server 24 in the store system 10, but also acquired by the data center 12. (play animation intermediation server 12e), studio system 14, animation distribution server 16, etc. can be distributed. Therefore, the game image can be used more effectively. In addition, since play video data can be distributed in a data format (first play video data format, second play video data format) according to the purpose of use at the destination of the play video data, effective use of game video can be efficient. In particular, in play video data, control data generated according to the execution status of the game is recorded in association with game video data based on the time of occurrence of the execution status, so video editing etc. using control data are recorded. becomes possible. For example, in the studio system 14, it is possible to perform video editing using the control data of the play video data and reproduce the video.

Next, the moving image reproduction processing executed by the studio system 14 of this embodiment will be described. FIG. 20 is a flowchart showing an example of moving image reproduction processing in this embodiment. In the video reproduction process, the play video data in the first play video data format received from the store system 10 or the play video mediation server 12e is video edited (display format is changed) using control data by video processing (video processing program). change) to generate program data (play video data) for program broadcasting in the second play video data format and reproduce the video. The studio system 14 automatically executes program control based on control data, in addition to operations by the program production staff in the studio, such as changing the video playback frame of the program video and switching the video to be displayed. be able to.

Here, for example, it is assumed that an image of a program in which two game apparatuses A and B play a battle game is generated and broadcasted through the network 2 (network distribution). The studio system 14 combines play video data received from each of the game devices A and B, video (audio) of commentators and spectators filmed in the studio, and video (images) for commercials to produce a game. Produces programs such as live broadcasts of It is also possible to use other data such as data transmitted from viewers of the program through the network 2 (text data of chats, data posted to simple blogs, etc.) to create video of the program.

In the studio system 14, in order to create a video for the program, a moving image reproduction frame definition defining the configuration of the video for the program is set (step E1). In the video playback frame definition, for example, the video playback frame (frame pattern) that displays the video on the screen, the data that specifies the video to be displayed in each frame in the frame pattern, and the change of the frame according to the control data included in the play video data and data indicating changes in the video to be displayed are set.

When the studio system 14 starts video playback (program production/distribution processing) (step E2), it switches to the initial video playback frame set in the video playback frame definition (step E3), and displays the corresponding video in each frame. display (step E4).

FIG. 21(a) shows a display example of video using initial moving image reproduction frames. FIG. 21(a) shows an example of a frame pattern in which one screen is equally divided into four, and defines a display form before a battle game is started, for example. The video data (A2) of game device A (FIG. 8(c)) is displayed in frame F11, and the video data (B2) of game device B (FIG. 8(c)) is displayed in frame F12. is shown. That is, images of the respective players of the game devices A and B before the competition game is started are displayed. Further, in the frame F13, for example, an image (S1) shot of the audience in a studio, image data (A4) of the game device A (FIG. 8(e)), and image (B4) of the game device B (FIG. 8 ( e)) is switched and displayed. A frame F14 indicates that a commercial image (C1) is displayed.

FIG. 21(b) shows a display example of video using another initial video playback frame. FIG. 21(b) shows an example of a frame pattern in which a plurality of small frames F22, F23, and F24 are provided within a main frame F21 that is the entire screen. It defines the display form before the battle game starts. In the frame F21, image data (A2) (B2) photographing the players of the game devices A and B, image data (A4) (B4) photographing the spectators of the game devices A and B (FIG. 8(e)), Alternatively, it indicates that either one of the images (S2) and (S3) photographed by the two commentators in the studio is switched and displayed. Frames F22 and F23 indicate that different commercial images (C2) and (C3) are displayed. A frame F24 indicates that an image (S1) of an audience photographed in a studio, for example, is displayed.

When the studio system 14 detects the occurrence of an event from the control data of the play video data received from the game devices A and B (step E5, Yes), the studio system 14 responds to the control data (event) according to the video reproduction frame definition. Switch to the moving picture playback frame (step E6). Also, according to the moving image reproduction frame definition, the video displayed in each frame of the moving image reproduction frame after switching is switched as necessary.

For example, when the control data indicating the start of the game is detected, the studio system 14 switches the moving image reproduction frame shown in FIG. 21(a) to the moving image reproduction frame for the battle game shown in FIG. In FIG. 21(c), one frame F31 is enlarged and used as a main frame, and game images (A1) and (B1) of game devices A and B are displayed. Note that if the game images in the competitive game are the same (third-person viewpoint) on the game devices A and B, either one of the game images (A1) and (B1) may be displayed. If the game images displayed on the game devices A and B are different (for example, from the player's viewpoint), they can be switched according to the game situation (occurrence of an event). For example, in the case of the attack turn of the player of game device A, the game image (A1) of game device A is displayed, and in the case of the attack turn of the player of game device B, the game image (B1) of game device B is displayed. do.

Frames F32 and F33 show images (A2) and (B2) of the players of the game devices A and B, respectively, and frames F34 and F35 show the hands of the players of the game devices A and B. Images (A3) and (B3) are displayed respectively. That is, by displaying the game image and the image of the player and the player's hand, it is possible to easily grasp the progress of the competitive game. A frame F36 displays an image (S1) of the audience photographed in the studio.

FIG. 21(e) shows a display example of video using moving image reproduction frames when another event occurs. For example, an example of a case where there is control data indicating that the player of the game device A has performed a preset special action (movement, vocalization, etc.) is shown. In this case, an image (A2) of the player of the game device A is displayed in the frame F51 of the main frame according to the control data (event). Also, the game image (A1) is displayed in the frame F52 in which the player of the game device A has been imaged. Frames F53, F54, and F55 continue to display the same images as frames F33, F34, and F35 shown in FIG. 21(c).

FIG. 21(g) shows a display example of video using moving image reproduction frames when another event occurs. For example, an example of a case where there is control data indicating that the player of game device A has won the competitive game is shown. In this case, in frame F71 of the main frame, the game image (A1) at the end of the battle of the game device A, ie, the image representing victory in the battle, is displayed according to the control data (event). Frames F72, F73, and F76 continue to display the same video as frames F32, F33, and F37 shown in FIG. 21(c). In the frames F74 and F75, since there is no need to display the images at the player's hand due to the end of the battle, for example, different commercial images (C4) and (C5) are displayed.

In this way, it is possible to change the moving image reproduction frame and dynamically change the image displayed in the frame according to the game execution status indicated by the control data included in the play moving image data.

Although FIGS. 21(c), 21(e) and 21(g) show examples of video playback frames obtained by dividing the screen into tiles (each frame does not overlap), FIGS. As such, it is also possible to use video playback frames where the frames are altered to overlap other frames.

FIG. 21(d) shows an example of a moving image playback frame during a competitive game. In the moving image reproduction frame shown in FIG. 21(d), a frame F41 displaying the game image (A1) of the game device A and a frame F42 displaying the game image (B1) of the game device B are overlapped. Also, in frames F43 and F44, images (A2) and (B2) of the players of the game devices A and B are displayed, respectively.

Here, for example, if there is control data indicating that a special event has occurred in game device A, as shown in FIG. to overlap other frames F62, F63 and F64. The images displayed in F61, F62, F63, and F64 continue to display the same images as frames F41, F42, F43, and F44 shown in FIG. 21(d).

FIG. 21(h) shows an example in which there is control data indicating that the player of game device A has won the competitive game. In this case, the entire screen is set to the frame F81 of the main frame according to the control data (event), and the game image (A1) at the end of the battle of the game device A, that is, the image representing the victory of the battle is displayed. Also, an image (A2) of the player is displayed in a frame F82 overlapping the frame F81.

In this way, by changing the shape of the frame in accordance with the execution status of the game indicated by the control data, it is possible to display a program image that can be expected to have various dramatic effects.

In the above explanation, the shape of the video playback frame and the video displayed in the frame are switched according to the game execution status (event) indicated by the control data included in the play video data. It can also be controlled according to the operation by the staff. When the program production staff performs a frame switching operation and a video displayed in the frame switching operation (step E7, Yes), the studio system 14 switches the moving image playback frame according to the switching operation (step E7, Yes). step E8).

The studio system 14 repeats the above-described processes (steps E4 to E9) until the moving image reproduction is completed (step E9, Yes).

In this way, in the studio system 14, by video processing (video processing program), the control data included in the play video data is used to edit the video (change the display form), and the play in the second play video data format is performed. It is possible to generate moving image data and reproduce the moving image. Therefore, it is possible to generate program data (play moving image data) for program broadcasting and perform moving image reproduction (network distribution) while greatly reducing the operation burden on the program production staff in the studio. In particular, it is effective for distributing in real time the actual state of a game executed on the game device 26 .

In the above description, the shape of the moving image reproduction frame and the switching of the video displayed in the frame are taken as an example. In addition, in accordance with the timing indicated by the control data in the play video data, sounds that are not included in the play video data, such as pre-prepared jingles and other sound effects, can be added, and pre-prepared images such as superimposed images ( (including text) can be added to the video.

In the above description, the control data associated with the game image (image data 1 shown in FIG. 8(a)) is mainly used as an example, but other image data (for example, the player, the spectator, etc.) It is also possible to edit moving images using control data associated with video) and other audio data (for example, audio of players and spectators). In this case, if the data to be controlled according to the control data, such as switching the video according to the control data associated with the audio data, is set in the video playback frame definition, video, audio, and other Any image (commercial, etc.) may be used.

Furthermore, in the above example, the game devices A and B play a one-on-one match game. Play video data including game video from each user's viewpoint is transmitted. In such a case, based on the control data included in any piece of play animation data, an image or sound may be selected according to the execution status of the game to create an image.

In addition, as described above, based on the play video data in the first play video data format, the video is edited using the control data and the play video data in the second play video data format is generated. In the system 10 (shop server 24, game device 26) and the play video mediation server 12e, it can be executed in the same way.

Moreover, the present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the present invention at the implementation stage. Further, various inventions can be formed by appropriate combinations of the plurality of constituent elements disclosed in the above embodiments. For example, some components may be omitted from all components shown in the embodiments. Furthermore, components across different embodiments may be combined as appropriate.

Further, the method described in the embodiment can be executed by a computer as a program (software means), such as a magnetic disk (flexible disk, hard disk, etc.), an optical disk (CD-ROM, DVD, MO, Blu-ray ( (registered trademark), etc.), semiconductor memory (ROM, RAM, flash memory, etc.), or can be transmitted and distributed via a communication medium. The programs stored on the medium also include a setting program for configuring software means (including not only execution programs but also tables and data structures) to be executed by the computer. A computer that realizes this device reads a program recorded on a recording medium, and optionally builds software means by a setting program, and executes the above-described processing by controlling the operation by this software means. It should be noted that the recording medium in this specification is not limited to those for distribution, and includes storage media such as magnetic disks and semiconductor memories provided inside computers or devices connected via a network.

2 Network 10 (10-1, 10-2, ..., 10-n) Store system 12 Data center 12a Authentication/distribution server 12b Ranking server 12c Billing/storage server 12d Matching server 12e Play video mediation server 14 Studio system 16 Video distribution server 18 Electronic device 24 Store server 24a Processor 24b Memory 24c Storage device 24d Display unit 24e Input unit 24f Communication unit 24g Media I/F 24j Card reader 26 (26-1, 26-2, 26-m) Game device 28 Video output device.

Claims (4)

game image data corresponding to each of a plurality of game images displayed along with the execution of the game, and in accordance with a plurality of execution situations occurring along with the execution of the game, based on the occurrence time of the execution situation A first mode in which one of the plurality of game images is simultaneously displayed on a screen associated with game image data and changed according to the occurrence of the execution situation, or one of the plurality of game images and the game A second form of displaying at least one of images taken through a camera during execution of the game different from the images or images recorded in a file separately from the execution of the game in advance. receiving means for receiving first play video data including control data corresponding to any of a plurality of different frame patterns provided with a plurality of areas for display;
setting means for presetting a frame pattern indicating a form of displaying an image on a screen according to the execution status of the game indicated by the control data, which is used for editing the first play video data;
When the control data detected from the first play video data received by the receiving means indicates the first mode, any one of the plurality of game videos based on the game video data is selected. , a first video edited so as to be individually displayed in areas of a first frame pattern corresponding to the control data indicating the first form set in advance, or when the control data indicates the second form; any one of the plurality of game images based on the game image data and an image corresponding to data stored in advance separately from the execution of the game, which is different from the game image, is set in advance; generating means for generating second play moving image data of a second video edited so as to be individually displayed in areas of a second frame pattern different from the first frame pattern corresponding to the control data indicating the two modes; video recording device. 2. A moving picture recording apparatus according to claim 1, wherein said control data correspond to events that occur while the game is being executed. game image data corresponding to each of a plurality of game images displayed along with the execution of the game, and in accordance with a plurality of execution situations occurring along with the execution of the game, based on the occurrence time of the execution situation A first mode in which one of the plurality of game images is simultaneously displayed on a screen associated with game image data and changed according to the occurrence of the execution situation, or one of the plurality of game images and the game A second form of displaying at least one of images taken through a camera during execution of the game different from the images or images recorded in a file separately from the execution of the game in advance. receive first play video data including control data corresponding to any of a plurality of different frame patterns provided with a plurality of areas for display,
setting in advance a frame pattern indicating a form in which an image is displayed on a screen according to the execution status of the game indicated by the control data, which is used for editing the first play video data;
When the control data detected from the received first play video data indicates the first mode, one of the plurality of game videos based on the game video data is set in advance. A first image edited to be individually displayed in areas of a first frame pattern corresponding to the control data indicating the first form, or the game image when the control data indicates the second form Any one of the plurality of game images based on data and an image corresponding to data different from the game image and stored in advance separately from the execution of the game are shown in the second form set in advance. A moving image generation method for generating second play moving image data of a second video edited so as to be individually displayed in areas of a second frame pattern different from the first frame pattern corresponding to the control data. the computer,
game image data corresponding to each of a plurality of game images displayed along with the execution of the game, and in accordance with a plurality of execution situations occurring along with the execution of the game, based on the occurrence time of the execution situation A first mode in which one of the plurality of game images is simultaneously displayed on a screen associated with game image data and changed according to the occurrence of the execution situation, or one of the plurality of game images and the game A second form of displaying at least one of images taken through a camera during execution of the game different from the images or images recorded in a file separately from the execution of the game in advance. receiving means for receiving first play video data including control data corresponding to any of a plurality of different frame patterns provided with a plurality of areas for display;
setting means for presetting a frame pattern indicating a form of displaying an image on a screen according to the execution status of the game indicated by the control data, which is used for editing the first play video data;
When the control data detected from the first play video data received by the receiving means indicates the first mode, any one of the plurality of game videos based on the game video data is selected. , a first video edited so as to be individually displayed in areas of a first frame pattern corresponding to the control data indicating the first form set in advance, or when the control data indicates the second form; any one of the plurality of game images based on the game image data and an image corresponding to data stored in advance separately from the execution of the game, which is different from the game image, is set in advance; Functions as generating means for generating second play moving image data of a second video edited so as to be individually displayed in areas of a second frame pattern different from the first frame pattern corresponding to the control data indicating the two modes. program to make

Images