JP7072282B2 - Server devices, video distribution systems, control methods and computer programs used for them - Google Patents

Description

The present invention relates to a server device or the like in which a display terminal for displaying a predetermined screen and a shooting terminal for shooting at least one terminal moving image are connected via a network.

There is a server device to which a display terminal for displaying a predetermined screen is connected via a network. For example, there is known an image processing system in which a client that displays a game screen including a plurality of play video images representing the contents of a game being played by a plurality of users is connected to a cloud service (see, for example, Patent Document 1). ).

Japanese Unexamined Patent Publication No. 2012-90120

In the image processing system of Patent Document 1, the game screen functions as a predetermined screen, the client functions as a display terminal, and the cloud service functions as a server device. Then, each client is displayed with a game screen in which a plurality of play video images are combined. However, a plurality of play moving images are only the same kind of moving images. That is, in the image processing system of Patent Document 1, although the user who plays the game is different, the moving image of the same game provided by each client of the same type is only displayed on the game screen. Further, in Patent Document 1, it is not assumed that different types of moving images are provided by other than each client. As a result, in the image processing system of Patent Document 1, the types of moving images to be synthesized to be displayed on the game screen are limited.

Therefore, an object of the present invention is to provide a server device or the like capable of displaying different types of moving images on a predetermined screen displayed by a display terminal.

The server device of the present invention is a server device in which a display terminal for displaying a predetermined screen and a shooting terminal for shooting a terminal moving image are connected via a network, and a plurality of moving images different from each other can be produced. The video storage means for storing the video identification information in association with the video identification information for identifying the video, and the specific information for specifying the terminal video and the video identification information to be associated with the terminal video are acquired from the shooting terminal. A video discriminating means for discriminating as a target video a video corresponding to the video identification information specified by the specific information among the plurality of videos based on the video acquisition means and the acquisition result of the video acquisition means, and the video. Based on the discrimination result of the discriminating means, the display terminal is provided with the terminal moving image and the moving image providing means for providing the target moving image.

The control method of the present invention is a server device in which a display terminal for displaying a predetermined screen and a shooting terminal for shooting a terminal moving image are connected via a network, and a plurality of moving images different from each other are produced. Specific information for identifying the terminal video and the video identification information to be associated with the terminal video in a computer incorporated in a server device provided with a video storage means for storing the video identification information in association with the video identification information for identifying the video. Based on the video acquisition procedure for acquiring the video from the shooting terminal and the acquisition result of the video acquisition procedure, the video corresponding to the video identification information specified by the specific information among the plurality of videos is determined as the target video. The terminal video and the target so that the composite screen in which both the terminal video and the target video are displayed is displayed as the predetermined screen based on the video discrimination procedure to be performed and the discrimination result of the video discrimination procedure. It is intended to execute a video providing procedure for providing a video.

Further, the computer program for the server device of the present invention is a server device in which a display terminal for displaying a predetermined screen and a shooting terminal for shooting a terminal moving image are connected via a network, and are different from each other. A computer incorporated in a video distribution system provided with a video storage means for storing a plurality of videos in association with video identification information for identifying each video is the terminal video and the video identification information to be associated with the terminal video. Corresponds to the moving image identification information specified by the specific information among the plurality of moving images based on the acquisition results of the moving image acquisition means for acquiring the specific information for specifying the above and the moving image acquisition means. Based on the video discriminating means for discriminating the video as the target video and the discriminating result of the video discriminating means, the composite screen in which both the terminal video and the target video are displayed is displayed as the predetermined screen. It is configured to function as a moving image providing means for providing the terminal moving image and the target moving image.

The moving image distribution system of the present invention includes a display terminal for displaying a predetermined screen, a shooting terminal for shooting a terminal moving image, and a server device, and the display terminal, the shooting terminal, and the server device include the display terminal, the shooting terminal, and the server device. A video distribution system connected via a network, the video storage means for storing a plurality of videos different from each other in association with the video identification information for identifying each video, the terminal video, and the terminal video. Based on the acquisition result of the moving image acquisition means for acquiring the specific information for specifying the moving image identification information to be associated from the shooting terminal and the moving image acquisition means, the specific information is specified among the plurality of moving images. A composite screen in which both the terminal video and the target video are displayed based on the discrimination result of the video discriminating means for discriminating the video corresponding to the video identification information as the target video and the video discriminating means is the predetermined screen. The terminal moving image and the moving image providing means for providing the target moving image are provided so as to be displayed as a screen.

The video distribution system of the present invention is a video distribution system in which a display terminal for displaying a predetermined screen, a shooting terminal for shooting a terminal video, and a server device are connected via a network, and a plurality of different video distribution systems are connected to each other. The video storage means for storing the video in association with the video identification information for identifying each video, and the terminal video, and the specific information for specifying the video identification information to be associated with the terminal video are taken. Video discrimination that discriminates a video corresponding to the video identification information specified by the specific information among the plurality of videos as a target video based on the video acquisition means acquired from the terminal and the acquisition result of the video acquisition means. Based on the discrimination result of the means and the moving image discrimination means, the synthetic moving image generation means for generating the synthetic moving image in which the terminal moving image and the target moving image are synthesized, and the synthetic moving image generation means based on the generation result of the synthetic moving image generating means. A moving image providing means for providing the synthesized moving image is provided so that the moving image is displayed on the predetermined screen.

The server device of the present invention is a server device in which a display terminal for displaying a predetermined screen and a shooting terminal for shooting a terminal moving image are connected via a network, and a plurality of moving images different from each other can be produced. The video storage means for storing the video identification information in association with the video identification information for identifying the video, and the specific information for identifying the terminal video and the video identification information to be associated with the terminal video are acquired from the shooting terminal. A moving image determination means for discriminating a moving image corresponding to the moving image identification information specified by the specific information among the plurality of moving images as a target moving image based on the moving image acquisition means and the acquisition result of the moving image acquisition means, and the moving image. Based on the discrimination result of the discrimination means, the synthetic moving image generation means for generating the synthetic moving image in which the terminal moving image and the target moving image are synthesized, and the synthetic moving image are the predetermined synthetic moving image based on the generation result of the synthetic moving image generation means. It is provided with a moving image providing means for providing the synthesized moving image so as to be displayed on the screen.

The figure which shows the outline of the whole structure of the game system to which the video distribution system which concerns on one form of this invention is applied. The figure which shows the structure of the main part of the control system of a game system. The figure which shows typically an example of the game machine which is providing a music game, and the user who is playing. An explanatory diagram for explaining an example of a video distribution service when a synthetic video in which a game video and a play video are combined is distributed. An explanatory diagram for explaining an example of a method of discriminating between a game video and a play video to be synthesized. An explanatory diagram for explaining an example of each phase included in a music game. An explanatory diagram for explaining an example of the limitation of some play videos. An explanatory diagram for explaining an example of a limiting condition. The figure which shows an example of the content of the main video data. The figure which shows an example of the content of a sub video data. The figure which shows an example of the content of synthetic video data. The figure which shows an example of the flowchart of the main video data generation processing routine. The figure which shows an example of the flowchart of the sub-video data generation processing routine. The figure which shows an example of the flowchart of the synthetic moving image generation processing routine. The figure which shows an example of another delivery screen schematically. The figure which shows the structure of the main part of the control system of the game system which concerns on the modification.

Hereinafter, a game system to which the video distribution system according to one embodiment of the present invention is applied will be described. FIG. 1 is a diagram showing an outline of the overall configuration of a game system to which the video distribution system according to one embodiment of the present invention is applied. As shown in FIG. 1, the game system 1 includes a center server 2 as a server device and a plurality of game machine GMs. The center server 2 is not limited to the example composed of one physical device. For example, one logical center server 2 may be configured by a group of servers as a plurality of physical devices. Further, the center server 2 may be logically configured by using cloud computing. Further, the game machine GM may function as the center server 2.

Each game machine GM is connected to the center server 2 via the network 3. Each game machine GM is a commercial (commercial) game machine that allows a user to play a game within a range corresponding to the price in exchange for consumption of a predetermined price. As an example, each game machine GM provides a music game in exchange for consumption of a predetermined price. An appropriate number of each game machine GM is installed in a commercial facility such as a store 4 as a facility.

Further, the user terminal 5 is connected to the center server 2 via the network 3. The user terminal 5 is a kind of network terminal device that exhibits various functions by executing software. As the user terminal 5, for example, a personal computer 5a as a display terminal and a mobile phone 5b (including a smartphone) as a shooting terminal are used. As the user terminal 5, various network terminal devices capable of network connection may be appropriately used.

The network 3 includes a WAN (wide area network) 3A and a LAN (local area network) 3B. As WAN3A, for example, the Internet that realizes network communication using the TCP / IP protocol is used. The LAN 3B is constructed for each store 4 so as to connect between the game machines GM in each store 4. Further, the LAN 3B is constructed by, for example, an intranet using the TCP / IP protocol. The LAN 3B and the center server 2 are connected to the WAN 3A via the router 6.

The network 3 is not limited to the form using the TCP / IP protocol. As the network 3, various forms using a wired line for communication, a wireless line (including infrared communication, short-range wireless communication, etc.) and the like may be used. Alternatively, the communication between the user terminal 5 and the game machine GM or the like conforms to a predetermined standard so as to include various information such as a two-dimensional code without using a communication line (including wired and wireless). It may be realized by using the code generated by the above (for example, a two-dimensional code). Therefore, the term of network (or communication line) includes a form of transmitting and receiving information without using a line, such as a communication method using such a code.

The center server 2 provides various game machine services to each game machine GM or its user. As a service for a game machine, for example, a service that receives identification information of a user from each game machine GM and authenticates the user may be provided. Further, a service may be provided in which the play data of the authenticated user is received from each game machine GM and saved, or the play data to be saved is provided to each game machine GM. Further, the service for game machines includes a service for distributing and updating programs or data of each game machine GM via network 3, and when a plurality of users play a common game via network 3, users can interact with each other. A matching service or the like for matching may be included.

Further, the center server 2 provides various Web services to the user of the user terminal 5 via the network 3. The Web service includes, for example, a game information service that provides various information about a game provided by each game machine GM. The Web service also includes a distribution service that distributes various data or software (including updates of data and the like) to each user terminal 5. Similarly, the Web service also includes services such as a community service that provides a place for interaction by users such as information transmission, exchange, and sharing, and a service that assigns a user ID for identifying each user. In addition, community services include video distribution services. Then, the game system 1 functions as a video distribution system according to one embodiment of the present invention by providing a video distribution service. The details of the video distribution service will be described later.

Next, a main part of the control system of the game system 1 for providing the video distribution service will be described. FIG. 2 is a diagram showing a configuration of a main part of the control system of the game system 1. As shown in FIG. 2, the center server 2 includes a control unit 10 and a storage unit 11. The control unit 10 is configured as a computer unit in which a microprocessor and various peripheral devices such as an internal storage device (ROM and RAM as an example) necessary for the operation of the microprocessor are combined. An input device such as a keyboard, an output device such as a monitor, and the like may be connected to the control unit 10, but their illustrations are omitted.

The storage unit 11 is connected to the control unit 10. The storage unit 11 is configured by a large-capacity storage medium such as a magnetic tape so that the storage can be held without supplying power. The server program 15 is stored in the storage unit 11. The server program 15 is a computer program required for the center server 2 to provide various services to the game machine GM and the user terminal 5. When the control unit 10 reads and executes the server program 15, a game machine service management unit 16 and a Web service management unit 17 are provided inside the control unit 10.

The game machine service management unit 16 executes the process for providing the above-mentioned game machine service. On the other hand, the Web service management unit 17 executes the processing necessary for providing the above-mentioned Web service. The game machine service management unit 16 and the Web service management unit 17 are logical devices realized by a combination of computer hardware and a computer program. Although various other logical devices may be provided inside the control unit 10, their illustrations are omitted.

The storage unit 11 further records various data that can be referred to when the server program 15 is executed. For example, such various types of data include ID management data 18, main video data 19, sub video data 20, and synthetic video data 21. These details will be described later.

As various data, for example, the above-mentioned play data may be recorded in addition to the above-mentioned ID management data 18 and the like. The play data is data in which information regarding the past play results of each user is described. The play data may be used, for example, to inherit the play results (past achievements) up to the previous time from the next time onward, or to inherit the setting contents unique to each user. Further, various types of data may be stored in the storage unit 11, but their description and illustration will be omitted.

On the other hand, each game machine GM is provided with a control unit 30 as a computer, a storage unit 31, and an encoder EC. The control unit 30 is configured as a computer unit in which a microprocessor and various peripheral devices such as an internal storage device (ROM and RAM as an example) necessary for the operation of the microprocessor are combined. Similar to other known game machines, the control unit 30 may be connected to various output devices or input devices such as a monitor, a speaker, a control panel, a coin authentication device, or a card reader. Such an input device includes, for example, a state detection device. The state detection device is a well-known device for detecting the state of the person to be detected (including information on the state of the whole posture, the position of each part, the skeleton, etc.) and the change in the state. The state detection device is, for example, an optical sensor (a well-known sensor for detecting the state and movement of each part of the subject to be detected) and a depth sensor (for detecting the distance between the state detection device and the subject to be detected). Well-known sensor) is included. However, the illustration of such various output devices or input devices is omitted.

The storage unit 31 is connected to the control unit 30. The storage unit 31 is composed of, for example, a magnetic recording medium, an optical recording medium, a flash SSD (Solid State Drive), or the like so that storage can be held without supplying power. The game data 34 and the game program 35 are stored in the storage unit 31. The game program 35 is a computer program required for the game machine GM to provide a card game. A game service processing unit 36 is provided inside the control unit 30 with the execution of the game program 35. The game service processing unit 36 executes various processes necessary for providing the music game. The game service processing unit 36 is a logical device realized by a combination of computer hardware and a computer program. Various other logical devices may be provided inside the control unit 30, but their illustrations are omitted.

The game data 34 is data that can be referred to with the execution of the game program 35. The game data 34 includes, for example, image data and sound effect data. The image data is data necessary for displaying various images such as various game screens for music games on a monitor. The sound effect data is data necessary for the speaker to reproduce various sounds for a music game such as sound effects. Further, the game data 34 may include, for example, the above-mentioned play data and ID management data 18. As an example, the play data and the ID management data 18 are provided at least in part from the center server 2 so as to include necessary parts. The game data 34 may also include various data necessary for providing music data, but description and illustration thereof will be omitted.

The encoder EC is a device for providing a video distribution service. For example, the game screen of the music game provided by each game machine GM is also provided to the center server 2 via the encoder EC. The encoder EC is controlled by the control unit 30. The encoder EC may be omitted. In this case, the control unit 30 may function in the same manner as the encoder EC. Alternatively, the encoder EC may be provided separately from each game machine GM. Then, for example, each game machine GM and each user terminal 5 may be connected via an encoder EC. In this case, for example, each user terminal 5 may function as a control terminal that controls a part of the functions of each game machine GM via the encoder EC. More specifically, the control unit 30 of each game machine GM and the control unit 40 of each user terminal 5 may be connected via the encoder EC (see FIG. 16). Then, as a part of the function, a function for executing various settings (for example, an instruction to start the video distribution service) necessary for providing the video distribution service (for example, the game screen is appropriately displayed on the center server 2 as described above). The functions and the like provided to the control unit 40 may be controlled by the control unit 40. That is, the encoder EC may function as a device for making each user terminal 5 separately connected at an appropriate time function as a part of each game machine GM. Then, the user terminal 5 may add a function as a device for providing a video distribution service to each existing game machine GM via the encoder EC. That is, in this case, the function for realizing the video distribution service may not be provided in advance in each game machine GM.

The user terminal 5 is provided with a control unit 40 and a storage unit 41. The control unit 40 is configured as a computer unit in which a microprocessor and various peripheral devices such as an internal storage device (ROM and RAM as an example) necessary for the operation of the microprocessor are combined. In addition, various input devices and output devices provided in known computer devices capable of network connection may be connected to the control unit 40. For example, such various input devices may include a camera for taking an image and a GPS (Global Positioning System) receiver for calculating a position. That is, as an example, the user terminal 5 may have a shooting function for shooting an image (including a moving image) and a so-called GPS function (a function for calculating position information). However, their illustration is omitted. Further, in the following, the mobile phone 5b will be described as an example of the user terminal 5 having these shooting functions and GPS functions.

The storage unit 41 is connected to the control unit 40. The storage unit 41 is configured by, for example, a non-volatile semiconductor recording device or the like so that storage can be held without supplying power. The terminal data 44 and the terminal program 45 are stored in the storage unit 41. The terminal program 45 is a computer program required for the user terminal 5 to receive the Web service from the center server 2. When the control unit 40 reads and executes the terminal program 45, a Web service processing unit 46 is provided inside the control unit 40.

The Web service processing unit 46 cooperates with the Web service management unit 17 of the center server 2, for example, to execute various processes necessary for the user to use the Web service. As an example of such a Web service, the Web service processing unit 46 executes various processes necessary for providing the video distribution service. In addition, the Web service processing unit 46 also executes various well-known processes necessary for providing the Web service, for example. The Web service processing unit 46 is a logical device realized by a combination of computer hardware and a computer program. Although various other logical devices may be provided inside the control unit 40, their illustrations are omitted.

On the other hand, the terminal data 44 is various data that can be referred to with the execution of the terminal program 45. For example, the terminal data 44 may include the ID management data 18. As an example, the ID management data 18 is provided by the center server 2 at least in part so as to include a necessary portion. The terminal data 44 may also include various data necessary for providing the Web service, but the description and illustration thereof will be omitted.

Next, the music game provided by the game machine GM will be described. The music game is a type of game in which the time when an appropriate play action should be executed is guided according to the music, and when the appropriate play action is executed, the execution time of the play action is evaluated. More specifically, a music game is a type of music game in which a user's dance movement performed in accordance with the rhythm of music is evaluated. That is, as an appropriate play action, an appropriate user's dance motion (posture such as the position and orientation of each part) is evaluated. As an example, each game machine GM provides a game opportunity to play such a music game each time a predetermined consideration is consumed.

FIG. 3 is a diagram schematically showing an example of a game machine GM providing a music game and a user playing the game. As shown in FIG. 3, each game machine GM is provided with a monitor MO. The game screen 50 is displayed on the monitor MO. That is, at each game opportunity, the music game is played via the game screen 50.

The game screen 50 includes, for example, two silhouette images 51 and a user character image 52. The user character image 52 is an image for reproducing the dance motion of a user (hereinafter, a user who is playing a music game may be particularly referred to as a performer P) in the game. The dance motion of the performer P is detected by, for example, the above-mentioned state detection device, and is reproduced in the game as the dance motion of the user character image 52.

Each silhouette image 51 is an image for guiding an appropriate dance motion (posture) to the performer P. The two silhouette images 51 show the same posture as part of the dance motion. More specifically, each silhouette image 51 shows the same specific posture that the user character image 52 should show. Further, as an example, the two silhouette images 51 appear on both the left and right sides of the user character image 52, and at the same time, move toward the user character image 52 so as to overlap the user character image 52. And the overlapping time is the appropriate time to perform the dance movement. That is, each silhouette image 51 informs the performer P of an appropriate posture of the dance movement and an appropriate time when the posture should be taken by overlapping them. Then, the actual dance motion of the performer P accompanying it is reproduced in the game as the dance motion of the user character image 52. Further, the degree of coincidence between each silhouette image 51 and the user character image 52 (posture of performer P and its timing) is evaluated. Specifically, the higher the degree of matching between the silhouette image 51 and the user character image 52, the higher the evaluation.

On the other hand, a play area PA is provided at a predetermined position in front of each game machine GM (display direction of the monitor MO). The play area PA is an area for the performer P to perform a dance action as a play act. The play area PA is arranged at an appropriate position where the state detecting device can detect the state of the performer P (detected person). That is, the dance motion of the performer P is appropriately detected by being executed in the play area PA.

In the example of FIG. 3, the posture of each silhouette image 51 and the posture of the user character image 52 match. That is, the performer P is performing an appropriate dance posture. Further, each silhouette image 51 is located immediately before overlapping with the user character image 52. Therefore, if this posture is maintained even when each silhouette image 51 overlaps with the user character image 52, it is evaluated that an appropriate dance motion is executed at an appropriate time. As an example, each game machine GM provides such a music game.

Next, an example of the video distribution service will be described in detail. The video distribution service is, for example, a service that distributes various videos related to a game to a personal computer 5a. As an example, a video distribution service distributes a video by a streaming method. In the video distribution service, game videos are distributed as an example of various videos. The game video is a video corresponding to the game screen 50 being played. More specifically, the game screen changes as appropriate during play. The game video is a video showing such a change in the game screen, that is, a change in the game screen that changes with the passage of time during play. As an example, such a game moving image is generated by the encoder EC of each game machine GM and provided to the center server 2.

Further, in the video distribution service, as an example, a composite video in which a video shot by a mobile phone 5b is synthesized is also distributed. More specifically, among the moving images taken by the mobile phone 5b, the play moving image of the performer P being played is used for compositing. Then, in the video distribution service, as an example, a synthetic video in which such a game video and a play video are synthesized is distributed by a streaming method. That is, as an example, the synthetic moving image is divided into a plurality of frame moving images for each predetermined period, distributed to the personal computer 5a for each frame moving image, and reproduced at any time. Then, a composite moving image is formed by a set of each frame moving image along with the passage of time. As an example, in a video distribution service, a synthetic video is distributed by such a streaming method.

The distribution of the synthetic moving image will be further described with reference to FIG. FIG. 4 is an explanatory diagram for explaining an example of a video distribution service when a synthetic video in which a game video and a play video are combined is distributed. As shown in FIG. 4, as a moving image distribution service, a distribution screen 60 as a composite screen is provided to each personal computer 5a via the center server 2. The distribution screen 60 includes a moving image area 61 and a chat area 62.

The chat area 62 is an area used as a place for exchanging opinions of users of each personal computer 5a. Specifically, in the chat area 62, for example, the opinions of each user provided via each personal computer 5a are displayed.

On the other hand, the moving image area 61 is an area for displaying a synthetic moving image. Therefore, the composite moving image CM (including the frame moving image) is displayed at any time in the moving image area 61 (in FIG. 4, the synthesized moving image CM is displayed as a still image due to the nature of the drawing in FIG. 4. For each subsequent figure and each moving image. The same applies). The synthetic moving image CM is formed by synthesizing each game moving image G and each play moving image M as a terminal moving image. Further, as an example, each game video G and each play video M are synthesized so that each game video G is displayed as a main video and each play video M is displayed as a sub video.

Specifically, each game moving image G is displayed over the entire area of the moving image area 61, while each play moving image M is displayed in a part of the moving image area 61. That is, the display area 66 of each play video M is provided in the display area (corresponding to the video area 61) of each game video G. Then, both are displayed so that each play video M functions as a part of each game video G. That is, each play video M is combined with each game video G so as to function as a so-called wipe video. As an example, a synthetic moving image CM synthesized so as to display each game moving image G and each play moving image M is displayed in the moving image area 61.

Further, as an example, in order to realize streaming distribution, each game video G and each play video M are also divided into a plurality of frame videos, and each game machine GM or each mobile phone 5b is connected to the center server 2 in units of frame videos. Provided. Specifically, each game machine GM is used by each performer P in each store 4. The center server 2 acquires changes in each game screen 50 during play of each performer P as a frame moving image at predetermined intervals from each game machine GM at any time with the passage of time. Then, the game moving image G is formed by the set of such frame moving images.

On the other hand, in each store 4, there are many cases where a plurality of spectators generally exist around each performer P. In addition, each spectator generally owns a mobile phone 5b. As an example, a play moving image M shot by such a mobile phone 5b is used as a synthesis target. The center server 2 acquires the captured play video M as a frame video at predetermined intervals from the mobile phone 5b at any time with the passage of time. Then, the play moving image M is formed by the set of such frame moving images.

In the example of FIG. 4, each play moving image M includes a first play moving image M1 and a second play moving image M2. More specifically, the center server 2 has a play video M1 shot by the first mobile phone 5b1 as a play video M shot by the first mobile phone 5b1 and a play shot by the second mobile phone 5b2 among the mobile phones 5b owned by the audience. The second play moving image M2 is acquired as the moving image M, respectively. Then, the center server 2 generates a composite moving image CM in which both play moving images M1 and M2 are arranged on the lower left and right sides of each game moving image G as a wipe moving image.

Further, each synthetic moving image CM is generated, for example, by frame moving images of both play moving images M1 and M2 and each game moving image G at the same time. That is, each synthetic moving image CM is generated so that the time passages of both play moving images M1 and M2 and each game moving image G are synchronized with each other. Such synchronization may be performed, for example, based on the real time measured by each game machine GM or each mobile phone 5b (for example, absolute time such as "12:00"). Alternatively, if the elapsed time (relative time) from the actual time at the start of shooting is given to each frame moving image, the execution may be performed based on the actual time and the elapsed time. As a result, a synthetic moving image CM that synchronously reproduces each game moving image G and each play moving image M is generated. Then, the center server 2 distributes such a synthetic moving image CM. That is, both the game moving image G and the frame moving images of each play moving image M at the same time are simultaneously displayed on each personal computer 5a via the distribution screen 60 including such a synthetic moving image CM. Further, such a synthetic moving image CM is, as an example, stream-delivered to each personal computer 5a in near real time. That is, the center server 2 attaches these to each personal computer 5a immediately after acquiring each frame video of each game video G and each play video M at the same time (before acquiring all of each frame video). The distribution screen 60 including the above is provided in order. As an example, in the video distribution service, such a synthetic video CM is distributed via the distribution screen 60.

An example of a method for discriminating between a game video to be synthesized and a play video will be described with reference to FIG. A game video G is generated for each game provided by each game machine GM. The same applies to each play video M. Further, in the case of each play moving image M, it is provided from each mobile phone 5b. Therefore, a plurality of game moving images G and a plurality of playing moving images M are provided as synthesis targets on the center server 2, and are stored at least temporarily. Then, the synthesis target is determined from these game video G and play video M, and the game video G and play video M related to each other are synthesized.

FIG. 5 is an explanatory diagram for explaining an example of a method for discriminating between the game moving image G and the play moving image M to be synthesized. As shown in FIG. 5, in the center server 2, each game video G to be synthesized is stored as a game video group GG in association with a stream ID as video identification information. The stream ID is information for identifying each game video G from each other. That is, the stream ID is a unique ID for each game video G. Similarly, in the center server 2, each play video M to be synthesized is also stored as a play video group MM in association with each game video G and a common stream ID. Then, the game video G and the play video M having a common stream ID are discriminated and synthesized.

In the example of FIG. 5, the game video group GG includes the A game video G1 associated with the “A stream ID”. Similarly, the play video group MM includes the first play video M1 and the second play video M2 associated with the “A stream ID”. In this case, these game moving images G1 and the two play moving images M1 and M2 are determined as synthesis targets. Then, a synthetic moving image CM in which these are combined is generated and distributed. Further, in this case, the A game moving image G1 having the same stream ID as these play moving images M1 and M2 functions as the target moving image of the present invention.

With reference to FIG. 6, the stream ID associated with each game video G and each play video M will be described. FIG. 6 is an explanatory diagram for explaining an example of each phase included in the music game. As shown in FIG. 6, the music game includes, as an example, an ID acquisition phase, an ID provision phase, and a play phase in order.

The ID acquisition phase is a phase for each game machine GM to acquire a stream ID. Specifically, each game machine GM acquires a stream ID from the center server 2. That is, the stream ID is given to each game play by the center server 2 as an example. Therefore, as a stream ID, a different ID is assigned to each game opportunity to play the game.

The next ID providing phase is a phase for providing each mobile phone 5b with the stream ID acquired in the ID acquisition phase. For example, in the ID provision phase, each game machine GM provides a stream ID to each mobile phone 5b. Specifically, as an example, the stream ID is provided to each mobile phone 5b via the ID providing screen 80. The ID providing screen 80 includes a two-dimensional code image 81. The two-dimensional code image 81 is an image of a two-dimensional code configured according to a predetermined standard so as to include information on the stream ID. Each mobile phone 5b acquires the stream ID information via the two-dimensional code image 81. That is, each mobile phone 5b reads the two-dimensional code image 81 and acquires the information of the stream ID contained therein. As an example, each mobile phone 5b uses a distribution service application (software) to perform this reading.

The subsequent play phase is a phase for distributing the above-mentioned synthetic moving image CM. Specifically, in the play phase, each game machine GM provides the music game as described above. Then, each game machine GM provides the center server 2 with a game video G indicating a change in the game screen 50 of the music game being played, together with a stream ID indicating the current game opportunity.

On the other hand, each mobile phone 5b, as an example, shoots each play moving image M via a distribution service application. The application for the distribution service provides the shooting result as the play moving image M to the center server 2. Specifically, the distribution service application provides the captured play video to the center server 2 together with the stream ID acquired in the ID provision phase. As a result, each game video G and each play video M are stored in the center server 2 in association with a common stream ID. Then, in the center server 2, as described above, the game video G and the play video M that captures the game video G are discriminated and synthesized using the common stream ID as a key. As an example, the stream ID is thus associated with each game video G and each play video M. Further, as an example, each mobile phone 5b functions as a shooting terminal of the present invention via a distribution service application.

With reference to FIG. 7, the limitation of some play moving images M will be described. As described above, the plurality of play moving images M are provided by the plurality of mobile phones 5b. Further, in the same store 4, a plurality of spectators may shoot a play video M of the same performer P at the same game opportunity. Therefore, there is a possibility that a large number of play videos M are associated with one game video G. Therefore, the play moving image M to be synthesized with each game moving image G is limited by the limiting condition.

FIG. 7 is an explanatory diagram for explaining an example of the limitation of some play moving images M. As shown in FIG. 7, the play moving image group MM includes a large number of play moving images M having the same common stream ID. On the other hand, the specific play video group MM1 formed by these a large number of play video Ms may include a video that is inappropriate for synthesis with the game video G. Therefore, among the specific play video group MM1, the use of a video (at least a video having a high possibility of being inappropriate) that is inappropriate for compositing with each game video G is restricted. Specifically, the specific play video group MM1 is further narrowed down to the play video group MM2 to be synthesized, which does not include a video that is likely to be inappropriate based on the restriction conditions when the synthetic video CM is generated. Then, each play video M and each game video G of the play video group MM2 to be synthesized are combined, and each synthetic video CM is generated.

In the example of FIG. 7, the play moving image group MM includes, for example, the first play moving image M1 to the third play moving image M3 as the specific play moving image group MM1. On the other hand, the play moving image group MM2 to be synthesized does not include the third play moving image M3. That is, the third play moving image M3 is determined to be a moving image that is highly likely to be inappropriate due to the limiting conditions, and its use is restricted. In this way, the use of some play moving images M is restricted based on the restriction conditions.

FIG. 8 is an explanatory diagram for explaining an example of the limiting condition. As shown in FIG. 8, the limiting condition includes, for example, a time condition, a place condition, a credit condition, a capacity condition, and a designated condition. That is, as an example, the restriction condition may be satisfied when any of these time condition, place condition, credit condition, capacity condition, and designated condition is satisfied. Although the limiting conditions include various other conditions, the illustration and description thereof will be omitted.

The time condition includes, for example, a shooting time or an acquisition time as a requirement. That is, in the time condition, as an example, the shooting time or the acquisition time is used as a criterion of improperness. For example, the time condition is satisfied when the shooting time or acquisition time of each play moving image M does not belong to a predetermined time range. Specifically, for example, the time condition that requires the shooting time is satisfied, for example, when the shooting time is significantly different from the play time corresponding to each game moving image G. That is, in this case, as an example, the use of each play video M whose shooting time is so different that it cannot be assumed that the performer P corresponding to each game video G has been shot is restricted. A moving image whose shooting time is significantly different from the playing time is likely to be a moving image unrelated to the performer P. In addition, there is a high possibility that it will not function as a play video M in the first place. Alternatively, the actual time measured by each mobile phone 5b may be different. In this case, there is a high possibility that each play video M is not properly synchronized with each game video G. Time conditions that require shooting time limit the use of inappropriate videos such as these.

Similarly, for example, the time condition that requires the acquisition time is satisfied when the acquisition time is later than the play start time (start time of each game video G) by a predetermined time or more. For example, in the case of real-time streaming distribution, the delay in acquisition means a deviation between each game video G and each play video M. That is, in this case, as an example, the use of each play moving image M in which a deviation of a predetermined time or more occurs from each game moving image G is restricted. Time conditions that require acquisition time limit the use of video that can cause such deviations.

The location condition includes, for example, a shooting location as a requirement. That is, in the location condition, as an example, the shooting location is used as a criterion of inadequacy. For example, the location condition is satisfied when the shooting location does not belong to a predetermined range of locations. Specifically, the location condition is satisfied, for example, when the shooting location is different from the location of each store 4. Further, the location condition may be satisfied, for example, when the shooting location of each play video M does not correspond to the location of the store 4 where the game machine GM that provides the corresponding game video G is installed. That is, in this case, the use of each play video M whose shooting location is deviated from the store 4 where each game machine GM is installed is restricted. For example, after the stream ID is acquired, a moving image taken at another place may be provided from each mobile phone 5b. Such a video is inappropriate as a play video. As an example, location conditions that require a shooting location limit the use of such improper video.

The credit terms include, for example, a user ID as user identification information as a requirement. That is, in the credit terms, as an example, the user ID is used as a criterion of improperness. The user ID is information for identifying each user. For example, the credit condition is satisfied when the specific user ID data does not include the user ID of the user who shot each play moving image M. Alternatively, conversely, the credit condition may be satisfied when the specific user ID data includes the user ID of the user who shot each play moving image M. The specific user ID data is data prepared in advance. More specifically, as the specific user ID data, for example, data in which the user ID of a highly credible user or conversely the user ID of a user with low credibility is described is used. That is, in this case, the use of each play moving image M provided by a user with low credibility is restricted based on the user ID of the specific user ID data. In general, a user with high credibility (highly likely to provide an appropriate play video M) or a user with low credibility (less likely to provide an appropriate play video M) is likely to be fixed. The credit conditions that require the user ID of the specific user ID data limit the use of videos by such unreliable users. Alternatively, a dedicated user ID may be prepared for shooting each play moving image M. That is, when shooting the play moving image M to be synthesized, a dedicated user ID (that is, a common user ID) may be used by each user. In this case, this dedicated user ID may be described in the specific user ID data. Then, the synthesis of the play moving image M corresponding to the user ID other than the dedicated user ID may be restricted.

The capacity condition includes, for example, the capacity of each play moving image M, the range or number that can be synthesized, and the processing capacity as requirements. That is, in the capacity condition, as an example, the capacity of each of these play moving images M, the capacity of the range or number that can be synthesized, or the processing capacity is used as a criterion of improperness. For example, the capacity condition is satisfied when the capacity of each play moving image M is larger than a predetermined amount. That is, in this case, the use of each play moving image M having a capacity larger than a predetermined amount is restricted. If each play video M with a capacity larger than the predetermined amount is used due to the communication capacity of the network 3 (per unit time) or the processing capacity of each personal computer 5a, it will lead to a delay in display and display appropriately. It may not be done. Capacity conditions that require the capacity of each play video M limit the use of videos that may not be displayed properly, such as these.

Further, the capacity condition is satisfied by, for example, when each play moving image M is specified as a synthesis target in order according to a predetermined rule, the range or number that can be combined, and each play moving image M after exceeding the processing capacity. That is, in this case, the use of each play moving image M after exceeding them is restricted so that each play moving image M to be synthesized is within the range or number that can be synthesized and the processing capacity. For example, unless the display area 66 of each play moving image M is reduced, the displayable range of the distribution screen 60 or the number that can be displayed on the distribution screen 60 is limited. If such a limit is exceeded, there is a high possibility that proper synthesis will not be possible. Similarly, as described above, there is a limit to the processing capacity of the network 3, the center server 2, or each game machine GM. If the processing capacity limit is exceeded as described above, there is a high possibility that the network 3 or the like will be overloaded and cannot be properly processed. The range or number that can be synthesized and the capacity condition that requires the processing capacity limit the use of the play moving image M that is unlikely to be properly synthesized or processed.

The designation condition includes, for example, a user ID as a requirement, similar to the credit condition. Alternatively, the main moving image ID and the sub moving image ID may be included as requirements. The main video ID is information for specifying each game video G, and the sub video ID is information for specifying each play video M. That is, under the specified conditions, these user IDs and the like are used as criteria for improperness. Specifically, before the distribution screen 60 is provided, a list screen of each play moving image M of the synthesis candidate may be provided. Further, each play moving image M to be synthesized may be designated by the user of each personal computer 5a through the list screen. Then, as an example, the designated condition may be satisfied by a sub-moving image ID other than the sub-moving image ID of each designated play moving image M or a user ID of a user other than the user who provided the sub-moving image ID. That is, in this case, the use other than each play moving image M specified by the user is restricted. The play moving image M preferable as a synthesis target may differ depending on each user. In this case, there is a possibility that it is not suitable for each user except for the play moving image M which is preferable as the synthesis target. The designated conditions requiring the designated user ID limit the use of each play moving image M, which is not preferable for each user, such as these. The same applies when each game video G is specified.

Next, the details of the ID management data 18, the main video data 19, the sub video data 20, and the synthetic video data 21 will be described. The ID management data 18 is data for managing various IDs such as user IDs. The ID management data 18 may be used, for example, as various IDs for managing the above-mentioned stream ID. That is, the issued stream ID or the like may be managed by the ID management data 18. Further, the ID management data 18 may be used for managing the housing ID as the housing identification information for identifying each game machine GM. Similarly, the ID management data 18 may be used for managing the store ID for identifying each store 4. In this case, each store ID may be managed in association with facility location information indicating the location of each store 4. Further, each store ID may be managed in association with each housing ID of each game machine GM arranged in each store 4. That is, the ID management data 18 may be used for managing the location of each store 4 and each game machine GM arranged in each store 4. Further, the ID management data 18 may include specific user ID data. In this case, the ID management data 18 functions as the specific user data of the present invention.

The main video data 19 is data for expressing each game video G. FIG. 9 is a diagram showing an example of the contents of the main moving image data 19. As shown in FIG. 9, the main moving image data 19 includes a management information unit and a moving image data unit. The video data unit is video data for expressing each game video G. That is, the moving image data for expressing each game moving image G is managed in association with the management information unit by the main moving image data 19.

The management information unit is a portion in which management information for managing each game video G is described. The management information unit includes, for example, information on a main moving image ID, a stream ID, a housing ID, a user ID, a start time, a frame, and an acquisition time.

The main video ID is information for identifying each game video G as described above. Therefore, as the main video ID, a unique ID is used for each game video G. For example, the main video ID is used to distinguish between each play video M and each game video G. Therefore, as an example of the main moving image ID, a combination of the distinction information and the stream ID for distinguishing each play moving image M and each game moving image G may be used. In this case, only such distinction information may be described in the management information unit, or the description of the stream ID described later may be omitted. Alternatively, when each game video G is specified by the housing ID and the start time, such information may function as the main video ID. That is, the housing ID may be used as at least a part of the stream ID. In this case, the main moving image ID may be omitted.

The stream ID is as described above. Similarly, as described above, the housing ID is also information for identifying each game machine GM. As the housing ID, for example, an IP address, a unique device ID, or the like may be used. The user ID is also as described above. Further, as the user ID information, for example, the user ID information of the performer P is described. The start time is information indicating a play start time, that is, a start time of each game video G. The frame is information for specifying each frame moving image when each game moving image G is divided into a plurality of frame moving images. As the frame information, the information of the number assigned to each frame moving image may be used in chronological order. Alternatively, as the frame information, the time information corresponding to each frame moving image in each game moving image G may be used. The acquisition time is information indicating the time when the moving image data for expressing each game moving image G (including each frame moving image) is acquired. As an example, the management information unit is configured as a set of records in which these information are described so as to be managed by each other.

Further, the sub moving image data 20 is data for expressing each play moving image M. FIG. 10 is a diagram showing an example of the contents of the sub moving image data 20. As shown in FIG. 10, the sub moving image data 20 includes a management information unit and a moving image data unit, similarly to the main moving image data 19. The moving image data unit is moving image data for expressing each play moving image M. That is, similarly to the main moving image data 19, the moving image data of each play moving image M is managed in association with the management information unit by the sub moving image data 20.

The management information unit is a portion in which management information for managing each play moving image M is described. The management information unit includes, for example, information on a sub video ID, a stream ID, a user ID, a shooting location, a start time, a frame, and an acquisition time.

The sub moving image ID is information for specifying each play moving image M as described above. Therefore, as the sub video ID, a unique ID is used for each play video M. For example, the sub video ID is used to distinguish between each play video M and each game video G, similar to the main video ID described above. Therefore, as an example of the sub-video ID, a combination of the distinction information and the stream ID for distinguishing each play video M and each game video G may be used. In this case, only such distinction information may be described in the management information unit, or the description of the stream ID described later may be omitted. Alternatively, when each play moving image M is specified by the shooting place and the start time, such information may function as a sub moving image ID. That is, in this case, the sub moving image ID may be omitted. If there is information that identifies each mobile phone 5b, that information may be used as a sub video ID.

The stream ID and user ID are as described above. Further, as the user ID information, for example, the user ID information of the photographer is described. Further, the information of the start time (functioning as the shooting time), the frame, and the acquisition time is the same as that of the main moving image data 19, although the target (targeting each play moving image M) is different. The shooting location is information indicating the shooting location of each play moving image M. As the information on the shooting location, for example, the position information acquired by the GPS function of each mobile phone 5b may be used. As an example, the management information unit is configured as a set of records in which these information are described so as to be managed by each other.

The synthetic moving image data 21 is data for expressing each synthetic moving image CM. FIG. 11 is a diagram showing an example of the contents of the synthetic moving image data 21. As shown in FIG. 11, the synthetic moving image data 21 includes a management information unit and a moving image data unit, similarly to the main moving image data 19 or the sub moving image data 20. The moving image data unit is moving image data for expressing each synthetic moving image CM. That is, the moving image data of each synthetic moving image CM is managed by the synthetic moving image data 21 in association with the management information unit, similarly to the main moving image data 19 and the like.

The management information unit is a part in which management information for managing each synthetic moving image CM is described. The management information unit includes, for example, synthetic moving image ID, stream ID, user ID (for performer P and photographer), start time, and frame information.

The synthetic moving image ID is information for identifying each synthetic moving image CM. Therefore, as the synthetic moving image ID, for example, a unique ID is used for each synthetic moving image CM. As the synthetic moving image ID, for example, a combination of the above-mentioned main moving image ID and the like may be used. The stream ID, housing ID, user ID, start time, and frame information are the same as those of the main video data 19 and the like, although the targets (targets for each synthetic video CM) are different.

Next, the main video data generation process, the sub video data generation process, and the synthetic video data generation process will be described. The main moving image data generation process is a process for generating the main moving image data 19. Similarly, the sub-moving image data generation process is a process for generating the sub-moving image data 20. Further, the synthetic moving image generation process is a process for generating synthetic moving image data.

For example, the main moving image data generation process is realized by the routine of FIG. 12, the sub moving image data generation process is realized by the routine of FIG. 13, and the composite image generation process is realized by the control unit 10 of the center server 2 through the routine of FIG. More specifically, the routines of FIGS. 12 to 14 are executed through the Web service management unit 17 of the control unit 10. In addition to these processes, the control unit 30 of the game machine GM and the control unit 10 of the center server 2 execute various well-known processes independently or in cooperation with each other. The same applies to the control unit 40 of the user terminal 5. However, their detailed description will be omitted.

FIG. 12 is a diagram showing an example of a flowchart of a main moving image data generation processing routine for realizing the main moving image data generation processing. As an example, the routine of FIG. 12 is executed every time a game is played on each game machine GM, that is, every time a game opportunity is provided. Further, the information on the provision of the game opportunity may be transmitted, for example, each time the game opportunity is provided from each game machine GM.

When the routine of FIG. 12 is started, the Web service management unit 17 first acquires each game video G in step S11. More specifically, the Web service management unit 17 acquires data for expressing each game video G, that is, video data corresponding to the video data unit of each game video G. Further, this acquisition, that is, the process of step S11 may be executed for each frame moving image of each game moving image G as an example. The same applies to the subsequent steps (processes) of the routine of FIG.

In the following step S12, the Web service management unit 17 acquires management information. More specifically, the Web service management unit 17 acquires each information included in the management information unit such as the stream ID, the housing ID, and the user ID (performer P) as management information from each game machine GM or the like. .. In the routine of FIG. 12, for convenience of explanation, the process of step S11 and the process of step S12 are described as separate processes, but these may be executed as one process. That is, the acquisition of each game video G and the management information corresponding thereto may be executed at once as the same process.

In the next step S13, the Web service management unit 17 generates the main moving image data 19 based on the acquisition results of the steps S11 and S12. Specifically, the Web service management unit 17 describes the main video data 19 in which each game video G (video data unit) acquired in step S11 and the management information (management information unit) acquired in step S12 are associated with each other. (Or each record constituting the main moving image data 19) is generated. Then, when the Web service management unit 17 finishes the process of step S13, the Web service management unit 17 ends the current routine. As a result, the main video data 19 for managing each game video G in association with the management information is generated.

Similarly, FIG. 13 is a diagram showing an example of a flowchart of a sub-moving image data generation processing routine for realizing the sub-moving image data generation processing. As an example, the routine of FIG. 13 is executed every time shooting is started via the distribution service application. The start of shooting via the distribution service application may be provided, for example, from the mobile phone 5b at each start of shooting.

When the routine of FIG. 13 is started, the Web service management unit 17 first acquires each play moving image M in step S21 in the same manner as in step S11 of the routine of FIG. More specifically, the Web service management unit 17 acquires data for expressing each play video M, that is, video data corresponding to the video data unit of each play video M. Further, this acquisition, that is, the process of step S21 may be executed for each frame moving image of each play moving image M as an example, as in step S11 of the routine of FIG. The same applies to the subsequent steps (processes) of the routine of FIG.

In the following step S22, the Web service management unit 17 acquires management information. More specifically, the Web service management unit 17 uses each mobile phone as management information, such as stream ID, user ID (photographer), shooting location, start time, acquisition time, and other information included in the management information unit. Obtained from 5b and the like. As in the routine steps S11 and S12 of FIG. 12, the process of step S21 and the process of step S22 may be executed as one process.

In the next step S23, the Web service management unit 17 generates the sub moving image data 20 based on the acquisition results of the steps S21 and S22. Specifically, the Web service management unit 17 describes the sub-video data 20 in which the play video M (video data unit) acquired in step S21 and the management information (management information unit) acquired in step S22 are associated with each other. (Or each record constituting the sub moving image data 20) is generated. Then, when the Web service management unit 17 finishes the process of step S23, the Web service management unit 17 ends the current routine. As a result, sub-video data 20 for managing each play video M in association with the management information is generated.

Further, FIG. 14 is a diagram showing an example of a flowchart of a synthetic moving image generation processing routine for realizing the synthetic moving image generation processing. As an example, the routine of FIG. 14 is executed every time each personal computer 5a requests the provision of a video distribution service. Further, as an example, the request may include the designation of each game video G (for example, the information of the stream ID corresponding to the designated game video G). In addition to this, the request may include various information that specifies the moving image to be distributed, such as the designation of each play moving image M, the designation of each stream ID, or the designation of the user ID.

When the routine of FIG. 14 is started, the Web service management unit 17 first determines in step S31 each game video G targeted for the operation distribution service. For example, in step S31, the Web service management unit 17 determines each game video G targeted for the motion distribution service based on the designation of each game video G included in the request for providing the video distribution service. Specifically, for example, the Web service management unit 17 determines each target game video G based on the stream ID (an example of information that specifies each game video G) included in the request for providing the video distribution service. .. Further, this determination, that is, the process of step S31 may be executed for each frame moving image of each game moving image G as an example. Similarly, in the subsequent steps (processes) of the routine of FIG. 14, it may be executed for each frame moving image of each play moving image M or each synthetic moving image CM.

In the following step S32, the Web service management unit 17 determines each play video M corresponding to each game video G specified in step S31. This determination is performed, for example, based on the stream ID. Specifically, as an example, the Web service management unit 17 has each play video M having a common stream ID with the stream ID of each game video G determined in step S31 in step S32 (specific play of the example of FIG. 7). (Corresponding to the moving image group MM1) is determined.

In the next step S33, the Web service management unit 17 limits each play moving image M determined in step S32 based on the limiting condition. Specifically, the Web service management unit 17 restricts the use of each play moving image M satisfying the restriction conditions so that it is not used as a synthesis target. That is, the Web service management unit 17 narrows down each play video M determined in step S32 so that each play video M satisfying the restriction condition is not included (that is, the play video group MM2 to be synthesized in the example of FIG. 7). To identify).

In the following step S34, the Web service management unit 17 generates the synthetic moving image data 21 based on the determination result in step S31 and the restriction result in step S33. As an example, this generation is executed as follows. That is, first, the Web service management unit 17 synthesizes each game video G determined in step S31 and each play video M narrowed down (specified) in step S33. Specifically, the Web service management unit 17 generates data for expressing a synthetic moving image CM obtained by synthesizing these, that is, moving image data corresponding to the moving image data unit of each synthetic moving image CM. This generation is executed using, for example, the moving image data unit of the main moving image data 19 and the sub moving image data 20. Subsequently, the Web service management unit 17 acquires management information corresponding to this video data unit, that is, information corresponding to the management information unit from the main video data 19 or the sub video data 20. Then, the Web service management unit 17 constitutes the synthetic video data 21 (or the synthetic video data 21) described so as to associate the generated synthetic video CM (video data unit) and the acquired management information (management information unit) with each other. Record) is generated. As an example, the Web service management unit 17 generates the synthetic moving image data 21 in this way in step S34.

In the next step S35, the Web service management unit 17 distributes each synthetic moving image CM based on the synthetic moving image data 21 generated in step S34 so as to be displayed in the moving image area 61 of the distribution screen 60. Then, when the Web service management unit 17 finishes the process of step S35, the Web service management unit 17 ends the current routine. As a result, a synthetic moving image CM is generated based on each game moving image G and each playing moving image corresponding thereto. Further, the synthetic moving image data 21 in which the moving image data of the synthesized moving image CM and the management information are associated with each other is generated. Further, based on the synthetic video data 21, the synthetic video CM is distributed to the personal computer 5a according to the request of the video distribution service. That is, a video distribution service targeting each synthetic video CM is provided.

As described above, according to this embodiment, each game moving image G and each play moving image M are associated with each other via a stream ID. Each play video M is a video in which the performer P being played is shot. That is, each game video G and the video of the performer P playing the game video G are associated with each other via the stream ID. Then, each game video G and each play video M to be synthesized are determined based on the stream ID, and the distribution screen 60 including the composite video CM synthesized so that both of them are displayed is distributed. That is, different types of moving images such as the game moving image G and the playing moving image M can be displayed on the distribution screen 60 via the synthetic moving image CM.

Further, each play video M is synthesized as a wipe video in the composite video CM. As a result, both the game video G and each play video M can be provided only in the display area of the game video G (video area 61). As a result, the range to be seen by the user can be aggregated in the display area for the game moving image G. Thereby, the game video G and each play video M can be provided in an easy-to-see manner.

In this form of music game, the dance movement (or operation) of the performer P during play is important. Therefore, there is a high demand for such a performer P's dance movement. It is particularly effective if it is provided together with the change of the game screen 50 during play, that is, the content of the game moving image G. In the video distribution service, such highly important information can be provided to each user in an easy-to-see manner through each synthetic video CM. This makes it possible to promote the use of music games. Further, due to the above-mentioned requirements, it is more convenient to play the game video G and each play video M in each synthetic video CM synchronously. Each synthetic video CM is synthesized so that the game video G and each play video M are synchronized. Therefore, the convenience of each synthetic moving image CM can be improved.

Further, the restriction condition restricts the use of each play moving image M, which is not preferable as a synthesis target. This makes it possible to generate more appropriate or preferable synthetic moving image commercials. These can improve the fun of the game.

In the above embodiment, the control unit 10 of the center server 2 functions as the moving image acquisition means of the present invention by executing the routine of FIG. 13 through the Web service management unit 17. Further, the control unit 10 of the center server 2 also functions as a moving image determination means, a moving image providing means, and a synthetic moving image generation means of the present invention by executing the routine of FIG. 14 through the Web service management unit 17. On the other hand, the storage unit 11 of the center server 2 functions as a moving image storage means by storing the main moving image data 19.

The present invention is not limited to the above-mentioned form, and can be carried out in an appropriate form. For example, in the above-described embodiment, the synthetic moving image data 21 is generated according to the request of the moving image distribution service through the routine of FIG. However, the present invention is not limited to such a form. For example, the synthetic moving image data 21 may be generated in advance. In this case, the video distribution service may provide each user with a list of each synthetic video CM (for example, a part of each synthetic video CM is displayed like a thumbnail). Then, the synthetic moving image CM selected from the list may be delivered to each user. Therefore, for example, the routine of FIG. 14 may be divided into a part for generating a synthetic moving image CM and a part for delivering a synthetic moving image CM.

In the above-described form, the moving image of the performer P playing the game is adopted as each play moving image M, and the game moving image G is adopted as the synthesis target. However, the present invention is not limited to such a form. As the moving image to be synthesized, various moving images (hereinafter, may be referred to as a main moving image for convenience of distinguishing from the moving image taken by the mobile phone 5b) may be adopted. For example, as the main moving image, various moving images such as a music moving image (including an image used in karaoke or the like) or a movie (including a TV program) may be adopted. As an example, these may be stored in the center server 2 in advance. Similarly, as each play moving image M, for example, a video of a user during karaoke, a video of a user watching a movie, or the like may be adopted. In this case, as the stream ID, for example, a music ID for identifying each music, an ID for identifying each movie, or the like may be used.

Further, the moving image taken by the mobile phone 5b (hereinafter, may be referred to as a sub moving image for convenience) is not limited to the play moving image M. As the sub moving image, various moving images taken by the mobile phone 5b may be adopted. Furthermore, the form is not limited to the form in which the main video and the sub video are combined. For example, sub-videos may be combined based on the stream ID. That is, the sub moving image (shooting moving image) may function as the main moving image. In this way, various moving images can be combined as a sub moving image and a main moving image. Therefore, depending on the type of moving image, the sub moving image and the main moving image may not be combined so as to be synchronized. That is, the present invention is not limited to the form in which the sub moving image and the main moving image are displayed so as to be synchronized.

Further, in the above-described form, each synthetic moving image CM is generated by the center server 2 through the routine of FIG. In this case, the processing load of each personal computer 5a can be reduced. However, the present invention is not limited to such a form. For example, each synthetic moving image CM may be generated in each personal computer 5a. In this case, the processing load of the center server 2 can be reduced. Further, in this case, the game moving image G and each play moving image M to be synthesized may be provided to each personal computer 5a by the center server 2 so that each synthetic moving image CM is generated in each personal computer 5a.

In the above-described form, each play video M is combined with each game video G as a wipe video. However, the present invention is not limited to such a form. Each play video M may be combined with each game video G in various ways. FIG. 15 is a diagram schematically showing an example of another distribution screen 60. As shown in FIG. 15, for example, each game moving image G and each play moving image M may be synthesized so as to share the moving image area 61. That is, each play moving image M may be displayed in another area of the moving image area 61 instead of a part of the display area of the game moving image G. Further, each play moving image M may be arranged not as a synthetic moving image CM but as a moving image in a region different from the synthetic moving image CM or the game moving image G (for example, a chat area 62 or the like). That is, each game video G and each play video M may be separately displayed on the distribution screen 60 as a single video without being synthesized. Similarly, the number of play moving images M displayed on the distribution screen 60 (or combined with the synthetic moving image CM) may be arbitrary.

In the above-mentioned form, the use of a part of the play moving image M is restricted at the time of generating each synthetic moving image CM based on the limiting condition. However, the present invention is not limited to such a form. For example, the limitation based on the limitation condition as described above may be executed at the time of acquisition of each play moving image M. That is, the acquisition of a part of the play moving image M may be restricted based on the restriction condition. Alternatively, the restriction based on such a restriction condition may be omitted. That is, all the play moving images M whose stream ID matches each game moving image G may be unconditionally synthesized as a synthesis target.

In the above-described embodiment, as an example, a stream ID is provided to each mobile phone 5b via the two-dimensional code image 81. However, the present invention is not limited to such a form. For example, the stream ID may be provided from each game machine GM to each mobile phone 5b by various communications such as infrared communication. Alternatively, each game machine GM may simply display the stream ID information. Then, the stream ID may be input to each mobile phone 5b by each user who refers to the stream ID. Further, the stream ID may be provided by the center server 2. For example, the stream ID may be provided through a web service. More specifically, for example, the stream ID may be provided through the stream ID notification screen as one of the game information services. Further, such a notification screen may be displayed on each personal computer 5a, for example. Then, for example, the stream ID may be input to each mobile phone 5b by each user in the same manner as when it is displayed on each game machine GM. Alternatively, for example, each mobile phone 5b may be provided with a candidate for a game machine GM in the vicinity thereof or each game video G corresponding to the game machine GM from the center server 2 based on the position information. Then, the stream ID may be provided from the center server 2 through selection from the candidates.

Alternatively, when the candidates for each game video G are provided, the center server 2 may specify the stream ID by the selection. In this case, the stream ID information itself may not be provided to each mobile phone 5b. Therefore, each mobile phone 5b is not limited to the form of providing the stream ID as information for identifying the main moving image. From each mobile phone 5b, various specific information that can identify the main moving image may be provided. For example, each mobile phone 5b may also provide the center server 2 with location information indicating its own location as specific information based on the GPS function. In this case, the store 4 and the game machine GM can be specified based on the location information and the facility location information. As a result, each game video G corresponding to the specified game machine GM can also be specified. As described above, various information such as information for designating the main moving image or location information may be adopted as the specific information.

Further, the stream ID is not limited to the form assigned to each game machine GM by the center server 2. For example, when information unique to each game machine GM such as a housing ID is used as the stream ID, the stream ID may not be particularly assigned to each game machine GM by the center server 2. In such a case, the stream ID may be provided to each mobile phone 5b through a Web service as described above, or may be provided by a medium other than the center server 2 such as a promotional material such as a poster or a POP. May be good. In these cases, for example, the stream ID may be stored in advance in each game machine GM.

In each of the above-mentioned forms, the game provided by each game machine GM is not limited to the music game. Each game machine GM may provide various games such as an action game, a role playing game, a simulation game, and a shooting game.

Further, the shooting terminal is not limited to the mobile phone 5b. As long as it has a shooting function and can be connected to a network, for example, a personal computer 5a or a simple camera may be used as a shooting terminal. The same applies to the display terminal. Various devices may be used as display terminals as long as they can be connected to a network and can display moving images. Further, one user terminal 5 may function as both a display terminal and a shooting terminal.

In the above-mentioned form, each game machine GM provides a game in exchange for consumption of a predetermined consideration. However, each game machine GM is not limited to such a form. For example, each game machine GM may provide, for example, a game opportunity for playing each game free of charge. That is, each game opportunity may be offered, for example, independently of the consumption of consideration. For example, each game opportunity may be offered when certain starting conditions unrelated to the consumption of consideration are met. Further, for example, a predetermined start condition may be satisfied when a predetermined start operation is executed or when start information is provided. Further, for example, the predetermined start information may include a user ID. Therefore, for example, each game opportunity may be provided regardless of the consumption of consideration each time the user ID of the user who plays the game is provided via a card for the user who records the user ID or the like.

Further, the game machine GM is not limited to a commercial game machine. As game machine GM, for example, a home-use stationary game machine (including a stationary personal computer capable of executing a game), a portable game machine (a smartphone, a tablet PC capable of executing a game, a portable personal computer). (Including mobile terminals such as), etc., an appropriate form may be adopted. Further, in the above-described embodiment, the control unit 30 and the storage unit 31 are provided in the game machine GM. However, the game machine of the present invention is not limited to such a form. For example, the control unit 30 and the storage unit 31 may be logically provided on the network by using cloud computing. That is, the game machine GM may be configured as a terminal that displays and provides the processing result of the control unit 30 through the network 3. Further, the game system of the present invention may be realized by a single game machine without the center server 2.

Hereinafter, an example of the present invention obtained from the above contents will be described. In the following description, reference numerals of the accompanying drawings are added in parentheses to facilitate understanding of the present invention, but the present invention is not limited to the illustrated form.

In the server device of the present invention, a display terminal (5a) for displaying a predetermined screen (60) and a shooting terminal (5b) for shooting a terminal moving image (M) are connected via a network (3). The server device (2), the moving image storage means (11) for storing a plurality of moving images (G) different from each other in association with the moving image identification information (for example, stream ID) for identifying each moving image, and the above-mentioned. A video acquisition means (10) for acquiring a terminal video and specific information (for example, a stream ID) for specifying the video identification information to be associated with the terminal video from the shooting terminal, and acquisition of the video acquisition means. Based on the result, the video discriminating means (10) for discriminating the video corresponding to the video identification information specified by the specific information among the plurality of videos as the target video (G1), and the discriminating result of the video discriminating means. Based on the above, the display terminal is provided with a moving image providing means (10) for providing the terminal moving image and the target moving image.

According to the present invention, the terminal moving image is associated with the moving image identification information via the specific information. Further, the target moving image corresponding to the terminal moving image is determined based on the moving image identification information, and the composite screen including both of them is displayed on the display terminal as a predetermined screen. Then, as a terminal moving image, various moving images can be taken through the shooting terminal. That is, the terminal video is not limited to a specific type or the like. As a result, different types of terminal moving images and target moving images can be displayed on the composite screen as a predetermined screen displayed by the display terminal. The determination of the moving image discrimination means includes, for example, a case where a terminal moving image corresponding to the moving image identification information of a specific target moving image is determined when a plurality of terminal moving images exist.

The terminal moving image and the target moving image may be displayed on the composite screen in various modes. For example, in one aspect of the server device of the present invention, both the terminal video and the target video may be displayed on the composite screen through a composite video (CM) in which the terminal video and the target video are synthesized. .. Further, in this embodiment, in the terminal moving image and the target moving image, the terminal moving image display area (66) is provided in the target moving image display area (61), and the terminal moving image and the target moving image are displayed in the target moving image display area. Both of the target moving images may be displayed. In this case, both the terminal video and the target video can be provided only in the display area for the target video. As a result, the range that the user should see can be aggregated in the display area for the target moving image. This makes it possible to provide the terminal video and the target video in an easy-to-see manner.

In the embodiment in which the synthetic moving image of the present invention is generated, the synthetic moving image generation means (10) for generating the synthetic moving image is further provided based on the discrimination result of the moving image discrimination means, and the moving image providing means is provided through the synthetic moving image. The synthesized moving image may be provided as the terminal moving image and the target moving image so that both the terminal moving image and the target moving image are displayed on the synthetic screen. In this case, the generated synthetic moving image is provided to the display terminal. Therefore, the display terminal does not have to generate a synthetic moving image. As a result, the processing load of the display terminal can be reduced.

In the server device of the present invention, a display terminal (5a) for displaying a predetermined screen (60) and a shooting terminal (5b) for shooting a terminal moving image (M) are connected via a network (3). The server device (2), the moving image storage means (11) for storing a plurality of moving images (G) different from each other in association with the moving image identification information (for example, stream ID) for identifying each moving image, and the above-mentioned. A video acquisition means (10) for acquiring a terminal video and specific information (for example, a stream ID) for specifying the video identification information to be associated with the terminal video from the shooting terminal, and acquisition of the video acquisition means. Based on the result, the video discriminating means (10) for discriminating the video corresponding to the video identification information specified by the specific information among the plurality of videos as the target video (G1), and the discriminating result of the video discriminating means. A video providing means (10) for providing the terminal video and the target video so that the composite screen (60) in which both the terminal video and the target video are displayed is displayed as the predetermined screen. And has.

The number of terminal videos may be arbitrary. For example, in one aspect of the server device of the present invention, the acquisition means acquires a plurality of terminal videos, and the synthetic video generation means does not use each terminal video satisfying the restriction conditions based on the restriction conditions. In addition, the use of the plurality of terminal moving images for at least a part of the synthesized moving images may be restricted. Alternatively, the moving image acquisition means may restrict the acquisition of at least a part of the plurality of terminal moving images so that the terminal moving images satisfying the limiting conditions are not acquired based on the limiting conditions.

Various conditions may be adopted as the limiting conditions. For example, in an embodiment in which the acquisition or use of a part of the terminal moving image of the present invention is restricted, the moving image acquisition means further obtains information on at least one of the shooting time and the acquisition time of each terminal moving image from the shooting terminal. When the shooting time or the acquisition time is used as a reference as the limiting condition for the acquisition, and the limiting condition does not belong to the shooting time or the acquisition time of each terminal moving image. May be satisfied. Further, the moving image acquisition means further acquires information on the shooting location of each terminal video from the shooting terminal, and as the limiting condition, a condition based on the shooting location is adopted, and the limiting condition is each terminal. It may be satisfied when the shooting location of the moving image does not belong to a predetermined range. Alternatively, the moving image acquisition means further acquires user identification information (for example, a user ID) for identifying each user of the shooting terminal from the shooting terminal in association with each terminal video, and as the limiting condition, A condition based on the user identification information is adopted, and the restriction condition includes the user identification information related to each terminal video in the specific user data (18) in which the user identification information of some users is described. It may be satisfied if it is not or is included.

Any number of terminal videos may be displayed on the composite screen. For example, in an embodiment in which a plurality of terminal videos of the present invention are shot, the video providing means has the plurality of terminal videos and the target so that the plurality of terminal videos and the target video are displayed on the composite screen. You may provide a video.

Further, in one aspect of the server device of the present invention, the target moving image and the terminal moving image are divided into a plurality of frame moving images (G, M) at predetermined periods according to the passage of time, and the terminal is displayed on the composite screen. Each frame moving image of the target moving image and the terminal moving image at the same time may be displayed so that the time passage of the moving image and the target moving image are synchronized with each other. The target video and the terminal video may include a type of video whose convenience is improved by synchronization. In this case, the convenience of the composite screen can be improved in the use of such a type of target moving image and terminal moving image.

Various moving images may be stored as a plurality of moving images in the moving image storage means. For example, in one aspect of the server device of the present invention, at least one game machine (GM) that provides a plurality of game opportunities played through the game screen (50) is further connected via the network, and the moving image storage means. In the above-mentioned plurality of game videos, the plurality of game videos (G) showing changes in the game screen that change with the passage of time at each of the plurality of game opportunities are stored as the plurality of videos. It may be provided by a game machine.

In one aspect of the server device of the present invention, as the terminal moving image, a play moving image (M) taken by each user who is playing at the game opportunity may be used. In this case, the game screen and the corresponding user state are provided through the composite screen. That is, both the game screen and the user's state are provided through the composite screen. Depending on the type of game, information on the playing behavior (for example, operation, movement, etc.) of the user during play may be important. For example, in a music game, there is a high demand for information on specific operations (or actions) corresponding to problems in the game screen. That is, in this type of game, information on both the game screen and the user's state is of high importance. Therefore, by providing such information, it is possible to provide each user with highly important information. This makes it possible to promote the use of the game. It is also possible to improve the fun of the game.

Various types of information may be used as specific information. For example, in one aspect of the server device of the present invention, as the at least one game machine, a plurality of game machines arranged in a plurality of facilities (4) are connected via the network, and each of them is used as the moving image identification information. The facility location information indicating the location of each facility where the game machine is arranged and the shooting location information indicating the location where the terminal video was shot are used as the specific information, respectively, and the facility location information and the shooting location information are used. At least a part of each game moving image provided by the game machine of the facility corresponding to the shooting place may be specified as the target moving image. Alternatively, the game machine may provide the video identification information, and the video identification information provided by the game machine may be used as the specific information. Further, in this aspect, the game machine may provide the moving image identification information to the shooting terminal via the code by displaying the code (81) configured to include the moving image identification information.

Similarly, various types of information may be used as the moving image identification information. For example, in one aspect of the server device of the present invention, a plurality of game machines are connected via the network as the at least one game machine, and the plurality of game machines are identified with each other as the moving image identification information. The housing identification information may be used.

In the control method of the present invention, a display terminal (5a) for displaying a predetermined screen (60) and a shooting terminal (5b) for shooting a terminal moving image (M) are connected via a network (3). Server device (2), the server including a moving image storage means (11) for storing a plurality of different moving images (G) in association with moving image identification information (for example, stream ID) for identifying each moving image. A moving image acquisition procedure for acquiring specific information (for example, a stream ID) for specifying the terminal moving image and the moving image identification information to be associated with the terminal moving image on a computer (10) incorporated in the device from the shooting terminal. A video discrimination procedure for discriminating a video corresponding to the video identification information specified by the specific information among the plurality of videos as a target video (G1) based on the acquisition result of the video acquisition procedure, and the video. A video that provides the terminal video and the target video so that the composite screen (60) in which both the terminal video and the target video are displayed is displayed as the predetermined screen based on the discrimination result of the discrimination procedure. It is to execute the provision procedure.

Further, in the computer program for the server device of the present invention, a display terminal (5a) for displaying a predetermined screen (60) and a shooting terminal (5b) for shooting a terminal moving image (M) are connected to a network (3). ), Which is a server device (2), and is a moving image storage means for storing a plurality of different moving images (G) in association with moving image identification information (for example, a stream ID) for identifying each moving image. The computer (10) incorporated in the server device provided with (11) is provided with specific information (for example, a stream ID) for specifying the terminal video and the video identification information to be associated with the terminal video. Based on the acquisition results of the video acquisition means acquired from the video acquisition means and the video acquisition means, the video discrimination corresponding to the video identification information specified by the specific information among the plurality of videos is discriminated as the target video (G1). The terminal video and the target so that the composite screen (60) in which both the terminal video and the target video are displayed is displayed as the predetermined screen based on the discrimination result of the means and the video discriminating means. It is configured to function as a video providing means for providing a moving image. The server device of the present invention can be realized by executing the control method or the computer program of the present invention.

The moving image distribution system of the present invention includes a display terminal (5a) for displaying a predetermined screen (60), a shooting terminal (5b) for shooting a terminal moving image (M), and a server device (2). A moving image distribution system (1) in which the display terminal, the shooting terminal, and the server device are connected via a network (3), and a plurality of different moving images (G) are identified for each moving image. The video storage means (11) that stores the video identification information in association with the video identification information (for example, the stream ID) for the purpose, and the specific information (for example, the terminal video) for specifying the terminal video and the video identification information to be associated with the terminal video. It corresponds to the moving image identification information specified by the specific information among the plurality of moving images based on the moving image acquisition means (10) for acquiring the stream ID) from the shooting terminal and the acquisition result of the moving image acquisition means. The predetermined screen (60) in which both the terminal video and the target video are displayed based on the discrimination result of the video discriminating means (10) for discriminating the video as the target video (G1) and the video discriminating means. The terminal moving image and the moving image providing means (10) for providing the target moving image are provided so as to be displayed as the screen of.

In the moving image distribution system of the present invention, a display terminal (5a) for displaying a predetermined screen (60), a shooting terminal (5b) for shooting a terminal moving image (M), and a server device (2) are connected to a network. A video distribution system (1) connected via (3), in which a plurality of different videos (G) are stored in association with video identification information (for example, a stream ID) for identifying each video. A moving image acquisition means (10) for acquiring a moving image storage means (11) and specific information (for example, a stream ID) for specifying the terminal moving image and the moving image identification information to be associated with the terminal moving image from the shooting terminal. ) And the moving image discrimination means (10) that discriminates the moving image corresponding to the moving image identification information specified by the specific information among the plurality of moving images as the target moving image (G1) based on the acquisition result of the moving image acquisition means. And, based on the discrimination result of the moving image discrimination means, the synthetic moving image generation means (10) for generating the synthetic moving image (CM) in which the terminal moving image and the target moving image are synthesized, and the generation result of the synthetic moving image generating means. Based on this, the moving image providing means (10) for providing the synthesized moving image is provided so that the synthesized moving image is displayed on the predetermined screen.

1 Game system (video distribution system)
2 Center server (server device)
3 Network (communication line)
4 stores (facility)
10 Control unit (computer, video acquisition means, video discrimination means, video providing means, synthetic video generation means)
11 Storage unit (video storage means)
18 ID management data (specific user data)
50 Game screen 60 Distribution screen (composite screen)
81 Two-dimensional code image (code)
5a Personal computer (display terminal)
5b Mobile phone (shooting terminal)
G game video (video)
G1 A game video (target video)
M play video (terminal video)
GM game console CM composite video

Claims (1)

A server device in which a display terminal that displays a predetermined screen and a plurality of shooting terminals that shoot terminal moving images by shooting are connected via a network.
A video storage means that stores multiple videos that are different from each other in association with the video identification information for identifying each video.
A video acquisition means for acquiring specific information for specifying the terminal video and the video identification information to be associated with the terminal video from the shooting terminal.
A video discriminating means for discriminating a video having the specific information in common among the plurality of videos acquired from the plurality of shooting terminals based on the acquisition result of the video acquisition means.
A video providing means for providing a plurality of the terminal videos having at least the same specific information to the display terminal based on the discrimination result of the moving image discriminating means.
Equipped with
The moving image acquisition means is a server device that restricts acquisition of at least a part of the plurality of terminal moving images so that each terminal moving image satisfying the limiting conditions is not acquired based on the limiting conditions.

Images