JP2020179045A - Display control device, display control method, and display control program - Google Patents

Abstract

To enable viewers to easily grasp a highlight scene for each of a plurality of teams during a match.SOLUTION: A display control device includes: an extraction unit for extracting a highlight scene on the basis of a result of analyzing video of a match by a plurality of teams; a determination unit for determining which team of the plurality of teams the highlight scene is for; and a display control unit for displaying the highlight scene in a display region corresponding to the team determined by the determination unit of display regions that are allocated to the respective teams and are not overlapped with each other.SELECTED DRAWING: Figure 2

Description

The present invention relates to a display control device, a display control method, and a display control program.

Video is used for watching various competitive sports, for example, in general competitive sports including e-sports. For example, the highlight scenes in the competitive sports are presented as highlight scenes on the screen installed at the spectator venue or the display of the spectator who is watching the game remotely.

Here, as an example of the technique for presenting the highlight scene, there is a technique for extracting the highlight scene from the recorded video content. In this technique, a display control device that detects a highlight scene in a content based on an evaluation value calculated based on feature data extracted from the image or audio data of the content has been proposed.

Japanese Unexamined Patent Publication No. 2007-123981

However, with the above technique, as will be described next, it may be difficult for the spectator to grasp the highlight scenes of each of the plurality of teams in the battle.

That is, in the above display control device, since the video for a predetermined time up to the highlight scene is only displayed on the display screen as a replay image, the highlight scene displayed on the display screen is any team. It's hard to tell if it's a highlight. For example, even if a spectator of a competitive sport is supporting one of multiple teams, is it the highlight scene of the team supported by the spectator, or is the team playing against the team supported by the spectator? It is difficult to grasp whether it is the highlight scene of. In this way, even if the highlight scene is presented to the spectator, it is difficult to convey the fun of the competitive sport to the spectator because the good and bad of the battle situation of the team supported by the spectator is not transmitted.

In one aspect, it is an object of the present invention to provide a display control device, a display control method, and a display control program that enable a spectator to easily grasp the highlight scenes of each of a plurality of teams in a match.

In one aspect, the display control device includes an extraction unit that extracts highlight scenes based on the analysis results of images of battles by a plurality of teams, and highlights the highlight scenes for any of the plurality of teams. The determination unit for determining whether the scene is a scene and the display area allocated to each of the plurality of teams and not overlapping each other, the display area corresponding to the team determined by the determination unit is the display area. It has a display control unit that displays a highlight scene.

You can easily grasp the highlight scenes of each of the multiple teams in the match.

FIG. 1 is a block diagram showing an example of a functional configuration of the display control device according to the first embodiment. FIG. 2 is a diagram showing an example of screen layout. FIG. 3 is a diagram showing an example of a tag assigned to a highlight scene. FIG. 4 is a diagram showing an example of highlight scene information. FIG. 5A is a diagram showing an example of a method for determining a display size of a clip. FIG. 5B is a diagram showing an example of a clip format. FIG. 6 is a diagram showing an example of a method of shifting the arranged clip. FIG. 7 is a diagram showing an example of a method of narrowing down clips related to a match that has been completed. FIG. 8 is a diagram showing an example of a highlight scene distribution method. FIG. 9 is a flowchart showing a procedure of clip placement processing according to the first embodiment. FIG. 10 is a flowchart showing the procedure of the clip update process according to the first embodiment. FIG. 11 is a flowchart showing a procedure of clip distribution processing according to the first embodiment. FIG. 12 is a diagram showing another example of the screen layout. FIG. 13 is a diagram showing another example of the screen layout. FIG. 14A is a diagram showing an application example of highlight classification. FIG. 14B is a diagram showing an application example of highlight classification. FIG. 14C is a diagram showing an application example of highlight classification. FIG. 15 is a diagram showing another example of the screen layout. FIG. 16 is a diagram showing an example of camera arrangement in motion tracking. FIG. 17 is a diagram showing an example of a computer hardware configuration.

The display control device, display control method, and display control program according to the present application will be described below with reference to the accompanying drawings. It should be noted that this embodiment does not limit the disclosed technology. Then, each embodiment can be appropriately combined as long as the processing contents do not contradict each other.

[System configuration]
FIG. 1 is a block diagram showing an example of a functional configuration of the display control device 10 according to the first embodiment. The display control device 10 shown in FIG. 1 has a display control function related to a match image of a competitive sport, for example, a display control function for a highlight scene.

The display control device 10 is an example of a computer that provides the above display control function.

As one embodiment, the display control device 10 can be implemented as package software or online software by installing a display control program that realizes the above display control function on an arbitrary computer. For example, the display control device 10 can be implemented as a server that provides the above display control function on-premises. In this case, the display control device 10 does not necessarily have to be provided outside the match venue of the competitive sport, and is incorporated in a part of an information system, for example, a video system 20 or the like installed at the site of the match venue of the competitive sport. It doesn't matter. Not limited to this, the display control device 10 may be implemented as a SaaS (Software as a Service) type application to provide the above display control function as a cloud service.

Here, in this embodiment, e-sports (electronic sports) is taken as an example of competitive sports, and watching sports is performed through video contents such as a game video displayed on the screen of the e-sports venue and its highlight scene. Take the use case that takes place as an example.

As shown in FIG. 1, the video system 20 and the user terminal 50 can be connected to the display control device 10. The display control device 10, the video system 20, and the user terminal 50 are communicably connected via an arbitrary network NW. The network NW may be any kind of communication network such as the Internet or LAN (Local Area Network) regardless of whether it is wired or wireless. Note that, for convenience of explanation, FIG. 1 shows an example in which one user terminal 50 is connected to one display control device 10, but a plurality of user terminals 50 are connected to one display control device 10. Does not interfere.

The video system 20 is a system for displaying an e-sports game video or the like. For example, the video system 20 may include a game device 21, a switcher 23, and a display device 25, as shown in FIG.

The game device 21 is a computer on which computer game software is executed. Further, the game device 21 is a device operated by the player. The "game device" mentioned here is a label given from the aspect that computer game software is executed, and the hardware configuration and the type of software to be installed are not limited, and any type of computer can be used. It doesn't matter. Further, the "computer game" may be any title or genre. On top of that, first-person shooters, third-person shooters, real-time strategies, multiplayer online battle arenas, fighting games, sports games, racing games, puzzle games, and more. The game screen from the player's viewpoint of the game device 21 is input to the switcher 23 via the capture board or the like installed in the game device 21.

The switcher 23 is a device for switching an image displayed on a predetermined screen by the display device 25. For example, the switcher 23 is selected from a player-viewing game screen output by the game device 21 or a bird's-eye view game screen in which fields and maps on the game are viewed from above via a control panel (not shown). The moving image is output to the display device 25. A game video displayed on the screen in chronological order by such a selection operation may be described as a "match video".

The display device 25 is a device that displays an image on a predetermined screen.

As an example, a liquid crystal display, an organic EL (electroluminescence) display, or the like that realizes display by light emission can be adopted as the display device 25. As another example, a projector that realizes display by projection can be adopted as the display device 25. When the projector is adopted in this way, a dedicated screen can be used, or a flat surface such as a wall or floor can be used as the screen.

For example, the display device 25 displays a live game image input from the switcher 23 on a predetermined screen. In addition, the display device 25 can also display the highlight scene of the e-sports game image on a predetermined screen.

The user terminal 50 is an example of a computer used by an esports spectator. The "user terminal" referred to here is a label given from the aspect of a computer user, and the hardware configuration and the type of software to be installed are not limited, and any type of computer may be used. .. For example, the user terminal 50 is supported by all mobile terminal devices such as smartphones, mobile phones, PHS (Personal Handyphone System), and tablet terminals. These are merely examples, and the user terminal 10 may be a desktop computer such as a personal computer, or any computer such as a laptop computer or a wearable terminal.

[One aspect of the task]
The technology listed in the background technology column above has the problem that it is difficult to grasp the highlight scenes of each of the multiple teams in the battle.

That is, in the display control device mentioned in the above background technology column, the video for a predetermined time up to the highlight scene is only displayed on the display screen as a replay image. Therefore, it is difficult to know which team the highlight scene displayed on the display screen is the highlight.

Taking e-sports as an example, there is an aspect that core players and core fans participate in many e-sports competitions. Core players and core fans have a high level of knowledge about esports games. On the other hand, non-players and light fans do not have the same level of knowledge as core players and core fans. However, with the increasing popularity of consumer games, non-players and light fans can be potential esports spectators. For such non-players and light fans, the gap in knowledge level with core players and core fans is one of the factors that raise the hurdle for watching games.

For example, non-players and light fans do not always have knowledge about avatars and the like used by players of each team. Therefore, even if the highlight scene explained in the background technology section above is displayed, it is the highlight scene of the team supported by the spectator, or the team playing against the team supported by the spectator. It is difficult to grasp whether it is the highlight scene of. In this way, it is difficult to convey the fun of watching sports to the spectators in a situation where it is not clear whether the highlights of the teams supported by the spectators are displayed or the highlights of the teams in the competition are displayed. For this reason, it is not possible to enjoy watching sports together with core players and core fans, which is one of the factors that raise the hurdle for watching sports.

[One aspect of the problem-solving approach]
Therefore, the display control device 10 according to the present embodiment highlights the display area of the team related to the highlight scene extracted from the match video of the e-sports in the display area corresponding to each of the opponent teams of the e-sports. Realize display control to display the scene.

FIG. 2 is a diagram showing an example of screen layout. FIG. 2 shows the layout of the screen when an e-sports match is played by a total of two teams, A team and B team, each of which has four players. As shown in FIG. 2, the video system 20 installed at the e-sports venue includes the game devices 21 _{PA1 to} 21 _PA4 used by the four players _{PA1 to PA4} of Team A and the four players of Team B. The game devices 21 _{PB1 to} 21 _PB4 used by _{PB1 to PB4} are included. Further, in the video system 20, team screens 251A and team screens 251B are arranged on the left and right sides of the main screen 250 as an example of a display area in which images are displayed by the display device 25. Hereinafter, when the labels of the team screen 251A and the team screen 251B are not distinguished, it may be described as "team screen 251".

The main screen 250, the team screen 251A, and the team screen 251B can be implemented by allocating three displays, or by allocating a display area in which one display is divided into three. In addition, a display area such as the main screen 250, the team screen 251A, or the team screen 251B can be formed by combining the plurality of displays. In addition, when the display is performed by projection, a part of the e-sports venue, for example, a wall surface can be assigned as the main screen 250, the team screen 251A or the team screen 251B.

A live game image of e-sports is displayed on the main screen 250. For example, the match video displayed on the main screen 250 is switched by the switcher 23. In the example shown in FIG. 2, the game screens of the player _{PA1 to PA4} viewpoints and the player _{PB1 to PB4} viewpoints input from the game devices 21 _{PA1 to} 21 _PA4 and the game devices 21 _{PB1 to} 21 _PB4 are input to the switcher 23. In this case, in the switcher 23, one viewpoint is selected from the player PA1 to PA4 viewpoint, the player PB1 to PB4 viewpoint, and the bird's-eye view of the field in the game from above via a control panel (not shown). To. Such a selection operation is performed by a staff member called a switcher, or a commentator or a commentator, as an example.

Further, the team screen 251 corresponds to an example of a display area allocated to each of a plurality of teams and which does not overlap with each other. For example, the team screen 251A displays the highlight scene of team A in the e-sports game video. In the example shown in FIG. 2, small areas CA1 to CA7 on which the moving image of the highlight scene of the team A is displayed are arranged on the team screen 251A. Further, on the team screen 251B, the highlight scene of the B team in the game video of the e-sports is displayed. In the example shown in FIG. 2, small areas CB1 to CB2 on which the moving image of the highlight scene of the B team is displayed are arranged on the team screen 251B. Hereinafter, the moving image of the highlight scene clipped on the team screen 251A or the team screen 251B may be referred to as a “clip”.

As described above, in the display control device 10 according to the present embodiment, display control is realized in which the highlight scenes of each team are arranged and displayed on the screen assigned to each team. With such display control, it is possible to identify whether the highlights of the team supported by the spectator are displayed or the highlights of the team in the match are displayed. For example, in the example shown in FIG. 2, when a spectator supports team A, the highlights of team A can be observed by looking at clips CA1 to CA7 displayed on the team screen 251A assigned to team A. Can be done.

Therefore, according to the display control device 10 according to the present embodiment, it is possible for the spectator to easily grasp the highlight scenes of each of the plurality of teams in the battle.

Further, in the display control device 10 according to the present embodiment, a plurality of clips are arranged side by side in time series on the team screen 251. For example, in the team screen 251A and the team screen 250B, the earlier the clip is extracted, the farther the clip is displayed from the main screen 250. On the other hand, in the team screen 251A and the team screen 250B, the clips are displayed side by side closer to the main screen 250 as the timing at which the clips are extracted approaches the current time, for example, the time when the latest frame of the live game video is being played. Further, on the team screen 251A and the team screen 250B, in addition to the match during the match, the clips extracted in the match played before the match are also arranged in chronological order.

For example, assume that the match between Team A and Team B shown in FIG. 2 is the final. In this case, the team screen 251A is played as the final clips CA1 to CA4 and the match before the final in order from the side closest to the main screen 250, that is, from the right end of the team screen 251A when viewed from the front of the main screen 250. The semi-final clips CA5 to CA7 are displayed. Further, among the clips of the final match, the latest clip CA1, the second new clip CA2, the third new clip CA3, and the fourth new clip CA3 are displayed in order from the right. Further, in the semi-final clip, the latest clip CA5, the second newest clip CA6, and the third newest clip CA7 are displayed in order from the right.

Further, the team screen 251B was played as the final clips CB1 to CB2 and the match before the final in order from the side closest to the main screen 250, that is, from the left end of the team screen 251B when viewed from the front of the main screen 250. Clips CC1 to CB5 of the 3rd place playoff are displayed. Furthermore, among the clips in the final, the latest clip CB1 and the second newest clip CB2 are displayed in order from the left. Furthermore, in the clip of the 3rd place playoff, the latest clip CC1, the 2nd new clip CC2, the 3rd new clip CC3, the 4th new clip CC4, and the 5th new clip CC5 are displayed in order from the left. To.

Here, when the clip in the match before the match in the match is displayed, as shown in the team screen 251B, not only the clip of the B team but also the highlight scene of the C team who is active in the past, for example, the third place playoff. The moving image can be displayed as clips CA5 to CA7.

In this way, since a plurality of clips for each team are arranged side by side on the team screen 251 in chronological order, it is possible to easily grasp the battle situation of the game in e-sports in chronological order. Further, since the clips of the previous game are arranged side by side in chronological order on the team screen 251, the log of the game through the e-sports tournament can be displayed. As a result, since the spectator can look back on the past games, it is easy to grasp the flow of the whole game, and it is easy to grasp the time series of the tournament even if the timing of watching the game is delayed.

In addition, the above display control allows the spectator to intuitively grasp the superiority or inferiority of the game situation in e-sports. That is, since scenes that affect the game situation in e-sports are extracted from the highlight scene, the number of clips displayed on each team screen is related to the superiority or inferiority of the game situation. Therefore, by comparing the number of clips displayed on each team screen relatively, it is possible to grasp the superiority or inferiority of the game situation in e-sports. For example, in the example shown in FIG. 2, in the final, the team screen 251A displays four clips CA1 to CA4, while the team screen 251B displays only two clips CB1 to CB2. .. From this, the spectator can intuitively understand that Team A, which has a large number of videos of the highlight scene clipped on Team Screen 251A, is advancing the match more than Team B. it can.

[Configuration of display control device 10]
Next, an example of the functional configuration of the display control device 10 according to this embodiment will be described. As shown in FIG. 1, the display control device 10 includes a communication interface 11, a storage unit 13, and a control unit 15. Note that FIG. 1 shows a solid line showing the relationship between data transfer, but for convenience of explanation, only the minimum part is shown. That is, the input / output of data relating to each processing unit is not limited to the illustrated example, and the input / output of data other than those shown in the drawing, for example, between the processing unit and the processing unit, between the processing unit and the data, and between the processing unit and the outside. Data may be input and output between the devices.

The communication interface 11 is an interface that controls communication with another device, for example, a video system 20 or a user terminal 50.

As an example, a network interface card such as a LAN card can be adopted as the communication interface 11. For example, the communication interface 11 accepts various images from the video system 20, such as a live game video and a game video from each player's viewpoint, and outputs a display instruction of a clip arranged on each team screen 251 to the video system 20. To do. Further, the communication interface 11 receives a request from the user terminal 50 to download a video of the highlight scene, and transmits a clip corresponding to the download request to the user terminal 50.

The storage unit 13 is a functional unit that stores data used in various programs such as the above-mentioned display control program, including an OS (Operating System) executed by the control unit 15.

As an example, the storage unit 13 corresponds to the auxiliary storage device in the display control device 10. For example, HDD (Hard Disk Drive), optical disk, SSD (Solid State Drive), etc. correspond to the auxiliary storage device. In addition, flash memory such as EPROM (Erasable Programmable Read Only Memory) also supports auxiliary storage devices.

The storage unit 13 stores the moving image information 13a and the highlight scene information 13b as an example of the data used in the program executed by the control unit 15. In addition to these data, data that is referenced or generated by the display control program, for example, setting information such as the time length of the moving image per highlight may be stored in the storage unit 13. The moving image information 13a and the highlight scene information 13b will be described together with the description of the control unit 15 in which each data is referenced or generated.

The control unit 15 is a functional unit that performs overall control of the display control device 10.

As one embodiment, the control unit 15 can be implemented by a hardware processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). Here, a CPU and an MPU are illustrated as an example of a processor, but it can be implemented by any processor regardless of a general-purpose type or a specialized type. In addition, the control unit 15 may be realized by hard-wired logic such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

By executing the above display control program, the control unit 15 virtually places the processing unit shown in FIG. 1 on the work area of a RAM such as a DRAM (Dynamic Random Access Memory) mounted as a main storage device (not shown). Realize. Here, an example is given in which packaged software in which a series of functions such as a highlight scene extraction function, a display control function, and a distribution function are packaged is executed, but this is a program running on the display control device 10. Not limited to. For example, any of the above packaged software functions such as highlight scene extraction function, display control function, or distribution function may be extracted and executed as a program module, or referred to as a library. ..

For example, as shown in FIG. 1, the control unit 15 includes a collection unit 15A, an extraction unit 15B, a determination unit 15C, a display control unit 15D, a determination unit 15E, and a distribution unit 15F.

The collection unit 15A is a processing unit that collects various types of data.

As one aspect, the collecting unit 15A collects the game video and the game video from each player's viewpoint from the switcher 23 in real time in synchronization with the progress of the game in the computer game. For example, the collecting unit 15A receives the stream data of the moving image transmitted from the switcher 23 from the start of the game to the end of the game in the computer game for each video such as the game video and the game video from each player's viewpoint. The game video and the game video from each player's viewpoint collected in real time in this way are stored in the storage unit 13 as video information 13a.

Here, as an example, each video is collected in real time, but each video does not necessarily have to be collected in real time, and the video for a predetermined period may be collected by batch processing. .. Further, here, an example in which the moving image information 13a stored in the storage unit 13 is read out by the extraction unit 15B is given, but the game video stored in the buffer area set in the memory is referred to by the extraction unit 15B. It doesn't matter.

The extraction unit 15B is a processing unit that extracts highlight scenes based on the analysis result of the game video collected by the collection unit 15A.

As an example, the extraction unit 15B uses a prediction model learned to predict the volume of the audience from the game video of the battle game, and uses a prediction model to predict the highlight scene based on the degree of excitement obtained for each scene of the game video. Is extracted.

More specifically, when the latest frame of the game video is added to the moving image information 13a stored in the storage unit 13, the extraction unit 15B makes a difference between the latest frame and the previous frame, for example, SAD. It is determined whether or not (Sum of Absolute Difference) is equal to or greater than a predetermined threshold value. At this time, if the difference between the frames is equal to or greater than the threshold value, it can be determined that there is a high possibility that a scene change has occurred in which the viewpoint is switched between the bird's-eye view and the player's viewpoint, or between each player's viewpoint. In this case, the extraction unit 15B extracts the game video of the section from the start of the game game or the previous scene change detection to the present time as the latest scene.

Further, after the latest scenes have been extracted, or in parallel with the extraction of the latest scenes, the extraction unit 15B displays the game video as a still image (hereinafter, 1 second) at predetermined time intervals (hereinafter, 1 second). Divide into match images). Specifically, the extraction unit 15B extracts frames of a game video having a predetermined frame rate, for example, at 1-second intervals. Next, the extraction unit 15B inputs the divided match image into the prediction model that predicts the degree of excitement of the spectator who viewed the match image for each divided match image, so that the spectator can output the prediction model as an output. Get the excitement when watching. As an example of such a prediction model, a learning model created by machine learning such as deep learning can be used based on the teacher data in which the degree of excitement of the spectator with respect to the game image is given as the correct answer.

Then, the extraction unit 15B cuts out a section having a time length set as the number of seconds per highlight by setting information (not shown) from the latest scene. For example, when the time length per highlight is specified as 10 seconds, the extraction unit 15B is 5 seconds before and after the time when the degree of excitement peaks in the game image included in the latest scene. Cut out the section as a highlight scene candidate. Subsequently, the extraction unit 15B calculates (predicts) the degree of excitement of the highlight scene candidate. For example, the extraction unit 15B obtains statistical values of the degree of excitement of the match images included in the highlight scene candidates, such as an average value, a median value, a mode value, and a maximum value. Finally, when the statistical value of the degree of excitement of the highlight candidate is equal to or higher than a predetermined threshold value, the extraction unit 15B extracts the highlight scene candidate as a highlight scene.

By repeatedly extracting such highlight scenes, even if sensors such as microphones are installed at the venue of e-sports and the spectator's voice is not sensed, the highlight scenes that the spectators of the computer game get excited about. Can be extracted.

In addition, although the extraction of the highlight scene using the above prediction model is illustrated here as an example, a known method for extracting the highlight scene such as Patent Document 1 can be used. Needless to say.

The determination unit 15C is a processing unit that determines which of the plurality of teams the highlight scene is the highlight scene for.

As one embodiment, when a new highlight scene is extracted by the extraction unit 15B, the determination unit 15C identifies the team to which the player who takes an action in the highlight scene belongs, and the highlight scene for any team. Is determined.

For example, when the game video of the section corresponding to the highlight scene is a game video from the player's viewpoint, the determination unit 15C highlights the highlight scene extracted by the extraction unit 15B to the team to which the player from the player's viewpoint belongs. Judge that there is.

On the other hand, when the game video of the section corresponding to the highlight scene is the game video of the bird's-eye view, the determination unit 15C is included in each frame from each frame of the game video of the bird's-eye view of the section corresponding to the highlight scene. The character string is read by image processing such as character recognition. Then, the determination unit 15C determines whether or not the character string read from each frame includes a specific phrase including the player name. An example of such a specific phrase is an e-sports battle situation, such as a phrase related to a kill or score, such as "○○ has defeated". At this time, when a specific phrase is included, the determination unit 15C determines that the highlight scene extracted by the extraction unit 15B is a highlight for the team to which the player included in the specific phrase belongs. It is not always necessary to use a bird's-eye view game video to identify the player. For example, the determination unit 15C reads a character string included in each game video from the game video of each player's viewpoint in the section corresponding to the highlight scene extracted by the extraction unit 15B by image processing such as character recognition. Then, the determination unit 15C identifies the player's viewpoint from which the character string corresponding to a specific action in the computer game, such as a kill or a continuous kill, has been read. Then, the determination unit 15C determines that the highlight scene extracted by the extraction unit 15B is a highlight for the team to which the player from the player's viewpoint has read the character string corresponding to the specific action.

In this way, the determination unit 15C determines the team name and player name corresponding to the highlight scene by the image processing such as the above character recognition, and the action corresponding to the highlight scene by the image processing such as the above character recognition. And various items such as the number of consecutive times thereof are further determined.

Based on the determination results of these items, the determination unit 15C generates a tag to be added to the highlight scene. FIG. 3 is a diagram showing an example of a tag assigned to a highlight scene. As shown in FIG. 3, a section of 5 seconds before and after the time when the degree of excitement peaks in the game image included in the latest scene is cut out as a highlight scene candidate by the extraction unit 15B. When the statistical value of the degree of excitement of the match image in the highlight scene candidate is equal to or higher than a predetermined threshold value, the highlight scene candidate is extracted as a highlight scene by the extraction unit 15B. When the highlight scene is extracted in this way, the determination unit 15C generates a tag including the determination result such as the serial number, the time, the team name, the player screen, the player name, the action, the number of consecutive times, and the degree of excitement.

The "serial number" referred to here refers to a number assigned to the highlight scenes in the order in which the highlight scenes are extracted from the start of the game. Further, the “time” refers to at least one of the center time at which the degree of excitement peaks in the highlight scene, the start time of the highlight scene, and the end time of the highlight scene. The "team name" refers to the team corresponding to the highlight scene, in other words, the team corresponding to the showcase. Further, the "player name" refers to a player corresponding to a highlight scene, in other words, a player corresponding to a showcase. Further, the "player screen" refers to a game video from the player's viewpoint in the section corresponding to the highlight scene. Further, the "action" refers to an action detected in the highlight scene. Further, the "continuous number of times" refers to the number of times the action is continuous in the highlight scene. Further, the “excitement degree” refers to the excitement degree corresponding to the highlight scene, for example, the statistical value of the excitement degree of the match image included in the highlight scene.

After that, the determination unit 15C additionally registers a new record in which various information such as the above tag is associated with the moving image data of the highlight scene in the highlight scene information 13b of the storage unit 13.

FIG. 4 is a diagram showing an example of highlight scene information 13b. As shown in FIG. 4, the highlight scene information 13b corresponds to video data of the highlight scene, for example, a binary format video file, the above tags, as well as information such as a video ID, silhouette shape, number of downloads, and comments. The attached new record is additionally registered.

The "moving image ID (IDentification)" referred to here refers to an example of identification information given to the highlight scene from the aspect of identifying the highlight scene stored in the storage unit 13. The "silhouette shape" refers to the outer shape when the moving image of the highlight scene is clipped on the team screen 251. For example, clips extracted from the same game are set with a silhouette shape unique to each highlight scene from the side of identifying the individual clip corresponding to each highlight scene. The silhouette shape set on the clip in this way may be a figure having an arbitrary contour, but the accuracy of identifying the individual clip is such that the silhouette shape with low similarity between each highlight scene is set. Can be enhanced.

The "number of downloads" refers to the number of times the highlight scene has been downloaded. The "comment" refers to a comment posted on a video of a highlight scene. When a new record corresponding to the highlight scene is additionally registered in the highlight scene information 13b, the initial value or the NULL value of these "number of downloads" and "comment" is stored or left blank. After that, when the highlight scene is downloaded, the number of downloads of the highlight scene is incremented. Also, when a comment is posted in the highlight scene, the posted comment is added.

The display control unit 15D is a processing unit that performs various display controls.

As one embodiment, when the highlight scene is extracted by the extraction unit 15B, the display control unit 15D executes the following processing. That is, the display control unit 15D sets the team screen 251 corresponding to the "team name" among the tags attached to the highlight scene extracted by the extraction unit 15B as the clip display destination. Further, the display control unit 15D sets the display size of the clip based on the “degree of excitement” of the tags attached to the highlight scene extracted by the extraction unit 15B. Further, the display control unit 15D sets a shape corresponding to the “silhouette shape” among the tags attached to the highlight scene extracted by the extraction unit 15B as the display shape of the clip.

FIG. 5A is a diagram showing an example of a method for determining a display size of a clip. As shown in FIG. 5, the display control unit 15D sets a smaller display size as the display size of the clip as the tag “excitement degree” attached to the highlight scene decreases. On the other hand, the display control unit 15D sets a larger display size as the display size of the clip as the tag “excitement degree” attached to the highlight scene increases. Note that FIG. 5 shows an example in which the display size of the clip is set based on the tag “degree of excitement” given to the highlight scene, but the present invention is not limited to this. For example, the display control unit 15D may set the display size of the clip based on the number of downloads instead of the degree of excitement, or may set the display size of the clip based on both the degree of excitement and the number of downloads. It doesn't matter.

After that, the display control unit 15D gives an instruction to the display device 25 to arrange the clip in the above display size and the above display shape at the initial position on the team screen 251 where the clip is displayed, for example, the position near the main screen 250. .. The clip arranged on the team screen 251 at the display destination in this way can perform other display in addition to the display that loops the reproduction of the moving image of the highlight scene.

FIG. 5B is a diagram showing an example of a clip format. FIG. 5B shows an example in which the clip corresponding to the record shown in FIG. 4 of the highlight scene information 13b is displayed. As shown in FIG. 5B, the clip may include a display area for reproducing the moving image of the highlight scene, that is, a shaded portion of the shaded area in the figure, and also includes a display area related to an action. For example, in the example shown in FIG. 5B, the number of consecutive times "2" of the action "kill" that occurred in the highlight scene is displayed, and the player name "XXXXXX" that caused the action is displayed. The display related to such an action allows the spectator to grasp the degree to which the battle situation of the game moves in the highlight scene. In addition, the clip also includes an area in which the number of times the video of the highlight scene is downloaded "57" is displayed. By displaying the number of downloads in this way, the spectator can grasp the popularity of the highlight scene.

In parallel with the process of arranging the clips in this way, the display control unit 15D performs a process of updating the position and display contents of the clips already arranged on each team screen 251.

As one aspect, the display control unit 15D executes the following processing every time a predetermined cycle, for example, a cycle corresponding to the frame rate of the game video, or a fixed cycle elapses. That is, the display control unit 15D synchronizes the number of downloads displayed on the clips arranged on each team screen 251 with the number of downloads corresponding to the moving image ID of the clip in the highlight scene information 13b. This updates the download count display to the latest version. Further, the display control unit 15D shifts the position of each clip already arranged on each team screen 251 to the side opposite to the main screen 250. As a result, the clip whose highlight scene is extracted earlier is displayed closer to the opposite side of the main screen 250, and the clip whose highlight scene is extracted later is displayed closer to the main screen 250.

FIG. 6 is a diagram showing an example of a method of shifting the arranged clip. For convenience of explanation, FIG. 6 shows an excerpt of the display of the team screen 251B among the team screen 251A and the team screen 251B. Further, FIG. 6 shows an example in which the right side of the match title “final” and the team name “Team B” arranged at the leftmost position closest to the main screen 250 of the team screen 251B is the initial position of the clip. It is assumed that t0, t1, t2 and t3 are t0 <t1 <t2 <t3.

As shown in FIG. 6, the clip is not extracted at the stage of time t0. Subsequently, at time t1, the clip CB 11 is arranged at the initial position of the team screen 251B. After that, the process of shifting the clip CB 11 to the right side of the team screen 251B by a constant shift amount is continued until the clip CB 12 is placed at the initial position of the team screen 251B at time t2. Then, the process of shifting the clip CB 11 and the clip CB 12 to the right side of the team screen 251B by a constant shift amount is continued until the clip CB 13 is arranged at the initial position of the team screen 251B at time t3.

Note that, for convenience of explanation, FIG. 6 shows an excerpt of the display of the team screen 251B among the team screens 251A and 251B. However, in the team screen 251A as well, the initial position and shift direction of the clip are reversed left and right. There is no change.

As a further aspect, the display control unit 15D narrows down the display to the clips related to the match in which the match has ended, to the clips in which the number of downloads satisfies a predetermined condition in the subsequent matches of the match. As an example, the display control unit 15D executes the following processing every time a predetermined cycle, for example, a cycle corresponding to the frame rate of the game video, or a fixed cycle elapses in the subsequent game. That is, the display control unit 15D is arranged on the team screen 251 and the number of downloads among the clips related to the match that has been completed is the statistical value of the number of downloads of all the clips, for example, the average value, the median value, or the mode value. Remove clips that are less than. On top of that, the display control unit 15D shifts the position of the clip related to the match that has been arranged on the team screen 251 and has finished the match to the side opposite to the main screen 250. The display position of the clip that has moved to the end opposite to the main screen 250 on the team screen 251 is fixed.

FIG. 7 is a diagram showing an example of a method of narrowing down clips related to a match that has been completed. For convenience of explanation, FIG. 7 shows an excerpt of the display of the team screen 251B among the team screen 251A and the team screen 251B. Further, FIG. 7 shows an example in which the right side of the match title “1st round” and the team name “B team” arranged at the leftmost position closest to the main screen 250 of the team screen 251B is the initial position of the clip. It is assumed that t1, t2 and t3 are t1 <t2 <t3.

As shown in FIG. 7, seven clips CB21 to CB27 are arranged on the team screen 251B at the stage of time t1 when the game of team B ends. After that, the process of shifting the seven clips CB21 to CB27 to the right side of the team screen 251B by a fixed amount of shift is continued until the time t2 when the next game is started. Then, at the stage when the time t2 at which the next game starts is reached, the number of downloads of the two clips, clip CB24 and clip CB27, becomes less than the statistical value of all the clips displayed on each team screen 251 and is removed. To. As a result, the display of team B on the team screen 251B is narrowed down to five clips of clip CB21, clip CB22, clip CB23, clip CB25, and clip CB26. After that, the process of shifting the five clips of clip CB21, clip CB22, clip CB23, clip CB25 and clip CB26 to the right side of the team screen 251B by a fixed amount of shift is continued until the time t3 when the next game starts. To. Then, at the stage when the time t3 at which the next game starts is reached, the number of downloads of the three clips of clip CB21, clip CB22 and clip CB25 becomes less than the statistical value of all the clips displayed on each team screen 251. Is further removed. As a result, the display of team B on the team screen 251B is narrowed down to two clips, clip CB23 and clip CB26.

Note that, for convenience of explanation, FIG. 7 shows an excerpt of the display of the team screen 251B among the team screens 251A and 251B. However, in the team screen 251A as well, the initial position and shift direction of the clip are reversed left and right. There is no change.

Note that, in FIGS. 6 and 7, examples of shifting all clips by a fixed shift amount are given, but different shift amounts may be used depending on the clips. For example, the shift amount of the clip can be changed according to the position where the clip is arranged and the display size of the clip. For example, the closer the position where the clip is arranged to the main screen 250, the smaller the shift amount can be shifted, or the larger the display size of the clip, the smaller the shift amount can be shifted.

The determination unit 15E is a processing unit that determines which of the clips displayed on the team screen 251 is to be downloaded as the video of the highlight scene.

In one embodiment, the determination unit 15E receives a request to download a moving image of the highlight scene. Hereinafter, a request for downloading a video of a highlight scene may be described as a "DL (DownLoad) request". As an example, the DL request can be accepted via the user terminal 50 in which the application program for watching e-sports is installed. Hereinafter, the application program for watching e-sports may be referred to as "app for watching e-sports". For example, when a GUI operation for executing a DL request is performed while the e-sports watching application is activated on the user terminal 50, the e-sports watching application activates the camera mounted on the user terminal 50. After that, when a camera shooting operation is performed, the e-sports watching application makes a DL request for a highlight scene to the display control device 10 together with a clip image captured by the camera through the shooting operation.

When the DL request for the highlight scene is received in this way, the determination unit 15E extracts the silhouette shape of the clip from the clip image received together with the DL request. Then, the determination unit 15E collates the silhouette shape included in the highlight scene information 13b with the silhouette shape extracted from the clip image by image processing such as template matching. As a result, when the silhouette shape matching the silhouette shape extracted from the clip image is hit by the highlight scene information 13b, the determination unit 15E hits the matching among the highlight scenes included in the highlight scene information 13b. A highlight scene having a silhouette shape is determined as a download target by the user terminal 50.

The distribution unit 15F is a processing unit that distributes a moving image of a highlight scene.

As one embodiment, the distribution unit 15F distributes a moving image of the highlight scene determined by the determination unit 15E as a download target by the user terminal 50 to the user terminal 50. As a result, the video of the highlight scene is downloaded by the user terminal 50. This makes it possible to provide the spectator with a collection function of highlight scenes that he / she likes by looking at the team screen 251. By providing such a highlight scene collection function, it is possible to increase the incentive to visit the e-sports venue.

FIG. 8 is a diagram showing an example of a highlight scene distribution method. FIG. 8 shows an example of downloading the highlight scene reproduced by the clip CB31 of the team screen 251B. As shown in FIG. 8, when the clip CB31 displayed on the team screen 251B is photographed by the camera of the user terminal 50, the DL request of the highlight scene is sent from the user terminal 50 together with the clip image 51 captured by the camera. This is performed on the display control device 10 (step S1). When the DL request for the highlight scene is received in this way, the silhouette shape that matches the silhouette shape extracted from the clip image 51 is searched from the highlight scene information 13b. In the example shown in FIG. 8, the silhouette shape extracted from the clip image 51 hits the silhouette shape of the moving image ID “YYYYYYYY”. In this case, the highlight scene having the moving image ID "YYYYYY" is determined as the download target by the user terminal 50 (step S2). After that, the moving image of the highlight scene determined to be downloaded by the user terminal 50 is delivered to the user terminal 50 (step S3). As a result, the video of the highlight scene is downloaded by the user terminal 50. When the video of the highlight scene is downloaded in this way, the number of downloads of the video ID "YYYYYY" among the records of the highlight scene information 13b is incremented from "76DL" to "77DL".

[Clip placement process]
FIG. 9 is a flowchart showing a procedure of clip placement processing according to the first embodiment. As an example, step S101 of this process is executed before the start of the game of the computer game. As shown in FIG. 9, after the team screen 251 is assigned to each of the opponent teams of the computer game (step S101), the game of the computer game is waited for the start (step S102).

After the start of the game of the computer game, the collecting unit 15A collects the game video, the game video from each player's viewpoint, and the like from the switcher 23 (step S103). Next, the extraction unit 15B uses a prediction model learned to predict the volume of the audience from the game video of the battle game, and creates a video of the highlight scene based on the degree of excitement obtained for each scene of the game video. Extract (step S104).

Then, when a new highlight scene is extracted in step S104 (step S105Yes), the determination unit 15C identifies the team to which the player who takes an action in the highlight scene belongs, and the high extracted in step S104. It is determined which team the light scene is the highlight scene for (step S106).

Subsequently, the determination unit 15C generates a tag including various items such as the team name and player name corresponding to the highlight scene determined in step S106, the action corresponding to the highlight scene, and the number of consecutive times thereof. (Step S107).

After that, the display control unit 15D sets the team screen 251 corresponding to the “team name” among the tags attached to the highlight scene extracted in step S104 as the clip display destination (step S108).

Further, the display control unit 15D sets the display size of the clip based on the “excitement degree” of the tags attached to the highlight scene extracted in step S104 (step S109).

Further, the display control unit 15D sets a shape corresponding to the “silhouette shape” among the tags attached to the highlight scene extracted in step S104 as the display shape of the clip (step S110).

Then, the display control unit 15D sets the display size set in step S109 and the display size set in step S110 at the initial position on the team screen 251 of the clip display destination set in step S108, for example, a position closer to the main screen 250. An instruction to arrange the clip in the displayed display shape is given to the display device 25 (step S111).

After that, the processes from step S103 to step S111 are repeatedly executed until the game of the computer game is completed (step S112No). Then, when the game of the computer game is completed (step S112Yes), the process is completed.

[Clip update process]
FIG. 10 is a flowchart showing the procedure of the clip update process according to the first embodiment. This process can be executed in parallel with the process shown in FIG. As shown in FIG. 10, when a predetermined cycle, for example, a cycle corresponding to the frame rate of the game video, or a fixed cycle has elapsed (step S301Yes), the following processing is executed.

That is, the display control unit 15D synchronizes the number of downloads displayed on the clips arranged on each team screen 251 with the number of downloads corresponding to the moving image ID of the clip in the highlight scene information 13b (step S302). This updates the download count display to the latest version.

Further, the display control unit 15D shifts the position of each clip already arranged on each team screen 251 to the side opposite to the main screen 250 (step S303). As a result, the clip whose highlight scene is extracted earlier is displayed closer to the opposite side of the main screen 250, and the clip whose highlight scene is extracted later is displayed closer to the main screen 250.

After that, the processes from step S301 to step S303 are repeatedly executed until the game of the computer game is completed (step S304No). Then, when the game of the computer game is completed (step S304Yes), the process is completed.

[Clip delivery process]
FIG. 11 is a flowchart showing a procedure of clip distribution processing according to the first embodiment. As an example, this process can be executed in parallel with the processes shown in FIGS. 9 and 10. As shown in FIG. 11, when the DL request for the highlight scene is received (step S501Yes), the determination unit 15E extracts the silhouette shape of the clip from the clip image received together with the DL request (step S502).

Then, the determination unit 15E searches the highlight scene information 13b for a silhouette shape that matches the silhouette shape extracted from the clip image by image processing such as template matching (step S503).

As a result, when the silhouette shape matching the silhouette shape extracted from the clip image is hit by the highlight scene information 13b (step S504Yes), the determination unit 15E executes the following processing. That is, the determination unit 15E determines, among the highlight scenes included in the highlight scene information 13b, the highlight scene having the silhouette shape that hits the collation as the download target by the user terminal 50 (step S505).

Then, the distribution unit 15F distributes the moving image of the highlight scene determined by the determination unit 15E as the download target by the user terminal 50 to the user terminal 50 (step S506). As a result, the video of the highlight scene is downloaded by the user terminal 50. After that, the number of downloaded highlight scenes downloaded from the record of the highlight scene information 13b is incremented (step S507), and the process ends.

On the other hand, when the silhouette shape matching the silhouette shape extracted from the clip image does not hit in the highlight scene information 13b (step S504No), the determination unit 15E executes the following processing. That is, the determination unit 15E responds to the user terminal 50 that the download of the video of the highlight scene has failed (step S508), and ends the process.

[One aspect of the effect]
As described above, the display control device 10 according to the present embodiment corresponds to the display area of the team in which the highlight scene is extracted from the match video of the e-sports, out of the display areas corresponding to each of the opponent teams of the e-sports. Realizes display control to display the highlight scene. With such display control, it is possible to identify whether the highlights of the team supported by the spectator are displayed or the highlights of the team in the match are displayed. Therefore, according to the display control device 10 according to the present embodiment, it is possible for the spectator to easily grasp the highlight scenes of each of the plurality of teams in the battle.

Although examples of the disclosed device have been described above, the present invention may be implemented in various different forms other than the above-described examples. Therefore, other examples included in the present invention will be described below.

[Application example 1 of screen layout]
In Example 1 above, the layout of the screen when there are two opponent teams is illustrated, but the scope of application of the above display control function is not limited to the case where there are two opponent teams, and there are three opponent teams. The above display control function can be applied even when there are teams or more.

FIG. 12 is a diagram showing another example of the screen layout. FIG. 12 shows the layout of the screen when an e-sports match is played by a total of four teams, A team, B team, C team, and D team, each of which has four players. As shown in FIG. 12, when the main screen 250 is viewed from the front, the team screen 251A, the team screen 251B, the main screen 250, the team screen 251C, and the team screen 251D are arranged in this order from the left.

Of these, team screen 251A is assigned to team A, and team screen 251B is assigned to team B. Further, the team screen 251C is assigned to the C team, and the team screen 251D is assigned to the D team.

In these team screens 251A, team screens 251B, team screens 251C, and team screens 251D, a plurality of clips are arranged side by side in chronological order. In the screen layout shown in FIG. 12, as in the case of the screen layout shown in FIG. 2, the earlier the clip is extracted, the farther the clip is displayed from the main screen 250 and the clip is extracted. Clips are displayed side by side closer to the main screen 250 as the timing approaches the current time, for example, the time when the latest frame of the live match video is being played.

[Screen layout application example 2]
In the first embodiment described above, the team screen 251A and the team screen 251B are arranged side by side on the main screen 250, but the team screen 251 does not necessarily have to be arranged side by side on the main screen 250. The shape of the team screen 251 is not necessarily limited to a specific shape such as a rectangle.

FIG. 13 is a diagram showing another example of the screen layout. FIG. 13 also shows the layout of the screen when an e-sports match is played by a total of four teams, A team, B team, C team, and D team, each of which has four players. As shown in FIG. 13, team screens 251A, team screens 251B, team screens 251C, and team screens 251D can be arranged in a radial pattern around the main screen 250 in a shape other than a rectangle. For example, when the main screen 250 is viewed from the front, the team screen 251A, the team screen 251B, the team screen 251C, and the team screen 251D are arranged in the order clockwise from the 9 o'clock direction.

Also in these team screens 251A, team screens 251B, team screens 251C and team screens 251D, a plurality of clips are arranged side by side in chronological order. In the screen layout shown in FIG. 13, as in the case of the screen layout shown in FIG. 2, the earlier the clip is extracted, the farther the clip is displayed from the main screen 250 and the clip is extracted. Clips are displayed side by side closer to the main screen 250 as the timing approaches the current time, for example, the time when the latest frame of the live match video is being played.

[Application example of highlight classification]
In the above-mentioned Example 1, the highlight scenes are classified according to the game and the team and the clips are arranged, but the highlight classification is not necessarily limited to this, and the clips are arranged by other classifications. You can also.

14A-14C are diagrams showing application examples of highlight classification. For convenience of explanation, FIGS. 14A to 14C show excerpts of the display of the team screen 251B among the team screen 251A and the team screen 251B.

For example, it is possible to classify highlight scenes by past games and teams and arrange clips. That is, as shown in FIG. 14A, clips of today's game of team B and clips of yesterday's game of team B can be arranged in order from the main screen 250. You can also classify highlight scenes by action and place clips. That is, as shown in FIG. 14B, clips related to the action "dunk" and clips related to the action "crossover" can be arranged in order from the main screen 250. Furthermore, the highlight scenes can be classified by player and clips can be arranged. That is, as shown in FIG. 14C, clips related to player C and clips related to player D can be arranged in order from the main screen 250.

[Application to real sports]
In the first embodiment, the above display control function is applied to watching e-sports, but the scope of application of the above display control function is not limited to watching e-sports, and is real other than e-sports. The above display control function can also be applied to watching sports.

FIG. 15 is a diagram showing another example of the screen layout. FIG. 15 shows the layout of the screen when a basketball match between Team A and Team B is played. For example, when watching a basketball game, as shown in FIG. 15, it is possible to classify the highlight scenes according to the quarters of the 1st quarter, the 2nd quarter, the 3rd quarter, and the 4th quarter, and arrange the clips.

When determining whether or not the highlight scene of a real sport such as basketball is the highlight scene for which team, the determination unit 15C can use the motion tracking technique.

FIG. 16 is a diagram showing an example of camera arrangement in motion tracking. As shown in FIG. 16, a real space on the basketball field F is generated as a free-viewpoint image of watching a basketball game. In this case, the plurality of cameras 41A to 41N are arranged from the periphery of the field F toward the inside of the field F. At this time, by combining the shooting ranges of the plurality of cameras 20, each camera 20 is installed in an arrangement in which the entire area of the field F falls within the shooting ranges of the plurality of cameras 41A to 41N. Further, in order to analyze the three-dimensional structure of the subject existing on the field F from the pixels on the image common to the two or more cameras 41, each camera 41A to 41N is connected to the other cameras 41. It is arranged so that a part of the shooting range overlaps. Under such an arrangement, a plurality of cameras 41A to 41N simultaneously shoot for each frame, so that a plurality of images taken at the same timing for different viewpoints, that is, multi-viewpoint images can be obtained in frame units. ..

The tracking device 40 that acquires multi-viewpoint images from these cameras 41A to 41N analyzes three-dimensional information of a subject such as a player or a ball from the multi-viewpoint images captured by the plurality of cameras 41. This makes it possible to generate a free-viewpoint image of watching a basketball game. On that basis, the tracking device 40 can provide the display control device 10 with tracking information in which the movements of the ball, the player, and the referee are tracked from the above three-dimensional information. Using such tracking information, the determination unit 15C, when the highlight scene is extracted, the player who made a shot to score a goal in the highlight scene, the player who made a pass to the player who made the shot, and the like. By specifying, it is possible to determine that it is a highlight scene for the team to which these players belong. In this way, when identifying a player related to a score, score, point, etc., taking ball games as an example, a player who was in contact with the ball or the like immediately before or immediately before the score or score fluctuates. The team can be judged from. In addition, the team whose score or score fluctuates due to character recognition may be identified from a scoreboard or the like.

[Distributed and integrated]
Further, each component of each of the illustrated devices does not necessarily have to be physically configured as shown in the figure. That is, the specific form of distribution / integration of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically distributed / physically in arbitrary units according to various loads and usage conditions. It can be integrated and configured. For example, the collection unit 15A, the extraction unit 15B, the determination unit 15C, the display control unit 15D, the determination unit 15E, or the distribution unit 15F may be connected via a network as an external device of the display control device 10. Further, another device has a collection unit 15A, an extraction unit 15B, a determination unit 15C, a display control unit 15D, a determination unit 15E, or a distribution unit 15F, respectively, and is connected to a network to cooperate with the above display control device. 10 functions may be realized.

[Display control program]
Further, the various processes described in the above-described embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. Therefore, in the following, an example of a computer that executes a display control program having the same function as that of the above embodiment will be described with reference to FIG.

FIG. 17 is a diagram showing an example of a computer hardware configuration. As shown in FIG. 17, the computer 100 includes an operation unit 110a, a speaker 110b, a camera 110c, a display 120, and a communication unit 130. Further, the computer 100 has a CPU 150, a ROM 160, an HDD 170, and a RAM 180. Each part of these 110 to 180 is connected via a bus 140.

As shown in FIG. 17, the HDD 170 exhibits the same functions as the collection unit 15A, the extraction unit 15B, the determination unit 15C, the display control unit 15D, the determination unit 15E, and the distribution unit 15F shown in the first embodiment. The display control program 170a is stored. The display control program 170a may be integrated or separated like the components of the collection unit 15A, the extraction unit 15B, the determination unit 15C, the display control unit 15D, the determination unit 15E, and the distribution unit 15F shown in FIG. Absent. That is, not all the data shown in the first embodiment may be stored in the HDD 170, and the data used for processing may be stored in the HDD 170.

Under such an environment, the CPU 150 reads the display control program 170a from the HDD 170 and deploys it to the RAM 180. As a result, the display control program 170a functions as the display control process 180a as shown in FIG. The display control process 180a expands various data read from the HDD 170 in the area allocated to the display control process 180a among the storage areas of the RAM 180, and executes various processes using the expanded various data. For example, as an example of the processing executed by the display control process 180a, the processing shown in FIGS. 9 to 11 is included. In the CPU 150, not all the processing units shown in the first embodiment need to operate, and the processing units corresponding to the processes to be executed may be virtually realized.

The display control program 170a may not necessarily be stored in the HDD 170 or the ROM 160 from the beginning. For example, the display control program 170a is stored in a "portable physical medium" such as a flexible disk inserted into the computer 100, that is, a so-called FD, CD-ROM, DVD disk, magneto-optical disk, or IC card. Then, the computer 100 may acquire and execute the display control program 170a from these portable physical media. Further, the display control program 170a is stored in another computer or server device connected to the computer 100 via a public line, the Internet, LAN, WAN, or the like, and the computer 100 acquires the display control program 170a from these. It may be executed.

The following additional notes will be further disclosed with respect to the embodiments including the above embodiments.

(Appendix 1) An extraction unit that extracts highlight scenes based on the analysis results of battle images by multiple teams,
A determination unit for determining which of the plurality of teams the highlight scene is the highlight scene for.
A display control unit that displays the highlight scene in a display area assigned to each of the plurality of teams that does not overlap with each other and that corresponds to the team determined by the determination unit.
A display control device characterized by having.

(Appendix 2) A feature is that a plurality of highlight scenes of a team determined by the determination unit, including the highlight scene, are displayed in chronological order in a display area corresponding to the team determined by the determination unit. The display control device according to Appendix 1.

(Appendix 3) The determination unit is characterized in determining which of the plurality of teams the highlight scene is the highlight scene based on the character information of the player read from the video. The display control device according to Appendix 1.

(Supplementary Note 4) The determination unit determines, based on the tracking information of the video, which team among the plurality of teams the highlight scene is the highlight scene. The display control device described in.

(Appendix 5) The display control unit displays a plurality of highlight scenes of a team determined by the determination unit, including the highlight scene, in a plurality of small areas having different shapes in the display area of the team. , Display each
It accepts a request for video information from a terminal operated by the user, identifies the shape of a small area included in the request, and among the plurality of highlight scenes, one of the highlight scenes corresponding to the identified shape. And the decision-making part that decides
The display control device according to Appendix 1, further comprising a distribution unit for distributing the moving image information of the determined highlight scene to the terminal of the user.

(Appendix 6) Highlight scenes are extracted based on the analysis results of the video of the battle by multiple teams.
It is determined which of the plurality of teams the highlight scene is the highlight scene for.
Among the display areas allocated to each of the plurality of teams and which do not overlap each other, the highlight scene is displayed in the display area corresponding to the team determined by the determination process.
A display control method characterized in that a computer executes processing.

(Appendix 7) Displaying a plurality of highlight scenes of a team determined by the determination process including the highlight scene in a time series in a display area corresponding to the team determined by the determination process. The display control method according to Appendix 6, which is a feature.

(Appendix 8) The determination process determines which of the plurality of teams the highlight scene is the highlight scene for, based on the character information of the player read from the video. The display control method according to Appendix 6, which is a feature.

(Supplementary note 9) The determination process is characterized in that it determines which of the plurality of teams the highlight scene is a highlight scene based on the tracking information of the video. The display control method according to 6.

(Appendix 10) The display process includes a plurality of highlight scenes of a team determined by the determination process, including the highlight scene, in a display area of the team, and a plurality of small areas having different shapes. And display each
It accepts a request for video information from a terminal operated by the user, identifies the shape of a small area included in the request, and among the plurality of highlight scenes, one of the highlight scenes corresponding to the identified shape. And the process of determining
The display control method according to Appendix 6, wherein a computer further executes a process of delivering the moving image information of the determined highlight scene to the terminal of the user.

(Appendix 11) Highlight scenes are extracted based on the analysis results of the video of the battle by multiple teams.
It is determined which of the plurality of teams the highlight scene is the highlight scene for.
Among the display areas allocated to each of the plurality of teams and which do not overlap each other, the highlight scene is displayed in the display area corresponding to the team determined by the determination process.
A display control program characterized by having a computer execute processing.

(Appendix 12) Displaying a plurality of highlight scenes of a team determined by the determination process, including the highlight scene, in a time series in a display area corresponding to the team determined by the determination process. The display control program according to Appendix 11, which is a feature.

(Appendix 13) The determination process determines which of the plurality of teams the highlight scene is the highlight scene for, based on the character information of the player read from the video. The display control program according to Appendix 11, which is a feature.

(Supplementary note 14) The determination process is characterized in that it determines which of the plurality of teams the highlight scene is the highlight scene for, based on the tracking information of the video. 11. The display control program according to 11.

(Appendix 15) The display process includes a plurality of highlight scenes of a team determined by the determination process, including the highlight scene, in a display area of the team, and a plurality of small areas having different shapes. And display each
It accepts a request for video information from a terminal operated by the user, identifies the shape of a small area included in the request, and among the plurality of highlight scenes, one of the highlight scenes corresponding to the identified shape. And the process of determining
The display control program according to Appendix 11, wherein a computer further executes a process of delivering the moving image information of the determined highlight scene to the terminal of the user.

1 System 10 Display control device 11 Communication interface 13 Storage unit 13a Video information 13b Highlight scene information 15 Control unit 15A Collection unit 15B Extraction unit 15C Judgment unit 15D Display control unit 15E Decision unit 15F Distribution unit

Claims (7)

An extraction unit that extracts highlight scenes based on the analysis results of battle videos by multiple teams,
A determination unit for determining which of the plurality of teams the highlight scene is the highlight scene for.
A display control unit that displays the highlight scene in a display area assigned to each of the plurality of teams that does not overlap with each other and that corresponds to the team determined by the determination unit.
A display control device characterized by having. Claim 1 is characterized in that a plurality of highlight scenes of a team determined by the determination unit are displayed in chronological order, including the highlight scene, in a display area corresponding to the team determined by the determination unit. The display control device described in. The determination unit is characterized in that it determines which team among the plurality of teams the highlight scene is the highlight scene based on the character information of the player read from the video. The display control device according to 1. The first aspect of claim 1, wherein the determination unit determines which of the plurality of teams the highlight scene is the highlight scene for, based on the tracking information of the video. Display control device. The display control unit displays a plurality of highlight scenes of the team determined by the determination unit, including the highlight scene, in the display area of the team in a plurality of small areas having different shapes. ,
It accepts a request for video information from a terminal operated by the user, identifies the shape of a small area included in the request, and among the plurality of highlight scenes, one of the highlight scenes corresponding to the identified shape. And the decision-making part that decides
The display control device according to claim 1, further comprising a distribution unit for distributing the moving image information of the determined highlight scene to the terminal of the user. Highlight scenes are extracted based on the analysis results of the video of the battle by multiple teams.
It is determined which of the plurality of teams the highlight scene is the highlight scene for.
Among the display areas allocated to each of the plurality of teams and which do not overlap each other, the highlight scene is displayed in the display area corresponding to the team determined by the determination process.
A display control method characterized in that a computer executes processing. Highlight scenes are extracted based on the analysis results of the video of the battle by multiple teams.
It is determined which of the plurality of teams the highlight scene is the highlight scene for.
Among the display areas allocated to each of the plurality of teams and which do not overlap each other, the highlight scene is displayed in the display area corresponding to the team determined by the determination process.
A display control program characterized by having a computer execute processing.

Images