JP7109737B2 - System, Server and Program - Google Patents

Description

The present invention relates to systems, servers and programs.

Conventionally, events related to computer games (hereinafter referred to as "game events") have been held. In recent years, among game events, so-called e-sports (electronic sports), which are tournaments in which computer games are held as competitions, have been attracting attention (for example, Patent Document 1).

JP 2020-44152 A

At game events (e.g., e-sports competitions), it is being considered to improve the interest of the game event by live commentary of computer game play. However, since the commentary is performed using terms related to computer games (for example, technical terms specific to computer games), it is assumed that some viewers cannot understand the content of the commentary. As a result, there is a possibility that the effect of improving the interest of the game event by commentary cannot be sufficiently obtained.

The present disclosure provides a system, server, and program that contribute to improving the interest of game events.

The first aspect is
an acquisition unit for acquiring audio relating to playing a computer game;
an extraction unit that extracts terms related to the computer game from the voice using voice recognition processing;
a selection unit that selects commentary information associated with the extracted term from a storage unit that associates and stores each term related to the computer game and commentary information about each term;
a display control unit that controls display of the selected commentary information;
A system characterized by comprising

In the first aspect, the storage unit stores each term in association with the situation of the computer game in which each term is used, and the display control unit associates each term with the extracted terms. display of the selected commentary information based on the relationship between a first game situation, which is the situation of the computer game, and a second game situation, which is the situation of the computer game based on the play; be able to.

Further, in the first aspect, the display control unit controls the selected commentary information when the first game situation matches the second game situation, It is possible to distinguishably display the selected commentary information when it does not match the game situation.

Further, in the first aspect, each term is a unique term unique to the computer game, or a common term commonly used with another computer game different from the computer game, and the display control A department can control the display of the selected commentary information based on whether the extracted term is the unique term or the common term.

Further, in the first aspect, the storage unit includes first terminology information that associates the specific term with commentary information about the specific term, and second terminology information that associates the common term with commentary information about the common term. and the display control unit may control display of the selected commentary information based on whether or not the extracted term is included in the second term information. can.

Moreover, in the first aspect, the display control section can control the display of the selected commentary information based on the number of times the extracted term is extracted within a predetermined period. Moreover, in the first aspect, the display control section can restrict display of the selected commentary information when the number of extractions within the predetermined period satisfies a predetermined condition. Further, in the first aspect, the display control unit may relax restrictions on the display of the selected commentary information based on the situation of the computer game based on the play and/or time conditions. can.

Further, in the first aspect, the storage unit stores each term in association with a viewing level of each term, and the display control unit stores the viewing level associated with the extracted term based on the viewing level associated with the extracted term. , to control the display of the selected commentary information. Further, in the first aspect, the determination unit that determines the viewing level of the user viewing the play, and the display control unit control the determined viewing level and the viewing level associated with the extracted term. and the display of the selected commentary information can be restricted.

Further, in the first aspect, the computer game includes a first part in which the play progresses and a second part other than the first part, and the display control unit controls the second part. , the extraction history-based display of the extracted terms can be controlled.

In the first aspect, the display control unit displays a predetermined number of the selected commentary information based on the extraction order of the extracted terms, and displays the selected commentary information exceeding the predetermined number. Display can be restricted. The display control unit can display an area requesting reference to the selected commentary information whose display is restricted.

A second aspect includes an acquisition unit that acquires a voice related to playing a computer game, an extraction unit that extracts terms related to the computer game from the voice using voice recognition processing, and each term related to the computer game. a selection unit that selects commentary information associated with the extracted term from a storage unit that stores commentary information associated with is a server characterized by

In a third aspect, a computer acquires a voice related to playing a computer game, extracts terms related to the computer game from the voice using voice recognition processing, each term related to the computer game, and each term related to the computer game. selecting commentary information associated with the extracted term from a storage unit that stores commentary information related to the term in association with it; and controlling output of the selected commentary information. It is a program characterized by

According to the present disclosure, it is possible to provide a system, a server, and a program that contribute to improving the interest of game events.

It is a figure which shows an example of the game event which concerns on this embodiment. It is a figure showing an example of an outline of an information processing system concerning this embodiment. It is a figure which shows an example of the hardware constitutions of each apparatus which comprises the information processing system which concerns on this embodiment. It is a figure showing an example of functional composition of each device which constitutes an information processing system concerning this embodiment. It is a figure which shows an example of term DB which concerns on this embodiment. FIG. 5 is a diagram showing an example of first display control of commentary information according to the present embodiment; FIG. 10 is a diagram showing an example of second display control of commentary information according to the present embodiment; FIG. 11 is a diagram showing an example of third display control of commentary information according to the present embodiment; FIG. 11 is a diagram showing an example of fourth display control of commentary information according to the present embodiment; FIG. 11 is a diagram showing an example of fifth display control of commentary information according to the present embodiment; FIG. 12 is a diagram showing an example of sixth display control of commentary information according to the present embodiment; FIG. 21 is a diagram showing an example of seventh display control of commentary information according to the present embodiment; 4 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment; FIG.

[Description of game event]
A game event in this embodiment is an event in which one or more players play a computer game. In the following, an e-sports competition in which computer games are held as a competition is assumed as an example of a game event, but the event is not limited to this. Gaming events may or may not be competitive. Computer games played at game events may be games in which players play against each other directly, or games in which players compete for the results of individual games played, or games in which players cooperate with each other. The game may be executed by

Such gaming events may be held, for example, in physical spaces such as arenas, gaming establishments, cafes, etc., accommodating players and spectators. In addition, the game event is not provided with the physical space, or in addition to the physical space, for example, in a virtual space provided by a server on the network. It may be held by connecting from a location via a predetermined terminal.

FIG. 1 is a diagram showing an example of a game event according to this embodiment. For example, as shown in FIG. 1, the computer game played at the game event is a one-on-one competitive game. A player who participates in the tournament shown in FIG. 1 activates one or more player characters (corresponding to objects) in the virtual game space, or pits the player characters against enemy characters, which are non-player characters.

For example, at the venue 60 shown in FIG. 1, players 602 and 604 are playing a competitive game. In addition, the video relating to the battle-type game is displayed on the display device D installed in the venue 60 . A spectator 606 in the venue 60 can enjoy the game event with the image displayed on the display device D. FIG. The display device D is, for example, a monitor, screen, liquid crystal panel, projector, or the like. One or more display devices D may be provided in the venue 60 . Also, the video relating to the competitive game may be distributed to a viewing terminal (not shown). Not only the spectators 606 in the venue 60 but also the spectators 606 not in the venue 60 can enjoy the game event by the images distributed to the viewing terminals. Note that the spectators 606 who are not at the venue 60 may be called viewers or the like. Also, it goes without saying that the viewer 606 in the venue 60 may use the viewing terminal.

Also, at the venue 60, a commentator 608 provides a commentary of the game event. For example, a voice related to the commentary (hereinafter referred to as "commentary voice") is picked up by a microphone M and output to the venue 60 by a speaker S provided in the venue 60 . Such commentary voice can excite the audience 606 . On the other hand, since the commentary includes terms related to computer games (for example, technical terms specific to computer games), some viewers 606 cannot understand the contents of the commentary.

Therefore, in the information processing system according to the present embodiment, a commentary voice is acquired, terms related to a computer game are extracted from the commentary voice using voice recognition processing, and information explaining the extracted terms (hereinafter referred to as "commentary information ) is displayed on the display device D and/or the viewing terminal. This makes it easier for the spectator 606 to understand the content of the commentary voice, thereby improving the interest of the game event.

As described above, the information processing system according to the present embodiment is a system for displaying commentary information about terms extracted from live speech using speech recognition processing. In the present embodiment, the commentary sound will be described as an example of the "sound related to playing the computer game", but the "sound related to playing the computer game" is not limited to the commentary sound. It may include voice such as.

[Configuration of information processing system]
<Outline configuration>
FIG. 2 is a diagram showing an example of a schematic configuration of an information processing system according to this embodiment. As shown in FIG. 2 , the information processing system 1 includes a server 2 , a playing terminal 3 , a viewing terminal 4 and a communication network 5 . Also, the server 2 may be connected to, for example, a display device D, a microphone M, and a speaker S provided in a venue 60 illustrated in FIG.

The server 2 outputs a video (hereinafter referred to as "play video") relating to a computer game played using the playing terminal 3 at the game event. For example, the server 2 may output the play video to the display device D provided in the venue 60 . The server 2 may also output the play video to the viewing terminal 4 connected via the communication network 5 .

Note that the server 2 may function as a game server. The game server is a device that takes part of the functions of the game execution process in the playing terminal 3, such as managing various information related to the user who plays the computer game and executing part of the game process. . The server 2 may be composed of one or a plurality of information processing devices, or may be composed of a virtual server (such as a cloud server).

The play terminal 3 is a terminal used for playing computer games, and transmits and/or receives various data related to the computer game played on the play terminal 3 to and from the server 2 . The viewing terminal 4 is a terminal used for viewing a computer game played at a game event, and displays play video distributed from the server 2 via the communication network 5 .

In this embodiment, for convenience of explanation, the playing terminal 3 and the viewing terminal 4 are described separately, but the playing terminal 3 and the viewing terminal 4 are not limited to separate terminals, and may be the same terminal. . For example, when the user of the terminal views the computer game, the terminal operates as the viewing terminal 4, and when the user of the terminal plays the computer game, the terminal operates as the playing terminal 3. good.

The playing terminal 3 and the viewing terminal 4 are, for example, computers such as mobile phones (including smartphones), tablets, personal computers, arcade game devices, consumer game devices, and amusement machines. The number of playing terminals 3 and viewing terminals 4 is not limited to that shown in FIG. 1, and may be one or more. The playing terminal 3 and the viewing terminal 4 may also be referred to as a "first terminal" and a "second terminal", respectively.

The communication network 5 is, for example, the Internet, an intranet, a wireless LAN, mobile communication, or the like. A communication network 5 connects the server 2 and the playing terminal 3 to each other. Note that the schematic configuration of the information processing system 1 shown in FIG. 1 is merely an example, and is not limited to what is illustrated. For example, the server 2 may be connected to a display device D, a microphone M and a speaker S via a predetermined device or communication network 5 . Also, a terminal for the commentator 608 that picks up the commentary voice may be connected to the communication network 5 .

<Hardware configuration>
FIG. 3 is a diagram showing an example of the hardware configuration of each device that configures the information processing system according to this embodiment. As shown in FIG. 3, the server 2, the playing terminal 3 and the viewing terminal 4 each have a communication interface (IF) 11, a storage device 12, a processor 13, an input device 14 and an output device 15. FIG. Communication interface 11 , storage device 12 , processor 13 , input device 14 and output device 15 are electrically connected via bus 16 .

Note that the server 2, the playing terminal 3, and the viewing terminal 4 do not have to have all the configurations shown in FIG. 3, and some of the configurations may be omitted. For example, the server 2 is connected to a display device D, a microphone M, and a speaker S provided outside the server 2 instead of at least a part of the input device 14 and the output device 15 (for example, a display, a microphone, a speaker, etc.). may

The communication IF 11 performs wired or wireless communication. Specifically, the communication IF 11 of the server 2 or the communication IF 11 of the play terminal 3 transmits and/or receives information via the communication network 5 .

The storage device 12 is composed of at least one of, for example, a HDD (Hard Disk Drive), a RAM (Random Access Memory), a ROM (Read Only Memory), and an SSD (Solid State Drive). Specifically, the storage device 12 stores various information and programs (for example, game programs, etc.).

The processor 13 is composed of a microcomputer including a CPU and a semiconductor memory. Specifically, various controls are performed based on information and programs stored in the storage device 12 and/or information transmitted or received by the communication IF.

The input device 14 is composed of at least one of, for example, a keyboard, touch panel, mouse, microphone, game controller, camera, web camera, and the like. The input device 14 receives input operations from the user.

The output device 15 is composed of at least one of, for example, a display and a speaker. The output device 15 outputs information under the control of the processor 13 . The output device 15 may constitute the "display section" of the present invention.

<Functional configuration>
FIG. 4 is a diagram showing an example of the functional configuration of each device that configures the information processing system 1 according to this embodiment. Note that FIG. 4 shows at least part of the functions of each device, and the functions of each device are not limited to the illustrated functions.

-server-
As shown in FIG. 4 , the server 2 includes a control section 21 , a storage section 22 and a transmission/reception section 23 . The control unit 21, the storage unit 22, and the transmission/reception unit 23 are configured by the processor 13, the storage device 12, and the communication IF 11 of the server 2, respectively.

The control unit 21 controls various processes performed by the server 2 . For example, the control unit 21 has a video generation unit 211 , an audio acquisition unit 212 , an extraction unit 213 , a selection unit 214 and a display control unit 215 .

The video generation unit 211 generates a play video based on the data regarding the play of the computer game from the playing terminal 3 (hereinafter referred to as “play data”). In addition, the video generation unit 211 causes the storage unit 22 to store the generated play video. Also, the video generation unit 211 may generate a play video for replay based on the play video stored in the storage unit 22 .

The audio acquisition unit 212 acquires commentary audio regarding the play of the computer game. For example, the voice acquisition unit 212 may acquire live voice picked up via a microphone M provided in the venue 60 .

The extraction unit 213 extracts terms related to computer games (for example, technical terms specific to computer games) from the commentary voice acquired by the voice acquisition unit 212 . Specifically, the extraction unit 213 performs speech recognition processing on the commentary voice, and generates a character string corresponding to the commentary voice. The extraction unit 213 also performs natural language processing on the generated character string to extract the specific term.

Here, the speech recognition processing includes, for example, acoustic analysis and recognition processing using a speech recognition dictionary. Acoustic analysis extracts feature amounts such as frequency components of the input commentary speech, sound intensity, interval, and time change. In the recognition process, character strings corresponding to live speech are generated based on features extracted by acoustic analysis and models learned by machine learning (for example, acoustic models, pronunciation dictionaries, language models, etc.). .

Natural language processing also includes, for example, morphological analysis, syntactic analysis, semantic analysis, and contextual analysis. By performing natural language processing on a character string generated by speech recognition processing, the character string is recognized as a sentence containing meaningful words. The extraction unit 213 extracts terms related to computer games recognized by natural language processing.

The selection unit 214 selects commentary information associated with the term extracted by the extraction unit 213 from the storage unit 22 that stores each term related to the computer game and the commentary information related to each term in association with each other. Specifically, the selection unit 214 searches the term database (DB) stored in the storage unit 22 using the term extracted by the extraction unit 213 as a search key, and extracts commentary information associated with the extracted term. to select.

FIG. 5 is a diagram showing an example of a term DB stored in the storage unit 22. As shown in FIG. The term DB is a database that associates at least terms related to computer games with commentary information about each term, and is also called term information or a table. In addition, the term DB may associate the viewing level of the user who is the target of commentary on each term and the situation of the computer game in which each term is used (hereinafter referred to as "game situation") with each term. good.

In addition, the plurality of terms stored in the DB are terms commonly used in each computer game (hereinafter referred to as "common terms") and/or certain computer games (for example, "Fighting V" in FIG. ) (hereinafter referred to as “unique terms”).

As shown in FIG. 5, the terminology DB includes a terminology DB (hereinafter referred to as "common terminology DB") that associates a common term with commentary information on the common term, and a terminology DB that associates a specific term with commentary information on the specific term. terminology DB (hereinafter referred to as “unique terminology DB”). The unique terminology DB is also called first terminology information or a first table, and the common terminology DB is also called second terminology information or a second table.

The common terminology DB may associate the common terminology, commentary information about the common terminology, the viewing level of the user for whom the common terminology is to be explained, and the game situation in which the common terminology is used. Further, the proper term DB may associate the proper term, commentary information about the proper term, the viewing level of the user who is the subject of the commentary of the proper term, and the game situation in which the proper term is used.

Since the common terminology DB can be commonly used for a plurality of computer games, it may be shared by a plurality of game companies. Note that the common terminology DB may be provided for each game genre (for example, a fighting game, a sports game, etc.), and store common terms common to each game genre in association with commentary information. On the other hand, the unique term DB is used uniquely to a certain computer game, so it may be used by the game company that provides the computer game. In this way, by distinguishing between the common terminology DB and the specific terminology DB, the common terminology DB can be shared by a plurality of game companies. can be reduced.

In FIG. 5, the terminology DB is divided into a common terminology DB and a specific terminology DB. However, the terminology DB is not limited to this. good too. In the term DB, information indicating whether each term is a common term or a specific term (hereinafter referred to as “term classification information”) may be associated with each term.

Also, in FIG. 5, a unique term DB is provided for each computer game, but this is not the only option. may be In this case, information indicating a computer game in which each unique term is used (hereinafter referred to as "game information") may be associated with each unique term and description information for each unique term.

The selection unit 214 selects commentary information associated with the term extracted by the extraction unit 213 from the common term DB or the unique term DB as described above. Alternatively, the selection unit 214 may search the common term DB first, and then search the unique term DB if the extracted term is not detected from the common term DB. For example, when the extraction unit 213 extracts the term “ΔΔ” from the commentary speech, the common term DB is searched using the extracted term “ΔΔ” as a search key. Since the term "ΔΔ" is not included in the common term DB shown in FIG. 5, the selection unit 214 searches the unique term DB using the extracted term "ΔΔ" as a search key. The selection unit 214 selects the commentary information "preventing an approach with a medium punch" associated with the term "ΔΔ" in the specific term DB.

The display control unit 215 controls screen display on the display device D. FIG. Specifically, the display control unit 215 controls display of the play video generated by the video generation unit 211 . Also, the display control unit 215 controls display of commentary information selected by the selection unit 214 . For example, the display control unit 215 controls display of the commentary information using at least one of the first to seventh display controls. The first to seventh display controls will be described in detail with reference to FIGS.

<<First display control>>
FIG. 6 is a diagram showing an example of first display control of commentary information according to the present embodiment. For example, FIG. 6 shows a screen D1 displayed on the display device D when the commentary voice "here, ●● player is doing △△" is acquired. It is assumed that the commentary voice is output via the speaker S at the venue 60 .

Also, in FIG. 6, the speech acquisition unit 212 acquires the commentary speech by the commentator 608 via the microphone M, and the extraction unit 213 extracts specific words. It is assumed that "△△" is extracted. Also, it is assumed that the selection unit 214 has selected from the specific term DB the commentary information "to restrain an approach with a medium punch" associated with the specific term "ΔΔ".

For example, as shown in FIG. 6, the display control unit 215 causes the play video generated by the video generation unit 211 to be displayed in a region R11 within the screen D1. The display control unit 215 displays the commentary information "Prevent approaching with a medium punch" selected from the unique term DB using the term "△△" extracted from the commentary voice of the play video as a search key, in the screen D1. is displayed in the region R12. In FIG. 6, commentary information is displayed together with the play video generated by the video generation unit 211 on the screen D1, but the present invention is not limited to this, and only the commentary information may be displayed on the screen D1.

As shown in FIG. 6, by displaying on the screen D1 the commentary information about the term ".DELTA..DELTA..DELTA..DELTA..DELTA..DELTA..DELTA..DELTA..DELTA..DELTA." You can understand the contents of the commentary voice from the provided commentary information.

<<Second display control>>
Based on the relationship between the game situation (first game situation) associated with the term extracted from the commentary voice by the extraction unit 213 and the game situation based on the play (second game situation), the display control unit 215 may be used to control the display of the commentary information selected by the selection unit 214 . Here, the "game situation associated with the term extracted from the commentary voice" is, for example, the game situation associated with the extracted term in the common term DB or specific term DB of FIG. On the other hand, the “game situation based on the play” is the game situation when the commentary sound is acquired by the sound acquisition unit 212, for example, the game situation indicated by the play data synchronized with the timing of the commentary sound. good too.

By considering the relationship between the game situation associated with the term extracted from the commentary voice and the game situation based on the play (for example, whether or not they match) It can be distinguished whether it relates to a situation (ie the current game situation) or to a game situation different from the current game situation (ie a hypothetical game situation).

FIG. 7 is a diagram showing an example of second display control of commentary information according to the present embodiment. For example, in Figure 7, the commentary voice says, ``This is where ●● player is doing △△. As expected." is obtained, the screen D2 displayed on the display device D is shown. In addition, FIG. 7 demonstrates centering around difference with FIG.

As shown in FIG. 7, in a region R21 of the screen D2, a play image is displayed in which the game situation is "initiate middle punch". Therefore, in FIG. 7, the above commentary voice ``This is where ●● player is doing △△. As expected." is obtained, the game situation is "Medium punch activated". In FIG. 7, the extraction unit 213 extracts the terms “ΔΔ”, “□□”, and “▽▽” from the commentary voice. The selection unit 214 selects the extracted terms “ΔΔ”, “□□”, and “▽▽” from the unique term DB shown in FIG. □□” and “▽▽” are respectively associated with commentary information “checking approach with medium punch”, “xxxxxxxxxx” and “yyyyyyyyyy”.

Here, in the unique term DB shown in FIG. 5, the term “ΔΔ” is associated with the game situation “initiate medium punch”. On the other hand, the terms "□□" and "▽▽" are respectively associated with the game situation "zzz activated". As described above, the game situation "medium punch activated" associated with the term "△△" extracted from the commentary voice matches the game situation "medium punch activated" when the commentary voice was acquired. On the other hand, the game situation "zzz activated" associated with the terms "□□" and "▽▽" extracted from the commentary voice does not match the game situation "medium punch activated" when the commentary voice was acquired.

Therefore, the display control unit 215 provides commentary information in the case where the game situation associated with the term extracted from the commentary voice matches the game situation when the commentary voice was acquired, and the term extracted from the commentary voice. The commentary information when the associated game situation does not match the game situation when the commentary sound was acquired may be displayed in a distinguishable manner.

For example, in FIG. 7, the game situation “initiate a medium punch” associated with the extracted term “ΔΔ” matches the game situation “initiate a medium punch” when the commentary voice was acquired. displays the commentary information "checking approach with a medium punch" associated with the extracted term "ΔΔ" in the region R22 in the first display method (here, surrounded by a solid line). On the other hand, the game situation "zzz in action" associated with the extracted terms "□□" and "▽▽" does not match the game situation "medium punch in action" when the commentary voice was acquired. 215 displays the commentary information “xxxxxxxxxx” and “yyyyyyyyyy” associated with the extracted terms “□□” and “▽▽” in the regions R23 and R24 in the second display method (here, surrounded by dashed lines). indicate.

In FIG. 7, the types of lines (here, solid lines and dashed lines) surrounding the commentary information are different between the first display method and the second display method, but the present invention is not limited to this. For example, if it is possible to distinguish between the commentary information displayed by the first display method and the commentary information displayed by the second display method, such as using different colors in the first display method and the second display method, which Such a display method may be used.

In addition, in FIG. 7, both commentary information when the game situation associated with the term extracted from the commentary voice matches the game situation when the commentary voice is acquired and commentary information when it does not match are displayed. is displayed in a different display method, it is not necessary to display the commentary information when they do not match. For example, in FIG. 7, the explanation information of the extracted term "△△", "to restrain the approach with a medium punch" is displayed on the screen D2, and the explanations of the extracted terms "□□" and "▽▽" are displayed. The information "xxxxxxxxxx" and "yyyyyyyyyy" may not be displayed on the screen D2.

<<Third display control>>
The display control unit 215 may control display of the commentary information selected by the selection unit 214 based on whether the term extracted from the commentary speech by the extraction unit 213 is a specific term or a common term.

FIG. 8 is a diagram showing an example of third display control of commentary information according to the present embodiment. For example, FIG. 8 shows a screen D3 displayed on the display device D when the commentary voice "here, ●● player is doing XX" is acquired. 6 differs from FIGS. 6 and 8 in that the common term "OO" is extracted from the live speech in FIG. The following description focuses on the differences from FIG.

In FIG. 8 , the selection unit 214 searches the common term DB using the term “○○” extracted by the extraction unit 213 from the commentary speech as a search key, and extracts commentary information associated with the specific term “○○”. Select "Inflict fatal damage". The display control unit 215 displays the commentary information "doing fatal damage" selected from the common term DB in the area R31 in the screen D3.

As shown in FIG. 8, the display control unit 215 replaces the commentary information "deal fatal damage" for the common term "OO" with the commentary information "with a medium punch" for the unique term "△△" shown in FIG. It may be displayed in a display method different from "to check approach". For example, region R31 in FIG. 8 is colored other than white, while region R12 in FIG. 6 is white. It should be noted that the method of displaying the explanation information of the proper term and the method of displaying the explanation information of the common term are not limited to those shown in FIGS. Also, the display control unit 215 does not have to display the commentary information of either the specific term or the common term.

Further, the display control unit 215 may control display of commentary information associated with the term extracted by the extraction unit 213 based on whether the term is included in the common term DB, as described above. This is because the selection unit 214 first searches the common term DB using the term as a search key, and searches the specific term DB when the term is not detected in the common term DB. In general, it is considered that the commentator 608 uses common terms more frequently than specific terms, so searching the common term DB first can shorten the search time. Note that the search order of the term DB is not limited to this, and it is a matter of course that the unique term DB may be searched first, and then the common term DB may be searched.

<<Fourth display control>>
The display control unit 215 may control display of commentary information associated with a term based on the number of times a term is extracted by the extraction unit 213 (hereinafter referred to as “extraction count”). Specifically, the display control unit 215 may limit the display of the commentary information when the number of times a certain term is extracted in a predetermined period satisfies a predetermined condition. Further, the display control section 215 may relax restrictions on the display of the commentary information based on the game situation and/or time conditions.

FIG. 9 is a diagram showing an example of fourth display control of commentary information according to the present embodiment. For example, FIG. 9 shows screens D41 to D43 corresponding to timings T41 to T43. The following description focuses on the differences from FIG. For example, in FIG. 9, the predetermined period is the period P1 and P2 from the start to the end of a match, but is not limited to this. There may be. In addition, in FIG. 9, the predetermined condition is that the number of times n of extraction of a specific term in period P>predetermined number X (here, X>1), but is not limited to this.

As shown in FIG. 9 , at timing T41, the voice acquisition unit 212 acquires the live commentary voice “Here is ●● player doing △△”, and the extraction unit 213 extracts the term “△△”. The number of times n of extraction of the term “ΔΔ” at timing T41 is a predetermined number X, which does not satisfy n>X. Therefore, the display control unit 215 causes the screen D41 to display the commentary information "Prevent approaching with a medium punch" associated with the extracted term "ΔΔ".

At timing T42, the voice acquisition unit 212 acquires the commentary voice “★★players are doing △△”, and the extraction unit 213 extracts the term “△△”. The number of times n of extraction of the term “ΔΔ” at timing T42 is a predetermined number X+1, and satisfies n>X. Therefore, the display control unit 215 restricts the display of the commentary information associated with the extracted term "ΔΔ" on the screen D42. For example, on the screen D42, the commentary information is not displayed due to the restriction. Thus, when n>X is satisfied, even if the term "ΔΔ" is extracted, the commentary information is not displayed.

On the other hand, the display control unit 215 may relax restrictions on the display of the commentary information for the specific term “ΔΔ” based on the game situation and/or temporal conditions. Specifically, in FIG. 9, based on the game situation "game end" or "game start", or based on the end of the period P1 or the start of the period P2, the explanation information of the specific term "△△" relax the display restrictions.

For example, in FIG. 9, the number of extractions of the term "ΔΔ" is initialized to 0 when the period P2 starts. At the timing T43, the voice acquisition unit 212 acquires the commentary voice "That's the player's specialty △△, isn't it?", and the extraction unit 213 extracts the term "△△". The number of extractions n of the specific term “ΔΔ” at timing T43 is 1, and does not satisfy n>X. Therefore, the display control unit 215 causes the screen D43 to display the commentary information "Prevent approaching with a medium punch" associated with the extracted term "ΔΔ".

As shown in FIG. 9, when the number of extractions of the term “ΔΔ” in the period P1 satisfies a predetermined condition, the display of commentary information on the term “ΔΔ” is restricted so that the spectator 606 can be seen in the play video. It can make it easier to concentrate. On the other hand, when the next period P2 starts, the restriction is relaxed. Therefore, even if the spectator 606 changes before the start of the next match, the new spectator 606 is provided with explanatory information about the term "ΔΔ". can be presented.

<<Fifth display control>>
The display control unit 215 may control display of commentary information associated with a specific term based on the viewing level associated with the specific term in the term DB.

FIG. 10 is a diagram showing an example of fifth display control of commentary information according to the present embodiment. In FIG. 10, in the same way as in FIG. 7, in FIG. 7, the commentary voice ``Here, ●● player is doing △△. , ●● player's judgment of the situation is as expected." is assumed to be acquired. Note that FIG. 10 will be described with a focus on differences from FIG. 7 .

For example, in FIG. 10, when a main monitor and a sub-monitor are provided as the display device D in the hall 60 of FIG. D52 (here, a screen for beginners) is shown. For example, the viewing level "intermediate" may be set for the screen D51 for the main monitor, and the viewing level "beginner" may be set for the screen D52 for the sub monitor. In addition, the terms "△△", "□□" and "▽▽" extracted by the extraction unit 213 from the commentary voice are stored in the unique term DB shown in FIG. Associated with 'Beginner'. Note that the game image may be displayed on the screen D51 for the main monitor, and the commentary information of the extracted term may be displayed on the screen D52 for the sub monitor in a manner corresponding to the viewing level.

If the viewing level associated with the extracted term is equal to or higher than the viewing level associated with screen D51 or D52, display control section 215 displays the commentary information associated with the specific term on screen D51 or D52. It can be displayed inside. For example, since the viewing level “intermediate” associated with the extracted term “ΔΔ” is equal to the viewing level “intermediate” defined on the screen D51, the display control unit 215 determines that the viewing level associated with the term “ΔΔ” is The commentary information may be displayed in the area R51 within the screen D51. On the other hand, since the viewing level “beginner” associated with the extracted terms “□□” and “▽▽” is lower than the viewing level “intermediate” set on the screen D51, the display control unit 215 Explanation information associated with the terms “□□” and “▽▽” is not displayed on the screen D51.

In addition, since the viewing level “beginner” associated with the extracted terms “□□” and “▽▽” is equal to the viewing level “beginner” set on the screen D52, the display control unit 215 Explanation information associated with "□□" and "▽▽" is displayed in areas R53 and R54 in screen D52. In addition, since the viewing level "intermediate" associated with the extracted term "△△" is a viewing level higher than the viewing level "beginner" set on the screen D52, the display control unit 215 selects the term "△△ is displayed in the area R52 in the screen D52.

As shown in FIG. 10, screens D51 and D52 corresponding to different viewing levels are displayed on a plurality of monitors in the venue 60, and only commentary information that matches the viewing level is displayed on each of the plurality of monitors. Even when there are viewers 606 with different viewing levels in the display 60, the viewers 606 can easily concentrate on the play video.

Note that in FIG. 10, the viewing level of the viewer 606 in the hall 60 may not be determined, but this is not the only option. A viewing level at 606 may be determined. That is, the display control unit 215 constitutes a “determining unit for determining the viewing level of the user viewing the play”, and based on the determined viewing level and the viewing level associated with the extracted term, display of the commentary information may be restricted.

For example, the display control unit 215 controls the viewing level of the viewers 606 in the venue 60 based on the viewing level ratio (eg, beginner, intermediate, advanced, etc.) registered in advance by each viewer 606 entering the venue 60. A level may be determined, and display of commentary information on the display device D in the hall 60 may be restricted based on the viewing level and the viewing level associated with the extracted term. For example, if the viewing level ratio is beginner:intermediate:advanced=5:4:1, display device D displays the beginner's screen D52 of FIG. If it is :5:2, the display device D may be caused to display the screen for intermediate level D51 of FIG. Also, the display mode of the commentary information may be changed according to the viewing level ratio. For example, when there are few viewers who are beginners, the display time of the commentary information may be shortened or the commentary information may be displayed in a small size. Beginner viewers are more likely to need commentary information than advanced viewers. You may In this case, even if there are few viewers for beginners, the commentary information for beginners should be displayed without fail, and if there are few viewers for advanced viewers, the commentary information for advanced viewers should be made inconspicuous. , the visibility of commentary information for beginners can be ensured.

Further, when the screen D51 or D52 based on the viewing level is distributed to the viewing terminal 4, the display control unit 215 may determine the viewing level of the user of the viewing terminal 4. FIG. The user's viewing level can be determined, for example, based on the user's rank as a player, the user's viewing history, the user's viewing time, and the like. The display control unit 215 may determine the screen to be distributed to the viewing terminal 4 (for example, either the intermediate screen D51 or the beginner screen D52 in FIG. 10) based on the viewing level of the user. good. In this way, the display control unit 215 provides information on the screen to be distributed to the viewing terminal 4 ( hereinafter referred to as “screen information”).

<<Sixth display control>>
The display control unit 215 controls display based on the extraction history of terms from the commentary speech. Generally, a computer game includes a first part in which play progresses (hereinafter referred to as "play part") and a second part other than the play part (hereinafter referred to as "non-play part"). The display control unit 215 may control display based on the extraction history in the play part in the non-play part.

Here, the play part is the part in which the player character in the computer game is operated based on the player's operation, and is the state in which the story in the virtual game space is progressing. The play part is, for example, a battle between player characters in the case of a battle-type game, but is not limited to this.

The non-play part is a part other than the play part. It is a state in which the story in space is not progressing. For example, in the case of a competitive game, the non-play part includes, but is not limited to, the preparation period from the end of the previous match to the start of the next match during the setting of match conditions. Note that the play part and non-play part may be called first and second scenes, respectively.

FIG. 11 is a diagram showing an example of sixth display control of commentary information according to the present embodiment. For example, FIG. 11 shows screens D61 and D62 displayed on the display device D in the non-play part from the end of the previous game to the start of the next game. As shown in FIG. 11, during the non-play part, the display control unit 215 may display a replay video of the play part (for example, the previous game) on the screen D61.

Further, the display control section 215 may display a list of explanations of terms in the non-play parts on the screen D62 based on the extraction history of terms in the play parts within the most recent predetermined period. The play part in the most recent predetermined period may be, for example, during the previous game, or during the previous game on the same day. Also, the term commentary list may indicate a list of commentary information about each term shown in the extraction history. The glossary list may be displayed regardless of whether or not the replay video exemplified on the screen D61 is displayed.

As shown in the screen D62 of FIG. 11, the glossary list is extracted along with the number of extractions in descending order of the number of extractions from the commentary voice during a predetermined period (for example, during the previous game or during the same day). Descriptive information for the term may be provided. By displaying the glossary list in the non-play part, the viewer 606 can review the meaning of the terms extracted from the commentary speech.

<<Seventh display control>>
Further, the display control unit 215 may display a predetermined number of pieces of commentary information based on the time series in which specific terms are extracted. Further, the display control unit 215 may limit the display of commentary information exceeding the predetermined number.

FIG. 12 is a diagram showing an example of seventh display control of commentary information according to the present embodiment. 6 to 10, the commentary information associated with the extracted term is displayed at the timing when the term is extracted in the play part, but in FIG. 12, based on the time series of the term extracted in the play part, A predetermined number of recent commentary information may be displayed. That is, it differs from FIGS. 6 to 10 in that a real-time glossary list is displayed in the play part. 6 to 10 will be mainly described below.

In FIG. 12, it is assumed that the most recent three items of commentary information are displayed in the term commentary list shown on the screens D71 and D72, but the number of displayed commentary information is not limited to three. Further, on the screens D71 and D72, explanation information of newly extracted terms is displayed at the top, but the display method is not limited to that shown in FIG. 12 as long as it is based on the extraction order of the specific terms.

For example, in FIG. 12, it is assumed that the extraction unit 213 extracts the terms “ΔΔ”, “□□”, and “▽▽” from the commentary voice acquired at timing T71. Since the latest three items of commentary information are displayed on the screen D71, the display control unit 215 displays the commentary information of the terms “ΔΔ”, “□□”, and “▽▽” extracted at the timing T71 according to the extraction order. Display on the screen D71.

On the other hand, the display control unit 215 restricts the display of commentary information on terms extracted before timing T71, as indicated by regions R71 and R72. For example, region R71 indicates that the specific term “ΔΔ” was extracted three times before timing T71. Also, the region R72 indicates that the specific term “□□” was extracted once before the timing T71.

Also, in FIG. 12, it is assumed that the extraction unit 213 extracts a specific term “OO” from the commentary voice acquired at timing T72. Since the latest three pieces of commentary information are displayed on the screen D72, the display control unit 215 newly displays the term "OO" extracted from the commentary voice on the screen D72. Further, the display control unit 215 restricts the display of the commentary information of the term “ΔΔ” extracted most recently on the screen D71, as shown in a region R73 on the screen D72. For example, region R73 indicates that the specific term “ΔΔ” was extracted four times before timing T72.

In FIG. 12, the real-time terminology list is displayed on screens D71 and D72 separate from the play video, but the real-time terminology list may be displayed on the same screen as the play video. good.

Further, when the screens D71 and D72 showing the real-time glossary list are distributed to the viewing terminal 4, the display control unit 215 causes the areas R71, R72 and R73 showing the explanation information whose display is restricted to be displayed on the viewing terminal. 4 may be configured as an area for requesting reference to the commentary information according to the input by the user, and information regarding the screen including the area may be generated. For example, when the screen D72 of FIG. 12 is displayed on the viewing terminal 4, the display of commentary information about the term “ΔΔ” extracted four times is restricted, and the user of the viewing terminal 4 can use the term “Δ The meaning of △” cannot be recognized. Therefore, the user of the viewing terminal 4 may perform a predetermined operation (for example, tapping) on the region R73 to request reference to the commentary information regarding the term “ΔΔ”.

As described above, the display control unit 215 may control the output of commentary information selected by the selection unit 214 using at least one of the first to seventh display controls. That is, the display control unit 215 may constitute an “output control unit that controls output of commentary information”. More specifically, the display control unit 215 may generate screen information regarding screens (for example, FIGS. 6 to 12) controlled using at least one of the first to seventh display controls. The display control unit 215 may output the generated screen information to the display device D. FIG. Further, the display control unit 215 may output the generated screen information to the viewing terminal 4 via the transmission/reception unit 23 .

The storage unit 22 stores various information and programs. Specifically, the storage unit 22 stores a term DB. As described above, the term DB may include a common term DB and a unique term DB. The storage unit 22 may also store a video DB that stores play video for replay.

The transmitting/receiving unit 23 transmits and/or receives information to/from the playing terminal 3 or the viewing terminal 4 via the communication network 5 . The transceiver 23 may also be called a "transmitter" or a "receiver."

Specifically, the transmission/reception unit 23 transmits and/or receives data relating to play (hereinafter referred to as “play data”) to/from the play terminal 3 . Further, the transmission/reception unit 23 transmits the screen information to the viewing terminal 4 .

-Play terminal-
As shown in FIG. 4 , the playing terminal 3 includes a control section 31 and a transmission/reception section 32 . The control unit 31 and the transmission/reception unit 32 are configured by the processor 13 and the communication IF 11 of the playing terminal 3, respectively. The control unit 31 controls various processes performed by the play terminal 3 . For example, the control section 31 has a display control section 311 , an input reception section 312 and a game control section 313 .

The display control unit 311 controls the screen displayed on the output device 15 of the playing terminal 3 . The display control unit 311 controls display of play video.

The input reception unit 412 receives input by operating the input device 14 of the playing terminal 3 . Specifically, the input receiving unit 412 receives an operation related to playing the computer game by the player. The input receiving unit 412 may receive input of a performance (for example, input of audio, video, etc.) directed at the viewer by the player who referred to the viewer information.

The game control section 313 controls execution of the computer game according to the operation of the input device 14 . Specifically, the game control unit 313 controls the generation and drawing of a play video including characters displayed on the output device 15 and various objects related to the virtual game space. The play video may be in a video format, but is not limited to this.

The transmitter/receiver 42 transmits and/or receives information to/from the server 2 via the communication network 5 . Transceiver 42 may also be referred to as a "transmitter" or a "receiver." Specifically, the transmission/reception unit 42 transmits data used for generating play video (hereinafter referred to as “play data”) to the server 2 .

－Viewing terminal－
As shown in FIG. 4 , the viewing terminal 4 includes a control section 41 and a transmission/reception section 42 . Note that the control unit 41 and the transmission/reception unit 42 are configured by the processor 13 and the communication IF 11 of the viewing terminal 4, respectively. The control unit 41 controls various processes performed by the viewing terminal 4 . For example, the controller 41 has a display controller 411 and an input receiver 412 .

The display control unit 411 controls the screen displayed on the output device 15 of the viewing terminal 4 . The display control unit 411 controls display of play video. Specifically, the display control unit 411 and the display control unit 215 control display of commentary information associated with the term extracted from the commentary speech based on the screen-related information from the server 2 . For example, the display control section 411 may control display of the commentary information based on at least one of the first to seventh display controls.

The input reception unit 412 receives input by operating the input device 14 of the viewing terminal 4 . Specifically, the input receiving unit 412 may receive an input of an instruction to use the electronic medium.

The transmitter/receiver 42 transmits and/or receives information to/from the server 2 via the communication network 5 . Transceiver 42 may also be referred to as a "transmitter" or a "receiver." Specifically, the transmission/reception unit 42 receives the play video from the server 2 . The transmission/reception unit 42 receives the screen information from the server 2 .

[Operation of information processing system]
FIG. 13 is a sequence diagram showing the operation of the information processing system according to this embodiment. Note that some steps in FIG. 13 may be omitted, and the order of some steps may be changed. For example, either step st107 or st108 may be omitted. It should be noted that FIG. 13 illustrates an example of an operation during a play part.

As shown in FIG. 13, in step st101, the playing terminal 3 transmits the play data in the playing terminal 3 to the server 2. As shown in FIG. At step st102, the server 2 generates a play video based on the play data.

At step st103, the server 2 acquires the commentary voice. At step st104, the server 2 uses speech recognition processing to extract terms related to the computer game from the commentary speech. At step st105, the server 2 selects commentary information associated with the term extracted at step st104 from the term DB.

At step st106, the server 2 controls display of the play video generated at step st102 and the commentary information selected at step st105. The server 2 uses at least one of the first to seventh display controls to control the display of commentary information on the screen (eg, FIGS. 6 to 12) and generate screen information on the screen.

At step st107, the server 2 outputs the play video and screen information to the display device D, and the display device D displays the screen. In step st108, the server 2 outputs the play video and screen information to the viewing terminal 4, and the viewing terminal 4 displays the screen.

To summarize the above, the program according to the present embodiment causes the control unit 21 (computer) of the server 2 to acquire live commentary (sound related to playing a computer game), and use speech recognition processing to , extracting terms related to the computer game, and selecting commentary information associated with the extracted terms from the storage unit 22 that stores each term related to the computer game and commentary information related to each term in association with each other. and controlling the output of the selected commentary information.

[effect]
According to the information processing system 1 according to the present embodiment, live speech is acquired, terms related to a computer game are extracted from the speech using speech recognition processing, and commentary information about the extracted terms is displayed on the display device D and/or By displaying it on the viewing terminal 4, it is possible to make it easier to understand the contents of the commentary voice. As a result, the interest of the game event can be improved.

[Other embodiments]
The various control means and processing procedures described in the above embodiments are examples, and are not intended to limit the scope of the present invention, its applications, or its uses. Various control means and processing procedures can be appropriately modified in design without changing the gist of the present invention.

In the above embodiment, in addition to or instead of displaying commentary information, related information corresponding to the extracted term may be displayed. For example, if the extracted term is a specific action (special move or combo) by the player character, the related information corresponding to the action may include the amount of damage caused by the action and the correction value (increase) of the amount of damage caused by the combo. amount) may be displayed. In this case, the storage unit stores information such as the amount of damage caused by the action in association with the game situation in which the action occurs. As a result, in addition to or instead of displaying the commentary information, it is possible to display the related information corresponding to the extracted term.

The related information may be information about the player character or other characters, or information about the player. For example, when a term related to introducing a character or a player is extracted, a list of characters or players, a correlation table, a battle history up to that point, or the like may be displayed as related information.

The related information may be information relating to the game situation, for example, in a sports game, statistical information of the match may be displayed. In a soccer game, statistical information such as ball dominance rates of both teams and a heat map showing the length of time players and balls stay at specific positions may be displayed in correspondence with the extracted specific terms. In the baseball game, information on pitcher's pitch type and pitching course, information on batting average by batter's pitch type and pitching course, stealing probability and success probability by runner's pitching count corresponding to the specific terms extracted , may be displayed.

The display of the related information may be controlled according to the game situation, time conditions, viewing level of the viewer, and the like. Note that the commentary information and related information may be displayed according to the game situation, time conditions, the viewing level of the viewer, and the like, regardless of whether or not terms are extracted from the voice regarding the play. For example, in a specific game situation or a non-play part, the explanation information and related information as described above may be automatically displayed.

In the above embodiment, the case where the computer game played at the game event is a competitive game has been exemplified, but the present invention is not limited to this. Games can be applied to various types of games, such as shooting games, role-playing games, simulation games, board games, and puzzle games.

In the above embodiment, the case where the server 2 alone causes the program to function was exemplified, but the present invention is not limited to this. At least part of the means of the program may be provided in one or more devices that constitute the server 2 .

Even when these other embodiments are employed, the effects of this embodiment are exhibited. Further, it is also possible to appropriately combine this embodiment with other embodiments, and other embodiments with each other.

1 information processing system 2 server 3 play terminal 4 viewing terminal 5 communication network 11 communication interface 12 storage device 13 processor 14 input device 15 output device 16 bus 21 control unit 22 storage unit 23 transmission/reception unit 31 control unit 32 transmission/reception unit 41 control Unit 42 Transmission/reception unit 211 Video generation unit 212 Audio acquisition unit 213 Extraction unit 214 Selection unit 215 Display control unit 311 Display control unit 312 Input reception unit 313 Game control unit 411 Display control unit 412 Input reception unit 60 Venue 602 Player 606 Spectator 608 Commentator D Display device M Microphone S Speaker

Claims (12)

to the computer,
Acquisition means for acquiring commentary audio relating to computer game play;
extracting means for extracting terms related to the computer game from the commentary voice using speech recognition processing;
selection means for selecting commentary information associated with the extracted term from a storage unit that associates and stores each term relating to the computer game and commentary information relating to each term;
display control means for displaying the selected commentary information together with the video of the play corresponding to the live commentary;
function as
the storage unit associates and stores each of the terms and the situation of the computer game in which the terms are used;
The display control means controls the relationship between a first game situation, which is the situation of the computer game associated with the extracted term, and a second game situation, which is the situation of the computer game based on the play. displaying the selected commentary information based on
A program characterized by The display control means controls the selected commentary information when the first game situation matches the second game situation, and the selected commentary information when the first game situation does not match the second game situation. displaying the selected commentary information in a distinguishable manner;
2. The program according to claim 1 , characterized by: to the computer,
Acquisition means for acquiring commentary audio relating to computer game play;
extracting means for extracting terms related to the computer game from the commentary voice using speech recognition processing;
selection means for selecting commentary information associated with the extracted term from a storage unit that associates and stores each term relating to the computer game and commentary information relating to each term;
display control means for displaying the selected commentary information together with the video of the play corresponding to the live commentary;
function as
Each of the terms is a unique term unique to the computer game, or a common term commonly used with other computer games different from the computer game,
The display control means displays the selected commentary information based on whether the extracted term is the unique term or the common term.
A program characterized by The storage unit stores first terminology information that associates the specific term with commentary information about the specific term, and second terminology information that associates the common term with commentary information about the common term. ,
The display control means displays the selected commentary information based on whether or not the extracted term is included in the second term information.
4. The program according to claim 3 , characterized by: to the computer,
Acquisition means for acquiring commentary audio relating to computer game play;
extracting means for extracting terms related to the computer game from the commentary voice using speech recognition processing;
selection means for selecting commentary information associated with the extracted term from a storage unit that associates and stores each term relating to the computer game and commentary information relating to each term;
display control means for displaying the selected commentary information together with the video of the play corresponding to the live commentary;
function as
The display control means displays the selected commentary information based on the number of times the extracted term is extracted within a predetermined period of time.
A program characterized by The display control means restricts display of the selected commentary information when the number of extractions within the predetermined period satisfies a predetermined condition.
6. The program according to claim 5 , characterized by: The display control means relaxes restrictions on the display of the selected commentary information based on the situation of the computer game based on the play and/or time conditions.
7. The program according to claim 6 , characterized by: to the computer,
Acquisition means for acquiring commentary audio relating to computer game play;
extracting means for extracting terms related to the computer game from the commentary voice using speech recognition processing;
selection means for selecting commentary information associated with the extracted term from a storage unit that associates and stores each term relating to the computer game and commentary information relating to each term;
display control means for displaying the selected commentary information together with the video of the play corresponding to the live commentary;
function as
The computer game includes a first part in which the play progresses and a second part other than the first part,
The display control means controls display based on the extraction history of the extracted terms in the second part.
A program characterized by to the computer,
Acquisition means for acquiring commentary audio relating to computer game play;
extracting means for extracting terms related to the computer game from the commentary voice using speech recognition processing;
selection means for selecting commentary information associated with the extracted term from a storage unit that associates and stores each term relating to the computer game and commentary information relating to each term;
display control means for displaying the selected commentary information together with the video of the play corresponding to the live commentary;
function as
The display control means displays a predetermined number of the selected commentary information based on the extraction order of the extracted terms, and limits display of the selected commentary information exceeding the predetermined number.
A program characterized by The display control means displays an area requesting reference to the selected commentary information whose display is restricted.
10. The program according to claim 9 , characterized by: a program storage unit for storing the program according to any one of claims 1 to 10;
a control unit that executes the program;
A server characterized by comprising: a program storage unit for storing the program according to any one of claims 1 to 10;
a control unit that executes the program;
A system characterized by comprising :

Images