JP7445166B2 - Video management system - Google Patents

Description

The present invention relates to an information processing system.
The present invention particularly relates to an information processing system that searches for a situation in another game space that has a similar relationship to a specific situation in a certain game space.

Patent Document 1 discloses a mechanism for presenting to a user of a specific game operations by the user and operations by other users so as to be comparable.
The game processing device described in Patent Document 1 records the operations performed by the user while the game is being played, and displays the contents of the operations by the user and the contents of the operations by other advanced users in a replay video of the game played by the user. This may be displayed in a superimposed manner, or the difference between the operation by the user and the operation by the advanced user may be expressed.

Japanese Patent Application Publication No. 10-028776

In order to improve a user's operation ability in a specific situation, it is effective to present the operation contents of other users in a situation similar to the specific situation.
Regarding this point, Patent Document 1 does not assume a situation in which the situations in which operations to be recorded are performed do not match, and there is no need to consider the degree of similarity of the situations.

The problem to be solved by the present invention is to efficiently search for similar situations similar to a target situation in a certain game space from other game spaces.

[A] In order to solve the above problem, an “information processing device” that is one aspect of the present invention analyzes a game control log recorded by a user terminal during game execution in association with the timeline of captured data, and A generating means for generating an index that includes at least key elements of one or more aspects recorded in the capture data, and a similar situation that refers to the index generated by the generating means and has key elements similar to query elements of the target situation. and a search means for searching.
[B] In order to solve the above problem, the "information processing device control method" which is one aspect of the present invention includes a game control log recorded by a user terminal during game execution in association with a timeline of capture data. a generation step of generating an index that includes at least key elements of one or more aspects analyzed and recorded in the captured data, and a key element similar to the query element of the target aspect by referring to the index generated in the generation step; a search step of searching for similar aspects having the same characteristics.
[C] In order to solve the above problem, a "control program" that is one aspect of the present invention analyzes a game control log recorded by a user terminal during game execution in association with the timeline of captured data, and analyzes the captured data. A generation function that generates an index that includes at least key elements of one or more aspects recorded in the data, and a similar situation that refers to the index generated by the generation function and has key elements similar to the query element of the target situation. A search function for searching is realized in a computer of an information processing device.
[D] In order to solve the above problem, a control program recorded on a "computer-readable recording medium", which is one aspect of the present invention, is recorded in association with a timeline of captured data by a user terminal running a game. A generation function that analyzes the captured game control log and generates an index that includes at least the key elements of the single or multiple situations recorded in the captured data, and a query element of the target situation by referring to the index generated by the generation function. A search function for searching for similar aspects having key elements similar to the above is realized in a computer of an information processing device.

The following technical limitations may be added to the "information processing device" in [A] above. Further, similar technical limitations may be added to the "control method" in [B] above, the "control program" in [C] above, and the control program recorded by the "recording medium" in [D] above.
- The generating means generates the index that includes at least the key element that can specify the first key item and the second key item in the situation recorded in the capture data, and the searching means A search is made for the similar situation having the key element similar to the query element for which a first query item and a second query item can be specified.
- The generating means generates the index including at least the key element that can further specify a key action performed from the first key item to the second key item, and the searching means generates the index that includes at least the key element that can further specify a key action performed from the first key item to the second key item, The similar situation having the key element similar to the query element that can further specify a query action performed from the item to the second query item is searched.
- The generating means generates the index that includes at least the key element that can specify the key action that displaces the object from the first key item to the second key item, and the searching means The similar situation having the key element similar to the query element that can specify the query action that displaces an object from one query item to the second query item is searched.
・Identification means for identifying the target situation by analyzing a game control log associated with specified capture data specified by the user, and advice for user operations performed in the target situation identified by the identification means. The apparatus further includes presentation means for presenting advice information in a superimposed manner on a display portion of the target situation of a replay video generated from the designated capture data.
・A specifying means for specifying the target situation by analyzing a snapshot obtained from a user terminal during game execution, and advice information indicating advice for a user operation to be performed in the target situation specified by the specifying means. The display device further includes presentation means for presenting the target aspect in a superimposed manner on the display portion.
- The presentation means presents the advice information statistically generated from key elements of similar situations searched by the search means.
- The presentation means presents the advice information that is statistically generated from key elements of reference situations that satisfy the specified criteria among the similar situations searched by the search means.
- The generating means generates the index further including a subkey element that can specify the effect of a key action performed from the first key item to the second key item, and the searching means satisfies the specified condition. The similar aspect having the subkey element indicating that an effect has been obtained is preferentially searched.
・Registration means for registering a partial video indicating the contents of a situation that can be searched by the index generated by the generation means in the distribution means and acquiring access destination information of the partial video; The apparatus further includes providing means for providing access destination information of the corresponding partial video to the user.
- Further comprising a partial image generating means for generating the partial image indicating the content of a searchable situation using the index generated by the generating means and containing no items other than items related to the key elements of the situation.
- The first key item, the second key item, the first query item, and the second query item are positions in the game space.
- The first key item, the second key item, the first query item, and the second query item are objects that exist within the game space.

In this specification, the following terms are used.
- "Capture data" includes at least video data and audio data.
- The "game control log" includes at least data regarding objects that may exist in the game space and data regarding events that occur in the game space.
- A "snapshot" includes at least data regarding objects existing in the game space.

The present invention analyzes a game control log recorded by a user terminal during game execution in association with a timeline of captured data, and generates an index that includes at least key elements of one or more aspects recorded in the captured data. At the same time, the index is referred to and a similar situation having a key element similar to the query element of the target situation is searched.
Therefore, according to the present invention, it becomes possible to efficiently search for a similar situation similar to a target situation in a certain game space from other game spaces.

It is an explanatory diagram of a game control log. (Example) FIG. 2 is an explanatory diagram of an overview of the system. (Example) This is an example of a network configuration. (Example) It is an example of a hardware configuration of a user device. (Example) It is an example of a hardware configuration of a server device. (Example) This is an example of a functional configuration of a video management system. (Example) This is an example of a data registration procedure. (Example) It is an explanatory diagram of metadata addition processing. (Example) This is an example of metadata items. (Example) This is an example of a search procedure. (Example) This is a display example of a search condition specification screen. (Example) This is a display example of a game video playback screen. (Example) This is an example of an advice presentation procedure. (Example) This is an example of displaying the target situation. (Example) This is an example of displaying advice information. (Example) This is a display example of a similar situation. (Example)

[1. Embodiment]
[1-1. Embodiment 1]
[1-1-1. overview]
Embodiment 1 relates to an information processing system that adds metadata to capture data that records video and audio of a game being executed on a user terminal.
In the first embodiment, in order to efficiently add detailed metadata to captured data, metadata is added by taking into account a game control log recorded by a user terminal in association with the timeline of captured data while the user terminal is running a game. has been adopted.

[1-1-2. Information processing device]
The information processing apparatus constituting the information processing system according to the first embodiment includes an acquisition unit that acquires a game control log recorded by a user terminal during game execution in association with a timeline of capture data, and an acquisition unit that acquires a game control log by the acquisition unit. addition means for adding metadata to the timeline of the captured data in consideration of a game control log that is generated.
The adding means can add a plurality of systems of the metadata by referring to a plurality of metadata addition rules. The multiple systems of metadata may be a combination of different types of data, such as a search tag and a chapter title, or may be a combination of the same type of data, such as an old search tag and a new search tag.

[1-2. Embodiment 2]
[1-2-1. overview]
Embodiment 2 relates to an information processing system that searches for a situation in another game space that has a similar relationship to a specific situation in a certain game space.
In Embodiment 2, in order to efficiently search for a similar situation similar to a target situation in a certain game space in another game space, game control data recorded by the user terminal in association with the timeline of capture data while the user terminal is running the game is used. A configuration is adopted in which logs are analyzed to generate an index, and the index is referenced for searches.

[1-2-2. Information processing device]
The information processing apparatus constituting the information processing system according to the second embodiment analyzes the game control log recorded by the user terminal during game execution in association with the timeline of the captured data, and analyzes the singular or a generating means for generating an index including at least key elements of a plurality of aspects; and a searching means for searching for a similar situation having a key element similar to a query element of a target situation by referring to the index generated by the generating means. Be prepared.
The target situation may be a situation in a game video that is identified by analyzing a game control log recorded in association with certain captured data, or a situation in a game video that is identified by analyzing a snapshot obtained from a user terminal during game execution. It may also be a situation within a specified game space.

[2. Example]
[2-1. overview]
This embodiment adds metadata to capture data that records video and audio of a game being executed on a user terminal, and searches for situations in other game spaces that have a similar relationship to a specific situation in a certain game space. related to information processing systems.
In this embodiment, in order to efficiently add detailed metadata to captured data and to efficiently search for similar situations similar to the target situation in a certain game space from other game spaces, the user terminal A configuration is adopted that uses a game control log recorded in association with the timeline of captured data.

The contents of the game control log will be explained with reference to FIG.
The game control log records the transition of parameters related to objects that may exist in the game space and the execution history of commands related to events that may occur in the game space in association with the timeline of the captured data.
In the game control log of FIG. 1, a change in parameter A 121, a change in parameter B 122, and a command execution history 130 are recorded in association with a timeline 110.

In FIG. 1, the value of parameter A changes from a1 to a2 to a3 according to commands c1 and c2. Further, in FIG. 1, the value of parameter B changes from b1 to b2 to b3 according to commands d1 and d2.
By arranging objects and generating events using the game control log, it is possible to reproduce at least a portion of the play content in a certain game space. It is also possible to generate a game video from this reproduction content.

An overview of the system of the embodiment will be explained with reference to FIG.
The user terminals 10a and 10b execute the electronic game according to user operations while exchanging data with the game management system 20 as necessary.
The user terminal 10a that is running the game records a game control log along with the capture data, and provides these data to the video management system 30.
The video management system 30 registers the game video indicated by the capture data in the distribution management system 40, and also adds metadata to the timeline of the capture data to generate an index for search.

The user terminal 10b searches for a game video in the video management system 30, and requests the distribution management system 40 to distribute the game video based on the search result. The distribution management system 40 streams the game video in response to a request from the user terminal 10b.
The user terminal 10b, which is playing a game video or executing a game, requests advice from the video management system 30. The video management system 30 searches for similar situations in response to a request from the user terminal 10b, and provides advice information to the user terminal 10b.

[2-2. Network configuration]
FIG. 3 shows an example of the network configuration of the system of the embodiment.
The system of this embodiment includes a plurality of user terminals 10 (user terminals 10a, user terminals 10b) used by users, a game management system 20 that provides game services, and a video management system 30 that provides video management services. , and a distribution management system 40 that provides a video distribution service.
The game management system 20 includes a user management server 21, a data management server 22, and a storage 23. The video management system 30 includes a user management server 31, a registration server 32, a data management server 33, a storage 34, and a search server 35. The distribution management system 40 includes a registration server 41, a file management server 42, a storage 43, and a distribution server 44.

The user terminal 10 and the user management server 21 can exchange data through the communication network 50. The user management server 21 can access data stored in the storage 23 via the data management server 22.
The user terminal 10, the user management server 31, and the search server 35 can exchange data with each other via the communication network 50. The registration server 32 and search server 35 can access data stored in the storage 34 via the data management server 33.

The user terminal 10, the registration server 41, and the distribution server 44 can exchange data through the communication network 50. The registration server 41 and distribution server 44 can access data stored in the storage 43 via the file management server 42.
The registration server 32 and the registration server 41 can exchange data through the communication network 50 or a dedicated line, or via a shared storage device.
The communication network 50 is at least one of existing networks such as the Internet, a mobile phone network, a wireless WAN (Wireless Wide Area Network), a wireless LAN (Wireless Local Area Network), and Ethernet (registered trademark). may contain.

[2-2-1. User terminal]
The user terminal 10 is a user device (computer) on which a predetermined game program and a web browser program are installed.
In the system of this embodiment, the user device is a general-purpose mobile device (e.g., a mobile phone, a smartphone, a tablet terminal, a tablet PC (personal computer), a wearable device) on which a game program and a web browser program can be installed. A wearable device, etc.) or a general-purpose processing device (for example, a personal computer (PC), etc.) can be used.

[2-2-2. Game management system]
The game management system 20 includes a user management server 21, a data management server 22, and a storage 23.
The user management server 21 is a server device (computer) in which a web server program (also referred to as HTTP daemon (HyperText Transfer Protocol Daemon)) is installed.
In response to a request, the user management server 21 reads necessary data from the storage 23 via the data management server 22 and provides it to the request source (response). Further, in response to a request, the user management server 21 writes data acquired from the request source to the storage 23 via the data management server 22, and provides a processing result to the request source (response).
Note that a server system may be configured by linking a plurality of server devices, and the functions of the user management server 21 may be shared or the load placed on the user management server 21 may be distributed.

The data management server 22 is a server device (computer) in which a DB (Database) server program is installed. The data management server 22 constitutes a DBMS (Database Management System) together with a built-in or externally connectable storage 23.
The data management server 22 stores data obtained from the request source in the storage 23 in response to a data storage request. In addition, the data management server 22 responds to the request source with data extracted from the storage 23 in response to the data extraction request.
Note that a server system may be configured by linking a plurality of server devices, and the functions of the data management server 22 may be shared or the load placed on the data management server 22 may be distributed.

The storage 23 is a storage device that stores various data related to game services.
Note that a plurality of storage devices may be prepared and each type of data stored in the storage 23 may be stored separately. It is also possible to distribute and arrange the data stored in the storage 23 in a plurality of storage devices.

[2-2-3. Video management system]
The video management system 30 includes a user management server 31, a registration server 32, a data management server 33, a storage 34, and a search server 35.
The user management server 31 is a server device (computer) in which a web server program is installed.
The user management server 31 passes the data acquired from the request source to the registration server 32. Further, the user management server 31 causes the search server 35 to search for necessary data in response to a request, and provides the processing result to the request source (response).
Note that a server system may be configured by linking a plurality of server devices, and the functions of the user management server 31 may be shared or the load placed on the user management server 31 may be distributed.

The registration server 32 is a server device (computer) in which an application program is installed.
The registration server 32 registers captured data or game video data processed therein in the distribution management system 40 . Further, the registration server 32 generates metadata and stores this in the storage 34 via the data management server 33.
Note that a server system may be configured by linking a plurality of server devices, and the functions of the registration server 32 may be shared or the load placed on the registration server 32 may be distributed.

The data management server 33 is a server device (computer) in which a DB server program is installed. The data management server 33 constitutes a DBMS together with a built-in or externally connectable storage 34.
The data management server 33 stores data obtained from the request source in the storage 34 in response to a data storage request. In addition, the data management server 33 responds to the request source with data extracted from the storage 34 in response to the data extraction request.
Note that a server system may be configured by linking a plurality of server devices, and the functions of the data management server 33 may be shared or the load placed on the data management server 33 may be distributed.

The storage 34 is a storage device that stores various data related to the video management service. In this embodiment, in particular, a game control log associated with captured data, metadata added to the captured data, an index formed by formatting the metadata, etc. are stored.
Note that a plurality of storage devices may be prepared and each type of data stored in the storage 34 may be stored separately. It is also possible to distribute the data stored in the storage 34 to a plurality of storage devices.

The search server 35 is a server device (computer) in which a search program is installed.
The search server 35 searches the index in response to a search request, and provides search results to the request source (response).
Note that a server system may be configured by linking a plurality of server devices, and the functions of the search server 35 may be shared or the load placed on the search server 35 may be distributed.

[2-2-4. Distribution management system]
The distribution management system 40 includes a registration server 41, a file management server 42, a storage 43, and a distribution server 44.
The registration server 41 is a server device (computer) in which an application program is installed.
In response to the registration request, the registration server 41 stores the video data provided from the request source in the storage 43 via the file management server 42, and provides the processing result to the request source (response).
Note that a server system may be configured by linking a plurality of server devices, and the functions of the registration server 41 may be shared or the load placed on the registration server 41 may be distributed.

The file management server 42 is a server device (computer) in which a file server program is installed.
The file management server 42 stores data obtained from the request source in the storage 43 in response to a data storage request. In addition, the file management server 42 responds to the request source with data extracted from the storage 43 in response to the data extraction request.
Note that a server system may be configured by linking a plurality of server devices, and the functions of the file management server 42 may be shared or the load placed on the file management server 42 may be distributed.

The storage 43 is a storage device that stores various data related to video distribution services. In this embodiment, in particular, moving image file data is stored.
Note that it is also possible to distribute the data stored in the storage 43 to a plurality of storage devices.

The distribution server 44 is a server device (computer) in which a streaming distribution server program is installed.
The distribution server 44 reads necessary data from the storage 43 via the file management server 42 in response to the distribution request (request), and streams the data (response) to the request source.
Note that a server system may be configured by linking a plurality of server devices, and the functions of the distribution server 44 may be shared or the load placed on the distribution server 44 may be distributed.

[2-3. Hardware configuration]
[2-3-1. Hardware configuration of user device]
FIG. 4 shows an example of the hardware configuration of the user device.
A typical user device includes an MPU (Micro-Processing Unit) 411 that constitutes a control processing section, a RAM (Random Access Memory) 421 that constitutes a main memory section, and a ROM (Read Only Memory) that constitutes an auxiliary memory section. 422 and EEPROM (Electrically Erasable Programmable Read-Only Memory) 423, a touch panel display 431 that constitutes an input section and a display section, a speaker 432 that constitutes an audio output section, and a NIC (Network Interface Controller) that constitutes a communication control section. 441 and a wireless LAN (Local Area Network) chip 442.

RAM 421, ROM 422, EEPROM 423, touch panel display 431, speaker 432, NIC 441, and wireless LAN chip 442 are connected to MPU 411 via a bus line.
The MPU 411 (1) reads a program stored in the ROM 422 or EEPROM 423 onto the RAM 421, (2) acquires data from at least one of the touch panel display 431, the EEPROM 423, the NIC 441, and the wireless LAN chip 442 according to the instructions of the program; (3) After calculating and processing the acquired data according to the procedure specified in the program, (4) transferring the calculated and processed data to at least the EEPROM 423, the touch panel display 431, the speaker 432, the NIC 441, and the wireless LAN chip 442. Provide to either.

[2-3-2. Hardware configuration of server device]
FIG. 5 shows an example of the hardware configuration of the server device.
A typical server device includes a control processing unit 510 including an MPU and a ROM, a main storage device 520 including a RAM, an auxiliary storage device 530 including an HDD (Hard Disc Drive), and an input device 540 including a mouse and a keyboard. , an output device 550 including a display and a speaker, and a communication control device 560 including a network interface card.

Main storage device 520, auxiliary storage device 530, input device 540, output device 550, and communication control device 560 are each connected to control processing device 510 via a bus line.
The control processing device 510 (1) reads a program stored in the auxiliary storage device 530 onto the main storage device 520, and (2) performs communication between at least the input device 540, the auxiliary storage device 530, and the communication control device 560 according to the instructions of the program. Acquire data from either, (3) calculate and process the acquired data according to the procedure specified in the program, and (4) communicate the calculated and processed data with the auxiliary storage device 530 and the output device 550. and at least one of the control device 560.

[2-4. Functional configuration]
FIG. 6 shows an example of the functional configuration of the video management system.
As illustrated in FIG. 6, the video management system 30 includes a reception section 611, a registration section 612, a data management section 621, a data storage section 622, an input section 631, a specification section 632, and a search section 633. and an output section 634.
The reception unit 611 is configured to include the user management server 31. The registration unit 612 includes the registration server 32.
The data management unit 621 is configured to include the data management server 33. The data storage unit 622 is configured to include the storage 34.
The input section 631 and the output section 634 are configured to include the user management server 31. The identification unit 632 and the search unit 633 are configured to include the search server 35.

The functions performed by the user management server 31 are realized by installing an OS (Operating System) for a server device and a web server program running on the OS into the server device.
The functions performed by the registration server 32 are realized by installing an OS for a server device and an application program running on the OS into the server device.
The functions carried out by the data management server 33 are realized by installing an OS for a server device and a DB server program running on the OS into the server device.
The functions performed by the search server 35 are realized by installing an OS for a server device and a search program running on the OS into the server device.

Programs to be installed on server devices are distributed in a state recorded on recording media such as CDs (Compact Discs), DVDs (Digital Versatile Disks), MO disks (Magneto-Optical disks), and flash memory. It may be read into the server device from the recording medium, or it may be superimposed on a carrier wave and supplied to the server device via a communication network.

The reception unit 611 acquires, from the user terminal 10a, the game control log recorded by the user terminal 10a during game execution in association with the timeline of the captured data, and the captured data.
In this embodiment, the game control log includes parameter changes and command execution history related to actions in which the first object participates in the second object in the game space.

The registration unit 612 registers the captured data acquired by the reception unit 611 or the video data obtained by processing the captured data in the distribution management system 40 . Further, the registration unit 612 adds metadata to the timeline of the captured data, taking into consideration the game control log acquired by the reception unit 611, and stores the metadata in the data storage unit 622 via the data management unit 621.
In this embodiment, the registration unit 612 adds multiple systems of metadata by referring to each of the multiple metadata addition rules.

Further, the registration unit 612 generates an index that includes at least key elements of one or more aspects recorded in the game control log.
The key element is data that can specify the first key item and the second key item in the situation recorded in the capture data. Preferably, the key element is data that can specify a key action performed from the first key item to the second key item. More preferably, the key element is data that can specify a key action that displaces the object from the first key item to the second key item. The first key item and the second key item may be positions within the game space or objects existing within the game space.
In this embodiment, the placement position of the first object and the placement position of the second object in the situation recorded in the capture data are the first key item and the second key item, respectively.

The input unit 631 inputs a search request from the user terminal 10b. The input unit 631 also receives an advice request from the user terminal 10b that is playing a game video or running a game.
When the requester of the advice request is playing a game video, the identifying unit 632 determines the target situation by analyzing the game control log corresponding to the situation at a specified position (for example, a pause position) of the game video being played. Specify as. On the other hand, when the requester of the advice request is executing a game, the identifying unit 632 determines the current situation in the game space of the game being executed as a target situation by analyzing the snapshot obtained from the user terminal 10b. Identify.

When a search request is input from the user terminal 10b, the search unit 633 searches for game videos to which metadata that satisfies the specified search conditions is added.
Further, when the search unit 633 receives an advice request from the user terminal 10b, the search unit 633 refers to the index generated by the registration unit 612 and searches for a similar situation having a key element similar to the query element of the target situation. The search target may be narrowed down to only similar situations that have subkey elements that have an effect that satisfies a predetermined condition. It is preferable that the items of the query element correspond to the items of the key element.

The output unit 634 outputs search results to the user terminal 10b when a search request is input from the user terminal 10b.
Further, when receiving an advice request from the user terminal 10b during playback of the game video, the output unit 634 adds advice information indicating advice for the user operation performed in the target situation specified by the search unit 633 to the game video. Present them in a superimposed manner. On the other hand, when the output unit 634 receives an advice request from the user terminal 10b during game execution, the output unit 634 superimposes advice information on the game screen indicating advice for the user operation to be performed in the target situation specified by the search unit 633. and present it.

Advice information is statistically generated using key elements of similar situations. For example, the direction, magnitude, strength, etc. of actions may be aggregated for each level of result quality, and information explaining the content of user operations may be generated for each result level.
Note that the advice information is superimposed on a non-important area (that is, an area that does not include the placement position of an object or the occurrence position of an event related to the content indicated by the key element) that is found by analyzing the game control log or snapshot. It is good.

[2-5. Data registration procedure]
FIG. 7 illustrates a data registration procedure by the video management system 30.
In S710, the reception unit 611 acquires registration data from the user terminal 10a. The registration data includes at least capture data and a game control log associated with the timeline of the capture data.

In S720, the registration unit 612 registers the captured data or the game video processed therein in the distribution management system 40.
In S730, the registration unit 612 adds metadata to the timeline of the captured data. In this embodiment, multiple systems of metadata are added by referring to each of the multiple metadata addition rules. In this embodiment, a search tag and a chapter title are added.
In S740, the registration unit 612 stores the added metadata in the data storage unit 622 via the data management unit 621. At this time, the registration unit 612 formats the set of search tags to generate an index, and stores it in the data storage unit 622 via the data management unit 621.

The metadata addition process will be described with reference to FIG. 8.
In this embodiment, the registration unit 612 applies multiple additional rules (for example, additional rules 820a and 820b) to one game control log 810, thereby creating multiple systems of metadata (for example, for search). tag 830a and chapter title 830b).

FIG. 9(a) shows an example of search tag items. A search tag is an example of metadata.
As illustrated in FIG. 9(a), the search tag includes the key item "video ID", "corresponding position" on the timeline, "action ID" that can identify the action, and " A singular or plural number associated with the viewpoints of "name", "subject" (first object), "object" (second object), "direction" (may be a vector including "size"), and "effect", respectively. Contains terms and.

The "effect" typically refers to the level or degree of damage caused by the "subject" to the "object" due to the "action". The magnitude of damage can be identified from the transition of parameters related to the "object" before and after the command corresponding to the "action".
In addition, in games where points are added according to the number of times the "subject" moves and the "subject" or another object collides with the "object" (number of hits), the level or number of hits is added as an "effect". A term indicating degree may be added.

FIG. 9(b) shows an example of chapter title items. Chapter titles are an example of metadata.
As illustrated in FIG. 9B, the chapter title includes key items "video ID" and "chapter number", a "corresponding position" on the timeline, and a "title" of the chapter.
Note that the chapter title may be a text in which terms associated with the "name", "subject", "object", "direction", and "result" aspects of the action are connected in a predetermined order.

[2-6. Search procedure]
FIG. 10 illustrates a search procedure by the video management system 30.
In S1010, the input unit 631 inputs a search request from the user terminal 10b. The search request includes search conditions specified by the user.
In S1020, the search unit 633 searches for game videos that meet the specified search conditions.
In S1030, the output unit 634 outputs the search results to the user terminal 10b. The search results in this embodiment include at least one or more hyperlinks pointing to the URL of the game video to which a parameter indicating the playback start position is added.

When one of the hyperlinks is designated and the link destination is accessed, streaming distribution from the distribution management system 40 to the user terminal 10b starts. On the user terminal 10b, the specified game video is played back from the specified playback start position.
Note that the game video may be played back by a web browser program or by a dedicated application program. When played by a web browser program, it may be played on a video playback page of a video distribution service, or may be played on a game video playback page of a video management service.

FIG. 11 is a display example of the search condition specification screen.
Screen 1100 includes a plurality of areas 1110 to 1150, each corresponding to a plurality of viewpoints of the search tag, and a button 1160.
Area 1110 includes a pulldown 1112 for specifying the "name" of the action. Area 1120 includes a pull-down 1122 for specifying the "subject" of the action. Area 1130 includes a pulldown 1132 for specifying the "object" of the action. Area 1140 includes a pulldown 1142 that specifies the "direction" of the action. Area 1150 includes a pulldown 1152 that specifies the "effect" of the action.
In each pulldown, it is preferable to select no specification or a specific term.
When the user performs a predetermined designation operation on the button 1160 after specifying an item in each area, the user terminal 10b transmits a search request to the search server 35.

[2-7. Display example of game video playback screen]
FIG. 12 is a display example of a game video playback screen.
Screen 1200 includes an area 1210 where game videos are displayed and an area 1220 where a chapter list is displayed.
In the area 1220, as many hyperlinks as the number of chapters are arranged, each linking to a URL of a game video to which a parameter indicating a playback start position is added. When any hyperlink is designated, streaming distribution from the distribution management system 40 to the user terminal 10b is started, and the game video is displayed in the area 1210.

[2-8. Advice presentation procedure]
FIG. 13 illustrates an advice presentation procedure by the video management system 30.
In S1310, the input unit 631 receives an advice request from the user terminal 10b that is playing a game video or running a game.
In S1320, the specifying unit 632 specifies the target situation in the game video being played or the game space of the game being executed.

In S1330, the search unit 633 refers to the index stored in the data storage unit 622 and searches for a similar situation having a key element similar to the query element of the target situation to the extent that it satisfies a predetermined criterion. In this embodiment, similar situations that further include a subkey element indicating that an effect satisfying a predetermined condition has been obtained are preferentially searched.
In S1340, the output unit 634 presents advice information generated using the key elements of the similar situation to the user terminal 10b.

FIG. 14 is a display example of the target situation. Screen 1400 illustrates a target situation in the game video being played on user terminal 10b.
The screen 1400 displays an object A1411, an object B1412, and a trajectory 1413 indicating the direction of an action performed from the object A1411 toward the object B1412.
Note that the element corresponding to the trajectory 1413 is not displayed on the game screen that displays the target situation in the game space of the game being executed.

FIG. 15 is a display example of advice information.
A screen 1400 illustrating a target situation includes a trajectory 1520 showing the direction of an action that produced a favorable effect in a similar situation, an area 1530 for displaying explanatory text of the action, and a pull-down 1540 for specifying criteria regarding the effect of the action. and a button 1550 for displaying a search result screen of game videos having similar situations that meet the specified criteria are arranged in an overlapping manner.
When a criterion is specified in the pulldown 1540, operation trends of other users in similar situations that meet the specified criterion are displayed superimposed on the game video. Further, when the button 1550 is designated, a list screen is displayed in which links to game videos (which may be partial videos described later) having similar situations that meet the criteria designated by the pull-down 1540 are set.

FIG. 16 is a display example of a similar situation.
On the screen 1600, a video of an action performed from an object A 1611 in a similar situation corresponding to the object A 1411 in the target situation toward an object B 1612 in a similar situation corresponding to the object B 1412 in the target situation is played back in a pinpoint manner.
Further, on the screen 1600, a pull-down 1621 for specifying the presence or absence of a background, a pull-down 1622 for specifying a background pattern, and a pull-down 1623 for specifying a background color are displayed in a superimposed manner.

It is preferable that the screen 1600 that displays similar situations does not include any elements other than the key elements of the similar situations. This allows the user to check only the movement of the object in the game space.
In the screen 1600, the background is a black and white grid. The pattern and color of the background can be changed at any time as specified by the user. It is assumed that the image will be switched to a single color with no pattern that does not overlap with the object icon. With these configurations, it is expected that visibility will be improved when confirming the direction of an action (in this embodiment, the direction of movement of an object) in the game space.

Game videos (parts) that do not include elements other than key elements (e.g., video and audio before and after searchable situations, backgrounds of searchable situations, effects images accompanying events, objects unrelated to key elements, etc.) The video) may be generated in advance by analyzing the game control log and registered in the distribution management system 40.
The registration unit 612 generates a partial video and registers it in the distribution management system 40. At this time, it is preferable that the registration unit 612 obtains the access destination information (for example, URL) of the registered partial video and stores it in the data storage unit 622 via the data management unit 621.

[3. Configuration example of invention]
[3-1. Invention 1]
[3-1-1. Problems with invention 1]
The problem that invention 1 aims to solve is to efficiently add detailed metadata to capture data recorded by a user terminal during game execution.
[3-1-2. Configuration of invention 1]
[A] In order to solve the above problem, an "information processing device" which is one aspect of the first invention provides an acquisition method for acquiring a game control log recorded by a user terminal during game execution in association with a timeline of capture data. and an addition means for adding metadata to the timeline of the captured data in consideration of the game control log acquired by the acquisition means.
[B] In order to solve the above problem, the “information processing device control method” which is one aspect of the first invention includes a game control log recorded by a user terminal during game execution in association with a timeline of capture data. The method includes an acquisition step of acquiring, and an addition step of adding metadata to the timeline of the captured data in consideration of the game control log acquired by the acquisition step.
[C] In order to solve the above problem, the "control program" that is one aspect of the first invention has an acquisition function that acquires a game control log recorded by a user terminal during game execution in association with the timeline of capture data. and an additional function of adding metadata to the timeline of the captured data in consideration of the game control log acquired by the acquisition function, in a computer of the information processing device.
[D] In order to solve the above problem, the control program recorded on the "computer-readable recording medium" which is one aspect of the first invention is recorded in association with the timeline of the captured data by the user terminal during game execution. an acquisition function for acquiring a game control log acquired by the acquisition function; and an additional function for adding metadata to the timeline of the captured data in consideration of the game control log acquired by the acquisition function. .
[3-1-3. Modification of configuration of invention 1]
The following technical limitations may be added to the "information processing device" in [A] above. Further, similar technical limitations may be added to the "control method" in [B] above, the "control program" in [C] above, and the control program recorded by the "recording medium" in [D] above.
- The adding means adds the metadata that associates at least one term with each of the plurality of viewpoints.
- The acquisition means acquires the game control log including an action in which a first object is involved in a second object in the game space, and the addition means acquires the game control log including an action in which a first object is involved in a second object in the game space, and the addition means acquires the game control log from each perspective of the type of action, subject, and object. Adding the metadata that associates each of the terms.
- The adding means adds the metadata that associates the term with the viewpoint of the result of the action in accordance with the transition of a parameter that can be changed by the action.
- The adding means adds the metadata that associates the term with respect to the direction of the action according to the positional relationship between the first object and the second object in the game space.
- The adding means adds multiple systems of the metadata by referring to a plurality of metadata addition rules.
- The adding means adds a search tag as the metadata by referring to a first rule for adding a search tag, and adds a chapter title by referring to a second rule to add a chapter title. Add as the metadata.
- The adding means adds the metadata with reference to a first rule, and updates the metadata with reference to a second rule that replaces the first rule.
[3-1-4. Effects of invention 1]
Invention 1 adds metadata to the timeline of the captured data by taking into consideration a game control log recorded by a user terminal during game execution in association with the timeline of the captured data.
Therefore, according to the first invention, it becomes possible to efficiently add detailed metadata to capture data recorded by a user terminal during game execution.

[3-2. Invention 2]
[3-2-1. Problems with invention 2]
The problem that invention 2 aims to solve is to efficiently search for similar situations similar to a target situation in a certain game space from other game spaces.
[3-2-2. Configuration of invention 2]
[A] In order to solve the above problem, an "information processing device" which is one aspect of the second invention analyzes a game control log recorded by a user terminal during game execution in association with the timeline of captured data, and A generating means for generating an index that includes at least key elements of one or more aspects recorded in the capture data, and a similar situation that refers to the index generated by the generating means and has key elements similar to query elements of the target situation. and a search means for searching.
[B] In order to solve the above problem, the “information processing device control method” which is one aspect of the second invention includes a game control log recorded by a user terminal during game execution in association with a timeline of capture data. a generation step of generating an index that includes at least key elements of one or more aspects analyzed and recorded in the captured data, and a key element similar to the query element of the target aspect by referring to the index generated in the generation step; a search step of searching for similar aspects having the same characteristics.
[C] In order to solve the above problem, a "control program" which is one aspect of the second invention analyzes a game control log recorded by a user terminal during game execution in association with the timeline of captured data, and analyzes the captured data. A generation function that generates an index that includes at least key elements of one or more aspects recorded in the data, and a similar situation that refers to the index generated by the generation function and has key elements similar to the query element of the target situation. A search function for searching is realized in a computer of an information processing device.
[D] In order to solve the above problem, the control program recorded on the "computer-readable recording medium" which is one aspect of the second invention is recorded in association with the timeline of the captured data by the user terminal during game execution. A generation function that analyzes the captured game control log and generates an index that includes at least the key elements of the single or multiple situations recorded in the captured data, and a query element of the target situation by referring to the index generated by the generation function. A search function for searching for similar aspects having key elements similar to the above is realized in a computer of an information processing device.
[3-2-3. Modification of configuration of invention 2]
The following technical limitations may be added to the "information processing device" in [A] above. Further, similar technical limitations may be added to the "control method" in [B] above, the "control program" in [C] above, and the control program recorded by the "recording medium" in [D] above.
- The generating means generates the index that includes at least the key element that can specify the first key item and the second key item in the situation recorded in the capture data, and the searching means A search is made for the similar situation having the key element similar to the query element for which a first query item and a second query item can be specified.
- The generating means generates the index including at least the key element that can further specify a key action performed from the first key item to the second key item, and the searching means generates the index that includes at least the key element that can further specify a key action performed from the first key item to the second key item, The similar situation having the key element similar to the query element that can further specify a query action performed from the item to the second query item is searched.
- The generating means generates the index that includes at least the key element that can specify the key action that displaces the object from the first key item to the second key item, and the searching means The similar situation having the key element similar to the query element that can specify the query action that displaces an object from one query item to the second query item is searched.
・Identification means for identifying the target situation by analyzing a game control log associated with specified capture data specified by the user, and advice for user operations performed in the target situation identified by the identification means. The apparatus further includes presentation means for presenting advice information in a superimposed manner on a display portion of the target situation of a replay video generated from the designated capture data.
・A specifying means for specifying the target situation by analyzing a snapshot obtained from a user terminal during game execution, and advice information indicating advice for a user operation to be performed in the target situation specified by the specifying means. The display device further includes presentation means for presenting the target aspect in a superimposed manner on the display portion.
- The presentation means presents the advice information statistically generated from key elements of similar situations searched by the search means.
- The presentation means presents the advice information that is statistically generated from key elements of reference situations that satisfy the specified criteria among the similar situations searched by the search means.
- The generating means generates the index further including a subkey element that can specify the effect of a key action performed from the first key item to the second key item, and the searching means satisfies the specified condition. The similar aspect having the subkey element indicating that an effect has been obtained is preferentially searched.
・Registration means for registering a partial video indicating the contents of a situation that can be searched by the index generated by the generation means in the distribution means and acquiring access destination information of the partial video; The apparatus further includes providing means for providing access destination information of the corresponding partial video to the user.
- Further comprising a partial image generating means for generating the partial image indicating the content of a searchable situation using the index generated by the generating means and containing no items other than items related to the key elements of the situation.
- The first key item, the second key item, the first query item, and the second query item are positions in the game space.
- The first key item, the second key item, the first query item, and the second query item are objects that exist within the game space.
[3-2-4. Effects of invention 2]
Invention 2 analyzes a game control log recorded by a user terminal during game execution in association with the timeline of captured data, and generates an index that includes at least key elements of one or more aspects recorded in the captured data. At the same time, the index is referred to and a similar situation having a key element similar to the query element of the target situation is searched.
Therefore, according to the second aspect of the invention, it is possible to efficiently search for a similar situation similar to a target situation in a certain game space from other game spaces.

10, 10a, 10b User terminal 20 Game management system 21 User management server 22 Data management server 23 Storage 30 Video management system 31 User management server 32 Registration server 33 Data management server 34 Storage 35 Search server 40 Distribution management system 41 Registration server 42 File Management server 43 Storage 44 Distribution server 50 Communication network

Claims (8)

Equipped with a processor,
The processor is configured to generate an index based on an index including the placement position of the object in the game space, which is associated with video data of the game and is generated based on a game control log that records information on the placement position of the object in the game space. , providing the user terminal with information about a game in a similar situation where the placement position is similar to an object in the game space in the target situation specified in the game being executed on the user terminal ;
the processor superimposes and presents advice information indicating advice based on a user operation performed in the similar situation on the target situation;
Information processing device. Equipped with a processor,
Arrangement positions of the first object and the second object in the game space, which are generated by the processor based on a game control log that is associated with video data of the game and records information on the arrangement positions of the objects in the game space. , information on a game in a similar situation where the first object and the second object in the game space are similar in arrangement position in the target situation specified in the game being executed on the user terminal is provided to the user terminal based on the index including the index. death,
The index includes information on an action performed from a first object toward a second object in the game space in the similar situation,
The processor provides the similar situation, which is searched based on the index, in which an action performed from a first object to a second object in the game space in the target situation is similar.
Information processing device. The processor generates the index based on the game control log, which is associated with game video data and records information on the location of objects in the game space, and includes the location of the object in the game space. providing the user terminal with information about a game in a similar situation where the placement position is similar to an object in the game space in the target situation specified in the game being executed on the user terminal;
a processor superimposes and presents advice information indicating advice based on a user operation performed in the similar situation on the target situation;
Information processing method. The processor determines the placement positions of the first object and the second object in the game space, which are associated with game video data and are generated based on a game control log that records information on the placement positions of objects in the game space. Based on the included index, information on a game in a similar situation where the first object and second object in the game space in the specified target situation in the game being executed on the user terminal are similar in arrangement position is provided to the user terminal. has a step,
The index includes information on an action performed from a first object toward a second object in the game space in the similar situation,
In the providing step, the processor provides the similar situation in which an action performed from a first object to a second object in the game space in the target situation is similar, which is searched based on the index.
Information processing method. Based on the index containing the placement position of the object in the game space, which is associated with the video data of the game and is generated based on the game control log that records information on the placement position of the object in the game space, the user terminal providing the user terminal with information about a game in a similar situation where the placement position is similar to an object in the game space in a specified target situation in the game being executed;
A program for causing a computer to execute a process of superimposing advice information on the target situation and presenting advice based on a user operation performed in the similar situation . An index containing the placement positions of the first object and the second object in the game space, which is associated with game video data and generated based on a game control log that records information on the placement positions of objects in the game space. the step of providing the user terminal with information about a game in a similar situation in which the first object and the second object in the game space in the specified target situation in the game being executed on the user terminal are similar in arrangement position based on the above information. run it,
The index includes information on an action performed from a first object toward a second object in the game space in the similar situation,
The providing step causes the computer to provide the similar situation in which an action performed from a first object to a second object in the game space in the target situation is similar, which is searched based on the index.
program. Equipped with a server and a user terminal,
The server is
Based on the index containing the placement position of the object in the game space, which is associated with the video data of the game and is generated based on the game control log that records information on the placement position of the object in the game space, the user terminal providing the user terminal with information about a game in a similar situation where the placement position is similar to an object in the game space in a specified target situation in the game being executed;
superimposing and presenting advice information indicating advice based on a user operation performed in the similar situation on the target situation;
system. Equipped with a server and a user terminal,
The server is
An index that includes the placement positions of the first object and the second object in the game space, which is associated with game video data and is generated based on a game control log that records information on the placement positions of objects in the game space. providing the user terminal with information about a game in a similar situation where the first object and the second object in the game space are similar in placement position in the target situation specified in the game being executed on the user terminal;
The index includes information on an action performed from a first object toward a second object in the game space in the similar situation,
providing the similar situation in which an action performed from a first object toward a second object in the game space in the target situation is similar, searched based on the index;
system.

Images