KR102589889B1 - Game ui analyzing method - Google Patents

Abstract

A game UI analysis method is disclosed. The analysis method includes identifying a first image corresponding to a first area included in the game UI, identifying a plurality of first objects included in the first image, and metadata for each of the plurality of first objects identified from the server. Receiving, obtaining and storing a second image reconstructed from the first image based on the received metadata, location information of the plurality of identified first objects, and the first image, and providing the stored second image. It includes a step, and the second image may include at least one of text or an icon corresponding to the information included in the metadata.

Description

Game UI analysis method {GAME UI ANALYZING METHOD}

The present invention relates to an analysis method for obtaining related information by analyzing images included in the UI of a game.

Recently, the number of users playing online games is increasing. Furthermore, the market related to E-Sports using online games is also expanding.

In E-Sports, as in general sports games, it is very important to measure and quantify each player's skills. Conventionally, in order to measure a player's individual skills, one had to rely on limited data provided by game developers, making it difficult to obtain numerical data that takes into account various aspects. Accordingly, there has been a continuous demand for a method of obtaining numerical data related to individual players' skills based on images included in the game's UI as well as data provided by game developers.

The present disclosure is in response to the above-described need, and the purpose of the present invention is to provide a game UI analysis method that obtains a reconstructed image based on the image included in the game UI and provides various information related to the user playing the game. there is.

A game UI analysis method according to an embodiment of the present invention to achieve the above object includes identifying a first image corresponding to a first area included in the game UI, a plurality of images included in the first image, Identifying a first object and receiving metadata for each of the identified plurality of first objects from a server, the received metadata, location information of the identified plurality of first objects, and the first image It may include obtaining and storing a second image reconstructed from the first image based on the first image and providing the stored second image.

Here, the second image may include at least one of text or an icon corresponding to information included in the metadata.

Here, calculating the distance between the plurality of first objects on the first image, respectively, obtaining information about the time when the distance between the plurality of first objects is less than a threshold distance based on the calculation result, It may further include obtaining and storing first information about a play type of a user playing the game based on the obtained information and the metadata, and providing a UI about the first information.

Here, the first information includes information about the degree to which the user cooperates with other users, and the UI about the first information displays the level of the user corresponding to the information included in the first information. You can.

Meanwhile, the step of acquiring and storing the second image includes identifying at least one second object included in the first image, the received metadata, location information of the identified plurality of first objects, the A second image reconstructed from the first image is obtained and stored based on the first image and location information of at least one identified second object, and the game UI analysis method includes: Calculating a distance between a first object and the at least one second object, information about a time when the distance between the plurality of first objects and the at least one second object is less than a threshold distance based on the calculation result Obtaining and storing second information about the play level of a user playing the game based on the obtained information and the metadata, and a UI related to the first information and the second information A step of providing a related UI may be further included.

Here, the second information includes information about the extent to which the user contributed to the game result, and the UI regarding the second information may display the user's level corresponding to the information included in the second information. there is.

Meanwhile, based on information about the time when the distance between the plurality of first objects is less than the critical distance and information about the time when the distance between the plurality of first objects and the at least one second object is less than the critical distance, a third It may further include obtaining information and providing a UI regarding the first information, a UI regarding the second information, and a UI regarding the third information.

Here, the plurality of first objects may be characters controlled by a user playing the game, and the at least one second object may be a structure whose position is fixed in space within the game.

Meanwhile, if at least one object among the plurality of first objects disappears or overlaps with another object, location information of the at least one object is provided based on at least one of location information included in the metadata or previously acquired location information. It may further include an acquisition step.

In addition, the step of receiving the metadata includes inputting the first image into a first neural network model to identify the plurality of first objects, and the first neural network model identifies the objects included in the image when the image is input. It may be a model learned to output information about.

Meanwhile, a program stored in a recording medium according to an embodiment of the present invention for performing a game UI analysis method identifies a first area included in a game UI provided through a display, and stores the first area in the identified first area. Identifying a corresponding first image, identifying a plurality of first objects included in the first image, and receiving metadata corresponding to each of the identified plurality of first objects from a server, the received It may include obtaining and storing a second image based on metadata, location information of the identified plurality of first objects, and the first image, and outputting the obtained second image through the display. there is.

Here, the second image may include at least one of text or an icon corresponding to information included in the metadata.

According to various embodiments of the present disclosure, various information obtained based on images included in the game UI as well as data provided by the game developer can be provided, thereby providing more quantitative information about the play of E-Sports players and general users. analysis becomes possible.

Figure 1 is a diagram for explaining a general game UI.
Figure 2 is a flowchart for explaining a game UI analysis method according to an embodiment of the present disclosure.
Figure 3 is a diagram for explaining an image to be analyzed according to an embodiment of the present disclosure.
FIG. 4 is a diagram illustrating identification of a plurality of first objects and acquisition of location information of the plurality of first objects according to an embodiment of the present disclosure.
Figure 5 is a diagram for explaining a distance identification operation between a plurality of first objects according to an embodiment of the present disclosure.
FIG. 6 is a diagram for explaining a distance identification operation between a first object and a second object according to an embodiment of the present disclosure.
Figure 7 is a diagram for explaining a new image reconstructed from an analysis target image according to an embodiment of the present disclosure.
FIG. 8 is a diagram illustrating a method of providing various information obtained based on an image included in a game UI according to an embodiment of the present disclosure.
Figure 9 is a block diagram showing the configuration of an electronic device for performing a game UI analysis method according to an embodiment of the present disclosure.

Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

The terms used in the embodiments of the present disclosure have selected general terms that are currently widely used as much as possible while considering the functions in the present disclosure, but this may vary depending on the intention or precedent of a technician working in the art, the emergence of new technology, etc. . In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description part of the relevant disclosure. Therefore, the terms used in this disclosure should be defined based on the meaning of the term and the overall content of this disclosure, rather than simply the name of the term.

In the present disclosure, expressions such as “have,” “may have,” “includes,” or “may include” refer to the presence of the corresponding feature (e.g., component such as numerical value, function, operation, or part). , and does not rule out the existence of additional features.

The expression at least one of A or/and B should be understood as referring to either “A” or “B” or “A and B”.

Expressions such as “first,” “second,” “first,” or “second,” used in the present disclosure can modify various components regardless of order and/or importance, and can refer to one component. It is only used to distinguish from other components and does not limit the components.

A component (e.g., a first component) is “(operatively or communicatively) coupled with/to” another component (e.g., a second component). When referred to as “connected to,” it should be understood that a certain component can be connected directly to another component or connected through another component (e.g., a third component).

Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “consist of” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are intended to indicate the presence of one or more other It should be understood that this does not exclude in advance the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

In the present disclosure, a “module” or “unit” performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Additionally, a plurality of “modules” or a plurality of “units” are integrated into at least one module and implemented by at least one processor (not shown), except for “modules” or “units” that need to be implemented with specific hardware. It can be.

In this disclosure, the term user may refer to a person who uses an electronic device. Hereinafter, an embodiment of the present disclosure will be described in more detail with reference to the attached drawings.

In this specification, ‘user’ may mean a person who plays the game.

Figure 1 is a diagram for explaining a general game UI.

Figure 1 shows the UI (User Interface) of a specific game (League of Legends™). The game is played in such a way that multiple users are assigned to two different teams and compete against the opposing team through characters they each control, and the team that achieves certain conditions wins. Specifically, the game can be played in such a way that two different teams contain multiple structures in each team's camp, and the team that achieves the condition of destroying the structures included in the opposing team's camp wins.

Here, UI generally refers to a physical or virtual medium created for the purpose of temporary or permanent access to enable communication between users and objects or systems, especially machines, computer programs, etc., but in the present disclosure, UI refers to a specific Assuming that this is a screen that provides visual information about the game to the user, we will explain a series of operations included in the game UI analysis method.

The game UI 100 may include various visual information. Here, the game UI 100 may include visual information corresponding to a part of the space within the game, and specifically, the game UI 100 includes characters 11-1, 11-2, structures 21, and mini-games. It may include visual information corresponding to the map (mini map) area 110 and the status indication area 120.

Here, the characters 11-1 and 11-2 may be objects that the user can control in the game. Users can control the character through input means (mouse, keyboard, etc.). Specifically, users can change the character's position in in-game space or control the character to take specific actions.

The structure 21 may include a geographical feature, structure, or workpiece arranged at a certain location in the space within the game. The structure 21 according to one example may be a turret that attacks a character controlled by a user of the opposing team.

The mini map area 110 may be an area where a mini map that displays a reduced space within the game is provided. Here, the mini map area 110 may include images of a plurality of characters 11-1 and 11-2 and structures.

The status indication area 120 may be an area that displays the status of each character. Specifically, the status indication area 120 may be an area that displays information about the character's abilities, resources, vitality, belongings, etc.

Hereinafter, various embodiments of obtaining a reconstructed image based on an image included in a game UI and providing various information related to a user playing the game will be described in more detail.

Figure 2 is a flowchart for explaining a game UI analysis method according to an embodiment of the present disclosure.

The game UI analysis method according to an embodiment of the present disclosure can identify the first image 110 corresponding to the first area included in the game UI 100 (S210). Here, the first area may be the mini map area described above.

Specifically, the step of identifying the first image 110 (S210) involves inputting the image corresponding to the game UI 100 into a neural network model to identify the first image 110 corresponding to the mini map area 110. You can.

Here, the neural network model is characterized as being created through learning. Here, being created through learning means that a basic neural network model is learned using a large number of learning data by a learning algorithm, thereby creating a predefined operation rule or neural network model set to perform the desired characteristics (or purpose). . This learning may be performed on the device itself that performs the artificial intelligence according to the present disclosure, or may be performed through a separate server and/or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.

Additionally, each neural network model may be composed of multiple neural network layers. Each of the plurality of neural network layers has a plurality of weight values, and neural network calculation is performed through calculation between the calculation result of the previous layer and the plurality of weights. The plurality of weights possessed by the plurality of neural network layers can be optimized based on the learning results of the neural network model. For example, a plurality of weights may be updated so that loss or cost values obtained from the neural network model are reduced or minimized during the learning process. Artificial neural networks may include deep neural networks (DNN), for example, Convolutional Neural Network (CNN), Deep Neural Network (DNN), Recurrent Neural Network (RNN), Restricted Boltzmann Machine (RBM), Deep Belief Network (DBN), Bidirectional Recurrent Deep Neural Network (BRDNN), or Deep Q-Networks, etc., but are not limited to the examples described above.

Next, the game UI analysis method may identify a plurality of first objects included in the first image 110 and receive metadata for each of the plurality of identified first objects from the server (S220).

Here, the first object may be a character controlled by a user playing the game, as described above. In identifying the first object, a neural network model may be used as in the case of identifying the first image 110.

Specifically, in the step of identifying the first object and receiving metadata about it (S220), a plurality of first objects may be identified by inputting the first image 110 into a first neural network model, where the first neural network The model may be a model learned to output information about objects included in the image when an image is input.

Meanwhile, metadata for each of the plurality of first objects is data stored in the server, and metadata according to one example includes information about the character, ID of the user controlling the character, information about events that occurred during the game progress, and game May contain information about service status.

More specifically, metadata may include information related to events such as a specific character destroying a specific structure, a specific character defeating another character, or a specific character installing a specific type of workpiece.

Subsequently, the game UI analysis method may obtain and store a second image reconstructed from the first image 110 based on the received metadata, location information of the plurality of identified first objects, and the first image 110. (S230).

Specifically, since the first image 110 may be an image with poor visibility, a second image reconstructed from the first image 110 can be obtained based on the received metadata and the location information of the first object. . Here, reconstruction may include a processing process that changes the size and shape of objects included in the image.

Additionally, the second image may include at least one of text or icons corresponding to information included in metadata. For example, the second image may include text or an icon corresponding to information related to an event, such as a specific character defeating another character or a specific character installing a certain type of workpiece. More specifically, the icon included in the second image has a shape that corresponds to the type of event that occurs in the game, and the text included in the second image may include content indicating information about the time the event occurred. You can.

Finally, the game UI analysis method may provide a stored second image (S240). Here, the method of providing may include providing images through a display or transmitting image files using electrical communication.

Here, the game UI analysis method according to an example calculates the distance between a plurality of first objects on the first image 110 based on the location information of each of the plurality of first objects, and based on the calculation result, a plurality of first objects are calculated. Information about the time when the distance between the first objects is less than the threshold distance can be obtained. Next, based on the obtained information and metadata, first information about the play type of the user playing the game may be obtained and stored.

In the above, it was explained that the distance between a plurality of first objects on the first image 110 is calculated, but the game UI analysis method according to another example calculates the distance between the first objects on the acquired first image 110. You can.

Here, the first information may be information about the degree to which the user plays the game in cooperation with other users belonging to the same team (hereinafter referred to as cooperation). Specifically, the longer the distance between the character played by a specific user belonging to the same team and the character played by another user is less than the critical distance, the more closely the users playing the two characters can be judged to have played the game in cooperation. , In this case, the game UI analysis method may obtain first information based on information about the time when the distance between the plurality of first objects is less than the threshold distance.

Additionally, the game UI analysis method according to one example may provide UI regarding the obtained first information. Here, the UI regarding the first information may display the level of the user corresponding to the cooperation of each user. Specifically, the UI regarding the first information may display the level corresponding to cooperation as 'High' when a specific user's cooperation is high, and display the level corresponding to cooperation as 'Low' when the cooperation of a specific user is low. Additionally, the UI regarding the first information can not only display the level in text format, but can also display the level using visual elements such as a bar graph.

Meanwhile, the step of acquiring and storing the second image (S230) identifies at least one second object included in the first image 110, receives metadata, and location information of the plurality of identified first objects. , A second image reconstructed from the first image 110 may be obtained and stored based on the first image 110 and the location information of at least one identified second object. Here, at least one second object may be a structure whose location is fixed in space within the game.

Specifically, when the first object is a character controlled by a user playing the game, the second object may include a plurality of structures corresponding to each of the plurality of characters. In one example, a character may be located in a space adjacent to a structure corresponding to the character for a significant amount of time or more during the game.

In addition, a game UI analysis method according to an example includes calculating a distance between a plurality of first objects and at least one second object on the first image 110, and calculating a distance between the plurality of first objects and at least one second object based on the calculation result. Obtaining information about a time when the distance between one second object is less than a threshold distance, obtaining and storing second information about the play level of a user playing the game based on the obtained information and metadata, and It may further include providing a UI regarding the first information and a UI regarding the second information.

In the above, it has been described as calculating the distance between a plurality of first objects and at least one second object on the first image 110, but the game UI analysis method according to another example calculates the distance between the plurality of first objects and at least one second object on the first image 110. The distance between the first object and the second object can be calculated.

Here, the second information may be information about the degree to which a specific user contributed to the game results (hereinafter referred to as activity level) evaluated according to a set standard. Specifically, if the second object according to one example is a turret that attacks a character controlled by the user of the opposing team, a character located for a long time close to the turret included in the team's camp is used during the game. Since the user who played may be evaluated as having low activity level in the game, in this case, the game UI analysis method is based on information about the time when the distance between the plurality of first objects and at least one second object is less than the threshold distance. 2 Information can be obtained.

Here, the UI regarding the second information may display the user's level corresponding to each user's activity level. Specifically, the UI regarding the second information may display the level corresponding to the activity level as 'High' when the activity level of a specific user is high, and display the level corresponding to the activity level as 'Low' when the activity level of the specific user is low. Additionally, the UI regarding the second information can not only display the level in text format, but can also display the level using visual elements such as a bar graph.

In addition, the game UI analysis method is based on information about the time when the distance between the plurality of first objects is less than the critical distance and information about the time when the distance between the plurality of first objects and at least one second object is less than the critical distance. Third information can be obtained. Here, the third information may be information about the degree to which a specific user received help from users belonging to the same team.

Specifically, the game UI analysis method according to one example may identify the level corresponding to the cooperation of a specific user based on the first information, but the first information is simply that the distance between the plurality of first objects is less than the threshold distance. As information obtained based on information about time, information about which user was in a position to provide help or to receive help is not included in the first information.

In this case, the game UI analysis method according to an example corresponds to each of the users who helped other users or the users who received help from other users based on information about the time when the distance between the first object and the second object was less than the threshold distance. Third information that can be obtained can be obtained.

Specifically, the plurality of first objects according to an example include a character a controlled by a user A and a character b controlled by a user B, and the second object includes a structure c corresponding to character a and a character b corresponding to character b. When the structure d is included, the game UI analysis method is that if the two characters a and b are separated by less than a critical distance, the user controlling the character that is more than a critical distance away from the structure corresponding to the character moves away from the structure corresponding to the character. It can be judged that this helps the user in controlling characters that are less than the critical distance away.

For example, for a specific time, the positions of character a and character b were separated by less than a critical distance, and at the same time, character a and structure c were separated by less than a critical distance, and character b and structure d were separated by more than a critical distance. The third information according to may include information indicating that user B helped user A during a specific time.

On the other hand, if the positions of character a and character b are separated by less than a critical distance during a specific time, and at the same time, character a and structure c are separated by more than the critical distance, and character b and structure d are separated by less than the critical distance, according to an example. The third information may include information indicating that user A helped user B during a specific time.

Additionally, the game UI analysis method according to one example may provide UI regarding the acquired third information. This will be explained in detail in FIG. 8.

Meanwhile, in the game UI analysis method according to an example, when at least one object among a plurality of first objects disappears or overlaps with another object, at least one object is analyzed based on at least one of location information included in metadata or previously acquired location information. The step of acquiring location information of the object may be further included.

In one example, various characters that appear in a game (League of Legends™) may disappear from space within the game for a certain period of time when their life force is exhausted. According to one example, if the first object is a character, the character whose vitality has been exhausted and disappears from the game space for a certain period of time may not be identified in the first image 110. In this case, the game UI analysis method identifies a character whose vitality has been exhausted and disappeared for a certain period of time in the space within the game based on metadata received from the server as being located at a preset point on the first image 110 or the first image 110. It can be identified as not being present in the image 110.

Meanwhile, when images corresponding to a plurality of characters included in the first image 110 overlap each other, some of the overlapping characters may not be identified. In this case, the game UI analysis method can obtain location information on a character that overlaps with another character based on location information on the unidentified character obtained before the character overlaps with another character.

Specifically, the game UI analysis method according to one example identifies the unidentified character as stopping at the position of the character acquired before the character overlaps with another character during the time it overlaps with the other character, and When the overlap with another character is resolved and the character is newly identified, it can be identified as having moved from the location of the character acquired before it overlapped with another character to the newly identified location.

Figure 3 is a diagram for explaining an image to be analyzed according to an embodiment of the present disclosure.

Referring to FIG. 3, a first image 110, which is an image to be analyzed in a game UI analysis method according to an example, is shown. The first image 110 may include a rectangular shape 111, and the shape 111 according to one example may be an area corresponding to a screen on which a game UI provides visual information about a specific game to the user. .

The first image 110 according to one example may be an image displaying a mini map corresponding to the game space. The first image 110 may include a plurality of objects, where the plurality of objects may include characters controlled by a user playing the game and structures whose positions are fixed in space within the game. However, the object may also include moving objects other than characters and various types of workpieces that the character can create.

As described above, the game UI analysis method according to an example can identify the first image 110 corresponding to the mini-map area on the game UI 100, and in this case, a neural network model can be used. Meanwhile, the game UI analysis method may identify the first image 110 based on edge information about the game UI 100.

Specifically, the game UI analysis method may identify the first image 110 based on an image captured through a camera of the game UI 100 provided through a display, and may identify a program installed on an electronic device running the game. The first image 110 may be identified by obtaining information corresponding to the first image 110.

According to one example, a game (League of Legends??) may provide a UI that includes a mini map area at the bottom of the screen. A game UI analysis method according to an example can identify edge information that distinguishes a mini-map area from other areas on the screen and identify the first image 110 based on the edge. Additionally, the game UI analysis method may identify the first image 110 based on the unique pixel information of the mini-map area or the motion information of a plurality of objects included in the mini-map area, in addition to edge information.

FIG. 4 is a diagram illustrating identification of a plurality of first objects and acquisition of location information of the plurality of first objects according to an embodiment of the present disclosure.

The game UI analysis method according to an embodiment of the present disclosure can identify a plurality of first objects included in the first image 110 and obtain location information of the identified first objects. Here, the first object may be a character controlled by a user playing the game.

Specifically, the game UI analysis method according to an example may identify a plurality of first objects by inputting the first image 110 into a first neural network model, where the first neural network model It may be a model trained to output information about the presence of the included character, the character's name, and the team the character belongs to.

Referring to FIG. 4, in the character recognition result image 400, at the bottom right of the first image 110, two characters (11-1, 12-1) belonging to different teams and their names (AA, FF) are displayed. Text corresponding to may be included.

A game UI analysis method according to an example can obtain location information corresponding to an identified character, where the location information includes the name of the character (Character_name), the relative X coordinate of the character (Relative_center_x), and the relative Y coordinate of the character (Relative_center_y ), the relative width of the character (Relative_width), and the relative height of the character (Relative_height).

Specifically, the character's relative For example, based on the lower left corner of the first image 110, the character AA (11-1) may have a relative X coordinate value of 0.8 and a relative Y coordinate value of 0.1. Meanwhile, the character BB (12-1) may have a relative X coordinate value of 0.85 and a relative Y coordinate value of 0.15.

Meanwhile, the relative width according to one example may mean the ratio of the horizontal length of the circular image corresponding to the character compared to the horizontal length of the first image 110. The relative height may mean the ratio of the vertical length of the circular image corresponding to the character compared to the vertical length of the first image 110. According to one example, the relative width and relative height of all characters may have a value of 0.05.

Figure 5 is a diagram for explaining a distance identification operation between a plurality of first objects according to an embodiment of the present disclosure.

Referring to FIG. 5, two characters (11-1, 11-2) belonging to the first team whose camp is located at the bottom left of the first image 110 and the second team whose camp is located at the top right of the first image 110 Two characters (12-1, 12-2) belonging to the team are shown.

A game UI analysis method according to an example includes obtaining location information for each of the two characters (11-1, 11-2) belonging to the first team and the two characters (12-1, 12-2) belonging to the second team, Based on the acquired plurality of location information, the distance between two characters belonging to the same team can be calculated.

According to the calculation results, the distance 510 between the two characters 11-1 and 11-2 belonging to the first team at the time shown in FIG. 5 may be greater than or equal to the critical distance. Meanwhile, the distance 520 between the two characters 12-1 and 12-2 belonging to the second team may be less than the critical distance. In one example, the game UI analysis method identifies the two characters (11-1, 11-2) belonging to the first team as not cooperating with each other, and the two characters (12-1, 12-2) belonging to the second team. ) can be identified as a state of cooperation.

In this case, the game UI analysis method acquires information about the identified time when the two characters (12-1, 12-2) belonging to the second team are cooperating, and the obtained information and the two characters belonging to the second team Based on the metadata corresponding to (12-1, 12-2), information about the play types of users who play the two characters (12-1, 12-2) belonging to the second team can be obtained and stored.

A game UI analysis method according to an example can identify users who play characters identified as cooperative with each other for a longer period of time as having a play type with a higher cooperativeness level.

FIG. 6 is a diagram for explaining a distance identification operation between a first object and a second object according to an embodiment of the present disclosure.

Referring to FIG. 6, the first image 110 may include two characters (11-1, 12-1) belonging to different teams and two structures (21-1, 22-1) corresponding to each character. You can. Here, the structures (21-1, 22-1) may be turrets that attack the characters (11-1, 12-1) controlled by the user of the opposing team. Specifically, the turret (21-1) belonging to the first team can attack the character (12-1) belonging to the second team, and the turret (22-1) belonging to the second team can attack the character (12-1) belonging to the first team. 11-1) can be attacked.

A game UI analysis method according to an example identifies a plurality of characters (11-1, 12-1) and at least one turret (21-1, 22-1) on the first image 110, and identifies a plurality of characters ( The distance between 11-1, 12-1) and at least one turret (21-1, 22-1) can be calculated respectively.

To this end, the game UI analysis method can identify turrets using a neural network model, similar to when identifying characters. Here, the neural network model may be a model learned to output information about the existence of a turret included in the image and the team to which the turret belongs when an image is input.

Additionally, the game UI analysis method can identify that the distance between the character and the turret is less than the critical distance when the character is located in an area with a certain range based on the identified turret. In one example, the area may be a rectangular area with a certain range based on the turret.

According to the calculation results, the distance between the character 11-1 belonging to the first team and the corresponding turret 21-1 at the time shown in FIG. 6 may be less than the critical distance. Meanwhile, the distance between the two characters (12-1) belonging to the second team and the corresponding turret (22-1) may be greater than or equal to the critical distance. In one example, the game UI analysis method determines that the user controlling the character (11-1) belonging to the first team contributed little to the game result, and the user controlling the character (12-1) belonging to the second team It can be judged to have greatly contributed to the outcome of the game.

In one example, the game UI analysis method can identify users who are judged to have contributed significantly to the game results as having a higher activity level.

Figure 7 is a diagram for explaining a new image reconstructed from an analysis target image according to an embodiment of the present disclosure.

Referring to FIG. 7, a second image 210 is shown by reconstructing the first image 110. Specifically, the second image 210 is based on location information of a plurality of characters identified as included in the first image 110, metadata corresponding to each of the identified plurality of characters, and the first image 110. It may be a reconstructed image of the first image 110.

According to one example, the size of characters included in the second image 210 may be smaller than that of the first image 110. Accordingly, in the second image 210, the phenomenon of characters overlapping with each other can be minimized, and even minute movements of the characters can be easily visually identified.

The game UI analysis method according to one example may store the obtained second image 210 and provide it to the user. Here, the method of providing may include providing images through a display or transmitting image files using electrical communication.

In FIG. 7, the second image 210 includes only the character and terrain features placed at a certain location in the space within the game, but the second object included in the first image 110, such as a turret, is also included in the second image ( 210), of course.

Additionally, although not shown in FIG. 7, the second image 210 may include at least one of text or an icon corresponding to information included in metadata. This not only makes it easier for users to visually identify the character's movements, but also provides real-time information about various events triggered by the character within the game.

FIG. 8 is a diagram illustrating a method of providing various information obtained based on an image included in a game UI according to an embodiment of the present disclosure.

FIG. 8 shows an image 800 in which various information obtained based on information about various objects included in the first image 110 is provided in a visual manner.

Image 800 according to one example may include information corresponding to a plurality of users controlling three different characters (801, 802, and 803). Specifically, information corresponding to multiple users may include information related to cooperation (810), information related to activity level (820), and information related to the degree of help received from users belonging to the same team (830).

According to one example, information related to the degree 830 of help received from users belonging to the same team may be expressed as a percentage. Specifically, if five users belong to a team, the percentages corresponding to the degree of help (830) for each of the five users can be added together to add up to 100%.

Additionally, this may mean that the user with the highest percentage corresponding to the degree of help received (830) received the most help from users belonging to the same team. Meanwhile, the cooperation 810 and activity level 820 are the same as described above, and according to one example, the cooperation 810 and activity level 820 may be expressed in the form of a bar graph indicating the level with a scale.

The game UI analysis method according to an embodiment of the present disclosure may assign a score to each user's play based on the cooperation (810), activity level (820), and degree of help received (830) corresponding to each user. .

According to one example, a score may be given based on the sum of the levels of cooperation (810) and activity (820) and a percentage corresponding to the degree of help received (830).

Specifically, the user controlling character XX (801) may have played with level '4' cooperation and activity level of '2'. Meanwhile, the user controlling character XX (801) received 15% help from users on the same team, so considering that he received relatively less help than other users, the score for that user's play was It can be granted.

Meanwhile, the user controlling character YY (802) may have played with '2' level cooperation and '3' level activity. Since the user received 25% of help from users on the same team, the fact that he received relatively more help compared to other users and the level of cooperation (810) and activity (820) added to character XX ( Considering that the level of cooperation (810) and activity (820) of the user controlling character XX (801) is lower than the sum of the levels, the score for that user's play is lowered than the score for the play of the user controlling character XX (801). It can be given relatively low.

According to the game UI analysis method described above, even if multiple users play with the same cooperation (810) and activity level (820), if the degree of assistance received (830) is different, the scores for the multiple users' play Since it is possible to assign differentially, it is possible to determine which user played better.

Figure 9 is a block diagram showing the configuration of an electronic device for performing a game UI analysis method according to an embodiment of the present disclosure.

The above-described game UI analysis method can be performed by the electronic device 900. To this end, the electronic device 900 according to an example may include an image recognition unit 910, an object recognition unit 920, a metadata fusion unit 930, an information acquisition unit 940, and an image acquisition unit 950. You can.

Here, the plurality of components 910 to 950 included in the electronic device 900 are a plurality of modules related to the functional configuration of the electronic device 900. Specifically, the plurality of modules 910 to 950 according to one example may be software modules stored in a memory (not shown) of the electronic device 900 or hardware modules implemented in circuitry on the electronic device 900. Alternatively, each of the plurality of modules may be implemented as a combination of software and hardware.

Meanwhile, functions corresponding to a plurality of modules may be performed by a processor (not shown), which is a component of the electronic device 900.

The image recognition unit 910 according to an embodiment of the present disclosure is a module that identifies the first image 110 corresponding to the mini-map area included in the game UI 100. The image recognition unit 910 according to one example may identify the first image 110 using a neural network model. Meanwhile, the image recognition unit 910 may identify the first image 110 based on edge information about the game UI 100.

Specifically, the image recognition unit 910 may identify the first image 110 based on an image captured by a camera of the game UI 100 provided through the display, and the electronic device 900 on which the game runs ) The first image 110 may be identified by obtaining information corresponding to the first image 110 through a program installed in the program.

The object recognition unit 920 according to an embodiment of the present disclosure is a module that can identify a plurality of first objects and at least one second object included in the first image 110. Here, the first object may be a character controlled by a user playing the game, and the second object may be a structure whose location is fixed in space within the game.

The object recognition unit 920 according to an example may identify a plurality of first objects and at least one second object included in the first image 110 using a neural network model. Here, the neural network model may be a model learned to output information about the first object and the second object included in the image when an image is input.

The metadata fusion unit 930 according to an embodiment of the present disclosure receives metadata about the first object and the second object identified from the server, and combines the received metadata with information about the object corresponding to the metadata. This is a module that can be matched and saved.

Specifically, the meta data fusion unit 930 according to an example receives meta data corresponding to each object based on the information about the object acquired by the object recognition unit 920, and collects information about the object and the corresponding object. The metadata can be matched and stored.

The information acquisition unit 940 according to an embodiment of the present disclosure is a module that can acquire first information, second information, or third information.

The information acquisition unit 940 according to an example calculates the distance between the plurality of first objects on the first image 110 based on the position information of each of the plurality of first objects, and calculates the distance between the plurality of first objects based on the calculation result. Information about the time when the distance between the first objects is less than the threshold distance can be obtained. Next, the information acquisition unit 940 may obtain and store first information about the play type of the user playing the game based on the acquired information and metadata corresponding to each of the plurality of first objects.

In addition, the information acquisition unit 940 according to an example calculates the distance between a plurality of first objects and at least one second object on the first image 110, and based on the calculation result, determines the distance between the plurality of first objects and the at least one second object. Information about the time when the distance between at least one second object is less than the threshold distance can be obtained. Next, the information acquisition unit 940 may obtain and store second information about the play level of the user playing the game based on the acquired information and metadata corresponding to each of the plurality of first objects.

In addition, the information acquisition unit 940 according to an example may provide information about the time when the distance between the plurality of first objects is less than the threshold distance and the time when the distance between the plurality of first objects and at least one second object is less than the threshold distance. Third information can be obtained and stored based on information about.

The image acquisition unit 950 according to an embodiment of the present disclosure is a module that can acquire and provide a second image 210 that is a reconstructed image of the first image 110. Specifically, the second image 210 includes location information of a plurality of first objects identified as included in the first image 110, metadata corresponding to each of the identified plurality of first objects, and the first image 110 ) may be an image reconstructed from the first image 110 based on .

In the second image 210 according to an example, the size of the first object included in the image may be smaller than that of the first image 110. Accordingly, in the second image 210, the phenomenon of first objects overlapping with each other can be minimized, and even minute movements of the first object can be easily visually identified.

The image acquisition unit 950 according to one example may store the acquired second image 210 and provide it to the user. Here, the method of providing may include providing images through a display or transmitting image files using electrical communication.

Furthermore, of course, a second object included in the first image 110, such as a structure whose position is fixed in space within the game, may also be included in the second image 210.

Meanwhile, the methods according to various embodiments of the present disclosure described above may be implemented in the form of applications that can be installed on the existing electronic device 900.

Additionally, the methods according to various embodiments of the present disclosure described above may be implemented only by upgrading software or hardware for the existing electronic device 900.

Additionally, the various embodiments of the present disclosure described above can also be performed through an embedded server provided in the electronic device 900 or at least one external server.

Meanwhile, the various embodiments described above may be implemented in a recording medium that can be read by a computer or similar device using software, hardware, or a combination thereof. According to software implementation, embodiments such as procedures and functions described in this specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

Meanwhile, computer instructions for performing the game UI analysis method according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium.

A non-transitory computer-readable medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as registers, caches, and memories. Specific examples of non-transitory computer-readable media may include CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, etc.

In the above, preferred embodiments of the present disclosure have been shown and described, but the present disclosure is not limited to the specific embodiments described above, and may be used in the technical field pertaining to the disclosure without departing from the gist of the disclosure as claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be understood individually from the technical ideas or perspectives of the present disclosure.

100: Game UI 110: First image
210: second image 900: electronic device
910: Image recognition unit 920: Object recognition unit
930: Metadata fusion unit 940: Information acquisition unit
950: Image acquisition unit

Claims (10)

In the game UI analysis method,
Identifying a first mini-map image corresponding to a first area of a mini-map representing an in-game space included in a game UI through an image recognition unit;
Identifying a plurality of first objects included in the first mini-map image through an object recognition unit;
Identifying location information of the plurality of first objects on the mini map through an information acquisition unit;
Receiving metadata for each of the identified plurality of first objects from a server through a metadata fusion unit;
Based on the received metadata, location information on the mini-map of the identified plurality of first objects, and the first mini-map image Reconstructing the first mini-map image through an image acquisition unit to identify a second object whose position and movement on the mini-map correspond to the position and movement on the mini-map of the first object included in the first mini-map image step;
Based on the information about the time when the distance between the plurality of first objects is less than the threshold distance or the information about the time when the distance between the plurality of first objects and at least one second object is less than the threshold distance through the information acquisition unit, the user Obtaining at least one of first information about cooperation, second information about user contribution, and third information about help between users;
Obtaining and storing a second mini-map image including text and a GUI indicating the state of the first object; and
It includes outputting the stored second mini-map image through a display,
The second mini map image is,
Among the first mini-map images, an area where the first object can be located is displayed in a first color, and an area where the first object cannot be located is displayed in a second color, and the information included in the metadata Contains at least one of the corresponding text or icons,
The first object and the second object are,
It corresponds to the character controlled by the user in the in-game space,
The relative size of the second object included in the second mini map image compared to the second mini map is,
A game UI analysis method having a value smaller than the relative size of the first object included in the first mini-map image compared to the first mini-map. According to paragraph 1,
Obtaining at least one of the first information about the cooperation of the users, the second information about the contribution of the users, and the third information about the help between users,
calculating distances between the plurality of first objects on the first mini-map image;
Obtaining information about a time when the distance between the plurality of first objects is less than a threshold distance based on the calculation result;
Obtaining and storing first information about a play type of a user playing a game based on the obtained information and the metadata; and
A game UI analysis method further comprising providing a UI related to the first information. According to paragraph 2,
The first information is,
Contains information regarding the extent to which said user cooperates with other users;
The UI related to the first information is,
A game UI analysis method that displays the level of the user corresponding to the information included in the first information. According to paragraph 2,
The step of obtaining and storing the second mini-map image includes:
Identifying at least one second object included in the first mini-map image,
The first mini-map image is reconstructed based on the received metadata, location information of the plurality of identified first objects, location information of the identified at least one second object, and the first mini-map image. 2 Obtain and save the mini map image,
Obtaining at least one of the first information about the cooperation of the users, the second information about the contribution of the users, and the third information about the help between users,
calculating a distance between the plurality of first objects and the at least one second object on the first mini-map image;
Obtaining information about a time when a distance between the plurality of first objects and the at least one second object is less than a threshold distance based on the calculation result;
Obtaining and storing second information about a play level of a user playing the game based on the obtained information and the metadata; and
A game UI analysis method further comprising providing a UI regarding the first information and a UI regarding the second information. According to paragraph 4,
The second information is,
Contains information regarding the extent to which said user contributed to the outcome of the game,
The UI related to the second information is,
A game UI analysis method that displays the level of the user corresponding to the information included in the second information. According to paragraph 1,
Obtaining at least one of the first information about the cooperation of the users, the second information about the contribution of the users, and the third information about the help between users,
Third information based on information about the time when the distance between the plurality of first objects is less than the threshold distance and information about the time when the distance between the plurality of first objects and the at least one second object is less than the threshold distance acquiring; and
A game UI analysis method further comprising providing a UI for the first information, a UI for the second information, and a UI for the third information. According to paragraph 4,
The plurality of first objects are characters controlled by a user playing the game,
A game UI analysis method, wherein the at least one second object is a structure whose position is fixed in space within the game. According to paragraph 1,
When at least one object among the plurality of first objects disappears or overlaps with another object, obtaining location information of the at least one object based on at least one of location information included in the metadata or previously acquired location information. Game UI analysis method further comprising steps; According to paragraph 1,
The step of receiving the metadata is,
Identifying the plurality of first objects by inputting the first mini-map image into a first neural network model,
The first neural network model is,
A game UI analysis method, which is a model learned to output information about objects included in the mini-map image when a mini-map image is input. In a recording medium storing a program for performing a game UI analysis method,
How to analyze game UI:
Identifying a first mini-map image corresponding to a first area of a mini-map representing an in-game space included in a game UI through an image recognition unit;
Identifying a plurality of first objects included in the first mini-map image through an object recognition unit;
Identifying location information of the plurality of first objects on the mini map through an information acquisition unit;
Receiving metadata for each of the identified plurality of first objects from a server through a metadata fusion unit;
Reconstructing the first mini-map image through an image acquisition unit based on the received metadata, location information on the mini-map of the plurality of identified first objects, and the first mini-map image to a first mini-map image identifying a second object whose location and movement on the mini-map correspond to the location and movement on the mini-map of an included first object;
Based on the information about the time when the distance between the plurality of first objects is less than the threshold distance or the information about the time when the distance between the plurality of first objects and at least one second object is less than the threshold distance through the information acquisition unit, the user Obtaining at least one of first information about cooperation, second information about user contribution, and third information about help between users;
Obtaining and storing a second mini-map image including text and a GUI indicating the state of the first object; and
It includes outputting the stored second mini-map image through a display,
The second mini map image is,
Among the first mini-map images, an area where the first object can be located is displayed in a first color, and an area where the first object cannot be located is displayed in a second color, and the information included in the metadata Contains at least one of the corresponding text or icons,
The first object and the second object are,
It corresponds to the character controlled by the user in the in-game space,
The relative size of the second object included in the second mini map image compared to the second mini map is,
A recording medium having a value smaller than the relative size of the first object included in the first mini map image compared to the first mini map.

Images