KR20220127452A - Virtual game system with artificial intelligence of cooperation, energy, and guide - Google Patents

Abstract

An apparatus and a method for controlling a virtual player are disclosed. According to one embodiment of the present invention, the method includes the steps of: controlling a first type of virtual player so that the first type of virtual player plays a cooperative role with a game user in a game; controlling a second type of virtual player when a first condition set in the game is satisfied so that the second type of virtual player plays a guide role for the game user in the game; and controlling a third type of virtual player when a second condition set in the game is satisfied so that the third type of virtual player plays a hostile role to the game user in the game.

Description

Virtual game system with artificial intelligence of cooperation, energy, and guide}

The embodiments below relate to a technique for controlling a virtual game player.

A user who newly enters the game can play the game in an isolated state without forming a relationship with other users. In this case, a user newly entering the game may leave early without feeling the fun of the game. . As a related prior art, there is Korean Patent Application Laid-Open No. 10-2017-0073059 (Title of the Invention: A game artificial intelligence system and an artificial intelligence implementation method of a game character using the same, Applicant: Sejong University Industry-Academic Cooperation Foundation). The game artificial intelligence system disclosed in the corresponding published patent publication stores an execution environment dataset related to the execution environment of the game, a behavioral data set related to the behavior of a game character, and a reward data set related to a reward value for the behavior of the game character, When the game is executed, a reinforcement learning method for learning the next action of the game character based on a reward value for the action of the game character according to the execution environment of the game, and the game based on a mutation process and a mating process selecting at least one of the genetic algorithms for searching for the next action of the character, evaluating the reward value for the next action of the game character according to the selected at least one of the reinforcement learning method and the genetic algorithm, Based on the above, the reward data set is updated.

According to one aspect, a method of operating a virtual player control apparatus includes: controlling the virtual player of the first type so that the virtual player of the first type performs a cooperative role with respect to a game user in a game; when the first condition set in the game is satisfied, controlling the second type of virtual player to act as a guide for the game user in the game; and controlling the third type of virtual player so that the third type of virtual player plays a hostile role to the game user in the game when the second condition set in the game is satisfied.

The controlling of the first type of virtual player may include injecting the first type of virtual player so that the first type of virtual player plays a game together with the game user on the game. [0006] Controlling the second type of virtual player may include injecting the second type of virtual player so that the second type of virtual player provides a guide to the game user on the game. The first condition may be satisfied when the game play progress level of the game user is equal to or greater than a threshold state.

Embodiments may provide social and/or economic support for one or more new game users in the game by strategically arranging or operating virtual players, or compete or provoke the game users. Accordingly, a customized personalized tutorial for a corresponding game user may be possible. In addition, the corresponding game user can feel more fun in the game and can quickly settle down without leaving the game, and the survival rate of the corresponding game user can increase.

1 is a diagram for explaining a game system according to an embodiment.
2 to 3 are diagrams for explaining a plurality of virtual players according to an exemplary embodiment.
4 to 5 are flowcharts for explaining an operation of a virtual player control apparatus according to an exemplary embodiment.
6 is a block diagram illustrating an apparatus for controlling a virtual player according to an embodiment.
7 is a flowchart illustrating a method for controlling a virtual player according to an embodiment.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes may be made to the embodiments, the scope of the patent application is not limited or limited by these embodiments. It should be understood that all modifications, equivalents or substitutes for the embodiments are included in the scope of the rights.

Terms used in the examples are used for the purpose of description only, and should not be construed as limiting. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present specification, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It is to be understood that this does not preclude the possibility of addition or existence of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

In addition, in the description with reference to the accompanying drawings, the same components are assigned the same reference numerals regardless of the reference numerals, and the overlapping description thereof will be omitted. In describing the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description will be omitted. FIG. 1 is a diagram for explaining a game system according to an embodiment. . Referring to FIG. 1 , a game system 100 according to an embodiment includes a virtual player control device 110 and a plurality of terminals 120 - 1 to 120 -n.

The virtual player control device 110 may be included in the game server or may be a device physically distinct from the game server. Each of the plurality of terminals 120-1 to 120-n may represent a mobile terminal (eg, a smartphone or tablet, etc.) and/or a fixed terminal (eg, a PC).

The virtual player control device 110 inputs virtual players in the game for the game user. For example, when a new game user starts a game for the first time, the virtual player control apparatus 110 may sequentially input virtual players. For example, the virtual player control apparatus 110 may input a first type of virtual player, and the first type of virtual player may perform a cooperative role with respect to a game user. The virtual player control apparatus 110 may input a second type of virtual player, and the second type of virtual player may serve as a guide for the game user. The virtual player control device 110 may input a third type of virtual player, and the third type of virtual player may play a hostile role with respect to the game user.

Each of the virtual players represents an artificial intelligence (AI) based game player. In other words, each of the virtual players has artificial intelligence. The virtual players will be described later with reference to FIGS. 2 to 3 .

The virtual player control apparatus 110 may perform reinforcement learning for each type of virtual player. In the past, if one or more game users newly entering the game play the game in an isolated state without forming a relationship with one or more other game users, they may leave the game early without feeling the fun of the game. According to one embodiment, the virtual player control device 110 provides social and/or economic support for one or more game users (eg, one or more new game users) within the game by strategically placing or operating virtual players. Or, you can compete or provoke the game user. Accordingly, a customized personalized tutorial for a corresponding game user may be possible. In addition, the game user can feel more fun in the game and quickly settle down without leaving the game, and the game survival rate of the game user can increase.

The above-described game may correspond to a game in which a plurality of game users participate, such as a Massively Multiplayer Online Role-Playing Game (MMORPG), a Massively Multiplayer Online Social Network Game (MMOSNG), or a Massively Multiplayer Online Simulation Game (MMOSLG). However, the above game is not limited to MMOPRG, MMOSNG, or MMOSLG.

2 to 3 are diagrams for explaining a plurality of virtual players according to an embodiment. Referring to FIG. 2 , when a game user 210-1 plays a game for the first time, the virtual player control device 110 injects a cooperative-type virtual player 210-2 to play a game with the game user 210-1. It is possible to establish a cooperative relationship on the In other words, the cooperative type virtual player 210 - 2 may have a one-to-one relationship with the game user 210-1 (or the game character of the game user 210-1). The cooperative type may be expressed differently as a partner type, and corresponds to the first type described with reference to FIG. 1 .

When each of the other users plays the game for the first time, the virtual player control apparatus 110 may input cooperative type virtual players to form a cooperative relationship with each of the other users in the game. In other words, each of the cooperative type virtual players may have a one-to-one relationship with other game users (or game characters of each other game users).

The virtual player control device 110 may input one or more guide-type virtual players to the game for the game user 210-1 according to the progress of the game, and may select one or more enemy-type virtual players. can be put in The guide type may be expressed differently as a neighbor type and corresponds to the second type described with reference to FIG. 1 , and the Enemy_ type may be differently expressed as a threat type and corresponds to the third type described with reference to FIG. 1 . As in the example shown in FIG. 2 , the virtual player control device 110 sets the cooperative type virtual player 230-2 in a one-to-one relationship with the game user 230-1 as a guide type of the game user 210-1. can be selected as a virtual player of The virtual player control device 110 may select and input a cooperative type virtual player in a one-to-one relationship with one or more other game users as a guide type virtual player of the game user 210-1. In other words, the number of guide-type virtual players of the game user 210-1 may be one or more. When the virtual player control device 110 inputs a guide-type virtual player for the game user 210-1 will be described later with reference to FIG. 4 . In addition, the virtual player control device 110 selects and inputs the cooperative type virtual player 220-2, which is in a one-to-one relationship with the game user 220-1, as the enemy type virtual player of the game user 210-1. can do. The virtual player control device 110 may select and input a cooperative-type virtual player in a one-to-one relationship with one or more other game users as the enemy-type virtual player of the game user 210-1. In other words, the number of enemy-type virtual players of the game user 210-1 may be one or more. When the virtual player control device 110 inputs an enemy-type virtual player for the game user 210-1 will be described later.

The virtual player 220-2 may correspond to an enemy-type virtual player for the game user 210-1, but may correspond to a guide-type or an enemy-type virtual play for the game user 230-1. In other words, the cooperative type virtual player in a one-to-one relationship with each of the game users may be a guide type or an enemy type for other game users except for their own game users.

The cooperative-type virtual player 210-2 of the game user 210-1 may be a guide-type virtual player or an enemy-type virtual player of another game user.

Each type of virtual player performs several roles for the game user in the game. At this time, each type of virtual player may exhibit behavioral patterns of direct influence, indirect influence, and influence exclusion on the game.

<The role of the cooperative type virtual player>

A cooperative-type virtual player can exhibit behavioral patterns of direct influence for game users. In the example shown in FIG. 3 , the cooperative type virtual player may perform at least one of economic support and cooperative play on the game to the corresponding game user. For example, a cooperative type virtual player may provide or support a resource to a game user (or a game character of the game user) in the game. In addition, the cooperative type virtual player can hunt monsters together with the game user (or the game character of the game user) in the game or attack other game users (or the game character of the other game user). In addition, when a game user uses a specific content (for example, PVP content or raid content), the cooperative type virtual player enters the content and helps the game user to clear or complete the content if there are not enough people. can In addition, the cooperative-type virtual player collects data about what resources the game user lacks in the game, what content can be performed together, and which game user to attack in order to increase the ranking of the game user. can be collected

A cooperative type virtual player may exhibit behavioral patterns of indirect influence for game users. In the example shown in FIG. 3 , the cooperative type virtual player may act to increase the ranking rank of the game user. For example, the cooperative-type virtual player may become an enemy-type virtual player to other users with a higher ranking than the corresponding game user, and by attacking other users in the game, the ranking of other users may be lowered. As another example, a cooperative-type virtual player may set their ranking lower than that of the corresponding game user (for example, an act of a cooperative-type virtual player intentionally losing to other users, etc.) It can lead to an overall ranking increase. For this reason, the ranking ranking of the corresponding game user may be increased by the action of the cooperative type virtual player. A cooperative type virtual player may exhibit a behavioral pattern of exclusion of influence for the game user. In the example shown in FIG. 3 , a cooperative type virtual player may collect data about a game user (eg, disposition) on a game. Although the cooperative type virtual player may provide resources to the game user or perform content together, the behavior pattern of exclusion of influence may be performed when the game user's tendency is reluctant to join the cooperative type virtual player. For example, a cooperative type virtual player decides to perform dungeon contents with his/her game user A.

However, if the corresponding game user A cancels the performance of the dungeon contents with the cooperative type virtual player and applies for entry to the dungeon contents again, the influence is excluded and the cooperative type virtual player does not perform the contents with the corresponding game user A for a while. In other words, the cooperative type virtual player may change from a behavior pattern of direct influence to a behavior pattern of exclusion of influence in consideration of the propensity of the game user A.

<The role of the guide-type virtual player>

A guide-type virtual player may exhibit behavioral patterns of indirect influence for game users. In the example shown in FIG. 3 , the guide-type virtual player may show the game user what the game user has not experienced in the game, and may perform active social activities. For example, the guide-type virtual player can gather resources or hunt specific monsters around the game user. In addition, the guide-type virtual player may attack the game character of another game user in the vicinity of the corresponding game user. In addition, the guide-type virtual player may repeatedly demonstrate a series of processes of completing a specific dungeon or quest in front of a game user as a plurality of accounts other than a specific single account. Accordingly, the guide-type virtual player indirectly induces the game user to know how to clear (or completes) a specific dungeon or quest, so that the game user is mistaken as having learned how to clear the specific dungeon or quest by himself. can make it

A guide-type virtual player may exhibit a behavioral pattern of exclusion of influence for the game user. In the example shown in FIG. 3 , a guide-type virtual player may collect data about a game user on the game. For example, the guide-type virtual player may collect data on a stage clear condition of a game user, whether a boss clears successfully, and whether an item resource is obtained. After collecting such data, the guide-type virtual player may show behavioral patterns of indirect influence. That is, the guide-type virtual player can collect data according to the behavioral pattern of exclusion of influence, and based on the collected data, the user can demonstrate content that the user has never tried before or has not yet succeeded.

<The role of the enemy-type virtual player>

Enemy-type virtual players can exhibit behavioral patterns of direct influence for game users. In the example shown in FIG. 3 , the enemy-type virtual player may transmit appropriate game stress to the corresponding game user in the game. For example, the enemy-type virtual player may be the corresponding game user (or the game user's game character) in the game. may threaten (eg, attack) or interfere with the game play of the game user. Game play may include, for example, collecting resources, hunting monsters, or attacking the game user.

Enemy-type virtual players may exhibit behavioral patterns of indirect influence for game users. In the example shown in FIG. 3 , the virtual player of the enemy type may act to lower the ranking of the corresponding game user. For example, the enemy-type virtual player of the corresponding game user may lower the ranking of the corresponding game user by making his/her ranking higher than that of the corresponding game user.

Enemy-type virtual players may exhibit behavioral patterns of exclusion of influence for game users. In the example shown in FIG. 3 , an enemy-type virtual player may collect data about a game user on the game. For example, the enemy-type virtual player may collect the location (coordinate) information of the game user and the degree of combat/defense power of the game user. After collecting this data, the enemy-type virtual player makes the battle power gap (or combat power difference) with the game user almost zero or slightly higher than the combat power of the game user so that he can beat the game user with a short delay. can do.

4 to 5 are flowcharts for explaining an operation of a virtual player control apparatus according to an exemplary embodiment.

Referring to FIG. 4 , the virtual player control device 110 inputs a cooperative type virtual player ( 410 ). For example, when the game user plays the game for the first time, the virtual player control device 110 controls the cooperative type virtual player in the game by allowing the cooperative type virtual player to send a friend invitation message to the corresponding game user. can be approached.

The virtual player control apparatus 110 may control the cooperative type virtual player so that the cooperative type virtual player can play a game together with the corresponding game user. A cooperative type virtual player can provide resources to game users in the game. In addition, the cooperative type virtual player may perform specific content (eg, dungeon or quest) and/or monster hunting with the corresponding game user.

When the initial part of the game is completed, the virtual player control device 110 inputs a guide-type virtual player ( 420 ). That is, the virtual player control apparatus 110 may input the guide-type virtual player when a condition for input of the guide-type virtual player is satisfied. For example, when the tutorial is completed, the level of the game character of the corresponding game user reaches a specific level, or the game play progress of the corresponding game user is greater than or equal to a threshold state, the virtual player control device 110 is a guide type virtual player. can be put in Here, the conditions for input of the guide type virtual player may be arbitrarily set or changed by the game content provider (or manager, operator) or the virtual player control device 110 . For example, a tutorial, a specific level, and/or a threshold state may be arbitrarily set or changed by the game content provider (or administrator, operator) or the virtual player control device 110. Even if a guide-type virtual player is input Co-op-type virtual players do not end their role in the game. In other words, even when a guide-type virtual player is input, the cooperative-type virtual player can perform monster hunting, etc. together with the game user. However, the proportion of the role of the cooperative type virtual player may decrease.

The virtual player control apparatus 110 may control the guide-type virtual player so that the guide-type virtual player may provide a guide to a corresponding game user. The guide-type virtual player may provide a game-related guide to the game user by collecting resources or hunting monsters around the game user (or the game character of the game user) in the game.

The virtual player control device 110 displays a type of virtual player suitable for the situation when the game user can use specific content ( 430 ). The specific content may correspond to, for example, dungeon content, PVP content, or raid content corresponding to the current level of the game user, but is not limited thereto.

For example, a game user may use a specific dungeon content by reaching a specific level, but may not be able to complete the corresponding dungeon content. In this case, the virtual player control device 110 may introduce a cooperative type virtual player. The cooperative type virtual player may perform the corresponding dungeon content together with the corresponding game user, so that the corresponding game user may complete the corresponding dungeon content.

As another example, the guide-type virtual player may collect resources and/or hunt in the vicinity of the game user.

As another example, the virtual player control device 110 may input an enemy-type virtual player. This will be described with reference to FIG. 5 .

Referring to FIG. 5 , the virtual player control device 110 may input an enemy-type virtual player when the game user becomes able to use PVP content ( 510 ). In an embodiment, the virtual player control device 110 may compare the amount of goods held in the game of the corresponding game user with the average holding amount of goods. Here, if the game user's holding amount of goods in the game is greater than the average holding quantity of goods, the virtual player control device 110 may inject an enemy-type virtual player. In this case, the enemy-type virtual player may be similar to the game level of the corresponding game user. The average holding of goods may correspond to the average of holdings of goods of each of the other users. Here, the other users may be, for example, all users in the game or game users of the same or similar level as the corresponding game user.

When the virtual player of the enemy type is input, the virtual player control device 110 may monitor whether the corresponding game user responds to the threat of the virtual player of the enemy type (in other words, copes with it) ( 520 ). If the corresponding game user does not respond to the threat of the enemy-type virtual player, the virtual player control device 110 does not appear the enemy-type virtual player for a certain period of time ( 550 ). When the corresponding game user responds to the threat of the enemy-type virtual player, the virtual player control device 110 may monitor the behavior change of the game user after the response ( 530 ). For example, the virtual player control device 110 may monitor whether the corresponding game user strengthens the game character of the corresponding game user after responding to the attack of the enemy-type virtual player.

The virtual player control device 110 periodically controls the enemy-type virtual player based on the monitoring result of step 530 .

It can appear as (540). For example, the virtual player control device 110 may periodically appear an enemy-type virtual player when the attack power of the game character of the corresponding game user is enhanced rather than the defense power of the game character. If the attack power of the game character of the corresponding game user is not strengthened, the virtual player control device 110 may not display the enemy-type virtual player for a certain period of time.

Even if an enemy-type virtual player is input, each of the cooperative-type virtual player and the guide-type virtual player_ can perform their own roles. However, the proportion becomes smaller.

Returning to FIG. 4 again, the virtual player control device 110 determines whether the game user's game remaining is stabilized ( 440 ). For example, the virtual player control device 110 may check the number of days the game user accesses through the log record of the game user, and the number of days the game user accesses is a specific number of days (eg, 14 days or 30 days). work, etc.), it can be determined that the game remaining of the game user is stabilized. In other words, the virtual player control device 110 determines that the game user will continue to play the game without leaving the game if the number of days the game user has been connected to is greater than or equal to a specific day (eg, 14 days, 30 days, etc.) can do.

When it is determined that the game remaining of the game user is stabilized, the virtual player control device 110 terminates the above-described roles of the virtual players ( 450 ).

6 is a block diagram illustrating an apparatus for controlling a virtual player according to an embodiment. Referring to FIG. 6 , the virtual player control device 110 includes a communication unit 610 and a controller 620 . The communication unit 610 communicates with the terminal of the game user. For example, the communication unit 610 may perform wireless or wired communication with the terminal of the game user.

The controller 620 controls or manipulates the virtual player of the first type so that the virtual player of the first type performs a cooperative role for the game user in the game. Here, the first type corresponds to the above-mentioned cooperative type. When the first condition set in the game is satisfied, the controller 620 controls or manipulates the second type of virtual player so that the second type of virtual player serves as a guide for the game user in the game. Here, the second type corresponds to the above-described guide type. The first condition may be satisfied, for example, when the game play progress level of the game user is equal to or greater than a threshold state, but is not limited thereto.

When the second condition set in the game is satisfied, the controller 620 controls or manipulates the third type of virtual player so that the third type of virtual player plays a hostile role to the game user in the game. Here, the third type corresponds to the above-described enemy type. The second condition may be satisfied when the game user becomes able to use specific content in the game, but is not limited thereto.

Since the matters described with reference to FIGS. 1 to 5 may be applied to the matters described with reference to FIG. 6 , a detailed description thereof will be omitted.

7 is a flowchart illustrating a method for controlling a virtual player according to an embodiment. The virtual player control method may be performed by the virtual player control device 110 . Referring to FIG. 7 , the virtual player control device 110 controls the first type of virtual player so that the first type of virtual player performs a cooperative role with respect to the game user ( 710 ). When the first condition set in the game is satisfied, the virtual player control device 110 controls the second type of virtual player so that the second type of virtual player serves as a guide for the game user in the game (S720). When the second condition set in the game is satisfied, the virtual player control device 110 controls the third type of virtual player so that the third type of virtual player plays a hostile role to the game user ( 730 ).

Since the matters described with reference to FIGS. 1 to 6 may be applied to the matters described with reference to FIG. 7 , a detailed description thereof will be omitted.

According to an embodiment, the operation of the virtual player control device 110 described with reference to FIGS. 1 to 7 may be performed by a game server.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). ), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, may be implemented using one or more general purpose or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that may include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

Software is a computer program, code, instruction, or one or more of these

Combinations may include, configuring the processing devices to operate as desired, or independently or collectively instructing the processing devices to operate as desired. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. , or may be permanently or temporarily embody in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

Claims (1)

A method of operating a virtual player control device, comprising:
controlling the first type of virtual player to perform a cooperative role for a game user in a game;
controlling the second type of virtual player to act as a guide for the game user in the game when the first condition set in the game is satisfied; and
When the second condition set in the game is satisfied, controlling the virtual player of the third type so that the virtual player of the third type plays a hostile role to the game user in the game, Virtual player control How the device works.

Images