KR102167650B1 - Apparatus, method and computer program for determining use of a game hack progrmam using image processing - Google Patents

Abstract

Obtaining at least one image frame by capturing a game execution screen displayed on a user terminal; Identifying characteristics of at least one object included in the acquired image frame; And determining whether to use the game hacking program based on the identified characteristics. A method of determining whether to use the game hacking program is disclosed by using image processing.

Description

How to determine whether or not to use a game hacking program using image processing, device and computer program {APPARATUS, METHOD AND COMPUTER PROGRAM FOR DETERMINING USE OF A GAME HACK PROGRMAM USING IMAGE PROCESSING}

The present invention relates to a method of determining whether to use a game hacking program, and more particularly, to a method of determining whether a user uses a game hacking program by using image processing.

With the development of computing devices and network environments, users who enjoy online-based games using various wired and wireless communication devices are increasing significantly.

However, with the development of online games, game hacking programs are also developing. The game hacking program refers to a program used for the purpose of inducing an operation different from the original operation by illegally hacking a game program. There are various types of hacking programs such as monthly hack, aim hack, map hack, speed hack, and resource hack.

Because only users who use game hacking programs benefit abnormally, users who do not use game hacking programs lose interest in the game, the overall balance of the online game collapses, and the game service itself is likely to end. . Therefore, the game service provider determines whether or not to use the game hacking program, and sanctions users who use the game hacking program.

Game service providers use various methods to determine whether a user uses a game hacking program. As the number of online games providing services and the number of game users explosively increase, determining whether to use a game hacking program It's getting more and more difficult.

Accordingly, there is a need for a method of determining whether to use an improved game hacking program to solve this problem.

It is possible to efficiently determine whether to use a game hacking program.

According to some embodiments of the present disclosure, there is provided a method for determining whether to use a game hacking program using image processing, the method comprising: obtaining at least one image frame capturing a game execution screen displayed on a user terminal; Identifying characteristics of at least one object included in the acquired image frame; And determining whether to use the game hacking program based on the identified characteristics.

In identifying the characteristics of the object, it is possible to identify a movement of the at least one object, a color of the at least one object, and whether the at least one object overlaps.

The method may further include controlling the type or direction of a viewpoint of the game execution screen.

In the obtaining of the at least one image frame, at least one image frame obtained by capturing a game execution screen in which the type or direction of the viewpoint is controlled may be obtained.

In the controlling of the type or direction of the viewpoint of the game execution screen, the type or direction of the viewpoint of the game execution screen displayed at the beginning of the game may be controlled.

In the controlling of the type or direction of the viewpoint of the game execution screen, the type or direction of the viewpoint of the game execution screen may be controlled so that at least one character object is displayed on the game execution screen.

The method may further include controlling a position of the at least one object included in the game execution screen.

In the obtaining of the at least one image frame, at least one image frame obtained by capturing a game execution screen in which the position of the at least one object is controlled may be obtained.

The controlling the position of the at least one object may include controlling a coordinate at which the at least one object is located when a game starts.

In the controlling of the position of the at least one object, the positions of the at least one object may be controlled so that the at least one object overlaps each other.

The step of identifying the characteristic of at least one object included in the obtained image frame may include identifying the characteristic of the at least one object included in the obtained image frame using a convolutional neural network. have.

The step of identifying the characteristic of at least one object included in the acquired image frame using the convolutional neural network includes determining a convolutional kernel according to the characteristic of the object desired to be identified, and using the determined kernel Processing the obtained at least one image frame; And identifying a characteristic of the at least one object based on the processing result.

Some embodiments of the present disclosure may provide a computer-readable recording medium in which a program for implementing the method is recorded.

According to some embodiments of the present disclosure, an apparatus for determining whether to use a game hacking program by using image processing includes: a memory for obtaining at least one image frame capturing a game execution screen displayed on a user terminal; And a processor that identifies characteristics of at least one object included in the acquired image frame, and determines whether to use a game hacking program based on the identified characteristics.

The processor may identify movement of the at least one object, a color of the at least one object, and whether the at least one object overlaps.

The processor may control the type or direction of the viewpoint of the game execution screen.

The memory may acquire at least one image frame capturing a game execution screen in which the type or direction of the viewpoint is controlled.

The processor may control the type or direction of the viewpoint of the game execution screen displayed when the game starts.

The processor may control the type or direction of a viewpoint of the game execution screen so that at least one character object is displayed on the game execution screen.

The processor may control the location of the at least one object included in the game execution screen.

The memory may acquire at least one image frame capturing a game execution screen in which the position of the at least one object is controlled.

The processor may control coordinates at which the at least one object is located when a game starts.

The processor may control the positions of the at least one object so that the at least one object overlaps each other.

The processor determines a convolutional kernel according to a characteristic of an object desired to be identified, processes the at least one image frame obtained using a convolutional neural network using the determined kernel, and based on the processing result Characteristics of the at least one object can be identified.

Game service providers and users can efficiently determine whether to use a game hacking program.

1 illustrates an online game providing system including a server and a user terminal according to some embodiments.
2 is a diagram for describing a game hacking program according to some embodiments.
3A to 3B are diagrams for explaining a change of a game execution screen according to a hacking program according to some embodiments.
4 is a flowchart of a method for determining whether a server uses a game hacking program according to some embodiments.
5A and 5B are diagrams for explaining a game viewpoint direction according to some embodiments.
6 is a flowchart of a method of determining whether or not to use a game hacking program by controlling a viewpoint of a game execution screen by a server according to some embodiments.
7A and 7B illustrate a method of obtaining at least one image frame by controlling a viewpoint of a game execution screen by a server, according to some embodiments.
8 is a flowchart of a method for determining whether to use a game hacking program by controlling the location of at least one object by a server, according to some embodiments.
9A and 9B illustrate a method of obtaining at least one image frame by a server controlling a location of at least one object, according to some embodiments.
10 and 11 are diagrams for describing an image processing method using a convolutional neural network according to some embodiments.
12 is a diagram for describing a detailed configuration of a server according to some embodiments.

Hereinafter, exemplary embodiments according to the present invention will be described in detail with reference to the contents described in the accompanying drawings. In addition, a method of configuring and using an electronic device according to an embodiment of the present invention will be described in detail with reference to the contents described in the accompanying drawings. The same reference numbers or reference numerals in each drawing indicate parts or components that perform substantially the same function.

Terms including ordinal numbers, such as first and second, may be used to describe various elements, but the elements are not limited by the terms. The terms are only used for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term and/or includes a combination of a plurality of related items or any one of a plurality of related items.

The terms used in this specification are used to describe examples, and are not intended to limit and/or limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as include or have are intended to designate the existence of features, numbers, steps, actions, components, parts, or a combination of them described in the specification, and one or more other features, numbers, or steps. It is to be understood that it does not preclude the possibility of the presence or addition of, operations, components, parts, or combinations thereof.

Throughout the specification, when a part is said to be connected to another part, this includes not only a case in which it is directly connected, but also a case in which it is electrically connected with another element interposed therebetween. In addition, when a certain part includes a certain component, it means that other components may be further included, rather than excluding other components unless specifically stated to the contrary. In addition, terms such as "... unit" and "module" described in the specification mean units that process at least one function or operation, which may be implemented as hardware or software, or as a combination of hardware and software. .

In the following specification, a game space may be referred to as a virtual space provided through a game service as a game space. The online game service provides game objects and provides a virtual space in which game objects can exist, and a virtual space in which game objects can exist may be referred to as a game space. Of course, the game space is not limited to a specific game service, and may mean a space in which a cyber object and all virtual objects exist.

In the following specification, an object may mean not only a background, a terrain, a character, a weapon, etc., but also an aiming point, a physical fitness interface, and anything displayed on the game execution screen. In particular, the object may include a structure object such as a building, a character object such as a user character or other user character, a weapon object that the character is equipped with, and the like, but is not limited thereto.

Hereinafter, in the present specification, the viewpoint of the game execution screen refers to a method in which the game space photographed through a virtual camera photographing the game space is displayed on the screen. The type of viewpoint on the game execution screen is a first-person viewpoint and a third-person viewpoint, and the first-person viewpoint means that the game execution screen is displayed according to the user's character's gaze, and the third-person viewpoint is not the viewpoint of the user's character. It means that the game execution screen including the user's character is displayed at different locations.

In addition, the direction of the viewpoint of the game execution screen means a photographing direction of a virtual camera that photographs the game space, and the left, right, front and rear of the game space may be displayed according to a user input.

In the following specification, a user may mean a user or a gamer, and is not limited to the above example.

1 illustrates an online game providing system including a server and a user terminal according to some embodiments.

The online game providing system 100 of the present invention may include a server 170 and at least one user terminal 110 to 160. The server 170 may provide an online game service through a network network. The server 170 may simultaneously provide an online game to at least one user terminal 110 to 160, and the online game may refer to a game that a plurality of users enjoy by accessing a network.

According to some embodiments, the server 170 may include a single server, a group of servers, a cloud server, and the like, and is not limited to the above example. The server 170 provides game services and may include a database for storing user data. In addition, the server 170 may include a payment server that generates and processes a payment event.

According to some embodiments, a network refers to a connection established (or formed) using all communication methods, and may refer to a communication network connected through all communication methods, transmitting and receiving data between a terminal and a terminal or between a terminal and a server. .

All communication methods may include all communication methods such as communication through a predetermined communication standard, a predetermined frequency band, a predetermined protocol, or a predetermined channel. For example, it may include a communication method through Bluetooth, BLE, Wi-Fi, Zigbee, 3G, LTE, and ultrasound, and may include short-range communication, long-distance communication, wireless communication, and wired communication. Of course, it is not limited to the above example.

According to some embodiments, the short-range communication method may refer to a communication method in which communication is possible only when a device (terminal or server) performing communication is within a predetermined range. For example, Bluetooth, NFC, etc. Can include. The long-distance communication method may mean a communication method in which a device performing communication can communicate regardless of a distance. For example, the long-distance communication method may refer to a method in which two devices performing communication through a repeater such as an AP can communicate even when they are over a predetermined distance, and a cellular network (3G, LTE) such as SMS and telephone is used. It may include the used communication method. Of course, it is not limited to the above example. The meaning of receiving a game service using a network network may include the meaning that communication between the game server and the terminal can be performed through all communication methods.

Throughout the specification, at least one user terminal (110 to 160) refers to a personal computer (110), a tablet (Tablet) 120, a mobile phone (Cellular Phone) 130, a notebook 140, a smart phone. 150, TV 160, as well as PDA (Personal Digital Assistants), PMP (Portable Multimedia Player), navigation, MP3 player, digital camera, refrigerator, washing machine, may include various electronic devices such as a vacuum cleaner, It is not limited to examples.

According to some embodiments, the online game may include various genres such as sports, MMORPG, AOS, FPS, TCG, and CCG. In addition, the online game may be a game of a confrontation between a user and a user, or may be a confrontation between a user and a computer (eg, artificial intelligence). Of course, it is not limited to the above example, and there is no limitation on the form of the online game.

According to some embodiments, the server 170 may determine whether to use a game hacking program by using image processing. The server 170 acquires at least one image frame capturing the game execution screen displayed on the user terminal, identifies the characteristics of at least one object in the obtained image frame, and based on the identified characteristics, the game hacking program Whether to use or not can be determined. The capture of the game execution screen may be performed by the user terminals 110 to 160 at the request of the server 170. Of course, it is not limited to the above example, and the game execution screen may be captured by the server 170 according to the type of game service provided. This will be described in more detail in FIGS. 6 to 12 below.

2 is a diagram for describing a game hacking program according to some embodiments.

The game client 203 installed in the user terminal 101 provides a game service to the user through communication with the server 101. According to some embodiments, the game client 203 may provide a game service by using the functions of the user terminal 102 under the control of the server 101.

For example, the game client 203 may display a game execution screen under the control of the server 101 and provide the user input received by the user terminal 102 to the server 101 for the displayed game execution screen. have. The server 101 may process the received user input and control the game client 203 included in the user terminal 102 to display a game execution screen changed according to the user input.

Online games are games where the same rules apply to all users. However, some users use the game hacking program 201 to gain unfair advantage.

In general, the game hacking program 201 can hack the game client 203 through various methods. For example, the game hacking program 201 may directly manipulate the game client 203 or manipulate data transmitted and received between the game client 203 and the server 101. Examples include speed hack, auto mouse, and packet modulation.

However, since the game service provider mandates the installation of a security program to prevent the game hacking program 201, the game hacking program 201 directly manipulates the game client 203, or the game client 203 and the server 101 The method of manipulating data transmitted and received between) has been quite eradicated.

However, recently, a game hacking program 201 for manipulating the game execution screen displayed on the user terminal by controlling the user terminal 101 that renders and displays the game execution screen has been developed.

Specifically, the game hacking program 201 controls the user terminal 102 to manipulate the rendered game execution screen. This game hacking program 201 is also called Wall Hack or Aim Hack. It will be described in more detail with respect to the moon nucleus and the aim nucleus in Figures 3a to 3b below.

3A to 3B are diagrams for explaining a change of a game execution screen according to a hacking program according to some embodiments.

3A shows a game execution screen 310 using a monthly hack. The game execution screen is displayed as a viewpoint when the first object 301 that is the user's character object looks at the wall that is the structure object 302.

In general, the structure object 302 must be rendered so that the object behind it is not transmitted. However, when the game hacking program renders the game execution screen in the user terminal, the structure object 302 modulates graphic data (for example, a graphic function or a variable of a graphic function) input to the memory of the user terminal from the game client. A third object 303, which is a character object of another user located behind, may be displayed.

The rendering method of the game execution screen using the moon core is not limited to the example shown in FIG. 3A, and by changing to render only the wire frame when rendering the game image, the character object of another user existing beyond the structure object is converted to the game execution screen. The character object of another user can be changed to be displayed on the game execution screen by changing the color of the objects or by changing the colors of the objects.

That is, when a game hacking program is used, the user knows the location of another user's character that should not be known, and the possibility of winning the competition with other users is very high.

3B shows a game execution screen 320 in which the aim hack is used. Aim Hack is a game hacking program used in FPS (First Person Shooter) games, and it is a program that helps users to deny aim easily. Aim Hack helps users to aim easily in various forms. It allows the user to shoot other objects easily through various methods, such as firing a guided bullet following the object or moving another object to the aimed position.

In particular, in FIG. 3B, a user can easily aim at another object through a method of changing and displaying a part of the color of another object and tracking the changed color. Other objects may include character objects of other users. In other words, it modulates the color of other objects, such as another user's character object or another user's character equipped weapon object, so that the user can easily check the character of another user, and furthermore, track the altered color. Enable automatic aiming.

Game hacking programs such as monthly hacking and aim hacking of FIGS. 3A and 3B hack the user terminal 101 rather than hacking the game client or server, so the game service provider monitors the users who use the game and hacks the game. There is no choice but to determine whether or not to use the program. For example, a game service provider may determine whether to use a game hacking program by analyzing an image frame capturing a game execution screen displayed on a user's terminal.

However, since the amount of analysis of image frames is increasing due to an increase in the type of game and the number of users, a method of determining whether to use an improved hacking program is required.

In particular, if an image frame that is difficult to determine whether to use a game hacking program is included, it takes a lot of time to determine whether to use a game hacking program, so a method and image for obtaining an appropriate image frame to determine whether to use a game hacking program There is a need for a way to process frames quickly.

4 is a flowchart of a method for determining whether a server uses a game hacking program according to some embodiments.

In step 410, the server may acquire at least one image frame capturing the game execution screen displayed on the user terminal.

According to some embodiments, the game execution screen may mean a screen displayed on the user terminal by the user executing the game. In addition, the game execution screen may include not only a screen when the game is in progress, but also an installation screen and a loading screen of the game.

According to some embodiments, the server may request an image frame in which the game execution screen is captured from the user terminal, and receive an image frame in which the game execution screen is captured from the user terminal in response to the request.

In addition, according to some embodiments, the server may obtain an image frame by directly capturing a game execution screen displayed on the user terminal. For example, when the server renders the game execution screen and provides it to the user terminal, at least one image frame may be obtained by capturing the game execution screen provided by the server directly to the user terminal.

According to some embodiments, the server may request at least one image frame in which the game execution screen is captured from a user terminal corresponding to a user account that satisfies a predetermined condition. For example, the server may request at least one image frame capturing a game execution screen from a user terminal corresponding to a user account that has received a notification of more than a predetermined number of times.

According to some embodiments, the user terminal may capture and transmit a game execution screen in response to a request from a server. In this case, the user terminal can capture and transmit the execution screen without a separate user input. For example, a game execution screen may be captured by a game client in the user terminal and transmitted to the server.

Further, according to some embodiments, the server may acquire at least one image frame loaded in the memory of the user terminal.

Additionally, according to some embodiments, the server may control the type or direction of the viewpoint of the game execution screen, and obtain at least one image frame by capturing the game execution screen in which the type or direction of the viewpoint is controlled.

In other words, the server may control the type or direction of the time point at which the game execution screen is displayed so that a game execution screen suitable for determining whether or not to use the game hacking program is captured. This will be described in detail in FIGS. 5A to 7B.

In addition, according to some embodiments, the server may control the position of the at least one object included in the game execution screen, and obtain at least one image frame by capturing the game execution screen in which the position of the at least one object is controlled. have.

In other words, the server may control the position of at least one object so that a game execution screen suitable for determining whether to use a game hacking program is captured. This will be described in detail in FIGS. 8 to 9B.

In step 430, the server may identify characteristics of at least one object included in the acquired image frame.

According to some embodiments, the characteristics of an object may include movement of the object, a color of the object, and whether the object overlaps. In addition, as described above, the object may include a character object or a weapon object, and in particular, a character object of another user, or a character object of another user included in the hostile camp in a game where the Pia is divided.

For example, by analyzing the acquired image frame, the server may determine whether an object included in the image frame has color, movement, or overlap.

According to some embodiments, the server may identify the properties of the object by various methods. For example, the server may identify the characteristics of an object included in the image frame by extracting a pixel value from a partial region of the acquired image frame or determining the number of rendered lines in a partial or full region.

In addition, according to some embodiments, the server may identify the characteristic of at least one object included in the acquired image frame by using the convolutional neural network. For example, the server acquires an image frame, inputs the acquired image frame into the convolutional neural network, and sets a predetermined kernel value to identify whether at least one object included in the image frame has a predetermined characteristic. I can. For example, the server may determine a color of a character object in an image frame acquired using a convolutional neural network, a movement of a character object, and the like. This will be described in more detail in FIGS. 10 to 11.

In step 450, the server may determine whether to use the game hacking program based on the identified characteristics.

According to some embodiments, the server may determine whether to use the game hacking program based on the characteristics identified in step 430. For example, when the color of the character object is displayed in red, the server may determine that the game hacking program is being used, or when the character object overlaps with the structure object and the character object is displayed, it may determine that the game hacking program is being used.

In other words, since the server can know the data of the original game execution screen that has not been manipulated by the hacking program, the server executes the original game when it acquires the characteristics of the location, arrangement, color, and movement of objects included in the game execution screen. The image frame acquired from the user terminal may be analyzed based on the screen data, and it may be determined whether or not to use a game hacking program.

5A and 5B are diagrams for explaining a game viewpoint direction according to some embodiments.

5A shows a first image frame 510 in which the game viewpoint direction is left. In other words, the left side of the game space is displayed in the first image frame 510. The type of game view of the first image frame 510 is a first-person view, and the direction of the game view is changed according to the direction viewed by the user character object 501.

Referring to FIG. 5A, in the first image frame 510, a first character object 503, a second character object 504, and a third character object 505, which are character objects of a user other than the user character object 501, are ) May be displayed.

According to some embodiments, the user terminal may receive a user input for switching a game viewpoint. Based on the received user input, the user terminal may display the game execution screen as the switched game time point.

In FIG. 5B, a second image frame 520 in which the game viewpoint direction is right is shown. In other words, in the second image frame 520, the right side of the game space is displayed.

As shown in FIG. 5A, the user terminal that displayed the left side of the game execution screen along the field of view of the user's character object 501 is a user who moves the field of view of the user's character object 501 or the position of the user character object 501 Can receive input. When the field of view of the user character object 501 is changed to the right according to the received user input, the user terminal may display the left side of the game space according to the changed field of view.

Referring to FIG. 5B, in addition to the user character object 501, a first character object 503 and a fourth character object 506, which are other user characters, may be displayed in the second image frame 520. Since the first character object 503 is located in the middle of the game space, even if the viewpoint of the user character object 501 is changed from left to right, it is still displayed on the game execution screen, and is not displayed in the first image frame 510. The fourth character object 506 that was not used may be newly displayed on the game execution screen by changing the direction of the game viewpoint.

As shown in FIGS. 5A to 5B, the user terminal displays different game execution screens according to the viewpoint direction and the viewpoint type, so that the server may acquire different image frames according to the viewpoint direction and viewpoint type.

The server determines whether or not the game hacking program is used by using the acquired image frame. In the case of capturing a game execution screen that makes it difficult to determine whether the game hacking program is used, unnecessary resources of the server may be wasted. Accordingly, in order to obtain an appropriate image frame for efficiently determining whether or not to use a game hacking program, a predetermined control by the server may be required. This will be described in detail below.

6 is a flowchart of a method of determining whether or not to use a game hacking program by controlling a viewpoint of a game execution screen by a server according to some embodiments.

In step 610, the server may control the type or direction of the viewpoint of the game execution screen.

According to some implementations, the server may control the type or direction of the viewpoint of the game execution screen displayed when the game starts. For example, the server may control the type or direction of the viewpoint of the game execution screen immediately after the game starts. The term immediately after the game starts may mean after a waiting time such as a loading time has passed in order to actually play the game.

In addition, according to some embodiments, the server may control the type or direction of the viewpoint of the game execution screen at the game start place. Depending on the type of game, there is a case where the server waits for a predetermined time at a predetermined place before the game starts, and the server may control the type or direction of the viewpoint of the game execution screen when waiting at the start place before the game starts. Of course, it is not limited to the above example, and the server may adjust the type or direction of the viewpoint of the game execution screen even during the game, if there is no inconvenience for the user to proceed with the game.

Also, according to some embodiments, the server may control the type or direction of the viewpoint of the game execution screen so that at least one character object is displayed on the game execution screen.

For example, the server may control the type or direction of the viewpoint of the game execution screen so that the direction in which the character object of another user is located is displayed on the game execution screen.

In addition, according to some embodiments, the server may control the type or direction of the viewpoint of the game execution screen so that the character object and the structure object of another user are located in the same direction.

Additionally, according to some embodiments, the server may control the type or direction of the viewpoint of the game execution screen so that the character object and the structure object of another user are located on the same straight line.

Specifically, when the viewpoint of the game execution screen varies according to the field of view of the user's character object, the server may adjust the position, direction, or field of view of the user's character object. When the server adjusts the position, direction, or field of view of the user character object, the viewpoint of the game execution screen is changed, and the arrangement, number, and type of objects displayed on the game execution screen may be changed by changing the viewpoint of the game execution screen. .

In addition, according to some embodiments, the server may control the game client to control the type or direction of the viewpoint of the game execution screen. The game client may be installed in the user terminal, and the server may control the type or direction of the viewpoint of the game execution screen by controlling the game client.

For example, the server may control the viewpoint or direction of the game execution screen by controlling the game client installed in the user terminal during the loading screen.

In addition, according to some embodiments, the server may control the viewpoint using packets transmitted and received with the game client. The server may control the viewpoint or direction of the game execution screen by transmitting a packet including a command for adjusting the viewpoint or direction of the game execution screen to the game client. Of course, it is not limited to the above example, and the command for controlling the viewpoint or direction of the game execution screen may be stored in the game client when the game is installed, or may be collectively applied to the game client with a predetermined policy distributed by the server. .

In step 630, the server may acquire at least one image frame capturing a game execution screen in which the type or direction of a viewpoint is controlled.

In other words, by controlling the type or direction of the viewpoint, the server can obtain at least one image frame in which it is easy to determine whether the game hacking program is used.

For example, in step 610, the server controls the direction of the viewpoint of the game execution screen so that the structure object and the character object of another user are located in the same direction on the game execution screen, and at least one image obtained by capturing the controlled game execution screen. You can get the frame. The server may determine whether to use the game hacking program of the user terminal in consideration of whether or not to display another user character object in the acquired image frame, color, and the like.

In addition, according to some embodiments, the server may check the movement of the user character by controlling the type of viewpoint. The server controls the game client to change the first-person view to the third-person view, acquires at least one image frame capturing the controlled game execution screen, and determines whether the user terminal uses a game hacking program.

In step 650, the server may identify characteristics of at least one object included in the acquired image frame.

In step 670, the server may determine whether to use the game hacking program based on the identified characteristics.

Steps 650 to 670 correspond to the contents described above, and thus detailed descriptions thereof will be omitted.

7A and 7B illustrate a method of obtaining at least one image frame by controlling a viewpoint of a game execution screen by a server, according to some embodiments.

7A and 7B illustrate a method of controlling the viewpoint of the game execution screen in the game waiting place 711 of the user character object 701 and the game waiting place 712 of other user character objects 705 to 709 do.

Referring to FIG. 7A, a user character object 701 is located in a game waiting area 711. As described above, the game waiting place may mean a waiting place before the game starts.

An arrow 721 in FIG. 7A denotes a field of view of the user character object 701. Assuming that the viewpoint of the game execution screen is changed according to the field of view of the user character, the user character object 701 is looking at the left edge of the game space. In other words, the user terminal will display the left edge of the game space according to the field of view of the user character object 701, and the structure object 703 or other user character objects 705 to 709 are not displayed in the corresponding portion.

When other objects are not displayed, even if the server acquires an image frame capturing the game execution screen, the server cannot determine whether or not the user uses the game hacking program. In other words, even if the server performs processing on the image frame, it cannot be determined whether or not the game hacking program is used. Accordingly, the server can adjust the field of view of the user character object 701 as shown in 7b.

Referring to the arrow 731 shown in FIG. 7B, it can be seen that the field of view of the user character object 701 has been changed. According to some embodiments, the server may change the field of view of the user character object 701 by changing at least one of the position, direction, and posture of the user character object 701. Of course, it is not limited to the above example, and the server may change the view of the user character object 701 in various ways.

As described above, it is assumed that the viewpoint of the game execution screen changes according to the field of view of the user character object 701, so the user character object 701 is looking at the right edge of the game space.

In other words, the user terminal will display the right direction on the game space according to the field of view of the user character object 701 and the structure object 703 and other user objects 705 to 709 are located in the corresponding portion.

Accordingly, the server may determine whether the user uses the game hacking program based on the color, overlapping, and shape of the structure object 703 and other user character objects 705 to 709 displayed on the game execution screen. In other words, the server acquires a game execution screen including at least one object necessary to determine whether to use the game hacking program, identifies the characteristics of at least one object, and uses the game hacking program based on the identified characteristics. You can judge whether or not.

In addition, according to some embodiments, the server may adjust the direction and type of the viewpoint of the game execution screen at the start position as well as the direction and type of the viewpoint of the game execution screen at the respawn position. The respawn location may mean a location where the user's character starts again after death, and a detailed description thereof will be omitted since it is apparent to those skilled in the art.

8 is a flowchart of a method for determining whether to use a game hacking program by controlling the location of at least one object by a server, according to some embodiments.

In step 810, the server may control the location of at least one object included in the game execution screen.

According to some embodiments, the server may control the location of at least one object included in the game execution screen. For example, the server may control the position of at least one object included in the game space and obtain at least one image frame in which a game execution screen in which the position of the at least one object is controlled is captured.

For example, the server can control the coordinates where the object is located when the game starts. The server controls the coordinates at which the object is located when the game starts, so that the game execution screen including at least one object is displayed on the user terminal.

In addition, according to some embodiments, the server may control the position of at least one object at the game start location. For example, the server may control coordinates at which a user character object and another user character object are generated when a game starts, and the example is not limited thereto.

Also, according to some embodiments, the server may control the respawn location. For example, the server may set the coordinates of the respawn position of the user character object or other user character object to a predetermined position.

According to some embodiments, the manner in which the server controls the location of at least one object corresponds to the contents described with reference to FIG. 6. The server may control the game client to control the type or direction of the viewpoint of the game execution screen, or may use packets transmitted and received with the game client. In addition, the location of at least one object may be stored in the game client when the game is installed, or may be collectively applied to the game client with a predetermined policy distributed by the server.

In operation 830, the server may acquire at least one image frame in which the game execution screen in which the location of at least one object is controlled is captured.

In other words, by controlling the position of at least one object, the server can obtain at least one image frame that is easy to determine whether or not to use the game hacking program.

For example, in step 810, the server controls the position of at least one object so that the structure object and the character object of another user are located in the same direction on the game execution screen, and at least one image frame that captures the controlled game execution screen. Can be obtained. The server may determine whether to use the game hacking program of the user terminal in consideration of whether or not to display another user character object in the acquired image frame, color, and the like.

In step 850, the server may identify characteristics of at least one object included in the acquired image frame.

In step 870, the server may determine whether to use the game hacking program based on the identified characteristics.

Steps 850 to 870 correspond to the contents described above, and thus detailed descriptions thereof will be omitted.

9A and 9B illustrate a method of obtaining at least one image frame by a server controlling a location of at least one object, according to some embodiments.

Unlike the contents described in FIGS. 7A to 7B, the server may control the position or arrangement of other user character objects 905 to 909 instead of adjusting the field of view of the user character object 901.

Referring to FIG. 9A, other user character objects 905 to 909 are positioned between a first structure object 902 and a second structure object 903. In other words, when the viewpoint of the game execution screen is based on the field of view of the user character object 901, the other user character objects 905 to 909 in the displayed game execution screen are the first structure object 902 and the second structure object. It does not overlap with (903).

In the case of the aforementioned moon hack, it is a game hacking program that displays another user character object displayed behind a structure object. Therefore, if the structure object and the other user character object are not overlapped and displayed, even if the server acquires and analyzes the image frame capturing the game execution screen, it is difficult to determine whether the user uses the game hacking program.

Accordingly, the server displays other user character objects so that at least one of the other user character objects 905 to 909 overlaps at least one of the first structure object 902 or the second structure object 903 on the game execution screen. You can control the location of (905 to 909).

The server may control positions of other user character objects as shown in FIG. 9B. In other words, the server is the second user so that the second user character object 905 and the third user character object 907 overlap the first structure object 902 on the game execution screen of the user terminal corresponding to the user character. Coordinates of the character object 905 and the third user character object 907 may be controlled.

In addition, according to some embodiments, the server may control the generation position of the character object. The server may control coordinates at which the user character object and other user character objects are located at the start of the game, rather than changing the position during game execution. According to some embodiments, that the server controls the coordinates for the object may mean setting the coordinates of the location where the character object is generated at the start of the game to a predetermined location.

Accordingly, the server may acquire at least one image frame in which the game execution screen in which the structure objects 902 to 903 and other user character objects 905 to 909 are overlapped and displayed, is captured, and at least one object It is possible to determine whether to use a game hacking program based on the identified characteristics by identifying the characteristics of the players.

In addition, according to some embodiments, the server may control the respawn location. Since the respawn location corresponds to the above description, a detailed description will be omitted.

10 and 11 are diagrams for describing an image processing method using a convolutional neural network according to some embodiments.

Recently, devices are using artificial neural networks to obtain high-accuracy judgment results through image processing. A neural network is a network having a structure similar to that of a human neural network, and an example of a neural network may be a convolutional neural network.

According to some embodiments, the server may use a convolutional neural network to identify characteristics of at least one object included in an acquired image frame, and determine whether to use a game hacking program based on the identification result.

According to some embodiments, the server may determine the convolution kernel according to the characteristics of the object to be identified, and process the at least one image frame obtained by using the determined kernel, and at least one image frame based on the processing result. Can identify the characteristics of the object. Hereinafter, a convolutional neural network will be described in detail.

Referring to FIG. 10, the server may input at least one image frame 1001 to the convolutional neural network 1000. The at least one image frame 1001 may be images obtained by capturing a game execution screen acquired from a user terminal.

The convolutional neural network 1000 may include a plurality of layers. In each layer 1021, a process of generating a feature map is performed by applying the kernel 1022 including the weight 1023 to the input image frame. At least one feature map may be generated in each layer 1021, and a plurality of kernels 1022 may be applied to at least one image frame 1001 in each layer. The weights 13 included in each kernel 1022 may be updated by learning of the convolutional neural network 1000.

The kernel 1022 may mean a matrix having weights used to process input data. Examples of kernels include a low-pass kernel that removes noise, a Gaussian kernel that blunts the corners, and a high-pass kernel that sharpens the corners. The kernel can also be referred to as a filter and a mask. Refers to the value applied when processing is performed to extract. In other words, the kernel 1022 may have different characteristics depending on which characteristics of the input data to be extracted.

Types of convolutional neural networks trained for image processing may include VGGnet, GoogleLeNet, and ResNet. Each convolutional neural network may have different types of kernels 1002 applied to image frames. The server can apply different kernels according to the characteristics of the object to be identified.

According to some embodiments, the first layer of the convolutional neural network 1000 may generate a first feature map by convolving the kernel and input image frame data, and the second layer of the neural network convolves the first created feature map and the kernel. By doing so, a second feature map can be created.

That is, the convolutional neural network 1000 may process input data in order to increase the accuracy of the determination or to increase the success rate of a target operation. The server may perform a more accurate determination based on the processing result 1002 output through the convolutional neural network 1000 passing through a plurality of layers. Additionally, the convolutional neural network 1000 may perform a pooling operation to simplify the output signal before outputting the output signal.

11 is a diagram illustrating processing of input image frame data through a convolutional neural network in another form. As described above, in the convolutional neural network, the kernel 1104 is applied to the input image frame 1101.

Referring to FIG. 11, a predetermined pixel in the input image frame 1101 is affected by surrounding pixels. Thus, the server performs a convolution operation for processing. The convolution operation may mean applying the kernel 1104, which is a weighted matrix, to image pixels.

For example, the convolution operation may be an operation in which a predetermined pixel value and a pixel value around a predetermined pixel are multiplied by the weight of each kernel, and the result values of each corresponding cell in the kernel (values in rows M and N) are summed have.

In FIG. 11, the weight of 1/9 is applied to the input image frame 1101 with a kernel 1104 having a size of 3x3. When a kernel is applied to the first pixel 1103 having a pixel value of 2 in the input signal, the remaining eight pixels, which are pixels around the first pixel 1103, are also calculated according to the size of the kernel. The operation to which the kernel is applied is as follows

(1/9)x2+(1/9)x2+(1/9)x4+(1/9)x6+(1/9)x2+(1/9)x5+(1/9)x5+(1/9)x5+(1 /9)x5 = 4

Accordingly, the output result 1102 is data in which the value of the first pixel 1103 of the input image frame 1101 is changed from 2 to 4, and other pixels may also be calculated in the same manner. In other words, the output result 1102 may mean data that is transformed by sweeping the input image frame 1101 with the kernel 1104. That is, convolution may mean changing a value of the center (eg, a specific pixel) by reflecting values of the surrounding (eg, surrounding pixels of a specific pixel). In addition, according to some embodiments, the output signal 1102 may be a feature map generated from the input image frame 1101. Based on the generated feature map, the convolutional neural network can determine the color of the object and the overlap display of the object, and the server determines the characteristics of the object using the convolutional neural network to determine whether there is a game hacking program. Can judge.

12 is a diagram for describing a detailed configuration of a server according to some embodiments.

As shown in FIG. 12, the server 1200 according to some embodiments may include a processor 1210, a communication unit 1230, and a memory 1250. However, not all of the components shown in FIG. 12 are essential components of the server 1200. The server 1200 may be implemented by more components than the components illustrated in FIG. 12, or the server 1200 may be implemented by fewer components than the components illustrated in FIG. 12.

According to some embodiments, the processor 1210 typically controls the overall operation of the server 1200. For example, the processor 1210 may generally control components included in the server 1200 by executing a program stored in the server 1200.

According to some embodiments, the processor 1210 controls the communication unit 1230 and the memory 1250, identifies characteristics of at least one object included in the acquired image frame, and based on the identified characteristics, a game hacking program You can determine whether to use.

In addition, according to some embodiments, the processor 1210 may identify movement of at least one object, a color of at least one object, and whether or not at least one object overlaps.

In addition, according to some embodiments, the processor 1210 may control the type or direction of the viewpoint of the game execution screen, and may control the type or direction of the viewpoint of the game execution screen displayed when the game starts. In addition, according to some embodiments, the processor 1210 may control the type or direction of the viewpoint of the game execution screen so that at least one character object is displayed on the game execution screen.

Additionally, according to some embodiments, the processor 1210 may control the location of the at least one object included in the game execution screen. Also, the processor 1210 may control coordinates at which the at least one object is located when the game starts. Also, according to some embodiments, the processor 1210 may control the positions of the at least one object so that the at least one object overlap.

In addition, according to some embodiments, the processor 1210 determines a convolution kernel according to the characteristics of an object desired to be identified, processes at least one image frame obtained using a convolutional neural network using the determined kernel, A characteristic of the at least one object may be identified based on the processing result.

According to some embodiments, the communication unit 1230 may receive at least one image frame capturing a game execution screen displayed on the user terminal. The received at least one image frame may be stored in the memory 1250.

Further, according to some embodiments, the communication unit 1230 may transmit a predetermined packet to a game client installed in the user terminal. In the predetermined packet, a policy distributed by the server, update data, a command for controlling the direction or type of a viewpoint, and a command for controlling the coordinates of a game object may be included, and the example is not limited thereto.

In addition, the communication unit 1230 may receive a report of the use of the game hacking program from the user terminal or may transmit a predetermined sanction command according to the use of the game hacking program to the user terminal.

According to some embodiments, the communication unit 1230 includes Bluetooth, Bluetooth Low Energy (BLE), Near Field Communication, WLAN, Zigbee, infrared data association (IrDA), and Wi-Fi Direct (WFD). , UWB (ultra wideband), Ant+, LTE, 3G, 5G, etc., regardless of the communication method, it can communicate through any method.

In addition, according to some embodiments, the memory 1250 may store a program for processing and controlling the processor 1210 and may store data input to the server 1200 or output from the server 1200.

According to some embodiments, the memory 1250 may acquire at least one image frame obtained by capturing a game execution screen displayed on the user terminal. According to some embodiments, the memory 1250 may obtain at least one image frame obtained by capturing a game execution screen displayed on the user terminal from the communication unit 1230.

That is, the memory 1250 may acquire and store at least one image frame capturing a game execution screen displayed on the user terminal from the communication unit 1230 under the control of the processor 1210.

In addition, according to some embodiments, the memory 1250 may acquire at least one image frame in which a game execution screen in which the type or direction of a viewpoint is controlled is captured. In addition, according to some embodiments, the memory 1250 may acquire at least one image frame in which a game execution screen in which the location of at least one object is controlled is captured.

According to some embodiments, the memory 1250 is a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (for example, SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (ROM, Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) , A magnetic memory, a magnetic disk, an optical disk, and at least one type of storage medium. Also, according to some embodiments, programs stored in the memory 1150 may be classified into a plurality of modules according to their functions.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

Although the embodiments have been described by the limited embodiments and drawings as described above, various modifications and variations can be made from the above description to those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

Claims (20)

In a method of determining whether to use a game hacking program using image processing,
Controlling a type of a viewpoint of a game execution screen displayed on a user terminal or a direction of a user character object at a predetermined time or place after the game starts;
Obtaining at least one image frame by capturing a game execution screen displayed on the user terminal according to the type of the controlled viewpoint or the direction of the controlled user character object;
Identifying characteristics of at least one object included in the acquired at least one image frame; And
Determine whether to use a game hacking program based on the identified characteristics,
Identifying the characteristics of at least one object included in the at least one image frame obtained,
Processing the acquired at least one image frame using a convolutional kernel updated by learning, and identifying a characteristic of the at least one object based on the processing result. The method of claim 1,
Identifying the characteristics of the object,
The method of identifying the movement of the at least one object, the color of the at least one object, and whether the at least one object overlaps. delete The method of claim 1,
At a predetermined time or a predetermined place after the start of the game, the step of controlling the type of the viewpoint of the game execution screen displayed on the user terminal or the direction of the user character object,
The method of controlling the type or direction of the viewpoint of the game execution screen displayed at the start of the game. The method of claim 1,
At a predetermined time or a predetermined place after the start of the game, the step of controlling the type of the viewpoint of the game execution screen displayed on the user terminal or the direction of the user character object,
The method of controlling the type or direction of the viewpoint of the game execution screen so that at least one character object is displayed on the game execution screen. The method of claim 1,
The above method,
Further comprising the step of controlling the position of the at least one object included in the game execution screen,
Acquiring the at least one image frame,
The method of obtaining at least one image frame capturing a game execution screen in which the position of the at least one object is controlled. The method of claim 6,
Controlling the position of the at least one object,
The method of controlling the coordinates at which the at least one object is located at the start of the game. The method of claim 6,
Controlling the position of the at least one object,
The method of controlling the position of the at least one object so that the at least one object overlaps each other. delete delete A device for determining whether to use a game hacking program using image processing, the device comprising:
Memory; And
Controls the type of game execution screen viewpoint displayed on the user terminal or the direction of the user character object at a predetermined time or place after the start of the game, and adjusts the type of the controlled viewpoint or the direction of the controlled user character object. Accordingly, at least one image frame obtained by capturing the game execution screen displayed on the user terminal is obtained, the characteristics of at least one object included in the obtained at least one image frame are identified, and based on the identified characteristics Includes a processor that determines whether to use a game hacking program,
The processor,
Processing the acquired at least one image frame using a convolutional kernel updated by learning, and identifying a characteristic of the at least one object based on the processing result. The method of claim 11,
The processor,
The apparatus for identifying the movement of the at least one object, the color of the at least one object, and whether the at least one object overlaps. delete The method of claim 11,
The processor,
A device that controls the type or direction of the viewpoint of the game execution screen displayed when the game starts. The method of claim 11,
The processor,
The apparatus for controlling the type or direction of the viewpoint of the game execution screen so that at least one character object is displayed on the game execution screen. The method of claim 11,
The processor,
Controlling the position of the at least one object included in the game execution screen,
The memory,
The apparatus for obtaining at least one image frame capturing a game execution screen in which the position of the at least one object is controlled. The method of claim 16,
The processor,
The device to control the coordinates at which the at least one object is located at the start of the game. The method of claim 16,
The processor,
The apparatus of controlling the position of the at least one object so that the at least one object overlaps each other. delete A computer-readable recording medium storing a program for executing the method of any one of claims 1 to 2 and 4 to 8 on a computer.

Images