KR20210032729A - Emotion based game apparatus and method - Google Patents

Abstract

Disclosed are a device and a method for an emotion-based game. According to an embodiment of the present technology, the present invention derives at least one skill matched to an emotion value derived from face image information of a gamer obtained by a camera and an input value of an input device to be predefined from an emotional motion regulation conversion server and controls a motion of a character of a running game by using the at least one derived skill, thereby further improving engagement and interest on the game.

Description

Emotion-based game device and method {EMOTION BASED GAME APPARATUS AND METHOD}

The present invention relates to an emotion-based game device and method, and more particularly, to further improve the immersion and interest of the game as the game is executed by reflecting the skill matching the emotional expression of the player to the behavior of the character. It's about a technology.

In recent years, as interest in games increases, the number of people who enjoy games using dedicated game machines such as PlayStation or Nintendo game machines or computers is increasing rapidly.

Depending on the content of these games, games are divided into various types. Except for some strategy games or simulation games, it is recommended that gamers control first-person or second-person characters in the form of humans or animals to proceed with the game. It is common.

However, in such a conventional game, when a game program is produced, a predetermined character is used, or a game is played by selecting one of a small number of characters.

Such a character's skill growth method is only for growth based on game experience, and insufficient elements are inherent in satisfying the gamer's desire for skill growth.

For example, since the character's skill cannot be developed within a short time, it is insufficient to satisfy the desire of the gamer, and thus, the immersion and interest in the game are lowered.

It is an object of the present invention to provide an emotion-based game device and method capable of further improving immersion and interest in the game as the game is executed by reflecting the skill matched with the gamer's emotional expression to the character's behavior. have.

The object of the present invention is not limited to the objects mentioned above, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

Emotion-based game device according to an embodiment of the present invention for achieving the above object,

A game terminal corresponding to an input value of an external input device and executing a game with at least one predefined skill; And a camera for acquiring facial image information indicating an emotional expression of a gamer,

The game terminal

After extracting feature information representing an emotional expression from facial image information acquired through the camera, an emotion value is calculated using the extracted feature information, and the behavior of the character is performed with the calculated emotion value and at least one skill matched with the input value. It characterized in that it is provided to control.

The game terminal,

An expression analyzer for extracting feature information of an emotional expression from facial image information acquired through the camera and calculating the extracted feature information as an emotion value;

An emotional behavior conversion rule server for deriving at least one skill matching the emotion value of the facial expression analyzer and the input value of the input device; And

It may include a character control user interface (UI) that controls the behavior of the character by reflecting the at least one derived skill on the character of the running game.

Preferably the emotion value is,

Including at least one of an emotion type, an expression judgment probability, and an expression duration,

The emotion value is derived based on the facial expression determination probability, the facial expression duration, and the weight, and the weight may be derived based on the facial expression determination probability, the facial expression duration, and a correlation between the emotion.

Preferably, the emotional behavior conversion rule server defines and stores at least one skill matching the input value and the emotion value based on the rule of the game, and extracts at least one skill matching the input value and the emotion value during game execution. It may be provided to transfer the extracted at least one skill to the character control UI.

According to another aspect of the embodiment, the emotion-based game method,

Extracting feature information representing an emotional expression from face image information of a gamer acquired through a camera and converting the extracted feature information into an emotion value;

Deriving at least one skill matching the emotion value of the facial expression analyzer and the input value of the input device from a pre-built emotional behavior conversion rule server;

It may be provided to include the step of controlling the behavior of the character being executed with at least one derived skill.

Preferably, the emotion value includes at least one of an emotion type, an expression determination probability, and an expression duration, and the emotion value is derived based on an expression determination probability, an expression duration time, and a weight, and the weight is an expression determination probability and Expression duration can be derived based on the correlation for each emotion.

Preferably, the emotional behavior conversion rule defines and stores at least one skill matching the input value and the emotion value of the input device based on the rule of the game,

In the deriving of the at least one skill, at least one skill matching the input value and the emotion value of the gamer's input device may be derived from the emotion behavior conversion rule server and transmitted to the character control UI.

According to an embodiment, at least one skill derived after deriving from the emotion behavior rule conversion server at least one skill that matches the emotion value derived from the gamer's face image information acquired through the camera and the input value of the input device As the game progresses by controlling the character's behavior, immersion and interest in the game can be further improved.

The following drawings attached in the present specification illustrate preferred embodiments of the present invention, and serve to further understand the technical idea of the present invention together with the detailed description of the present invention to be described later. It is limited to and should not be interpreted.
1 is a diagram showing the configuration of an emotion-based game device according to an embodiment.
2 is a detailed configuration diagram of a game terminal of the game device according to an embodiment.
3 is a flowchart showing an emotion-based game process according to an embodiment.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings and the following description. However, the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided so that the disclosed content may be thorough and complete and the spirit of the present invention may be sufficiently conveyed to those skilled in the art. The same reference numbers throughout the specification indicate the same elements. Meanwhile, terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” refers to the presence of one or more other components, steps, actions and/or elements in which the recited component, step, operation and/or element is Or does not preclude additions.

Hereinafter, an emotion-based game device and method according to an embodiment is intended to propose a technique capable of playing a game by reflecting the emotion of a gamer collected through a camera.

That is, in an embodiment, an emotion value representing an emotional expression is derived by analyzing the face image information of a gamer obtained from a camera, and then at least one skill matching the derived emotion value and the input value of the input device is derived. By controlling the behavior of the character with at least one skill, the game can be played based on the emotion of the gamer.

FIG. 1 is a diagram showing the configuration of an emotion-based game device according to an embodiment. Referring to FIG. 1, the emotion-based game device may include one or more of a game terminal 100 and a camera 200. . Here, there may be a plurality of cameras 200.

The game terminal 100 possessed by a gamer can play a game provided through an Internet network. The game terminal 100 is a device that executes a game and may be a device capable of driving a game such as a personal computer, a tablet, or a smart phone. The player can play the game by manipulating the game terminal 100.

2 is a diagram showing a detailed configuration of the game terminal 100. Referring to FIG. 2, the game terminal 100 may further include one or more of an input device 110, a character control UI (User Interface 120), an expression analyzer 130, and an emotion behavior conversion rule server 140. I can.

The input device 110 may extract at least one predefined skill matching the input value of the gamer from the emotion behavior conversion rule server 140 and transmit the extracted skill to the character control UI 120. Here, the skill may be an action command of a character to progress the game.

The character control UI (User Interface 120) transfers the skill provided from the input device 110 to a character selected by the gamer, and the character may execute an action command of the received skill.

Meanwhile, the camera 200 may acquire face image information of a gamer. Accordingly, the face image information may be image information on a face among all images acquired through the camera 200.

The gamer's face image information acquired through the camera 200 may be a character of the game or the face of an avatar. Accordingly, the emotional expression of the gamer acquired through the camera 200 is displayed on the character or avatar. It can be reflected and expressed.

The facial expression analyzer 130 receiving the facial image information acquired through the camera 200 may extract feature information representing an emotional expression included in the facial image information, and then calculate an emotion value matching the extracted feature information. . Here, the feature information may include at least one of an emotion type, an expression determination probability, and an expression duration.

The emotion type may be set based on a previously established emotion model, and the emotion type according to an embodiment may be expressed as six emotions E=[e ₁ , e ₂ , .. e ₆ ] based on big six emotions, and the constructed emotion type is established. It is not limited thereto depending on the emotion model.

And each of the six emotion values can be determined by the expression determination probability and the expression duration, and the expression determination probability has a value between 0 and 1 as an expression probability for each emotion type, and the expression duration is a value of 0 and 1. It is the time that the expression was maintained. Accordingly, each emotion value e _i satisfies Equation 1 below. Here, the facial expression determination probability is derived by statistical analysis of the emotion type predicted by the emotion expression, and the derived facial expression determination probability is stored as a table value for each emotion type.

[Equation 1]

e _i = α*(probability of expression judgment)+β*(expression duration)

Here, α and β are respective weights, and each weight represents the degree of correlation between emotion and facial expression judgment probability and facial expression duration in determining _{each emotion value e i. For example, α=0.7, β=0.3} Can be set.

On the other hand, the facial expression duration is set to a value of 1 when the same emotional expression is maintained for a predetermined time or longer based on a predetermined time (preferably 0.5 seconds), and is set to a value of 0 when the same emotional expression is maintained for less than a predetermined time. do.

으로 나타낼 수 있다. 스킬 SK는 스킬 종류 및 스킬 판단 확률을 포함하며, 이러한 스킬 SK는 감정값들의 조합에 의해 복수일 수 있고, 다수의 스킬이 조합된 복합 스킬과 다수의 스킬이 순차적으로 출력되는 연속 스킬을 포함할 수 있다. _{That is, the emotion value e i} derived from the feature information of the face image information is provided to the emotion behavior conversion rule server 140 and outputs at least one skill SK matching the emotion value defined according to the rules of the game. At this time, skill SK= [sk ₁ , sk ₂ ,… sk _n ],

It can be represented by Skill SK includes the skill type and skill determination probability, and this skill SK may be plural by a combination of emotion values, and include a composite skill in which a number of skills are combined and a continuous skill in which a number of skills are sequentially output. I can.

That is, the skill SK is one of a single skill, a compound skill, and a continuous skill, and in a single skill, one skill value among a plurality of skills is a non-zero value, the remaining skill value is 0, and a compound skill is one of the plurality of skill information. Two or more skill values are not 0, but the remaining skill values are 0, and a continuous skill is a combination of skills in which a plurality of skill information is sequentially connected with a time difference. Here, skill refers to an action command such as a character rotating or jumping.

Therefore, the continuous skill is the skill SK = SK _t1 + SK _t1 , _ti is time, and _i is output in advance with the smallest number.

In addition, the emotion behavior conversion rule server 140 includes an input value KI and an emotion value e _{i of the input device 110 defined by a predetermined game rule.} Matching skill SK can be saved.

The emotional behavior conversion rule server 140 may output the skill SK derived as an input of the _{emotion value e i (Rule 1).} In other words, E _to → SK _to

For example, if the emotion value is input with a rotten smile, the character can perform Freeze's single skill SK, which stops monsters in the entire map for 1 second.

In addition, the skill may be output as a complex skill including a plurality of single emotion values. For example, if the emotion value is laughter, a complex skill including a single skill in which the character rotates and a single skill in which the character jumps may be output.

On the other hand, the skill may be output as a single skill SK for the composite emotion value. _{For example, for a plurality of emotion values including the emotion value e i} of the mouth of the smiling expression _{and the emotion value e j} of the eyes of the sad expression, the skill of the emotion behavior conversion rule server 140 is a single skill that returns the character to the village. Can be output.

The emotional behavior conversion rule server 140 may derive a continuous skill SK _{to matching a plurality of emotional values E to} (Rule 2). In other words

Here, the plurality of emotion values E _to may be emotion values in which one emotion value is input and then other emotion values are sequentially input within a predetermined time (0.5 seconds). For example, when a smiling emotion value and a sad emotion value are sequentially input within a predetermined time, the emotion behavior conversion rule server 150 matches the plurality of emotion values and moves nearby monsters away from the character with the defined character's madman skill. A single skill can be output.

In addition, when a complex emotion value including a smiley emotion value and a frown emotion value is input, the emotion behavior conversion rule server 150 is matched to the complex emotion value and the defined character advances while lowering the monster's defense with charisma skill. It is possible to output a continuous skill that sequentially performs battle skills with a sword.

On the other hand, if the input value KI _to and the emotion value E _to are input at the same time, the emotional behavior conversion rule server 140 may output a single or complex skill SK _{to corresponding to the} input value KI to and the emotion value E _to (rule 3).

The emotional behavior conversion rule server 140 may _{output a skill SK t1} matching the sequential input of the _{emotion value E to} and the input value KI _t1 (Rule 4). For example, a skill performed when a single emotion value and a single input value are sequentially input may be defined as Rule 4.

Then, the emotional behavior conversion rule server 140 may _{output the defined skill SK t1} by matching the sequential input of the _{emotion value E t1} and the input value KI _to (Rule 5). When the emotion value E _t1 and the input value KI _to are sequentially input, the defined skill SK _t1 can be output.

The emotional behavior conversion rule server 140 may output a corresponding skill SK _tj when a single input value KI _{i is continuously input while a single emotion value E to} is maintained (Rule 6). Accordingly, when the single input value KI _i is continuously input while the single emotion value E _to is maintained, the skill SK _tj is output. In other words,

The character control UI 120 receiving such a skill may control the character of the running game to execute the received skill (action command). For example, an action command of a skill that moves nearby monsters away from the character with the character's maniac skill may be executed.

Accordingly, in the character control UI 120 of an embodiment, the character in the game according to the skill SK of the emotion behavior conversion rule server 140 that matches the input value KI of the input device 110 and the emotion value E of the facial expression analyzer 130 is The game progresses as you perform actions.

According to an embodiment, as the character of the game performs a skill defined by matching the emotion value representing the emotional expression derived from the gamer's face image information acquired through the camera and the input value of the input device, immersion in the game The degree and interest can be further improved.

3 is a flowchart showing an emotion-based game process according to an exemplary embodiment, and an emotion-based game method according to another exemplary embodiment will be described with reference to FIGS. 1 to 3.

First, in steps (S11) (S13), the game terminal 100 derives feature information representing an emotional expression from the face image information of the player acquired through the camera 200 and derives an emotion value for the derived feature information. do.

In steps S15 and S17, the game terminal 100 derives from the emotion behavior conversion rule server 150 the skill of the character defined by matching the emotion value and the input value of an input device such as a keyboard and a mouse joystick. The derived skill is transferred to the character control UI 120. Accordingly, the character of the running game performs the received skill and the game proceeds.

According to an embodiment, a character running based on a predefined skill is matched with an emotion value derived from the face image information of a player acquired through a camera and an input value of the player in a game based on an input value of an existing input device. As you perform, you can further improve your immersion and interest in the game.

The game terminal 200 described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions.

An operating system (OS) and one or more software applications executed on the operating system may be executed. Further, the processing device may access, store, manipulate, process, and generate data in response to the execution of software.

For the convenience of understanding, although it is sometimes described that one game terminal 200 is used, those of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types. It can be seen that the processing element of can be included. For example, the control unit may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

Here, the software may include a computer program, code, instruction, or a combination of one or more of them, and configure the processing device to operate as desired, or independently or collectively. You can command the processing unit.

Software and/or information, signals and data may be interpreted by a control unit or stored in any type of machine, component, physical device, virtual equipment, or computer to provide instructions or data to the processing unit. It may be permanently or temporarily embodyed in the medium or device, or the signal wave being transmitted.

The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like.

Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

Although the present invention has been described in detail through exemplary embodiments above, those of ordinary skill in the art to which the present invention pertains have found that various modifications can be made to the above-described embodiments without departing from the scope of the present invention. I will understand. Therefore, the scope of the present invention is limited to the described embodiments and should not be determined, and should be determined not only by the claims to be described later, but also by all changes or modifications derived from the claims and the concept of equality.

The emotion value derived from the gamer's face image information acquired through the camera and the input value of the input device are matched, and at least one predefined skill is derived from the emotion behavior rule conversion server, and is then executed with the derived at least one skill. By controlling the behavior of the characters in the game, the emotion-based game device and method that can further improve the immersion and interest in the game will bring a great progress in terms of accuracy and reliability of operation, and further in terms of performance efficiency. It is an invention that has industrial applicability because the possibility of commercialization or business such as next-generation wireless communication and game content using 5G/6G Internet networks is sufficient and can be practically clearly implemented.

Claims (7)

A game terminal corresponding to an input value of an external input device and executing a game with at least one predefined skill; And a camera for acquiring facial image information indicating an emotional expression of a gamer,
The game terminal
After extracting feature information representing an emotional expression from facial image information acquired through the camera, an emotion value is calculated using the extracted feature information, and the behavior of the character is performed with the calculated emotion value and at least one skill matched with the input value. Emotion-based game device, characterized in that provided to control. The method of claim 1, wherein the game terminal,
An expression analyzer for extracting feature information of an emotional expression from facial image information acquired through the camera and calculating the extracted feature information as an emotion value;
An emotional behavior conversion rule server for deriving at least one skill matching the emotion value of the facial expression analyzer and the input value of the input device; And
And a character control user interface (UI) for controlling the behavior of the character by reflecting the derived at least one skill on the character of the running game. The method of claim 2, wherein the emotion value is
Including at least one of an emotion type, an expression judgment probability, and an expression duration,
The emotion value is derived based on an expression determination probability, an expression duration, and a weight, and the weight is derived based on a correlation degree for each emotion of an expression determination probability and an expression duration time. . The method of claim 2, wherein the emotional behavior transformation rule server
Define and store at least one skill matching the input value and the emotion value based on the rules of the game,
Emotion-based game device, characterized in that it is provided to extract at least one skill matching the input value and the emotion value during game execution and then transfer the extracted at least one skill to the character control UI. Extracting feature information representing an emotional expression from face image information of a gamer acquired through a camera and converting the extracted feature information into an emotion value;
Deriving at least one skill matching the emotion value of the facial expression analyzer and the input value of the input device from a pre-built emotional behavior conversion rule server;
Emotion-based game method, characterized in that it is provided to include the step of controlling the behavior of the character being executed with at least one derived skill. The method of claim 5, wherein the emotion value includes at least one of an emotion type, an expression determination probability, and an expression duration, and the emotion value is derived based on an expression determination probability, an expression duration time, and a weight, and the weight is An emotion-based game method, characterized in that it is derived based on a correlation degree for each emotion of an expression determination probability and an expression duration time. The method of claim 5, wherein the emotion behavior transformation rule is
Define and store at least one skill matching the input value and the emotion value of the input device based on the rules of the game,
The deriving of the at least one skill is provided to derive at least one skill matching the input value and the emotion value of the gamer's input device from the emotion behavior conversion rule server and transmit it to the character control UI. How to play.

Images