KR20210033127A - Story controlling apparatus and method for game using emotion expressions - Google Patents

Abstract

Disclosed are a device and a method for controlling a game story using emotional expressions. According to an embodiment of the present technology, a character skill or story for each story element defined based on a game is matched to each emotional element to be stored and the character skill or the game is proceeded by the story matched to the emotional element derived from face image information of a gamer obtained through a camera, thereby further improving engagement and interest on the game and providing a new paradigm of game contents.

Description

Game story control device and method using emotional expressions {STORY CONTROLLING APPARATUS AND METHOD FOR GAME USING EMOTION EXPRESSIONS}

The present invention relates to an apparatus and method for controlling a story of a game using emotional expressions, and more particularly, to further improve the immersion and interest of the game as the game is played with a game story matching the gamer's emotional expression. It's about technology.

In recent years, as interest in games increases, the number of people who enjoy games using dedicated game machines such as PlayStation or Nintendo game machines or computers is increasing rapidly.

Depending on the content of these games, games are divided into various types. Except for some strategy games or simulation games, it is recommended that gamers control first-person or second-person characters in the form of humans or animals to proceed with the game. It is common.

However, in such a conventional game, when a game program is produced, a predetermined character is used, or a game is played by selecting one of a small number of characters.

Since a number of games using such character skills are played in a predetermined story, the boredom for the game increases in proportion to the number of game progression, and thus the immersion and interest in the game have reached the limit.

It is an object of the present invention to provide an apparatus and method for controlling a game story using an emotional expression that can further improve immersion and interest in the game as the game progresses with the game story matching the gamer's emotional expression. It is in the ship.

The object of the present invention is not limited to the objects mentioned above, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

A story control device for a game using an emotional expression according to an embodiment of the present invention for achieving the above object,

A game terminal that matches the input value of the input device provided from the outside and performs a character skill or game with a story of a predefined character control UI; And a camera for acquiring facial image information indicating an emotional expression of a gamer,

The game terminal

After extracting feature information representing the gamer's emotional expression from the gamer's facial image information acquired through the camera, the extracted feature information is used to derive the emotion element of the corresponding story element of the gamer, and match the derived emotion element of the gamer. It is characterized in that it is provided to extract the story of the corresponding story element from the emotion story conversion rule server and then proceed with the character skill or game with the extracted story of the corresponding story element.

Preferably the game terminal,

An emotion story conversion rule server for defining and storing a story for each of a plurality of story elements matching emotion elements representing a plurality of emotional expressions based on the rules of the game;

An facial expression analyzer that extracts feature information representing the gamer's emotional expression from the gamer's face image information acquired through the camera, and derives the gamer's emotion element of the corresponding story element based on the extracted feature information;

It may include a game driver for extracting the story of the emotion story conversion rule server matching the emotion element of the gamer of the corresponding story element and performing a character skill or game with the extracted story of the corresponding story element.

Preferably the emotion story transformation rule server,

Based on the game rules, a story for each story element is defined, a character skill for each defined story element is defined, and a game or character skill is matched to each emotion element as a story for each defined story element and saved,

It may be provided to extract a story of a corresponding story element of an emotion similar to the emotion of a corresponding story element of a gamer provided from the facial expression analyzer and then transmit it to a game driver.

Preferably the emotion value is,

It includes at least one of an emotion element, an expression determination probability, an expression duration, and an expression difficulty, and is derived based on the expression determination probability, an expression duration, an expression difficulty, and a weight,

The weight is derived based on correlations of the expression determination probability, the expression duration, and the expression difficulty for each emotion element, and may be provided to change according to each story element.

Preferably the game terminal,

A similarity calculator that calculates the similarity between the emotion of the corresponding story element of the gamer and the emotion of the corresponding story element of the emotion story conversion rule server, and then transmits the story matched with the emotion element of the corresponding story element with high similarity to the game driver. I can.

Preferably the game driver,

It may be provided to progress a character skill or game as one of a story matched with an emotional element of a corresponding story element having a high similarity and a story of a character control UI matched with an input value of a gamer's input device.

According to another aspect of the embodiment, a method for controlling a story in a game using an emotional expression,

(a) extracting feature information representing the gamer's emotional expression from the gamer's face image information received through the camera, and calculating emotions of the emotion elements of the corresponding story elements based on the extracted feature information;

(b) extracting a story of the story element matched with the emotion element of the story element according to the emotion story conversion rule; And

and (c) performing a character skill or game in one of the extracted story of the corresponding story element and the story selected based on the gamer.

Preferably, the emotion story conversion rule defines a story of each story element based on a game rule, defines a character skill of each story element, and then matches and stores the story and character skill of each defined story element with each emotion element. It can be provided.

Preferably the (b) step,

Calculate the similarity between the emotion element of the story element stored in accordance with the emotion story conversion rule and the emotion element of the story element in the facial expression analyzer, and set the emotion element matching the emotion element with the maximum similarity as a similar emotion as a result of the calculation. It may be provided to recommend a story of a corresponding story element that matches the emotion to the gamer.

According to an embodiment, a character skill or story for each story element defined based on a game is matched to each emotion element and stored, and then a story matched with the emotion element derived from the gamer's face image information acquired through the camera. As the character skill or game progresses, immersion and interest in the game may be further improved, and a new paradigm of game content may be provided.

The following drawings attached in the present specification illustrate preferred embodiments of the present invention, and serve to further understand the technical idea of the present invention together with the detailed description of the present invention to be described later. It is limited to and should not be interpreted.
1 is a block diagram of an apparatus for controlling a story in a game according to an embodiment.
2 is a detailed configuration diagram of a game terminal of the device according to an embodiment.
3 is a flowchart showing a story control process of a game according to an embodiment.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings and the following description. However, the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided so that the disclosed content may be thorough and complete and the spirit of the present invention may be sufficiently conveyed to those skilled in the art. The same reference numbers throughout the specification indicate the same elements. Meanwhile, terms used in the present specification are for describing exemplary embodiments and are not intended to limit the present invention. In this specification, the singular form also includes the plural form unless specifically stated in the phrase. As used herein, “comprises” and/or “comprising” refers to the presence of one or more other components, steps, actions and/or elements in which the recited component, step, operation and/or element is Or does not preclude additions.

Hereinafter, in an embodiment, a character skill or story for each story element defined based on a game is matched to each emotion element and stored, and then a story matched with the emotion element derived from the gamer's face image information acquired through the camera. I would like to suggest a character skill or a technique for playing the game.

1 is a diagram illustrating a configuration of an apparatus for controlling a story in a game using an emotional expression according to an exemplary embodiment. Referring to FIG. 1, an apparatus for controlling a story of a game using an emotional expression may include at least one of a game terminal 100 and a camera 200. Here, there may be a plurality of cameras 200.

The game terminal 100 possessed by a gamer can play a game provided through an Internet network. The game terminal 100 is a device that executes a game and may be a device capable of driving a game such as a personal computer, a tablet, or a smart phone. The gamer can play the game by manipulating the game terminal 100.

The camera 200 may be provided in plural, and the camera 200 may acquire face image information of a gamer. Accordingly, the face image information may be image information on a face among all images acquired through the camera 200.

The gamer's face image information acquired through the camera 200 may be a character of the game or the face of an avatar, and the emotional expression of the gamer obtained through the camera 200 is displayed on the character or avatar. It can be reflected and expressed.

2 is a detailed configuration diagram of the game terminal shown in FIG. 1. The game terminal 100, as shown in FIG. 2, is an emotion story conversion rule server 110, an expression analyzer 120, a similarity calculator 130, a game driver 140, an input device 150, and a character. One or more of the control UI 160 may be further included.

The emotion story conversion rule server 110 defines a story for each story element based on the rules of the game, defines a character skill for each story element, and matches the character skill and story for each defined story element with each emotion value. I can save it. Here, the story element may include a scene, a monster, a map, and a quest. One embodiment describes a scene among a plurality of story elements as an example, but is not limited thereto.

Meanwhile, the facial expression analyzer 120 receives the gamer's face image information acquired through the camera 200, extracts feature information representing the emotional expression included in the gamer's face image information, and then extracts each emotion matched with the extracted feature information. You can calculate the emotional value of an element.

That is, the facial expression analyzer 120 performs a spectral analysis on the face image acquired through the camera 200, extracts feature information representing the gamer's emotion as a result of the performed spectral analysis, and matches the extracted feature information. The emotional value of the gamer can be derived by quantifying the emotional elements of the gamer.

Here, the emotion value may include at least one of an emotion element, an expression determination probability, and an expression duration. In addition, the emotion element in one embodiment is described as an example of six emotions E=[e ₁ , e ₂ , .. e ₆ ] based on big six emotions, but may be variously set according to the built emotion model. However, it is not limited thereto. In one embodiment, the six emotional elements may include happiness, surprise, anger aversion, fear, and sadness.

Accordingly, a gamer's emotion value for an i-th scene (story element) may be derived as a respective weight for each emotion element. That is, C _i ( s _i ) = {e _1i , e _2i , ,,, e _6i }. For example, if the emotion of the first scene C ₁ ( s ₁ ) = {0, 0.1, 0, 0, 0, 0.9}, the representative emotion is 0.9 as sadness. In addition, the emotion value for the scene that has not progressed is set to null for all emotion elements. That is, C ₁ ( s ₁ )={null, null, null, null, null, null}

Based on these game rules, the gamer's emotion for all n scenes (story elements) is derived as C ₁ = [ C ₁ ( s ₁ ), C ₁ ( s ₂ ), .... C ₁ ( s _n )] do. Accordingly, the emotion of the gamer for n scenes of the facial expression analyzer 120 C ₁ = [ C ₁ ( s ₁ ), C ₁ ( s ₂ ), .... C ₁ ( s _n )] is the similarity calculator 130 Is provided as.

Meanwhile, the similarity calculator 130 derives a similarity between _{the emotion value C 1} of the gamer for all scenes n of the received facial expression analyzer 120 _{and the emotion value C 2} stored in the emotion story conversion rule server 110.

[Equation 1]

sim( C ₁ (s _j ) , C ₂ (s _j ) ) =

Here, the degree of similarity for an arbitrary scene j sim (C ₁ (s _j), C ₂ (s _j)) is zero, emotional feelings C ₁ and feelings story conversion rule server 110 of the player for the scene j C ₂ Is the same scene, and the similarity sim( C ₁ (s _j ) , C ₂ (s _j ) ) is 6, the gamer's emotion C ₁ with respect to the scene j and the emotion story conversion rule server 110's emotion C ₂ Says it's a completely different scene.

The similarity sim( C ₁ (s _j ) , C ₂ (s _j ) ) for the arbitrary scene j can be derived by dividing by emotion 6 in addition to Equation 1 and then performing normalization. At this time , the maximum value for the similarity sim(C ₁ (s _j ) , C ₂ (s _j ) ) is 1, and the minimum value can be derived as 0.

On the other hand, the similarity sim ( C ₁ (s _j ) , C ₂ (s _j ) ) for an arbitrary scene j can be derived in various ways such as cosine similarity, and one embodiment derives the similarity using Equation 1 It is described as an example, but is not limited thereto.

The similarity computing unit 130 emotion of each and every storage element gamer C ₁ (s _j) and the similarity sim (C ₁ (s _j between emotion story conversion emotion of the rule server (110), C ₂ (s _j)), C ₂ After deriving (s _j ) ), the similar sentiment of the story element with a high degree of similarity is output. In other words, the similarity sim ( C ₁ (s _j ) between the gamer's emotion C ₁ (s _j ) and the emotion story conversion rule server 110's emotion C ₂ (s _j ), ... C _n (s _{j) in the scene} ) , C ₂ (s _j ) ),... sim( C ₁ (s _j ) , C _n (s _j ) ) is derived, and then the emotion value with the maximum similarity is outputted. Here, the similar emotion refers to the emotion in which the difference between the emotion value of the gamer C ₁ (s _j ) and the emotion value of the emotion element is small.

For example, the similarity between the gamer's emotion C ₁ ( s _j ) “joy” and the emotion C ₂ ( s _j ) “exciting mood” determined in the emotion story conversion rule server 110 for scene j is the similarity calculator 130 The sentiment story conversion rule server 110, which is output high in and received similarity to the scene j , is stored by matching the emotion C ₂ ( s _j ) instead of the story matching the emotion C ₁ ( s _j ) for the scene j. The story may be transmitted to the game driver 140. Accordingly, a story of the same story element having a high similarity between the gamer's emotion and the emotion of the emotion story conversion rule server may be recommended to the gamer.

Meanwhile, the game driver 140 is a story or gamer recommended based on the character skill and emotion story conversion rule 110 of the character control UI 160 that matches the input value of the input device 150 operated by the gamer during the game. You can play the game with a story extracted based on your emotions.

Accordingly, according to an exemplary embodiment, by recommending a story of an emotion having a high similarity to that of a gamer to a gamer, immersion and interest in the game may be further improved, and a new paradigm of game content may be provided.

3 is a flowchart illustrating a story control process of a game using emotional expressions according to an exemplary embodiment, and a method of controlling a story of a game using emotional expressions according to another exemplary embodiment will be described with reference to FIGS. 1 to 3.

First, in steps (S11) (S13), the game terminal 100 of an embodiment derives feature information representing an emotional expression from the gamer's face image information acquired through the camera 200, and provides each of the derived feature information. Derive emotions for each emotion element.

In steps S15 and S17, the game terminal 100 according to an embodiment derives a similarity between emotions for each emotion element derived from an arbitrary story element and emotions for each emotion element in the emotion story conversion rule server, and the derived similarity Outputs the similar sentiment of the highest maritime story element.

In steps S19 and S21, the game terminal 100 according to an embodiment outputs a story for each story element that is matched with similar emotions and stored, and matches a story for each story element that matches the output similar emotion and the emotion of the gamer. The game is performed as one of the stories for each story element.

According to an embodiment, by recommending a story of an emotion having a high similarity to that of a gamer to a gamer, immersion and interest in the game may be further improved, and a new paradigm of game content may be provided.

The game terminal 200 described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions.

An operating system (OS) and one or more software applications executed on the operating system may be executed. Further, the processing device may access, store, manipulate, process, and generate data in response to the execution of software.

For the convenience of understanding, although it is sometimes described that one game terminal 200 is used, those of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types. It can be seen that the processing element of can be included. For example, the control unit may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

Here, the software may include a computer program, code, instruction, or a combination of one or more of them, and configure the processing device to operate as desired, or independently or collectively. You can command the processing unit.

Software and/or information, signals and data may be interpreted by a control unit or stored in any type of machine, component, physical device, virtual equipment, or computer to provide instructions or data to the processing unit. It may be permanently or temporarily embodyed in the medium or device, or the signal wave being transmitted.

The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software.

Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like.

Examples of program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

Although the present invention has been described in detail through exemplary embodiments above, those of ordinary skill in the art to which the present invention pertains have found that various modifications can be made to the above-described embodiments without departing from the scope of the present invention. I will understand. Therefore, the scope of the present invention is limited to the described embodiments and should not be determined, and should be determined not only by the claims to be described later, but also by all changes or modifications derived from the claims and the concept of equality.

The character skill or story for each story element defined based on the game is matched to each emotion element and stored, and then the character skill or game is played with a story that matches the emotion element derived from the gamer's face image information acquired through the camera. As a result, immersion and interest in the game can be further improved, and the accuracy and reliability of operation of the story control device and method of the game using emotional expressions that can provide a new paradigm of the game content, and further performance Invention that can bring great progress in terms of efficiency and has industrial applicability because it has sufficient potential for marketing or sales such as next-generation wireless communication and game content using 5G/6G Internet networks, as well as practically clear implementation. to be.

Claims (9)

A game terminal that matches an input value of an input device provided from the outside to progress a game or character skill with a story of a predefined character control UI; And a camera for acquiring facial image information indicating an emotional expression of a gamer,
The game terminal
After extracting feature information representing the gamer's emotional expression from the gamer's facial image information acquired through the camera, the extracted feature information is used to derive the emotion of the corresponding story element of the gamer, and the corresponding story that matches the derived gamer's emotion A story control device for a game using an emotional expression, characterized in that it is provided to extract a story of an element from an emotion story conversion rule server and then proceed with a character skill or game with the extracted story of the corresponding story element. The method of claim 1, wherein the game terminal,
An emotion story conversion rule server that defines and stores a story for each story element that matches emotions representing a plurality of emotion expressions based on the rules of the game;
An expression analyzer that extracts feature information representing the gamer’s emotional expression from the gamer’s face image information acquired through the camera, and derives emotions for each gamer’s emotion element of the story element based on the extracted feature information; And
A game using emotional expressions, characterized in that it comprises a game driver for extracting the story of the emotion story conversion rule server matching the emotion of the gamer of the corresponding story element and performing a character skill or game with the extracted story of the corresponding story element. Story control device. The method of claim 1, wherein the emotion story transformation rule server,
Based on the game rules, a story for each story element is defined, a character skill for each defined story element is defined, and the story and character skill for each defined story element are matched to each emotion and saved,
A story control device for a game using emotional expressions, characterized in that, after extracting a story of a corresponding story element of an emotion similar to that of a corresponding story element of a gamer provided from the facial expression analyzer, and transmitting it to a game driver. The method of claim 1, wherein the emotion is
It includes at least one of an emotion element, an expression determination probability, an expression duration, and an expression difficulty, and is derived based on the expression determination probability, an expression duration, an expression difficulty, and a weight,
The weight is derived based on correlations of the expression determination probability, expression duration, and expression difficulty for each emotion element, and varies according to each story element. The method of claim 1, wherein the game terminal,
A similarity calculator that calculates the similarity between the emotion of the corresponding story element of the gamer and the emotion of the corresponding story element of the emotion story conversion rule server, and then transmits the story matched with the emotion element of the corresponding story element with a high similarity to the game driver. Story control device for a game using an emotional expression, characterized in that. The method of claim 5, wherein the game driver,
A game using emotional expressions, characterized in that it is provided to progress a character skill or game as one of a story matched with an emotional element of a corresponding story element with high similarity and a story of a character control UI matched with an input value of a gamer's input device Story control device. (a) extracting feature information representing the gamer's emotional expression from the gamer's face image information received through the camera, and calculating emotions of the emotion elements of the corresponding story elements based on the extracted feature information;
(b) extracting a story of a corresponding story element matched with an emotion element of the corresponding story element according to an emotion story transformation rule; And
(c) proceeding a character skill or a game with one of the extracted story of the corresponding story element and the story selected based on the gamer. The method of claim 7, wherein the emotion story transformation rule
It characterized in that it is provided to define the story of each story element based on the game rules, define the story or character skill of each story element, and then match and store the story or character skill for each defined story element with each emotion element. How to control the story of a game using emotional expressions. The method of claim 8, wherein step (b),
Calculate the similarity between the emotion element of the story element stored in accordance with the emotion story conversion rule and the emotion element of the corresponding story element in the facial expression analyzer,
A story control method for a game using an emotional expression, characterized in that, as a result of the calculation, the emotional element matching the emotional element of the maximum similarity is set as a similar emotion, and then the story of the corresponding story element matching the set similar emotion is recommended to the gamer. .

Images