KR102365620B1 - Story controlling apparatus and method for game using emotion expressions - Google Patents

Abstract

The present technology discloses an apparatus and method for controlling a story of a game using emotional expressions. According to an embodiment of the present technology, character skills or stories for each story element defined based on the game are matched to each emotional element and stored, and then matched with the emotional element derived from the gamer's face image information obtained through the camera. As the character skill or game progresses through the story, immersion and interest in the game can be further improved, and a new paradigm of game content can be provided.

Description

Apparatus and method for controlling the story of a game using emotional expressions

The present invention relates to an apparatus and method for controlling a game story using an emotional expression, and more particularly, to a game story that matches a gamer's emotional expression so that the immersion and interest of the game can be further improved. It's about technology.

In recent years, as interest in games increases, the number of people who enjoy games using dedicated game consoles such as PlayStation or Nintendo game consoles or computers is rapidly increasing.

According to the content of these games, games are divided into various types. Except for some strategy games or simulation games, it is not necessary for gamers to control first-person or second-person characters composed of people or animals to play the game. It is common.

However, in such a conventional game, a predetermined character is used when a game program is produced, or a game is played by selecting one character from among a small number of characters.

Since a number of games using these character skills proceed with a predetermined story, the boredom of the game increases in proportion to the number of games progressed, and thus the level of immersion and interest in the game is reduced.

An object of the present invention is to provide a game story control apparatus and method using emotional expressions that can further improve immersion and interest in the game as the game progresses with the game story matching the gamer's emotional expression. is in the

Objects of the present invention are not limited to the objects mentioned above, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

A story control device for a game using an emotional expression according to an embodiment of the present invention for achieving the above object,

a game terminal that matches an input value of an input device provided from the outside and proceeds with a character's skill or game with a story of a predefined character control UI; and a camera that acquires face image information representing the emotional expression of the gamer,

The game terminal

Extracting characteristic information representing the emotional expression of the gamer from the gamer's face image information obtained through the camera, and then extracting the emotional element of the gamer's story element from the extracted characteristic information, and matching the derived gamer's emotional element It is characterized in that it is provided to extract the story of the corresponding story element from the emotional story conversion rule server and then proceed with the character skill or game with the extracted story of the corresponding story element.

Preferably the game terminal,

an emotion story conversion rule server for defining and storing stories for each of a plurality of story elements matched with emotional elements representing a plurality of emotional expressions based on the rules of the game;

a facial expression analyzer for extracting feature information representing a gamer's emotional expression from the gamer's face image information obtained through a camera, and deriving a gamer's emotional element of the corresponding story element based on each extracted feature information;

It may include a game driver that extracts the story of the emotional story conversion rule server matching the emotional element of the gamer of the corresponding story element, and performs character skills or a game with the extracted story of the corresponding story element.

Preferably, the emotion story conversion rule server,

Define the story for each story element based on the game rules, define the character skill for each defined story element, match the game or character skill to each emotion element and save the story for each defined story element,

It may be provided to extract the story of the corresponding story element of the emotion similar to the emotion of the corresponding story element of the gamer provided from the expression analyzer, and then deliver it to the game driver.

Preferably, the emotional value is

It may include at least one of an emotional element, an expression determination probability, an expression duration, and an expression difficulty, and may be provided to be changed according to each story element.

delete

Preferably the game terminal,

The gamer may further include a similarity calculator that calculates the similarity between the emotion of the corresponding story element and the emotion of the story conversion rule server for each story element, and then transmits the story matched with the emotion element of the story element with a high degree of similarity to the game driver. can

Preferably the game driver,

The character skill or game may be progressed as one of a story matched with an emotional element of a corresponding story element with high similarity and a story of a character control UI that matches an input value of a gamer's input device.

According to another aspect of one embodiment, the story control method of the game using emotional expressions,

(a) extracting characteristic information representing the emotional expression of the gamer from the gamer's face image information received through the camera, and calculating the emotions of the emotional elements of the corresponding story elements based on the extracted characteristic information;

(b) extracting the story of the corresponding story element matched with the emotional element of the corresponding story element based on the emotion story transformation rule; and

(c) performing a character skill or a game in one of the extracted story of the corresponding story element and the story selected by the gamer.

Preferably, the emotion story transformation rule defines the story of each story element based on the game rule, defines the character skill of each story element, and then stores the defined story and character skill for each story element by matching with each emotion element. can be provided.

Preferably, step (b) comprises:

Calculate the similarity between the emotion element of the story element stored in the emotion story conversion rule and the emotion element of the story element of the expression analyzer, and set the emotion element matching the emotion element with the maximum similarity as a similar emotion as a result of the calculation It may be provided to recommend a story of a corresponding story element matching the emotion to the gamer.

According to one embodiment, the character skill or story for each story element defined based on the game is matched to each emotional element and stored, and then the story is matched with the emotional element derived from the gamer's face image information obtained through the camera. As the character skill or game progresses, immersion and interest in the game may be further improved, and a new paradigm of game content may be provided.

The following drawings attached to this specification illustrate preferred embodiments of the present invention, and serve to further understand the technical spirit of the present invention together with the detailed description of the present invention to be described later, so the present invention is a matter described in such drawings should not be construed as being limited only to
1 is a block diagram of an apparatus for controlling a story of a game according to an embodiment.
2 is a detailed configuration diagram of a game terminal of the device according to an embodiment.
3 is a flowchart illustrating a story control process of a game according to an exemplary embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings and the content to be described later. However, the present invention is not limited to the embodiments described herein and may be embodied in other forms. Rather, the embodiments introduced herein are provided so that the disclosed subject matter may be thorough and complete, and that the spirit of the present invention may be sufficiently conveyed to those skilled in the art. Like reference numerals refer to like elements throughout. Meanwhile, the terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular form also includes the plural form unless otherwise specified in the phrase. As used herein, “comprises” and/or “comprising” means that the stated component, step, operation and/or element is the presence of one or more other components, steps, operations and/or elements. or addition is not excluded.

Hereinafter, in one embodiment, character skills or stories for each story element defined based on the game are matched to each emotional element and stored, and then the story is matched with the emotional element derived from the gamer's face image information obtained through the camera. I would like to suggest a character skill or a technique to progress the game.

1 is a diagram showing the configuration of a story control apparatus for a game using emotional expressions according to an embodiment. Referring to FIG. 1 , an apparatus for controlling a story of a game using emotional expressions may include at least one of a game terminal 100 and a camera 200 . Here, there may be a plurality of cameras 200 .

The game terminal 100 possessed by the gamer may play the game provided through the Internet network. The game terminal 100 is a device for executing a game, and may be a device capable of driving a game, such as a personal computer (PC), a tablet, or a smart phone. The gamer may proceed with the game by manipulating the game terminal 100 .

A plurality of cameras 200 may be provided, and the camera 200 may acquire face image information of a gamer. Accordingly, the face image information may be image information about a face among all images acquired through the camera 200 .

The gamer's face image information obtained through the camera 200 may be the face of a character or an avatar of a game, and the emotional expression of the gamer obtained through the camera 200 is displayed on the character or avatar. can be reflected and expressed.

FIG. 2 is a detailed configuration diagram of the game terminal shown in FIG. 1 . As shown in FIG. 2 , the game terminal 100 includes an emotion story conversion rule server 110 , an expression analyzer 120 , a similarity calculator 130 , a game driver 140 , an input device 150 , and a character. One or more of the control UI 160 may be further included.

The emotion story conversion rule server 110 defines a story for each story element based on the rules of the game, defines a character skill for each story element, and matches the defined character skill and story for each story element with each emotion value can be saved. Here, the story element may include a scene, a monster, a map, a quest, and the like. An embodiment describes a scene among a plurality of story elements as an example, and is not limited thereto.

On the other hand, the facial expression analyzer 120 receives the gamer's face image information obtained through the camera 200, extracts characteristic information representing the emotional expression included in the gamer's facial image information, and then each emotion matched with the extracted characteristic information You can calculate the emotional value of an element.

That is, the facial expression analyzer 120 performs spectral analysis on the face image obtained through the camera 200, extracts characteristic information representing the emotion of the gamer as a result of the performed spectral analysis, and matches the extracted characteristic information. It is possible to derive an emotional value by quantifying the emotional element of the gamer.

Here, the emotion value may include at least one of an emotion element, an expression determination probability, and an expression duration time. In addition, although the emotion element in an embodiment describes six emotions E = [e ₁ , e ₂ , .. e ₆ ] as an example based on the big six emotion, it can be set in various ways according to the built emotion model, , but not limited thereto. The six emotional elements in an embodiment may include happiness, surprise, anger disgust, fear, and sadness.

Accordingly, the gamer's emotional value for an arbitrary i-th scene (story element) may be derived as a weight for each emotional element. That is, C _i ( s _i ) = {e _1i , e _2i , ,,, e _6i }. For example, if emotion C ₁ ( s ₁ )={0, 0.1, 0, 0, 0, 0.9} of the first scene, the representative emotion is sadness, which is 0.9. In addition, the emotion value for a scene that has not progressed is set to null for all emotion elements. i.e. C ₁ ( s ₁ )={null, null, null, null, null, null}

Based on these game rules, the gamer's emotions for all n scenes (story elements) are derived as C ₁ = [ C ₁ ( s ₁ ), C ₁ ( s ₂ ), .... C ₁ ( s _n )] . do. Accordingly, the gamer's emotion C ₁ = [ C ₁ ( s ₁ ), C ₁ ( s ₂ ), .... C ₁ ( s _n )] for the n scenes of the expression analyzer 120 is the similarity calculator 130 . is provided as

Meanwhile, the similarity calculator 130 derives a similarity between the emotion value C ₁ of the gamer for all scenes n of the received expression analyzer 120 and the emotion value C ₂ stored in the emotion story transformation rule server 110 .

[Equation 1]

sim( C ₁ (s _j ) , C ₂ (s _j ) ) =

Here, if the similarity sim( C ₁ (s _j ) , C ₂ (s _j ) ) for an arbitrary scene j is 0, the gamer’s emotion C ₁ and the emotion C ₂ of the emotion story transformation rule server 110 for the scene j is the same scene, and if the similarity sim( C ₁ (s _j ) , C ₂ (s _j ) ) is 6, the gamer’s emotion C ₁ and the emotion C ₂ of the emotion story transformation rule server 110 for the scene j is a completely different scene.

The similarity sim( C ₁ (s _j ) , C ₂ (s _j ) ) for this arbitrary scene j can be derived by dividing by emotion 6 in addition to Equation 1 and then performing normalization. In this case, the maximum value for the similarity sim( C ₁ (s _j ) , C ₂ (s _j ) ) may be 1, and the minimum value may be derived from 0.

Meanwhile, the similarity sim( C ₁ (s _j ) , C ₂ (s _j ) ) for an arbitrary scene j may be derived in various ways such as cosine similarity, and in one embodiment, the similarity is derived using Equation 1 It is described as an example, and is not limited thereto.

Accordingly, the similarity calculator 130 calculates the similarity sim( C ₁ (s _j ) , C ₂ ) between the gamer’s emotion C ₁ (s _j ) and the emotion C ₂ ( s _j ) of the emotion story transformation rule server 110 for every story element. (s _j ) ), and then output the similar feeling of the derived story element with a high degree of similarity. That is, the similarity sim( C ₁ (s _j ) between the gamer's emotion C ₁ (s _j ) and the emotion C ₂ (s _j ), ... C _n (s _j ) of the emotion story transformation rule server 110 in the scene ) , C ₂ (s _j ) ),... sim( C ₁ (s _j ) , C _n (s _j ) ) are derived, and then the similar emotion is outputted with the emotion value with the maximum similarity. Here, the similar emotion represents an emotion with a small difference between the gamer's emotion value C ₁ (s _j ) and the emotion value of the emotion element.

For example, the similarity between the gamer's emotion C ₁ ( s _j ) “joy” and the emotion C ₂ ( s _j ) “exciting mood” determined in the emotion story transformation rule server 110 for scene j is calculated by the similarity calculator 130 . The emotion story transformation rule server 110 that is output high in and received the similarity for this scene j is stored by matching emotion C ₂ ( s _j ) instead of the story matching emotion C ₁ ( s _j ) for scene j . The story may be transmitted to the game driver 140 . Accordingly, a story of the same corresponding story element having a high degree of similarity between the gamer's emotion and the emotion of the emotion story conversion rule server may be recommended to the gamer.

On the other hand, the game driver 140 is a story or gamer recommended based on the character skill and emotion story conversion rule 110 of the character control UI 160 matching the input value of the input device 150 operated by the gamer during the game. The game can be played with the story extracted based on the emotions of

Accordingly, according to an embodiment, by recommending a story of an emotion with a high degree of similarity to the gamer's emotion to the gamer, immersion and interest in the game may be further improved, and a new paradigm of game content may be provided.

3 is a flowchart illustrating a story control process of a game using emotional expressions according to an embodiment. A method of controlling a story of a game using emotional expressions according to another embodiment will be described with reference to FIGS. 1 to 3 .

First, in steps S11 and S13, the game terminal 100 of an embodiment derives characteristic information representing an emotional expression from the gamer's face image information obtained through the camera 200, and for the derived characteristic information, each Deduce emotions for each emotional element.

In steps S15 (S17), the game terminal 100 of an embodiment derives a degree of similarity between the emotion for each emotion element derived from an arbitrary story element and the emotion for each emotion element of the emotion story conversion rule server, and the derived similarity Outputs similar emotions of up to high-resolution story elements.

In steps S19 and S21, the game terminal 100 of an embodiment outputs a story for each story element that is stored by matching the similar emotion, and the story for each story element that matches the output similar emotion and the gamer's emotion is matched The game is played as one of the stories for each story element.

According to an embodiment, by recommending a story with a high level of similarity to the gamer's emotions to the gamer, immersion and interest in the game may be further improved, and a new paradigm of game content may be provided.

The game terminal 200 described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions.

An operating system (OS) and one or more software applications running on the operating system may be executed. A processing device may also access, store, manipulate, process, and generate data in response to execution of the software.

For convenience of understanding, although it has been described that one game terminal 200 is used in some cases, those of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types. It can be seen that it can include a processing element of For example, the controller may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

Here, the software may include a computer program, code, instructions, or a combination of one or more thereof, and independently or collectively configure the processing device to operate as desired. The processing unit can be commanded.

Software and/or information, signals and data may be stored in any kind of machine, component, physical device, virtual equipment, computer storage, to be interpreted by a controller or to provide instructions or data to a processing device. It may be permanently or temporarily embodied in a medium or device, or a transmitted signal wave.

The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software.

Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like.

Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like.

The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Although the present invention has been described in detail through representative embodiments above, those of ordinary skill in the art to which the present invention pertains can make various modifications to the above-described embodiments without departing from the scope of the present invention. will understand Therefore, the scope of the present invention should not be limited to the described embodiments and should be defined by all changes or modifications derived from the following claims as well as the claims and equivalent concepts.

Character skills or stories for each story element defined based on the game are matched to each emotional element and stored, and then the character skill or game is played with the story matching the emotional element derived from the gamer's face image information obtained through the camera. Accordingly, it is possible to further improve the immersion and interest in the game, and the accuracy and reliability of the operation of the story control device and method of the game using emotional expressions, which can provide a new paradigm of game content, and furthermore the performance Invention with industrial applicability because it can bring a very big improvement in efficiency, and has sufficient potential for commercialization or sales of game contents using next-generation wireless communication and 5G/6G Internet networks, as well as practically and clearly implementable. am.

Claims (9)

a game terminal that matches an input value of an input device provided from the outside and performs a game or character skill with a story of a predefined character control UI; and a camera that acquires face image information representing the emotional expression of the gamer,
The game terminal
After extracting the characteristic information representing the emotional expression of the gamer from the gamer's face image information obtained through the camera, the emotion value of the corresponding story element of the gamer is derived from the extracted characteristic information, and the corresponding emotion matching the derived gamer's emotion After extracting the story of the story element from the emotional story transformation rule server, the extracted story element is provided to proceed with the character skill or game,
A degree of similarity between the emotion value of the gamer of the corresponding story element and the emotion value of the corresponding story element stored in the emotion story transformation rule is derived, and whether it is the same story element based on the derived similarity is determined, and as a result of the determination, a predefined value for the story element is determined. Instead of the story stored in the story of the character control UI, it is provided to proceed with the character skill or game with the stored story matching the emotion value having the maximum similarity.
The game's story control device using emotional expressions. According to claim 1, wherein the game terminal,
an emotion story conversion rule server for defining and storing stories for each of a plurality of story elements that match emotions representing a plurality of emotional expressions based on the rules of the game;
an expression analyzer for extracting feature information representing a gamer's emotional expression from the gamer's face image information obtained through a camera, and deriving the emotion for each emotional element of the gamer of the story element based on the extracted feature information; and
A game using emotional expressions, characterized in that it includes a game driver that extracts the story of the emotional story transformation rule server matching the gamer's emotion of the corresponding story element, and performs a character skill or game with the extracted story element's story 's story control unit. According to claim 2, wherein the emotion story conversion rule server,
Define the story for each story element based on the game rules, define the character skill for each defined story element, match the story and character skill for each defined story element to each emotion and store it,
A story control device for a game using emotional expressions, characterized in that the story of the corresponding story element of the emotion similar to the emotion of the corresponding story element of the gamer provided from the expression analyzer is extracted and then transmitted to the game driver. The method of claim 2, wherein the emotion value is
A story control apparatus for a game using an emotional expression, comprising at least one of an emotional element, an expression determination probability, and an expression duration, and varying according to each story element. According to claim 2, wherein the game terminal,
A similarity calculator that calculates the similarity between the emotion of the corresponding story element of the gamer and the emotion of the corresponding story element of the story conversion rule server, and then transmits the story matched with the emotion element of the corresponding story element with a high degree of similarity to the game driver. Story control device of the game using emotional expressions, characterized in that. The method of claim 5, wherein the game driver,
A game using an emotional expression, characterized in that it is provided to proceed with a character skill or game as one of a story matched with an emotional element of a corresponding story element with high similarity and a story of a character control UI that matches an input value of a gamer's input device 's story control unit. In the story control method of the game using the emotional expression performed by the game terminal of claim 1,
(a) extracting characteristic information representing the emotional expression of the gamer from the gamer's face image information received through the camera, and calculating the emotions of the emotional elements of the corresponding story elements based on the extracted characteristic information;
(b) extracting the story of the corresponding story element matched with the emotional element of the corresponding story element based on the emotion story transformation rule; and
(c) performing a character skill or a game with one of the extracted story of the corresponding story element and the story selected by the gamer,
The step (b) is,
A degree of similarity between the emotion value of the gamer of the corresponding story element and the emotion value of the corresponding story element stored in the emotion story transformation rule is derived, and whether it is the same story element based on the derived similarity is determined, and as a result of the determination, a predefined value for the story element is determined. A story control method of a game using an emotional expression, characterized in that it is provided to extract a stored story that matches the emotion value having the maximum similarity instead of the story stored in the story of the character control UI. The method of claim 7, wherein the emotion story conversion rule is
Define the story of each story element based on the game rules, define the story or character skill of each story element, and then match the story or character skill for each defined story element to each emotion element and store How to control the story of a game using emotional expressions. The method of claim 8, wherein (b) step,
Calculate the similarity between the emotion element of the story element stored according to the emotion story transformation rule and the emotion element of the story element of the expression analyzer,
A story control method of a game using an emotional expression, characterized in that an emotional element matching the emotional element of the maximum similarity is set as a similar emotion as a result of the calculation, and then a story of the corresponding story element matching the set similar emotion is recommended to the gamer .

Images