KR20200048637A - Method for analyzing video content information in video evaluation system and evaluation terminal adopting the same - Google Patents

Abstract

The present invention relates to a method for analyzing image content information in an image evaluation system and an evaluation analysis terminal using the same. The method for analyzing image content information in an image evaluation system comprises the steps of: providing image content information including content creator intention confirmation information; acquiring biometric information of a subject while executing the image content information, and analyzing the same to generate recognition information and emotion information of the subject; and generating content evaluation information by evaluating the image content information by analyzing the intention confirmation information and the recognition information and the emotion information.

Description

Analysis method of video content information in video evaluation system and evaluation analysis terminal using it {METHOD FOR ANALYZING VIDEO CONTENT INFORMATION IN VIDEO EVALUATION SYSTEM AND EVALUATION TERMINAL ADOPTING THE SAME}

The present invention relates to a method for analyzing video content information in a video evaluation system for analyzing whether a content creator's intention is accurately delivered to a content user in providing a video content service, and an evaluation analysis terminal using the same.

In modern computing and display technology, creators create and create various types of images. In addition to normal 2D images, Imax images that are expanded 2D, 3D images, and 4D images that utilize the five senses such as touch and smell are created according to the purpose.

Among these various images are virtual reality images and augmented reality images. Virtual reality (VR) typically includes the representation of digital or virtual image information that is not transparent to other real-world visual inputs, and augmented reality (AR) is used to visualize the real world around the user. As an augmentation, it typically includes a representation of digital or virtual image information. For example, an augmented reality scene is one or more virtual objects that a user of AR technology overlaps on or among real-world objects (e.g., real-world parks featuring people, trees, buildings in the background, etc.). Make them visible.

The creator, who is the creator of various types of video creations, expects viewers (or users) to watch the video to cause a specific reaction at a certain point, and develops a more interesting and realistic video by developing a story line according to the reaction. I hope. However, in the production process, the evaluation of the video material is merely a qualitative evaluation, and the interaction between the video product and the viewer cannot be evaluated, and thus the completed video production does not sufficiently convey the intention of the video producer to the viewer. There was.

Particularly, as shown in FIG. 1, when a user wearing a VR device uses a virtual reality content service, the content creator should focus attention on point A according to the intention in the virtual reality space, but the user looks differently on point B By focusing, it is possible to miss the video made at point A.

Therefore, the content creator needs to check whether the user sees point A when the content is completed.

Accordingly, before completing the video content, it is necessary to check whether the content creator's intention is accurately transmitted to the user and correct it.

The present invention has been devised in order to solve the above-mentioned problems, and provides video content information including the intention confirmation information of the video content producer to the test subject, and acquires the subject's recognition information and emotion information on the video content information to obtain the video content. The present invention is to provide a method for analyzing image content information in an image evaluation system and an evaluation analysis terminal to which the content evaluation information can be generated by comparing and analyzing the information.

In addition, the present invention has been devised to solve the above-described problems, and the method of analyzing video content information in a video evaluation system and evaluation analysis using the same can be objectively expressed by quantifying the emotion of a subject responding to the video content information. It is intended to provide a terminal.

In addition, the present invention has been devised to solve the above-described problems, and an analysis method for analyzing image content information in an image evaluation system and an evaluation analysis terminal using the same, which can generate content correction guide information based on the content evaluation information. It is to provide.

An analysis method of video content information in an image evaluation system, which is an embodiment of the present invention devised to solve the above-described configuration, includes: providing video content information including intention confirmation information of a content creator; Obtaining biometric information of a subject while executing the image content information, and analyzing it to generate biometric analysis information; And generating content evaluation information by comparing the intention confirmation information with the bio-analysis information and evaluating the video content information, and may include a method for evaluating video content information in the video analysis system.

Here, the intention confirmation information may include intention emotion information and intention target information.

Here, the biometric analysis information may include recognition information and emotion information.

Here, the recognition information includes gaze information, while obtaining the biometric information of the subject while executing the image content information, and analyzing it to generate biometric analysis information, the head mounted display device mounted on the subject's head Obtaining the gaze information through a gaze recognition sensor installed in the; And generating the recognition information by analyzing the gaze information.

Here, the emotion information includes brain wave information, pulse information and sweat secretion information, while obtaining the biometric information of the test subject while executing the image content information, and analyzing it to generate biometric analysis information, the subject's head Obtaining the EEG information using an EEG detection sensor attached to the EEG; Obtaining the pulse information and the sweat secretion information using an optical sensor attached to the skin of the subject; And analyzing the brainwave information, the pulse information, and the sweat secretion information to generate the emotion information.

Here, the generating of the emotion information may include: a normalization step of normalizing the brainwave information, the pulse information, and the sweat secretion information using a normalization function; A morphological processing step of morphologically processing the normalized brain wave information, the pulse information, and the sweat secretion information by reflecting a duration according to intensity; And analyzing the morphologically processed brainwave information, the pulse information, and the sweat secretion information to generate the emotion information.

Here, the normalization step may include the step of utilizing the sigmoid function of Equation 1 below.

Here, the ecological processing step may include utilizing the morphological swelling operation of Equation 2 below.

Here, comparing the intention identification information and the biometric analysis information to evaluate the image content information and generating content evaluation information includes analyzing the intention emotion information and the emotion information and included in the intention emotion information Analyzing the intention emotion information in the intention section data and the emotion information and quantifying a matching part as a true score; And analyzing the intention emotion information and the emotion information, and analyzing the intention emotion information and the emotion information outside the intention interval data included in the intention emotion information, to match the unmatched portion with a false score. Digitizing; may include.

Here, generating the content correction guide information based on the content evaluation information; may further include.

Here, the video content information may be 3D virtual reality content information.

According to another embodiment of the present invention, an evaluation and analysis terminal for video content information includes: a memory unit for storing video content information including intention identification information of a content creator; An image display unit displaying the virtual content information; A biometric information sensor unit for generating biometric information of the subject; And executing the image content information to display on the image display unit, analyzing the biometric information to generate the subject's recognition information and emotion information, and analyzing the intention confirmation information to the recognition information and the emotion information to analyze the image. It may include; an analysis control unit for generating content evaluation information by evaluating the content information.

Here, the analysis control unit normalizes the EEG information, the pulse information, and the sweat secretion information using a normalization function, and forms the normalized EEG information, pulse information, and sweat secretion information by reflecting a duration according to intensity An emotional information generating unit that analyzes the morphologically processed brainwave information, pulse information, and sweat secretion information to generate the emotional information; And a recognition information generation unit analyzing the gaze information and generating the recognition information.

Here, the analysis control unit analyzes the intention emotion information and the emotion information among the intention confirmation information and analyzes and matches the intention emotion information and the emotion information in the intention interval data included in the intention emotion information Is quantified as a matching score, and the intention target information and the recognition information among the intention confirmation information are analyzed to analyze the intention emotion information and the emotion information outside the intention interval data included in the intention emotion information. It may include; a numerical calculation unit for digitizing the unmatched portion to a mismatch score (false score).

According to an embodiment of the present invention having the above-described configuration, before providing the video content service, the content producers evaluate the video content produced by the author, and identify and correct the problems, thereby making unnecessary trial and error This minimizes the cost incurred.

In addition, by analyzing the intention of the content creator and the reaction of the test subject accordingly, various types of interactions can occur to produce high-quality video content.

In addition, it is possible to analyze whether the content creator's intention and the response of the subject match more accurately by detecting the psychological state of the subject, rather than simply detecting the gaze processing using the five sense sensor.

And, based on the content evaluation information, content correction guide information can be generated to efficiently provide a video content service to a real user.

1 is a view for explaining an example of the use of general video content.
2 is a block diagram illustrating a system for evaluating and analyzing video content information in a video evaluation system according to an embodiment of the present invention.
FIG. 3 is a detailed block diagram illustrating the analysis control unit illustrated in FIG. 2.
4 is a view showing emotion information generated through the morphological processing module shown in FIG. 3.
5 is a flowchart illustrating a method of analyzing image content information in an image evaluation system according to an embodiment of the present invention.
6 is a diagram illustrating a situation in which a test subject, which is an embodiment of the present invention, tests a video content service.
FIG. 7 is a detailed flowchart illustrating steps of generating the bioanalysis information illustrated in FIG. 6.
FIG. 8 is a detailed flowchart illustrating steps of generating content evaluation information illustrated in FIG. 6.
9 is a diagram illustrating an example in which content evaluation information generated according to an embodiment of the present invention is displayed on a display unit.
FIG. 10 is a diagram showing an average of matching scores for emotion information among content evaluation information generated when a plurality of users, which is an embodiment of the present invention, test a video content service.

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. The embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be interpreted as being limited to the embodiments described below. These embodiments are provided to explain the present invention in more detail to those of ordinary skill in the art.

2 is a block diagram for explaining an analysis system of image content information in an image evaluation system, which is an embodiment of the present invention, and FIG. 3 is a detailed block diagram for explaining the analysis control unit shown in FIG. 4 is a diagram showing emotion information generated through the morphological processing module shown in FIG. 3. Here, the image content information is described as including 3D virtual reality content information, but may not be limited thereto.

First, before the present invention provides the video content service, the content creator (not shown) adds the intention emotion information and the intention target information to the video content information produced by the content producer through testing the video content service. Here, the intention emotion information is information generated in anticipation of emotions generated while a user (subject) is watching the video content information, for example, the content creator is included in specific section data or a specific object (eg, video content information) The information that is input in advance to the character (for example, a zombie, a ghost, a beauty, etc.), surprise information, stability information, attention information, cognitive load information, stress information, etc. according to the content creator's expectations.

Further, the intention target information may be coordinate information or object location information for confirming whether the user's gaze is at the intended location of the content creator.

At this time, the intention emotion information and the intention target information may be included in the intention confirmation information.

The biometric analysis information to be described later refers to the user's recognition information and emotion information generated when the user views the video content information produced by the content creator. Here, the recognition information may include gaze information, and may include location information of a pupil obtained by the iris recognition sensor installed on the HUD device or motion information of a user obtained by the geomagnetic sensor installed on the HUD device.

Further, the recognition information may be, for example, a gaze recognition sensor, for example, a visual VR device wearable on a head, to obtain gaze information through a head mounted display device. The gaze information may include gaze movement information and gaze concentration time information, which may be visually displayed later. This will be described in more detail in FIG. 6. Alternatively, the recognition information may use FOVE0 as a device for acquiring gaze information using an eye tracking sensor, which can sample gaze information from the gaze tracking at 120 Hz, and wear it in the same way as wearing HMD Can be measured.

The emotion information may include brainwave information, pulse information, and sweat secretion information by analyzing various biological information obtained through an EEG sensor, a motion detection sensor, a pulse sensor, and a sweat secretion sensor, but is not limited thereto.

Specifically, the EEG information may be measured by wearing a wireless communication using Bluetooth using an EEG sensor, for example, an EEG sensor, and wearing it in the form of a head.

In addition, pulse information may be measured through a pulse measurement sensor, for example, a HRV (Heart Rate Variability) sensor, and sweat secretion information may be measured using an optical sensor attached to the skin, but is not limited thereto. For example, it can be measured by wearing it in a form that fits on a finger, such as a ring.

Such biometric analysis information is based on a tendency over time of biometric information, or when a critical movement is detected according to an event, based on this, stability score, surprise score, ambient concentration score, cognitive load score, stress score It generates emotion information such as. This will be described in more detail in FIGS. 9 and 10.

The content evaluation information may be information that visually displays errors or average data generated by analyzing intention confirmation information, recognition information, and emotion information, for example, numerically including numbers or graphs including diagrams.

In addition, the content correction guide information is information that guides a content creator to supplement a portion in which image content information, recognition information, and emotion information do not match with each other based on the content evaluation information, and may be text information and object information.

Next, with reference to FIGS. 2 to 10, an analysis method of image content information in an image evaluation system according to an embodiment of the present invention and an evaluation analysis terminal to which the method is applied will be described.

First, referring to FIG. 2, the video content production and evaluation system may be largely divided into a content production terminal 10 and an evaluation analysis terminal 20.

The content production terminal 10 is a device that produces, stores, and transmits video content produced by a content producer to the evaluation and analysis terminal 20, and the evaluation and analysis terminal 20 is produced by the content production terminal 10 It plays back the video content, evaluates the user's (subject's) recognition level or emotion level, and matches it with the content creator's intention to check how well the content creator's intention is communicated to the user.

Specifically, the content production terminal 10 may include a production DB 11, a production communication unit 12, and a production control unit 13.

The production DB 11 is a component that stores video content produced through the content production terminal 10, various programs for producing video content, authoring tools, and content creation tools. Here, the intention confirmation information is included in the video content. The intention confirmation information may include intention emotion information and intention target information as described above, and the intention emotion information is the emotion that a content creator has on a specific object or content story within a specific section data of the content, for example , It will be expected information such as surprise, joy, sadness, and response time information, and the intention target information is the gaze information of the intended user of the content creator, can be an object (character), and can be coordinate information and response time information. Can be.

The production communication unit 12 may be a wireless communication module (not shown) or a wired communication module (not shown) as a component for delivering the video content to the evaluation analysis terminal 20.

In addition, the production communication unit 12 functions to receive content correction guide information from the evaluation analysis terminal 20 generated by a method described later.

The production control unit 13 is a component that controls the overall operation of the production terminal 10, and uses the user input unit (not shown) and the content production program of the production DB 11 to produce video content, which is produced DB ( 11), and controls the production communication unit 12 to transmit the video content to the evaluation and analysis terminal 20. In addition, it functions to generate correction information for the video content based on the content correction guide information received through the production communication unit 12.

In addition, the evaluation and analysis terminal 20 includes a memory 21, a HUD 22, a biometric information sensor unit 23, a speaker 24, an analysis display unit 25, an analysis communication unit 26, and an analysis control unit 27 It may be configured to include.

The memory 21 is a medium for physically storing various information. In the present invention, data transmitted and received through the analysis and communication unit 26 and an operation program of the evaluation and analysis terminal 20 may be stored. For example, as well as biometric information obtained through the biometric information sensor unit 23, image content information received through the analysis communication unit 26, and content evaluation information generated after evaluation of the user, as well as providing an image content service It can store multiple application programs.

The HUD 22 is a device for playing video content, and is worn on a user's head to play a 3D video. The HUD 22 is also referred to as a head mounted display unit, and is defined as an image display unit in the claims. The HUD 22 is equipped with a gaze recognition sensor, which will be described later, to generate gaze information indicating where the user's gaze is directed.

The biometric information sensor unit 23 is attached to the user directly or indirectly to function to generate biometric information of the user. Specifically, the eye recognition sensor installed on the head mounted display device mounted on the user's head to obtain visual information, the brain wave detection sensor attached to the user's head to obtain brain wave information, pulse information and sweat secretion information It may include an optical sensor attached to the user's skin to obtain, but is not limited thereto.

The speaker 24 is a component that outputs voice information included in the above-described image content, so that the voice and sound of the image content are delivered to the user, and may be a part of the HUD 22.

The analysis display unit 25 is a separate component from the HUD 22, and a flat panel display is used as the analysis display unit 25 as a component for displaying content evaluation information generated by the evaluation analysis terminal 20. Can be. The number of content evaluation information generated after the user experiences the video content may be displayed or displayed as a graph.

The analysis communication unit 26 may be a wireless communication module (not shown) or a wired communication module (not shown) as a component for transmitting and receiving data with the manufacturing terminal. At this time, an input terminal (not shown) for data reception may also belong to this.

The analysis control unit 27 may execute the image content information to generate the user's recognition information and emotion information using the biometric information obtained from the user.

Specifically, the analysis control unit 27 executes the image content information and displays it on the image display unit 22, analyzes the biometric information, generates biometric analysis information including the user's recognition information and emotion information, and displays the intention confirmation information. The content evaluation information may be generated by evaluating the video content information by analyzing the biometric information. That is, the intention target information and the recognition information are compared and analyzed, the intention emotion information and the emotion information are compared and analyzed, and the content correction guide information is generated based on the content evaluation information, and this is produced through the analysis communication unit 26 through the production terminal 10 ), And displays the content evaluation information on the analysis display unit 25.

More specifically, referring to FIG. 3, the analysis control unit 27 may include an emotion information generation unit 270, a recognition information generation unit 272, and a numerical calculation unit 274.

When the user tests the video content information, the emotion information generation unit 270 can objectively generate how faithfully the content creator expresses emotion within a specific section data or a specific object intended by the content creator. For example, the emotion information of 'surprise' may be calculated as surprise degree information by using a sudden increase (or decrease) in the amount of change in the EEG sensor output raw signal. Stable information, attention information, cognitive load information, stress information, and the like may also be applied in the same manner as surprise information, but are not limited thereto.

The emotion information generation unit 270 may include a normalization processing module 2700 and a morphological processing module 2702.

The normalization processing module 2700 may normalize EEG information, pulse information, and sweat secretion information to values between 0 and 1 using a normalization function.

When the user tests the video content information, emotion information may be analyzed based on the user's biometric information, but there is a subject who has a large change in biometric information when the same emotion occurs to a plurality of users, and a user who does not. For example, when there are users A and B, it is assumed that user A is a person having a large change in biometric information, and user B is a person who is not. If you were equally surprised in the same section of A and B or the same object, A would have a large value and B would have a small value. Analyzing with these results results in unfair evaluation, and based on this, it is impossible to obtain reliable results when analyzing video content. Therefore, although it is necessary to normalize the emotion information based on the biosignal within the same range, it may be difficult for a person to define the parameters of the normalization function on their own due to the nature of the biosignal that shows a large variation for each person. In order to solve this problem, in the present invention, biometric information is normalized. As a method for properly normalizing biometric information for each person, it is possible to perform a task of finding an optimal parameter of a normalization function. At this time, the parameter may calculate a parameter of the normalization function using body information (eg, emotion information) felt by the user within the intended section data from the content creator.

In the present disclosure, a sigmoid function such as Equation 1 below is used.

The emotional information normalization function model includes the window size, window travel distance, and normalization function (assuming that the normalization function is used as sigmoid) and slope (e (E)) when analyzing signals. In this case, it is necessary to find five optimal parameters in the range of intensity (w). At this time, in Equation 1, r is emotion data, and S (r) means an output value of the sigmoid function and may be output as a value between 0 and 1.

The morphological processing module 2702 may morphologically process the biometric information normalized by the normalization processing module 2700 by reflecting the duration according to intensity.

The normalized biometric information changes from time to time. Based on this, if the content creator calculates whether it matches the intended intentional emotion information as a score, this result can be said to be correct in terms of signal, but the content creator can view and understand the graph. There are difficulties. Because, assuming that there is a rapid decrease in the user's biometric information at a certain moment, it can be seen that the emotion changes in an instant from a signal point of view, but the emotion actually felt by the user may exist in the form of lingering or even if the same surprise is felt. Biometric information reactions can occur at different time points for each subject. Due to these factors, morphological processing can be performed in the present invention rather than expressing emotion according to the emotion analysis algorithm.

As for the intention emotion information and the afterglow, the morphological expansion operation, which is frequently used in the morphological processing of images, is applied after the time when the emotion occurs. It is assumed that strong emotions last a little longer, and the expansion operation can be performed in proportion to the size of emotion information.

Biometric information of various people may reflect a time when emotions are felt for each individual, a time when the induced emotion is maintained, and a change time of emotion. Due to these various factors, it is not easy to quantify the emotion analyzed using biometric information. The reason is that even if the same emotion is felt, the triggered emotion will be recorded as a high score in the case of a long-lasting subject, and as a small value in the case of a user who is not. If you visualize and express this as it is, it may be correct from a signal point of view, but for those who want to analyze emotions through the results, there may be a possibility that misunderstandings such as the thought that a person who does not have long-lasting emotions felt little emotion have. For this reason, assuming that emotions do not change abruptly within a short period of time (1 second), the stronger the intensity of emotions caused at the time the emotion occurs, the longer the emotion is expressed so that everyone has a similar duration. The expression method performed the morphology expansion operation, which is frequently used in the morphological processing of images, to increase the number of iterations as the intensity was strong.

4 is a view showing emotion information generated through the morphological processing module 2702, (a) represents the biometric information generated through the normalization processing module 2700, (b) the normalized biometric information It is a diagram showing emotion information generated by morphological processing.

On the other hand, the morphology expansion operation equation is as shown in Equation 2. Equation 2 is replaced with the largest value among the surrounding values, and the shape of the graph expands as it is repeatedly calculated. The more intense the emotion, the more repetitive computation is to be performed.

The numerical calculation unit 274 analyzes the intention emotion information and the emotion information in the intention emotion information and analyzes the intention emotion information and the emotion information in the intention interval data included in the intention emotion information to match the matching points (true The score is quantified, and the intentional emotion information and emotion information outside the intention interval data included in the intention emotion information by analyzing the intention target information and the recognition information among the intention confirmation information is analyzed to determine the mismatched score (false) score).

Specifically, the content creator may set a specific object or a specific section data in which a surprise emotion appears in the corresponding video content according to the intention. For example, the interval between 1:05 and 1:07 hours can be set as a section that you want to be very surprised and set the degree of surprise (1:05 ~ 1:07, 100% surprise). Accordingly, when testing the video content service, it is possible to calculate a matching score (true score) and a mismatching score (false score) by comparing the feeling information and the intended emotion information.

The matching score may be a score that matches the intention emotion information set by the content creator and the user emotion information. If the match score is high, it means that the user actually triggered the emotion in the section or object intended by the content creator, which means that the content was produced as intended by the content creator. Conversely, if the matching score is low, it can be considered that the content was not produced as intended. More specifically, when emotion information that is normalized and morphological processing is input in a section or an object intended by a content creator, the average value divided by the section after accumulating it is calculated as a true score.

On the other hand, the mismatch score (false score) may be a score in which the user's emotion information does not match the intention emotion information set by the content creator. If the false score is high, it may mean that a lot of emotion information is generated in a section not intended by the content creator. This may or may not directly affect the content by causing unexpected emotions. More specifically, when emotion information that is normalized and morphological processing is input in a section not intended by the content creator, the average value divided by the section after accumulating it is calculated as a false score.

In the present disclosure, although the numerical calculation unit 274 analyzes the intention emotion information and emotion information to quantify the matching score and the mismatch score in or outside the intention section data, the present invention is not limited thereto, and the intention target information and the recognition information By analyzing, the matching score and the mismatching score within or outside the intended interval data can be quantified.

Hereinafter, a method of analyzing image content information in the image evaluation system will be described with reference to FIGS. 5 and 6. 5 is a flowchart for explaining a method of analyzing image content information in an image evaluation system, which is an embodiment of the present invention, and FIG. 6 is a diagram illustrating a situation in which a test subject, an embodiment of the present invention, tests an image content service. .

As illustrated in FIG. 6, image content information is performed as shown in FIG. 5 in a state in which various biological information sensor units 23 are attached to a user as a test subject.

First, the production terminal 10 produces and stores the video content information, and transmits it to the evaluation and analysis terminal 20 through the production communication unit 12 (S11).

As described above, the image content includes intended intention emotion information and intention target information to be obtained from the user.

Then, the evaluation and analysis terminal 20 receives the video content information through the analysis and communication unit 26 (S21). At this time, the video content information may include a program for providing a video content service.

Next, the user as a test subject is equipped with the biometric information sensor unit 23 as shown in FIG. 6, and the HUD 22 is worn on the head. In this state, the evaluation and analysis terminal 20 reproduces the video content information and performs a test of the video content service (S22).

Next, during the test execution of the video content service, the evaluation and analysis terminal 20 measures biometric information from the user (S23). Here, the biometric information may include gaze information, brain wave information, pulse information, and sweat secretion information, but is not limited thereto.

Next, the evaluation analysis terminal 20 may generate biometric analysis information of the user by analyzing the biometric information received from the user through the analysis control unit 27 (S24). Here, a method of generating the user's biometric analysis information will be described in detail with reference to FIG. 7.

Next, the evaluation and analysis terminal 20 compares the generated intention confirmation information with the recognition information and the emotion information to evaluate the video content information to generate the content evaluation information (S25). At this time, the content evaluation information may be displayed on the analysis display unit 25 to be displayed as a number or as a graph. Here, a method of generating content evaluation information will be described in more detail with reference to FIGS. 8 to 10.

Finally, the evaluation analysis terminal 20 analyzes the content evaluation information again to generate content correction guide information (S26). In the present invention, the content correction guide information is generated in the evaluation and analysis terminal 20, but the production terminal 10 can also automatically generate the content correction guide information through a separate program. The content correction guide information may be transmitted to the production terminal 10 (S27).

Alternatively, the evaluation analysis terminal 20 may transmit the generated content evaluation information to the production terminal 10, and accordingly, the production terminal 10 may generate content correction guide information based on the content evaluation information.

FIG. 7 is a detailed flowchart illustrating steps of generating the bioanalysis information illustrated in FIG. 6.

Referring to FIG. 7, the analysis control unit 27 of the evaluation analysis terminal 20 checks the user's body information (S30). The trend of the received biometric information over time is analyzed, and according to this trend, the user's recognition level and emotion information are analyzed. Here, the biometric information may include gaze information, brain wave information, pulse information, and sweat secretion information, but is not limited thereto.

First, the emotion information generating unit 270 may analyze the brainwave information, pulse information, and sweat secretion information (S31) and generate emotion information (S34).

Specifically, the emotion information generation unit 270 normalizes the brainwave information, pulse information, and sweat secretion information among the biometric information through the normalization processing module 2700 using a normalization function (S32), and a morphological processing module 2702 ) Through morphological processing of normalized EEG information, pulse information, and sweat secretion information by reflecting the duration according to intensity (S33), analyzing morphologically processed EEG information, pulse information, and sweat secretion information to obtain emotion information. It can be generated (S34).

Alternatively, the recognition information generating unit 272 may analyze the gaze information among the biometric information (S35) and generate recognition information (S36).

8 is a detailed flowchart illustrating a step of generating content evaluation information shown in FIG. 6, and FIG. 9 is a view for explaining an example in which content evaluation information generated according to an embodiment of the present invention is displayed on the analysis display unit , FIG. 10 is a diagram showing an average of match scores for emotion information among content evaluation information generated when a plurality of users, which are embodiments of the present invention, test virtual content services.

First, referring to FIG. 8, the analysis control unit 27 of the evaluation and analysis terminal 20 compares the intention confirmation information and the biometric analysis information to evaluate the image content information, and generates intention emotion among the intention confirmation information to generate the content evaluation information By checking the information, intention emotion information and emotion information may be analyzed (S40). In the present disclosure, it was described as analyzing intention emotion information and emotion information, but alternatively, intention target information and recognition information may be analyzed.

Next, the analysis control unit 27 analyzes the intention emotion information and the emotion information, and when emotion information is generated according to the intention emotion information in the intention section data included in the intention emotion information (S41), a numerical calculation unit ( Through 274), intention emotion information and emotion information in the intention interval data included in the intention emotion information may be analyzed to quantify the matched portion as a true score (S42).

In contrast, the analysis control unit 27 analyzes the intention emotion information and the emotion information, and when the intention emotion information outside the intention interval data included in the intention emotion information occurs (S43), the intention through the numerical calculation unit 274 By analyzing intention emotion information and emotion information outside the intention section data included in the emotion information, the mismatched portion may be quantified as a mismatch score (S44).

As illustrated in FIG. 9, the content evaluation information includes a gaze tracking area 100 that largely tracks a user's gaze, and an emotion evaluation area that displays a user's feelings while viewing video content in a graph over time ( 200).

The gaze tracking area 100 displays the gaze information obtained from the bio-information sensor unit 23 as described above and the gaze movement information and gaze stop time information according to the gaze movement information and gaze concentration time information. (120). Here, the line 110 indicates a direction of movement of the gaze, and the circle 120 indicates a time for the gaze to concentrate, and the longer the concentration time, the larger the size of the circle 120. Through this content evaluation information, the content creator can check at a glance whether the subject who is the test subject changes the gaze and whether or not the gaze is focused.

The emotional evaluation area 200 has a stability score based on a tendency over time, such as overpass information, pulse information, and sweat secret information obtained from the biometric information sensor unit 23 as described above, and a critical movement according to an event. , Surprise score, attention score, cognitive load score and stress score are classified and displayed, and the matching score (true) according to whether these scores match intention emotion information within intention interval data included in intention emotion information score) or a mismatch score (false score) according to whether these scores are mismatched with the intention emotion information outside the intention interval data included in the intention emotion information may be displayed as a graph over time.

On the other hand, as shown in FIG. 10, when a plurality of users test video content information, after calculating the matching score (true score) of each user, the calculated matching score (true score) is averaged to group and each You can check the user's matching score.

According to an embodiment of the present invention having the above-described configuration, before providing the video content service, the content producers evaluate the video content produced by the author, and identify and correct the problems, thereby making unnecessary trial and error This minimizes the cost incurred.

In addition, by analyzing the intention of the content creator and the reaction of the test subject accordingly, various types of interactions can occur to produce high-quality video content.

In addition, it is possible to analyze whether the content creator's intention and the response of the subject match more accurately by detecting the psychological state of the subject, rather than simply detecting the gaze processing using the five sense sensor.

And, based on the content evaluation information, content correction guide information can be generated to efficiently provide a video content service to a real user.

The described embodiments may be configured by selectively combining all or part of each embodiment so that various modifications can be made.

In addition, it should be noted that the embodiments are for the purpose of explanation and not for the limitation. In addition, a person skilled in the art of the present invention will understand that various embodiments are possible within the scope of the technical idea of the present invention.

10: production terminal
11: Production DB
12: Production Communication Department
13: Production control
20: evaluation analysis terminal
21: memory
22: HUD, video display
23: biometric information sensor unit
24: speaker
25: analysis display unit
26: analysis communication department
27: analysis control unit
270: emotion information generating unit
2700: Normalization processing module
2702: Morphological processing module
272: recognition information generation unit
274: numerical calculation unit

Claims (14)

Providing video content information including content creator's intention identification information;
Obtaining biometric information of a subject while executing the image content information, and analyzing it to generate biometric analysis information; And
And comparing the intention confirmation information with the bio-analysis information and evaluating the image content information to generate content evaluation information. According to claim 1,
The intention confirmation information includes intention emotion information and intention target information, a method for evaluating image content information in an image analysis system. According to claim 2,
The biometric analysis information includes recognition information and emotion information, and a method for evaluating image content information in an image analysis system. The method of claim 3,
The recognition information includes gaze information,
The step of acquiring biometric information of the subject while executing the image content information, and analyzing it to generate biometric analysis information,
Obtaining the gaze information through a gaze recognition sensor installed in a head mounted display device mounted on the subject's head; And
And analyzing the gaze information to generate the recognition information. The method of claim 3,
The emotion information includes brain wave information, pulse information and sweat secretion information,
The step of acquiring biometric information of the subject while executing the image content information, and analyzing it to generate biometric analysis information,
Obtaining the EEG information using an EEG detection sensor attached to the subject's head;
Obtaining the pulse information and the sweat secretion information using an optical sensor attached to the skin of the subject; And
And generating the emotion information by analyzing the brainwave information, the pulse information, and the sweat secretion information. The method of claim 5,
Generating the emotion information,
A normalization step of normalizing the brainwave information, the pulse information and the sweat secretion information using a normalization function;
A morphological processing step of morphologically processing the normalized brain wave information, the pulse information, and the sweat secretion information by reflecting a duration according to intensity; And
And analyzing the morphologically processed brainwave information, the pulse information, and the sweat secretion information to generate the emotion information. The method of claim 6,
The normalization step,
Using the sigmoid function of the following equation (1); including, evaluation method of the video content information in the video analysis system.

Where m is the midpoint, r is the emotional information measurement, e (E) is the slope, and w is the intensity The method of claim 6,
The ecological treatment step,
A method of evaluating image content information in an image analysis system, including; using a morphological swelling operation of Equation 2 below.

The method of claim 3,
Comparing the intention verification information and the bio-analysis information, and evaluating the video content information to generate content evaluation information,
Analyzing the intention emotion information and the emotion information, and analyzing the intention emotion information and the emotion information in the intention section data included in the intention emotion information to quantify the matched part with a true score step; And
Analyzing the intention emotion information and the emotion information, and analyzing the intention emotion information and the emotion information outside the intention interval data included in the intention emotion information to quantify the mismatched portion as a false score To do; A method of evaluating video content information in a video analysis system, which includes. According to claim 1,
And generating content correction guide information based on the content evaluation information. According to claim 1,
The video content information is a method for evaluating video content information in a video analysis system, which is 3D virtual reality content information. A memory unit for storing video content information including content creator's intention identification information;
An image display unit displaying the virtual content information;
A biometric information sensor unit for generating biometric information of the subject; And
The image content is executed and displayed on the image display unit, and the biometric information is analyzed to generate recognition information and emotion information of the test subject, and the intention confirmation information is analyzed by analyzing the recognition information and the emotion information to obtain the image content. An analysis control unit for evaluating information to generate content evaluation information; including, evaluation and analysis terminal of the video content information. The method of claim 12,
The analysis control unit,
Normalize the EEG information, the pulse information and the sweat secretion information using a normalization function, and morphologically process the normalized EEG information, pulse information, and sweat secretion information by reflecting a duration according to intensity, and the morphological An emotion information generating unit configured to generate the emotion information by analyzing processed brain wave information, pulse information, and sweat secretion information; And
A recognition analysis terminal comprising: a recognition information generator configured to analyze the gaze information to generate the recognition information. The method of claim 12,
The analysis control unit,
The intention emotion information and the emotion information by analyzing the intention emotion information and the emotion information in the intention interval data included in the intention emotion information by analyzing the intention emotion information to match the matched part (true score) Digitize to, and analyze the intention target information and the recognition information among the intention confirmation information to analyze the intention emotion information and the emotion information outside the intention interval data included in the intention emotion information and match the unmatched portion Numerical calculation unit for digitizing the score (false score); including, evaluation and analysis terminal of the video content information.

Images