KR102335968B1 - Method and apparatus for diagnosing conditions of a patient consuming digital content - Google Patents

Abstract

Disclosed are a method and apparatus for diagnosing a condition of a consumer who consumes digital content. A method for diagnosing a consumer's condition includes: receiving measurement data including behavioral data and physiological and psychological data of the consumer measured in the process of consuming digital content; synchronizing the received consumer measurement data with the digital content in time-series and displaying the same on a display; and diagnosing the state of the consumer using the measurement data displayed on the display.

Description

Method and device for diagnosing the condition of consumers consuming digital content

The present invention relates to a method and apparatus for diagnosing the state of a consumer who consumes digital content, and more particularly, to synchronize and display consumer behavioral data and physiological psychological data measured in the process of consuming digital content in time series with digital content. By doing so, it relates to a technology for diagnosing the condition of the consumer.

Recently, the consumption of digital contents for entertainment, advertisement, and learning is rapidly increasing. Examples are YouTube, Netflix, Afreeca TV, Google edu, and MOOC. The proliferation of smart devices and 5G communication networks is accelerating this trend.

This surge in consumption of digital contents has a negative side as well. Consumers can experience waste of time, physical and mental fatigue, and even addiction by misusing and misusing a large number of unspecified digital contents.

Digital content is selected and consumed on digital devices and wireless networks due to technical characteristics. With the recent 4th industrial revolution, changes are taking place in the digital content consumption environment. Wearables, IoT, and big data technologies provide technical conditions for real-time collection and analysis of non-intrusive data displayed in the context of consumer use of digital content, such as interaction behavior, spatiotemporal location, visual focus, and physiological and psychological responses. .

With this in mind, attempts to analyze big data in various fields such as movies, advertisements, health, and education are continuing. However, there is a problem in that it is difficult to properly understand the psychological state of individual consumers and provide a prescription according to it only with a technology-oriented data analysis approach.
Prior art document: Patent Publication No. 10-2018-0127775 (2018.11.30.)

The present invention may provide a method and apparatus for diagnosing a consumer's condition using measurement data including behavioral data and physiological psychological data of the consumer who consumes digital content.

In addition, the present invention provides a method that can help a user to diagnose a consumer's condition by displaying measured data including behavioral data and physiological and psychological data of a consumer who consumes digital content in time series with the corresponding digital content in synchronization and display; device can be provided.

A method for diagnosing a consumer's condition according to an embodiment of the present invention includes: receiving measurement data including the consumer's behavioral data and physiological psychological data measured in the process of consuming digital content; synchronizing the received consumer measurement data with the digital content in time-series and displaying the same on a display; and diagnosing the state of the consumer using the measurement data displayed on the display.

The displaying may include displaying a clinical threshold set for each of the measurement data displayed on the display together with the measurement data displayed on the display.

The clinical threshold value may be set based on a prior research by specialized field, a comparative group average, or a past cumulative average of consumers for each of the measured data.

The displaying may include: displaying, as an outlier position, a time point of measurement data determined to be an outlier by exceeding a clinical threshold among the measured data displayed on the display; The method may further include receiving and displaying the subjective judgment of the consumer on the scene of the digital content corresponding to the outlier position through an interface.

The displaying may include receiving and displaying a user's expert opinion determined based on the measurement data displayed on the display and the user's subjective judgment on the scene of the digital content corresponding to the outlier position among the measurement data through the interface. It may further include the step of

The diagnosing may include extracting a common factor causing a problem to the consumer based on a condition of the consumer diagnosed through the measurement data displayed on the display, and the extracted common factor is used to design and develop the digital content It can be used to fundamentally eliminate negative effects that will affect the consumer.

An apparatus for diagnosing a consumer's state according to an embodiment of the present invention includes a processor, wherein the processor receives measurement data including behavioral data and physiological psychological data of the consumer measured in the process of consuming digital content, and the receiving The measured data of the consumer may be time-series synchronized with the digital content and displayed on the display, and the state of the consumer may be diagnosed using the measured data displayed on the display.

The processor may display a clinical threshold set for each of the measurement data displayed on the display together with the measurement data displayed on the display.

The clinical threshold value may be set based on a prior research by specialized field, a comparative group average, or a past cumulative average of consumers for each of the measured data.

The processor displays, as an outlier position, a point of time of measurement data determined to be an outlier among the measurement data displayed on the display exceeding a clinical threshold, and the consumer for the scene of the digital content corresponding to the outlier position through an interface It is possible to receive and display the subjective judgment of

The processor may receive and display, through the interface, the user's expert opinion determined based on the measurement data displayed on the display and the consumer's subjective judgment on the digital content scene corresponding to the outlier position among the measurement data. .

The processor extracts a common factor causing a problem to the consumer based on the condition of the consumer diagnosed through the measurement data displayed on the display, and the extracted common factor affects the consumer when designing and developing the digital content It can be used to fundamentally remove the negative effect that it will have.

The present invention can diagnose a consumer's condition by using measurement data including behavioral data and physiological and psychological data of the consumer who consumes digital content.

In addition, the present invention can help the user in diagnosing the consumer's condition by displaying the measured data including the behavioral data and physiological psychological data of the consumer who consumes the digital content in time-series synchronization with the corresponding digital content.

1 is a diagram illustrating an apparatus for diagnosing a consumer's condition according to an embodiment of the present invention.
2 is a flowchart illustrating a consumer's condition diagnosis process according to an embodiment of the present invention.
3 is a diagram illustrating an example of a display configuration of an apparatus for diagnosing a state according to an embodiment of the present invention.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, since various changes may be made to the embodiments, the scope of the patent application is not limited or limited by these embodiments. It should be understood that all modifications, equivalents and substitutes for the embodiments are included in the scope of the rights.

The terms used in the examples are used for the purpose of description only, and should not be construed as limiting. The singular expression includes the plural expression unless the context clearly dictates otherwise. In this specification, terms such as "comprise" or "have" are intended to designate that a feature, number, step, operation, component, part, or a combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the embodiment belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

In addition, in the description with reference to the accompanying drawings, the same components are given the same reference numerals regardless of the reference numerals, and the overlapping description thereof will be omitted. In describing the embodiment, if it is determined that a detailed description of a related known technology may unnecessarily obscure the gist of the embodiment, the detailed description thereof will be omitted.

1 is a diagram illustrating an apparatus for diagnosing a consumer's condition according to an embodiment of the present invention.

When trying to diagnose the state of a consumer who consumes digital content, the psychological state of the consumer who consumes the digital content may be different depending on whether the purpose of consumption is entertainment, learning, or product information collection, even for the same digital content. . Therefore, different interpretation frameworks may be required for the misuse of digital content consumers, the degree of pathology, and intervention-promoting prescription.

Furthermore, when ignoring individual differences in subjective judgments such as the purpose of consumption, psychological strength, and valence, and making a judgment on the state of the consumer centered on the average person, the probability of causing not only diagnostic errors but also legal and ethical problems is high. have. Also, even for the same consumer, the pattern of reaction and the degree of pathology may vary from time to time depending on the type and content of digital content.

Therefore, the understanding of consumers who consume digital content is more valid through a clinical approach through the within-subject observational characteristic diagnosis based on the between-subject statistical difference analysis within the group. It can be done ethically.

To this end, a diagnostic equipment that helps clinical experts to accurately judge the consumer's condition by prescribing standardized diagnostic digital contents for individual consumers and presenting the behavioral responses and physiological and psychological responses of the moment systematically-immediately-visually may be needed

Referring to FIG. 1 , the consumer's condition diagnosis apparatus 100 may include a processor 110 , a display 120 , and an interface 130 . First, the processor 110 of the state diagnosis apparatus 100 may receive the measurement data 140 including the consumer's behavioral data and physiological psychological data measured in the process of consuming digital content. In this case, the digital content may be a standardized diagnostic digital content capable of measuring individual differences for each consumer in order to diagnose the consumer's condition.

Specifically, behavioral data is data that can occur in the process of consuming digital content by consumers, and is related to specific behavioral patterns that occur in the process of consumers consuming digital content, such as playback, pause, point search/movement, and adjustment of replay environment. may be information. In addition, the behavior data may additionally include image data of the consumer captured while the consumer consumes digital content.

In addition, the physiological and psychological data may be physiological and psychological measurement information generated in the process of consumers consuming digital content, such as pupil size, brain waves, heart rate variability, electromyography, and respiration.

The processor 110 of the state diagnosis apparatus 100 may synchronize the measurement data 140 selected by the user among the measurement data 140 collected in this way with digital content in time-series and display it on the display 120 . .

In addition, the processor 110 of the state diagnosis apparatus 100 receives the consumer's subjective judgment and the user's expert opinion on the measurement data 140 displayed on the display 120 through the interface 130 and displays it on the display 120 . By displaying it, it can help the user to diagnose the condition of the consumer.

The state diagnosis apparatus 100 stores the consumer's measurement data 140 measured in the process of consuming the digital content as described above and the subjective judgment of the consumer and the professional opinion of the user received through the interface 130 for each consumer in a database. can get angry In addition, the state diagnosis apparatus 100 may provide a management function for performing search-inquiry-deletion-modification, etc. of the measurement data 140 databased for each consumer, the subjective judgment of the consumer, and the professional opinion of the user. .

That is, the user comprehensively considers the measurement data 140 displayed on the display 120 and the consumer's subjective judgment and the user's professional opinion on the measurement data 140 through the management function of the state diagnosis apparatus 100 to become a consumer. condition can be diagnosed passively.

Meanwhile, the processor 110 of the state diagnosis apparatus 100 comprehensively considers the measurement data 140 stored in the database (not shown) and the consumer's subjective judgment and the user's professional opinion on the measurement data 140 . status can be automatically diagnosed.

2 is a flowchart illustrating a consumer's condition diagnosis process according to an embodiment of the present invention.

In operation 210 , the state diagnosis apparatus 100 may receive measurement data including consumer behavior data and physiological psychological data measured in the process of consuming digital content.

At this time, the measured behavioral data is data that can occur in the process of consuming digital content by consumers, and specific behavioral patterns that occur in the process of consumers consuming digital content, such as playback, pause, point search/movement, and adjustment of the replay environment. It may be information related to In addition, the behavior data may additionally include image data of the consumer captured while the consumer consumes digital content.

In addition, the physiological and psychological data may be physiological and psychological measurement information generated in the process of consumers consuming digital content, such as pupil size, brain waves, heart rate variability, electromyography, and respiration.

In operation 220, the state diagnosis apparatus 100 may synchronize the received consumer's measurement data with the corresponding digital content in time-series and display it on the display. In this case, the state diagnosis apparatus 100 may provide the user with a selection interface for selecting the measurement data determined to require intensive analysis from among the received consumer measurement data. Further, the state diagnosis apparatus 100 may extract only selected measurement data from among a plurality of measurement data based on the measurement data selection command received through the selection interface and display the extracted measurement data on the display.

In this case, the state diagnosis apparatus 100 may display a clinical threshold set for each of the measured data displayed on the display together with the corresponding measured data. Here, the clinical threshold may be set based on prior research or reference index for each specialized field for each of the measurement data, and the reference index may include a comparative group average for each of the measurement data or a past cumulative average of consumers. have.

In operation 230 , the state diagnosis apparatus 100 may display, as an outlier position, a time point of measurement data determined to be an outlier by exceeding a clinical threshold among measurement data displayed on the display. Through this, the condition diagnosis apparatus 100 can help the user to more accurately and quickly diagnose the condition of the consumer by specifying and providing the time point of the abnormal reaction shown by the consumer in the process of consuming the digital content. For example, the outlier location displayed on the display includes a bookmark function, so that when a user clicks in response to a specific outlier location, it is possible to quickly move to a scene of digital content corresponding to the specific outlier location.

In operation 240 , the state diagnosis apparatus 100 may receive the consumer's subjective judgment on the scene of the digital content corresponding to the outlier position through the interface and display it on the display. The subjective judgment felt by the consumer at the point in time of the measured data that is judged to be an outlier can be an important variable for the user to diagnose the state of the consumer along with the measured data.

And, in step 250, the state diagnosis apparatus 100 determines the user's expert opinion determined based on the user's subjective judgment on the measured data displayed on the display and the digital content scene corresponding to the outlier position among the measured data. can be received and displayed through the interface.

At this time, the state diagnosis apparatus 100 may database the consumer's measurement data measured in the process of consuming digital content as described above, the consumer's subjective judgment and the user's professional opinion received through the interface for each consumer. . In addition, the state diagnosis apparatus 100 may provide a management function for performing search-inquiry-deletion-modification, etc. of the measurement data databased for each consumer, the subjective judgment of the consumer, and the professional opinion of the user.

That is, the user can passively diagnose the state of the consumer by comprehensively considering the measurement data displayed on the display, the consumer's subjective judgment on the measurement data, and the user's professional opinion through the management function of the state diagnosis apparatus 100 . .

Contrary to this, in step 260 , the state diagnosis apparatus 100 may automatically diagnose the state of the consumer by comprehensively considering the measurement data stored in the database, the consumer's subjective judgment on the measurement data, and the user's professional opinion. .

In operation 270 , the state diagnosis apparatus 100 may provide an appropriate prescription to the consumer based on the state of the consumer diagnosed through the measurement data displayed on the display.

As an example, the condition diagnosis apparatus 100 analyzes the diagnosed consumer's condition and when a pathological predisposition (eg, epilepsy, ADHD, heart disease, cognitive dysfunction, etc.) outside the range of the general public is found, the pathological predisposition By providing a prescription corresponding to the

As another example, the state diagnosis apparatus 100 may analyze the diagnosed state of the consumer and extract a common factor causing a problem in a plurality of consumers including the corresponding consumer. And, the common elements extracted in this way can be used to fundamentally remove negative effects that may affect consumers when designing and developing digital content in the future.

3 is a diagram illustrating an example of a display configuration of an apparatus for diagnosing a state according to an embodiment of the present invention.

Referring to FIG. 3 , the state diagnosis apparatus 100 displays digital content consumed by the consumer in the first area 310 , and includes the consumer's behavioral data and physiological psychological data measured in the process of consuming the digital content. measurement data may be displayed on the second area 320 . In this case, the state diagnosis apparatus 100 may synchronize and display the digital content displayed on the first area 310 and the measurement data displayed on the second area 320 in time series.

The state diagnosis apparatus 100 may provide the user with a selection interface for selecting the measurement data determined to require intensive analysis from among the received consumer measurement data, and according to the measurement data selection command received from the user, a plurality of Only selected measurement data from among the measurement data may be extracted and displayed on the second area 320 .

In this case, the state diagnosis apparatus 100 may display a clinical threshold set for each of the measured data displayed on the second area 320 together with the corresponding measured data. As an example, the state diagnosis apparatus 100 may display the clinical threshold by superimposing it on the corresponding measurement data.

In addition, the state diagnosis apparatus 100 may display, as an outlier position 321 , a time point of the measured data that is determined to be an outlier by exceeding a clinical threshold among the measured data displayed in the second area 320 .

The state diagnosis apparatus 100 may receive the consumer's subjective judgment on the scene of the digital content corresponding to the outlier position through the interface and display it on the third area 330 . As described above, the subjective judgment felt by the consumer at the point of time of the measured data determined as an outlier can be an important variable for the user to diagnose the state of the consumer along with the measured data. In this case, the state diagnosis autonomous 100 may additionally provide an audio recording button and an audio recording button for recording the subjective judgment of the consumer.

Also, the state diagnosis apparatus 100 receives the user's expert opinion determined based on the measurement data displayed in the second area 320 and the subjective judgment of the consumer displayed in the third area 330 through the interface, and receives the user's expert opinion displayed in the fourth area. (340) can be indicated. In this case, the state diagnosis apparatus 100 determines the user determined by the consumer's image data displayed in the fifth area 350 in addition to the measurement data displayed in the second area 320 and the consumer's subjective judgment displayed in the third area 330 . The expert opinion of the user may be received through the interface and displayed in the fourth area 340 .

In addition, the condition diagnosis apparatus 100 uses the data displayed through the first area 310 to the fifth area 350 , when the user wants to diagnose the condition of the consumer, the consumer's personal information and past records, etc. can be additionally provided.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

Software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or apparatus, to be interpreted by or to provide instructions or data to the processing device. , or may be permanently or temporarily embody in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

As described above, although the embodiments have been described with reference to the limited drawings, those skilled in the art may apply various technical modifications and variations based on the above. For example, the described techniques are performed in an order different from the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result.

Therefore, other implementations, other embodiments, and equivalents to the claims are also within the scope of the following claims.

100: status diagnosis device
110: processor
120: display
130: interface
140: measurement data

Claims (12)

receiving, by the processor, measurement data including behavioral data and physiological and psychological data of consumers measured in the process of consuming digital content;
displaying, by the processor, time-series synchronization of the received consumer measurement data with the digital content on a display;
receiving, by the processor, a subjective judgment of a consumer on a scene of the digital content corresponding to a point in time of the measured data determined to be an outlier among the measured data displayed on the display;
Based on (i) the measurement data displayed on the display, (ii) the consumer's subjective judgment on the scene of the digital content corresponding to the outlier, and (iii) the consumer's image data displayed on one area of the display receiving the determined expert opinion of the user;
determining, by the processor, the state of the consumer by using the measurement data, the subjective judgment of the consumer, and the expert opinion of the user together;
extracting, by the processor, a common factor causing a problem in a plurality of consumers including the consumer by analyzing the determined state of the consumer
A method of determining the status of a consumer, comprising a. According to claim 1,
The step of displaying on the display comprises:
A method for determining a state of a consumer for displaying a clinical threshold set for each of the measurement data displayed on the display together with the measurement data displayed on the display. 3. The method of claim 2,
The clinical threshold is,
A method for determining the state of a consumer set based on a prior research by specialized field, a comparative group average, or a past cumulative average of consumers for each of the measurement data. According to claim 1,
The step of displaying on the display comprises:
A method of determining a state of a consumer for displaying a point of time of measurement data that is determined to be an outlier by exceeding a clinical threshold among the measurement data displayed on the display as an outlier position. 5. The method of claim 4,
The step of displaying on the display comprises:
A method for determining the state of a consumer that additionally provides a bookmark function for moving to a scene of digital content corresponding to the displayed outlier position. According to claim 1,
The extracted common elements are
A method for determining the state of a consumer used to fundamentally remove a negative effect that will affect the consumer when designing and developing the digital content. In the device for determining the state of a consumer,
processor
including,
The processor is
Receives measurement data including consumer behavior data and physiological psychological data measured in the process of consuming digital content, synchronizes the received consumer's measured data with the digital content in time series and displays it on a display, the display Receives the consumer's subjective judgment on the scene of the digital content corresponding to the point of time of the measured data determined as an outlier among the measured data displayed in (i) the measured data displayed on the display, (ii) corresponding to the outlier Receives a user's subjective judgment on a scene of digital content and (iii) a user's expert opinion determined based on the consumer's image data displayed on one area of the display, and receives the measurement data, the consumer's subjective judgment and the A consumer's state determination device for determining a consumer's state by using the user's expert opinion together, and extracting a common factor that causes problems for a plurality of consumers, including the consumer, by analyzing the determined state of the consumer. 8. The method of claim 7,
The processor is
A consumer's status determination device for displaying a clinical threshold set for each of the measurement data displayed on the display together with the measurement data displayed on the display. 9. The method of claim 8,
The clinical threshold is,
A consumer's status determination device set based on prior research by specialized field, a comparative group average, or a past cumulative average of consumers for each of the measurement data. 8. The method of claim 7,
The processor is
A consumer's state determination device for displaying a point of time of the measured data that is determined to be an outlier by exceeding a clinical threshold among the measured data displayed on the display as an outlier position. 11. The method of claim 10,
The processor is
A consumer's state determination device that additionally provides a bookmark function for moving to a scene of digital content corresponding to the displayed outlier position. 8. The method of claim 7,
The processor is
The extracted common elements are
A device for determining the state of a consumer used to fundamentally remove a negative effect that will affect the consumer when designing and developing the digital content.

Images