KR102216905B1 - Psychology consultation method capable of tracking psychological changes by providing personalized image and voice - Google Patents

Abstract

The present invention relates to a psychology consultation method capable of tracking psychological changes by providing personalized video and audio, which includes the steps of: preparing a base video; receiving covering video and audio from a counselee terminal; creating a mapping video by mapping the covering video and audio to the base video; transmitting the mapping video to the counselee terminal; receiving response information measured by a response information measurement unit while the mapping video is reproduced in the counselee terminal; creating consultation result information based on the response information; and transmitting the counseling result information to the counselee terminal. Therefore, a counselee can participate in counseling with a more comfortable mind.

Description

Psychological counseling method that can track psychological changes through personalized video and audio provision {PSYCHOLOGY CONSULTATION METHOD CAPABLE OF TRACKING PSYCHOLOGICAL CHANGES BY PROVIDING PERSONALIZED IMAGE AND VOICE}

The present invention relates to a psychological counseling method, and more particularly, to a psychological counseling method capable of tracking psychological changes through provision of personalized images and audio.

The number of counselees visiting the Department of Mental Health Medicine is increasing day by day. Although the prejudice has not completely disappeared yet, in order to recover a healthy mind in a busy daily life, even though he has not been diagnosed with a specific disease, he visits regularly to eliminate the rejection of counseling and is paying more and more attention to the health of the mind.

In general, in mental health medical consultation, experts such as doctors or clinical psychologists determine the current condition through consultation with the counselee, and treatment and prescription are performed based on this.

The counselee proceeds with several tests provided by the counselor and conducts counseling based on them to share the current state. For visitors who have previously visited or who clearly understand their condition, smooth consultation with the counselor and follow-up treatment are generally possible. However, when visiting for the first time or when the current condition or cause is not yet identified, smooth counseling and treatment are difficult only with existing tests and a few questions based on this.

During the initial visit, it is possible to reduce the burden on the counselor and conduct counseling in a more comfortable environment, so that the counselor and the counselor can smoothly consult and share information about the current state more clearly and positively, and both identify the cause of the cause and have a healthy mind. We need a means to find a way to find it.

Korean Patent Publication No. 10-2018-0099403

The present invention is to solve the above-described problems, and by providing a personalized video and audio mapping the covering image and audio desired by the consultant to the base image directly selected by the consultant, the consultant can participate in the consultation with a more comfortable mind. At the same time, its purpose is to provide a psychological counseling method capable of grasping and tracking the factors and patterns of change in the psychological state by collecting and analyzing the reaction information of the subject such as brain waves, pulse, and motion.

The subject of the present invention is not limited to the problems mentioned above, and other problems that are not mentioned will be clearly understood by those skilled in the art from the following description.

A psychological counseling method capable of tracking a psychological change by providing personalized video and audio according to an embodiment of the present invention for solving the above problem includes: preparing a base image; Receiving a covering video and audio from a target terminal; Generating a mapping image by mapping the covering image and audio to the base image; Transmitting the mapping image to the counselee terminal; Receiving response information measured by a response information measuring unit while the mapping image is being reproduced in the interviewee terminal; Generating counseling result information based on the response information; And transmitting the counseling result information to the counselee terminal.

According to an embodiment of the present invention, the preparing of the base image includes: collecting a plurality of base images; Extracting image information including 3D facial coordinate information of a target person appearing in the collected base images; Selecting a base image to be provided to the counselee from among the plurality of base images based on the existing counseling result information of the counselee; Transmitting image information on the selected base image to a target terminal; Receiving information on a base image selected by the counselee among the base images from the counselee terminal; And extracting voice information of the target person appearing in the base image selected by the counselee; including, and generating the mapping image, 3D facial coordinate information and voice information of the cover person appearing in the covering image Extracting; Mapping the cover person to a target person appearing in the base image selected by the consultant based on the 3D facial coordinate information of the cover person appearing in the covering image; And mapping the voice of the target person based on the voice information of the cover person, wherein the generating of the consultation result information comprises: generating analysis information based on the response information; Generating new consultation result information by matching image information on the mapping image with the analysis information; Generating the consultation result information including the existing consultation result information and the new consultation result information; And adding the new consultation result information to the existing consultation result information. Including, the response information may include at least one of pulse information, brain wave information, and motion information of the subject.

According to an embodiment of the present invention, the receiving of the information on the base image includes: receiving information on a target person to be mapped among people appearing in the base image selected by a counselee; And receiving view point information of the mapping image, wherein the analysis information comprises. It may include abnormal pulse information and abnormal EEG information measured as values outside a predetermined range, and motion information during a time when the abnormal pulse information or the abnormal EEG information is generated.

Advantageous Effects of Invention According to the present invention, it is possible to indirectly feel a situation that is difficult to face in reality and obtain counseling effects such as recognizing the current state of mind, recognizing changes in the state of mind, and improving the state of mind. The counselee can recognize the change in the psychological state and the psychological state, and it is possible to track the change in the psychological state by grasping the change between each time point during the corresponding psychological counseling and the change compared to the previous psychological counseling. In addition, the counselee can recognize the factors on the mapping image that have influenced the changes in the psychological state and mental state, and the change in the psychological state by grasping the change between each time point during the corresponding psychological counseling and the change compared to the previous psychological counseling. It is possible to trace.

In other words, through the mapping image, the counselee indirectly encounters the cover person in the covering image that he wants to confront through the mapping image and experiences the unfolding situation in the virtual situation in the base image, allowing him to simultaneously check his or her body change, so that he or she can recognize himself. It is possible to recognize the types of psychological states that are difficult to do, change patterns of psychological states, internal and external factors, etc., and track psychological changes through more or less changes in the base image in repeated psychological counseling, and provide directions for improving mental states. You will be able to explore.

However, the effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the following description.

1 is a block diagram of a psychological counseling system capable of tracking psychological changes through provision of personalized video and audio according to an embodiment of the present invention.
2 is an exemplary configuration diagram of a response information measuring unit of the psychological counseling system of FIG. 1.
3 is an exemplary configuration diagram of a counseling information processing unit of the psychological counseling system of FIG. 1.
4 is a flowchart illustrating steps of a psychological counseling method capable of tracking psychological changes through provision of personalized video and audio according to an embodiment of the present invention.
5 is a flowchart showing each step of the base image preparation step of the psychological counseling method of FIG. 4.
6 is a flowchart illustrating each step of a base image preparation step of the psychological counseling method of FIG. 4.
FIG. 7 exemplarily shows an internal configuration of a computing device that executes a psychological counseling method capable of tracking psychological changes through provision of personalized video and audio according to an embodiment of the present invention.

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but will be implemented in various forms different from each other, and only these embodiments make the disclosure of the present invention complete, and common knowledge in the technical field to which the present invention pertains. It is provided to completely inform the scope of the invention to those who have it, and the invention is only defined by the scope of the claims.

Various aspects and features will be presented by a system that may include multiple devices, components and/or modules, and the like. It is also noted that various systems may include additional devices, components and/or modules, and/or may not include all of the devices, components, modules, etc. discussed in connection with the figures. It must be understood and recognized.

As used herein, “an embodiment,” “example,” “aspect,” “example,” and the like may not be construed as having any aspect or design described as being better or advantageous than other aspects or designs. . The terms'~part','component','module','system', and'interface' used below generally mean a computer-related entity, for example, hardware, hardware It can mean a combination of software and software, or software.

In the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are the same as those generally understood by those of ordinary skill in the art to which the present invention belongs. It has meaning. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless explicitly defined in the embodiments of the present invention, an ideal or excessively formal meaning Is not interpreted as.

In describing the present invention, if it is determined that a detailed description of related known technologies may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted. When'include','have','consists of' and the like mentioned in the specification are used, other parts may be added unless'only' is used. In the case of expressing the constituent elements in the singular, it includes the case of including the plural unless specifically stated otherwise.

Each of the features of the various embodiments of the present invention can be partially or entirely combined or combined with each other, and as a person skilled in the art can fully understand, technically various interlocking and driving are possible, and each of the embodiments may be independently implemented with respect to each other. It may be possible to do it together in a related relationship.

Hereinafter, with reference to the accompanying drawings, a psychological counseling method capable of tracking psychological changes through provision of personalized images and audio according to the present invention will be described.

Referring to FIG. 1, a psychological counseling system capable of tracking psychological changes through provision of personalized video and audio includes a response information measuring unit 1000, a counseling information processing unit 3000, a counselee terminal 4000, and a counselor terminal. 5000).

The reaction information measuring unit 1000 collects reaction information generated by the reaction of the subject. Reaction information is biometric information such as EEG, pulse, body temperature, blood sugar, pupil changes, blood pressure, dissolved oxygen in blood, etc. that can be measured from the subject's body through a measurement module attached or worn on the subject's body, and detects the subject's movement. It includes motion information that can be measured through a capable detection module. The response information measurement unit 1000 transmits the collected response information to the consultation information processing unit 3000.

The counseling information processing unit 3000 generates, processes, transmits and receives, and stores counseling information, and transmits the counseling information to the counselee terminal 4000 and the counselor terminal 5000. The counseling information includes the above-described response information, image information related to an image to be provided to the counselee, an image to be provided to the counselor, response information, image information, and result information derived based on the image. The consultation information processing unit 3000 receives response information from the response information measurement unit 1000. The counseling information processing unit 3000 induces active counseling participation of the counselee by providing counseling information to the counselee, and may identify and track changes in factors and changes in the psychological state of the counselor.

The counselee terminal 4000 provides the counseling information received from the counseling information processing unit 3000 in a form that the counselee can check. The counselee terminal 4000 may provide image information, video, and counseling result information to the counselee to induce a change in psychology of the counselee, an action according to an intention, and an understanding of the counseling result.

The counselor terminal 5000 provides the counseling result information received from the counseling information processing unit 3000 in a form that the counselor can check. The counselor terminal 5000 provides information including response information, video information, video, counseling result information, intermediate calculation information derived from the process of processing the counseling information by the counseling information processor 3000 to the counselor. It can induce the counselor's psychological change, the counselor's understanding of intention, and the recognition of the counseling result.

The consultant terminal 4000 and the consultant terminal 5000 may be communication devices capable of network access such as a desktop computer, a laptop computer, a smart phone, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet PC, etc. There is no limit to the number of me. In particular, the target terminal 4000 includes a head mounted display (HMD) device for realizing virtual reality, and may enhance the reality of an indirect experience in the process of conducting psychological counseling while watching a mapping image to be described later.

Referring to FIG. 2, the response information measurement unit 1000 includes a pulse rate measurement module 1100, an EEG measurement module 1200, and a motion detection module 1300. The response information measuring unit 1000 transmits the collected response information of the counselee to the counseling information processing unit 3000.

The pulse measurement module 1100 is worn on the wrist of the subject to measure the pulse rate of the subject. Pulse information that can be obtained through pulse measurement includes heart rate, heart rate variability index, sympathetic activity index, parasympathetic activity index, autonomic activity index, and autonomic balance index. Pulse information of the counselee measured by the pulse rate measurement module 1100 may be transmitted to the counseling information processing unit 3000 and used to determine the psychological state of the counselee.

The pulse measurement module 1100 may include a sensor for measuring pulse rate, such as a photoplethysmography (PPG) sensor and an electrorocardiogram (ECG) sensor. In addition, the pulse rate measurement module 1100 may be provided with known elements and circuits required to process a signal generated from a sensor and transmit it to the consultation information processing unit 3000.

The EEG measurement module 1200 is attached to the head of the subject to measure the EEG of the subject. EEG information obtained through EEG measurement includes information on one or more frequency domains of delta, theta, alpha, beta, and gamma measured from the left and right brains. The EEG information of the counselee measured by the EEG measurement module 1200 may be transmitted to the counseling information processing unit 3000 and used to determine the psychological state of the counselee.

The EEG measurement module 1200 may include a sensor for measuring EEG, such as an Electroencephalogram (EEG) sensor. In addition, the EEG measurement module 1200 may be provided with known elements and circuits necessary for processing a signal generated from a sensor and transmitting it to the consultation information processing unit 3000.

The motion detection module 1300 is worn, attached, or held by the counselor to detect the motion of the counselor. Motion information that can be obtained through motion detection includes input motions such as selecting a part of two or more options or executing a function according to video playback, an expression motion required for consultation through video, and counseling. It may include psychological movements to identify psychological changes such as concentration, tension, and embarrassment of the counselee. The motion information of the counselee measured by the motion detection module 1300 may be transmitted to the counseling information processing unit 3000 and used to grasp the counselee's intentions, requirements, and mental state.

The motion detection module 1300 may include sensors for detecting various motions, such as a gyro sensor, an acceleration sensor, a pressure sensor, a torque sensor, and an iris recognition sensor. In addition, the motion detection module 1300 may include known elements and circuits required to process a signal generated from a sensor and transmit it to the consultation information processing unit 3000.

Referring to FIG. 3, the consultation information processing unit 3000 may include a processor 3100, a memory 3200, a network interface 3300, and a bus (shown by an arrow). The memory 3200 may include an operating system (OS) 3210, a program execution code 3220, and information on a consultant 3230. The consultation information processing unit 3000 may be a personal computer or a server. For example, the consultation information processing unit 3000 includes mobile devices such as smartphones and tablets, PCs such as desktops and laptops, mobile medical devices, digital cameras, and wearables. It may be a device or a smart watch.

The processor 3100 may include an image processing unit 3110, an image recommendation unit 3120, a reaction information collection unit 3130, a reaction information analysis unit 3140, and a consultation information providing unit 3150. . In another embodiment, the consultation information processing unit 3000 may further include components different from the components shown in FIG. 3.

The processor 3100 may be configured to process instructions of a computer program by performing input/output operations such as basic arithmetic, logic, and an image optimization method for a compressed package file. Instructions may be provided to the processor 3100 through the memory 3200 or the network interface 3300 or a bus. The processor 3100 includes program codes for the image processing unit 3110, the image recommendation unit 3120, the reaction information collection unit 3130, the reaction information analysis unit 3140, and the consultation information providing unit 3150. It can be configured to run. The program code may be stored in a recording device such as the memory 3200.

The processor 3100 includes consultation information including an image processing unit 3110, an image recommendation unit 3120, a response information collection unit 3130, a response information analysis unit 3140, and a consultation information providing unit 3150. It may be configured to implement the processing unit 3000. The processor 3100 may be configured such that some components are omitted, additional components not shown are further included, or two or more components are combined according to a method of implementing the counseling information processing unit 3000.

The memory 3200 is a computer-readable recording medium and may include a permanent mass storage device such as a random access memory (RAM), read only memory (ROM), and a disk drive. In the memory, the OS 3210, the program execution code 3220, and the counselor information 3230 including response information, video information, counseling result information, and personal information of the counselee may be stored. These software components may be loaded from a separate computer-readable recording medium such as a floppy drive, disk, tape, DVD/CD-ROM drive, or memory card. In another embodiment, software components may be loaded into the memory 3200 through the network interface 3300 rather than a computer-readable recording medium.

The network interface 3300 may be a computer hardware component for connecting the consultation information processing unit 3000 to a computer network. The network interface 3300 may connect the consultation information processing unit 3000 to a computer network using a wireless connection or a wired connection method. The consultation information processing unit 3000 may be wirelessly connected or wired to another electronic device or system through the network interface 3300.

The bus may enable communication and data transmission between components of the consultation information processing unit 3000. The bus may be configured using one or more of a high-speed serial bus, a parallel bus, a storage area network (SAN), and other communication methods.

The image processing unit 3110 may collect a plurality of base images. The image processing unit 3110 may collect a plurality of base images through various media through the network interface 3300. The image processing unit 3110 may collect the divided base image to include one or more scenes to proceed with psychological counseling with the counselee. The image processing unit 3110 may collect various base images in consideration of the length of the image, the number of scenes, the person who appears, and the viewpoint. The collected base image may be stored in the memory 3200, a separate recording medium, or an external database.

The image processing unit 3110 may extract image information including 3D facial coordinate information of a target person appearing in a plurality of collected base images. The image information is based on the length of the image, the number of people, the personality, age and sex of the person, the three-dimensional facial coordinate information of the person, the characteristics of the scene, the viewpoint information of the first person or the third person, the emotional characteristics between people, the characteristics of the change of emotion. May include information about. The image information for the base image includes 3D facial coordinate information for a target person, which is a person that can be mapped by a covering image, among appearing people. The image processing unit 3110 may extract image information on the collected base image, thereby providing various types of information required for selection of a base image by a subject and coordinate information necessary for mapping. The target person is a person who replaces the role of the person who wants to be indirectly encountered in the virtual situation given through the base video, and is mapped to the image of the cover person in the covering video, so that the cover person feels as if they are taking the role during consultation. Corresponds to the basic person.

The 3D facial coordinate information of the target person may be extracted from the base image by the image processing unit 3110 with a predetermined image processing algorithm previously stored in the memory 3200. The 3D facial coordinate information may be extracted through a specific shape, pattern, color, or combination thereof included in the face of the target person. Image processing algorithms for extracting facial coordinate information include HOG (Histogram of Oriented Gradient), Haar feature, SIFT (Scale Invariant Feature Transform), LBP (Local Binary Pattern), and various other known image processing algorithms. Can be. Based on such an image processing algorithm, coordinate information for one or more of the facial portions including the eye, nose, mouth, chin, and forehead may be extracted from the face of the target person. The 3D facial coordinate information of the target person may include a change value in each frame based on the coordinate information for the reference frame. In addition, the 3D facial coordinate information of the target person may be obtained by calculating one reference coordinate based on the facial coordinate information secured in each frame.

The image processing unit 3110 receives the covering image from the counselee terminal 4000. The covering image includes an image of a cover person to be mapped to a target person of the base image. In the covering image, a feature part of the cover person corresponding to all or part of the coordinates of the 3D facial image extracted from the target person may appear in order to map to the target person of the base image. The cover person of the covering image may be a real person who wants to indirectly face the counselee in the environment of the virtual mapping image in a situation given in the base image. The counselee visits the counselor with a covering video of a person who is difficult to face in person, and while watching a mapping image that maps the covering image to the base image provided by the counselor, indirectly feels a situation that is difficult to face in reality and from there Counseling effects such as recognizing the psychological state of the patient, recognizing the change in the mental state, and improving the mental state can be achieved.

The image processing unit 3110 generates a mapping image by mapping a covering image to a base image. The mapping image may be generated by synthesizing an image included in the covering image based on a part or the entire image of a target person in a part or all frames of the base image. The mapping image has substantially the same image information as the base image information, but may be generated by replacing or synthesizing a part or all images of the target person appearing in the base image with a part or all images of the cover person appearing in the covering image. . In this way, by mapping the covering image to the base image through the image processing unit 3110, when the subject views the mapping image, he or she can feel the psychological change that can be felt by viewing the existing base image, but the cover person of the covering image provided by the subject You can feel like it appears in this base video.

The image processing unit 3110 may extract 3D facial coordinate information of the cover person appearing in the covering image. The image information on the covering image includes 3D facial coordinate information on the cover person, which is a person to be mapped to the base image, among the people appearing. The image processing unit 3110 may prepare information for mapping to a target person of the base image by extracting 3D facial coordinate information of the cover person from the covering image.

The 3D facial coordinate information of the cover person may be extracted from the covering image through the image processing algorithm described above. The 3D facial coordinate information may be extracted through a specific shape, pattern, color, or combination thereof included in the face of the cover person. The 3D facial coordinate information of the cover person may be extracted from the covering image based on an angle obtained by obtaining the facial coordinates of the target person in the reference frame of the base image. In addition, the 3D facial coordinate information of the cover person may be obtained by calculating one reference coordinate based on the facial coordinate information secured in each frame.

The image processing unit 3110 may map the cover person to the target person appearing in the base image selected by the consultant based on 3D facial coordinate information of the cover person appearing in the covering image. The image processing unit 3110 may replace or synthesize a part or all images of the target person in the base image with a part or all images of the cover person in the covering image based on 3D facial coordinate information of the cover person and the target person. The image processing unit 3110 matches each characteristic part based on the 3D facial coordinate information of the cover person and the 3D facial coordinate information of the target person, and corresponds to the image according to the facial angle of the target person in each frame. You can create an image of a cover person. A well-known image synthesis algorithm may be freely employed to synthesize the image of the cover person into the base image.

The image processing unit 3110 transmits the generated mapping image to the counselee terminal 4000. The mapping image is transmitted from the consultation information processing unit 3000 to the counselee terminal 4000 after the mapping of the entire image is completed, or the viewable part is sequentially selected so that the counselee can directly view the mapping image while the mapping image is being transmitted. 4000) can also be transmitted in a streaming method.

The image recommender 3120 may select a base image to be provided to the counselee from among a plurality of base images based on the existing counseling result information of the counselee. If there is a history of psychological counseling, the image recommender 3120 may select a base image to be provided to the counselee based on the counseling result information accumulated in the counselee information 3230 stored in the memory 3200. The selected base image may include the base image provided in the previous psychological counseling, and may include other base images not previously provided in consideration of the relationship with the base image provided in the previous psychological counseling, the psychological change state of the counselee, and the like. If there is no history of psychological counseling, information necessary for selecting a base image may be obtained through a preliminary survey in the form of a questionnaire prior to psychological counseling, and may be added to the counselee information 3230.

The image recommender 3120 may transmit image information on the selected base image to the counselee terminal 4000. The image information transmitted to the client terminal 4000 includes the length of the image, the number of people, the personality, age and gender of the person, 3D facial coordinate information of the person, the characteristics of the scene, the viewpoint information of the first person or the third person, In addition to information on the emotional characteristics and the changing characteristics of emotions, various information on the base image, which is helpful in the selection of the counselee, may be included, including an image of a representative scene appearing in the base image.

The image recommending unit 3120 may receive information on the base image selected by the counselee among the base images from the counselee terminal 4000. The image recommending unit 3120 may receive identification information of a base image selected by a counselee from among the base images. The image recommender 3120 may receive information on one target person to be mapped when more than one target person appears in the base image as the information on the selected base image. When each image according to the first-person view and the third-person view is prepared for the base image having the same content, view information of the mapped image to be provided may be further received.

The reaction information collection unit 3130 receives reaction information of the counselee from the reaction information measurement unit 1000. The response information collection unit 3130 receives pulse information measured by the pulse measurement module 1100, receives brain wave information measured by the brain wave measurement module 1200, and is measured by the motion detection module 1300. Can receive motion information.

The response information collection unit 3130 receives the response information measured by the response information measurement unit 1000 while the mapping image is being played back in the target terminal 4000. The response information includes biometric information such as brain waves, pulse, body temperature, blood sugar, pupil changes, blood pressure, and the amount of dissolved oxygen in the blood that can be measured from the subject's body, and motion information capable of quantifying the detectable movement of the subject. The response information may include one or more of pulse information, brain wave information, and motion information of the subject. The pulse information may include one or more of the heart rate, heart rate variability index, sympathetic activity index, parasympathetic activity index, autonomic activity index, and autonomic balance index. The EEG information may include information on one or more frequency domains of delta, theta, alpha, beta, and gamma measured from the left and right brains. The motion information includes input motions such as selecting some of two or more options or executing a function according to the playback of an image, an intentional expression motion required to proceed with a consultation through an image, the client's concentration, tension, and It may include information on characteristic behaviors of the subject that can be quantified, such as psychological movements to grasp psychological changes such as embarrassment.

The response information analysis unit 3140 generates counseling result information based on the response information. The counseling result information may include analysis information that can be derived based on one or more of a response information of a counselee, detailed image information about a base image used in the mapping image and the mapping image, response information, and image information. Counseling result information may be provided to the counselor, and may include information for confirming what kind of reaction the counselee showed through viewing of the mapping image, and confirming the psychological state of the counselor's response and the contents of the psychological change.

The reaction information analysis unit 3140 may generate analysis information based on the received reaction information. The analysis information may include abnormal pulse information and abnormal EEG information measured as a value outside a predetermined range, and motion information during a time when the abnormal pulse information or the abnormal EEG information is generated. The abnormal pulse information and the abnormal EEG information may be pulse information and brain wave information measured during different sections, or pulse information and EEG information having a difference of more than a preset value compared to the average pulse information and EEG information. The analysis information is information on the psychological state of the subject such as tension, embarrassment, concentration, anxiety, stress, excitement, and tranquility through one or more of pulse information including abnormal pulse information, brain wave information including abnormal brain wave information, and motion information. It may include.

The response information analysis unit 3140 includes a gamma wave indicating an anxiety or excitement state of the subject through brain wave information, a beta wave indicating an activity, stress, or immersion state, an alpha wave indicating a stable state such as meditation or relaxation, and a shallow sleep or sleepiness. Through the theta wave representing the state and the delta wave representing the deep sleep state, the psychological state and its level of the counselee can be derived. The response information analysis unit 3140 can directly or indirectly derive the psychological state and level of the counselee by using the tendency to change irregularly by physical factors such as psychological factors such as anxiety and stress and physical factors such as movement of the counselee through pulse information. have. The type of reaction information required for the determination of each psychological state, the calculation process for determining the level of each psychological state according to the corresponding reaction information, and the numerical range for each level are adopted from known research results, but continuous consultation result information is accumulated. It can be reset through confirmation and feedback of the counselor and condition correction.

The analysis information may include analysis information on a relationship between the response information and the image information according to time while the counselee views the mapping image. The analysis information may include information on a psychological state determined according to the type and level of abnormal pulse information, abnormal brain wave information, or other reaction information and the level of change thereof. The reaction information analysis unit 3140 may generate analysis information with a state and change of reaction information according to the time-by-time image information through synchronization of the playing time of the mapping image and the reception time of the reaction information. Through this, the counselee can recognize the change in the psychological state and the psychological state, and it is possible to track the change in the psychological state by grasping the change between each time point during the corresponding psychological counseling and the change compared to the previous psychological counseling.

The counseling information providing unit 3150 may generate new counseling result information by matching image information on the mapping image with analysis information. The counseling result information may include progress information and results to be provided to the counselee who has undergone psychological counseling, such as response information, video information, analysis information, and information matching such information according to various conditions. The consultation result information may include analysis information and a content determining whether a meaningful relationship exists between features such as conversation content, background, and emotional change situation of the scene of the mapping image that have influenced the information. The counselee can recognize the factors on the mapping image that have influenced the change in the psychological state and the psychological state, and track the change in the psychological state by identifying the change between each time point during the corresponding psychological counseling and the change compared to the previous psychological counseling. It is possible.

The counseling information provider 3150 may add new counseling result information to the existing counseling result information. In the case of a counselor with an existing psychological counseling history, the existing counseling result information exists in the counselor information 3230 stored in the memory 3200 of the counseling information processing unit 3000, so when providing psychological result information, it is provided together with the existing counseling result information. Also, the counselor may add new counseling result information to the existing counseling result information of the counselee information 3230 to continue management.

The counseling information provider 3150 transmits the counseling result information to the counselee terminal 4000. The counseling information providing unit 3150 may transmit counseling result information in which the existing counseling result information and the new counseling result information are combined to the counselee terminal 4000. The counseling information providing unit 3150 may also transmit counseling result information to the counselor terminal 5000 so that the counselor may also check the counseling result information. The counseling result information transmitted to the counselee terminal 4000 may be provided by visualization so that the counselee can easily grasp response information, motion information, analysis information, etc. in addition to counseling result information for management.

Referring to FIG. 4, the psychological counseling method capable of tracking psychological changes through the provision of personalized images and audio according to an embodiment of the present invention using the aforementioned psychological counseling system includes a base image preparation step (S100), a covering image, and Voice reception step (S200), mapping image generation step (S300), mapping image transmission step (S400), response information reception step (S500), counseling result information generation step (S600), and counseling result information transmission step (S700) is included.

First, a base image that is the basis of the mapping image is prepared (S100). The base image may include an image for some scenes such as a movie, a drama, an animation, etc. that have been previously released, an image that can be released and used online, and a separately produced image. The base image may include content for proceeding with counseling for the counselee. For example, the base image may include a scene in which a plurality of people appear and have a conversation. The base image may include a scene in which people with a specific personality appear, have a conversation in a specific situation, and express a change in emotion. It is possible to provide a base image suitable for psychological counseling of the counselee by preparing a number of base images including various types of emotions and various types of emotion changes, with characters with various personalities appearing and various situations are given. Such a base image can greatly contribute to grasping the psychological state and factors of change that are difficult to clearly grasp by the counselee by providing a virtual situation that the counselee wants to encounter with the person he wants to be indirectly. The base image preparation step S100 may include the following specific steps.

Referring to FIG. 5, first, a plurality of base images may be collected (S110). As described above, a plurality of base images may be collected through various media. The divided base image may be collected to include one or more scenes to proceed with psychological counseling with the counselee. Various base images may be collected in consideration of the length of the image, the number of scenes, the characters, and viewpoints.

Next, image information including 3D facial coordinate information of a target person appearing in the collected plurality of base images may be extracted (S120). The image information is based on the length of the image, the number of people, the personality, age and sex of the person, the three-dimensional facial coordinate information of the person, the characteristics of the scene, the viewpoint information of the first person or the third person, the emotional characteristics between people, the characteristics of the change of emotion. May include information about. The image information for the base image includes 3D facial coordinate information for a target person, which is a person that can be mapped by a covering image, among appearing people. By extracting image information on the base image collected in the collecting step (S110), various pieces of information required for selection of the base image by the counselee and coordinate information necessary for mapping may be provided. The target person is a person who replaces the role of the person who wants to be indirectly encountered in the virtual situation given through the base video, and is mapped to the image of the cover person in the covering video, so that the cover person feels as if they are taking the role during consultation. Corresponds to the basic person.

The 3D facial coordinate information of the target person may be extracted from the base image through a predetermined image processing algorithm. The 3D facial coordinate information may be extracted through a specific shape, pattern, color, or combination thereof included in the face of the target person. Image processing algorithms for extracting facial coordinate information include HOG (Histogram of Oriented Gradient), Haar feature, SIFT (Scale Invariant Feature Transform), LBP (Local Binary Pattern), and various other known image processing algorithms. Can be. Based on such an image processing algorithm, coordinate information for one or more of the facial portions including the eye, nose, mouth, chin, and forehead may be extracted from the face of the target person. The 3D facial coordinate information of the target person may include a change value in each frame based on the coordinate information for the reference frame. In addition, the 3D facial coordinate information of the target person may be obtained by calculating one reference coordinate based on the facial coordinate information secured in each frame.

Thereafter, a base image to be provided to the counselee may be selected from among a plurality of base images based on the existing counseling result information of the counselee (S130). If there is a history of psychological counseling, a base image to be provided to the counselee may be selected based on accumulated counseling result information. The selected base image may include the base image provided in the previous psychological counseling, and may include other base images not previously provided in consideration of the relationship with the base image provided in the previous psychological counseling, the psychological change state of the counselee, and the like. If there is no history of psychological counseling, information necessary for selecting a base image can be obtained through a preliminary survey in the form of a questionnaire before psychological counseling.

Thereafter, image information on the selected base image may be transmitted to the target terminal (S140). The image information transmitted to the target terminal includes the length of the image, the number of people, the personality of the person, the age and gender, the three-dimensional facial coordinate information of the person, the characteristics of the scene, the viewpoint information of the first person or the third person, the emotional characteristics between the people, Along with information on the characteristics of the emotion change, various information on the base image, which is helpful for the selection of the counselee, including an image of a representative scene appearing in the base image may be included.

Information on the base image selected by the counselee among the base images may be received from the counselee terminal (S150). Identification information of the base image selected by the counselee among the base images transmitted in the base image information transmission step S140 may be received. In addition, when more than one target person appears in the base image, information on one target person to be mapped may be received. When each image according to the first-person view and the third-person view is prepared for the base image having the same content, view information of the mapped image to be provided may be further received.

Voice information of the target person appearing in the base image selected by the counselee may be extracted (S160). When a plurality of people appear in the base image, only the voice information of the target person to be mapped may be separated and extracted by the covering image. Voice information may include a voice waveform, frequency change, and intensity. In this step (S160), various means that can be used to grasp, extract, and analyze voice information may be employed.

Then, the covering video and audio are received from the target terminal (S200). The covering image and audio include an image and an audio of a cover person to be mapped to a target person of the base image. In the covering image and voice, a feature part of the cover person corresponding to all or part of the 3D facial image coordinates extracted from the target person in order to map to the target person in the base image and the target person in order to map the target person's voice in the base image. The feature of the cover person corresponding to all or part of the voice information extracted from may be displayed. The cover person of the covering image may be a real person who wants to indirectly face the counselee in the environment of the virtual mapping image in a situation given in the base image. The counselee visits the counselor with a covering video of a person who is difficult to face in person, and while watching a mapping image that maps the covering image to the base image provided by the counselor, indirectly feels a situation that is difficult to face in reality and from there Counseling effects such as recognizing the psychological state of the patient, recognizing the change in the mental state, and improving the mental state can be achieved.

Next, a mapping image is generated by mapping a covering image to the base image (S300). The mapping image may be generated by synthesizing an image included in the covering image based on a part or the entire image of a target person in a part or all frames of the base image. The mapping image has substantially the same image information as the base image information, but may be generated by replacing or synthesizing a part or all images of the target person appearing in the base image with a part or all images of the cover person appearing in the covering image. . In this way, by mapping the covering image to the base image, when the subject views the mapping image, he or she can feel the psychological change that can be felt by viewing the existing base image, as if the cover person of the covering image provided by the counselor appeared in the base image. I can feel it. The mapping image generation step S300 may include the following specific steps.

First, it is possible to extract 3D facial coordinate information and voice information of the cover person appearing in the covering image. The image information on the covering image includes 3D facial coordinate information and audio information for a cover person, which is a person to be mapped to a base image, among appearing people. Information for mapping to the target person of the base image may be prepared by extracting 3D facial coordinate information and audio information of the cover person from the covering image secured in the receiving step (S200).

The 3D facial coordinate information of the cover person may be extracted from the covering image through the image processing algorithm described above. The 3D facial coordinate information may be extracted through a specific shape, pattern, color, or combination thereof included in the face of the cover person. The 3D facial coordinate information of the cover person may be extracted from the covering image based on an angle obtained by obtaining the facial coordinates of the target person in the reference frame of the base image. In addition, the 3D facial coordinate information of the cover person may be obtained by calculating one reference coordinate based on the facial coordinate information secured in each frame.

Thereafter, the cover person may be mapped to the target person appearing in the base image selected by the counselor based on the 3D facial coordinate information of the cover person appearing in the covering image. Covering a part or the entire image of the target person in the base image based on the three-dimensional facial coordinate information of the cover person and the target person acquired through the base image information extraction step (S120) and the above-described covering image information extraction step It can be replaced or combined with a partial or full image of a person. Based on the 3D facial coordinate information of the cover person and the 3D facial coordinate information of the target person, each characteristic part is matched, and an image of the cover person corresponding to the image according to the facial angle of the target person is generated in each frame can do. A well-known image synthesis algorithm may be freely employed to synthesize the image of the cover person into the base image.

Based on the voice information of the cover person appearing in the covering image, the cover person may be mapped to the voice of the target person appearing in the base image selected by the counselee. Based on the voice information of the target person and the cover person obtained through the target person voice information extraction step (S160) and the above-described cover person voice information extraction step, a part or all of the target person's voice from the base image is covered by the cover person of the covering image. Can be replaced or altered with some or all of the voice. Each characteristic part can be matched based on the voice information of the cover person and the voice information of the target person, and the voice generated at each viewpoint can be changed.

Then, the generated mapping image is transmitted to the target terminal (S400). The mapping image may be transmitted to the client terminal after the mapping of the entire image is completed, or may be transmitted in a streaming manner so that the viewable portion is sequentially transmitted to the client terminal so that the client can immediately view the mapping image while the mapping image is being transmitted.

Then, the measured response information is received while the mapping image is being reproduced in the subject terminal (S500). The response information includes biometric information such as brain waves, pulse, body temperature, blood sugar, pupil changes, blood pressure, and the amount of dissolved oxygen in the blood that can be measured from the subject's body, and motion information capable of quantifying the detectable movement of the subject. The response information may include one or more of pulse information, brain wave information, and motion information of the subject. The pulse information may include one or more of the heart rate, heart rate variability index, sympathetic activity index, parasympathetic activity index, autonomic activity index, and autonomic balance index. The EEG information may include information on one or more frequency domains of delta, theta, alpha, beta, and gamma measured from the left and right brains. The motion information includes input motions such as selecting some of two or more options or executing a function according to the playback of an image, an intentional expression motion required to proceed with a consultation through an image, the client's concentration, tension, and It may include information on characteristic behaviors of the subject that can be quantified, such as psychological movements to grasp psychological changes such as embarrassment.

Next, the consultation result information is generated based on the reaction information (S600). The counseling result information may include analysis information that can be derived based on one or more of a response information of a counselee, detailed image information about a base image used in the mapping image and the mapping image, response information, and image information. Counseling result information may be provided to the counselor, and may include information for confirming what kind of reaction the counselee showed through viewing of the mapping image, and confirming the psychological state of the counselor's response and the contents of the psychological change. The step of generating counseling result information (S600) may include the following specific steps.

Referring to FIG. 6, first, analysis information may be generated based on the received reaction information (S610). The analysis information may include abnormal pulse information and abnormal EEG information measured as a value outside a predetermined range, and motion information during a time when the abnormal pulse information or the abnormal EEG information is generated. The abnormal pulse information and the abnormal EEG information may be pulse information and brain wave information measured during different sections, or pulse information and EEG information having a difference of more than a preset value compared to the average pulse information and EEG information. The analysis information is information on the psychological state of the subject such as tension, embarrassment, concentration, anxiety, stress, excitement, and tranquility through one or more of pulse information including abnormal pulse information, brain wave information including abnormal brain wave information, and motion information. It may include.

According to the EEG information, gamma waves indicating anxiety or excitement of the subject, beta waves indicating activity, stress, or immersion, alpha waves indicating stable states such as meditation or relaxation, theta waves indicating shallow sleep or sleepiness, and deep sleep. Through the delta wave representing the state, the psychological state of the counselee and its level can be derived. In addition, according to the pulse rate information, it is possible to directly or indirectly derive the psychological state and level of the counselee by using the tendency to change irregularly by physical factors such as psychological factors such as anxiety and stress, and physical factors such as movement of the counselee. The type of reaction information required for the determination of each psychological state, the calculation process for determining the level of each psychological state according to the corresponding reaction information, and the numerical range for each level are adopted from known research results, but continuous consultation result information is accumulated. It can be reset through confirmation and feedback of the counselor and condition correction.

The analysis information may include analysis information on a relationship between the response information and the image information according to time while the counselee views the mapping image. The analysis information may include information on a psychological state determined according to the type and level of abnormal pulse information, abnormal brain wave information, or other reaction information and the level of change thereof. By synchronizing the playback time of the mapping image and the reception time of the response information, the state and change of the response information according to the image information by time can be checked through the analysis information. Through this, the counselee can recognize the change in the psychological state and the psychological state, and it is possible to track the change in the psychological state by grasping the change between each time point during the corresponding psychological counseling and the change compared to the previous psychological counseling.

Next, new consultation result information may be generated by matching the image information on the mapping image with the analysis information (S620). The counseling result information may include progress information and results to be provided to the counselee who has undergone psychological counseling, such as response information, video information, analysis information, and information matching such information according to various conditions. The consultation result information is a content that determines whether there is a meaningful relationship between the analysis information generated in the analysis information generation step (S620) and features such as the dialogue content, background, and emotional change situation of the scene of the mapping image that has affected the information. It may include. The counselee can recognize the factors on the mapping image that have influenced the change in the psychological state and the psychological state, and track the change in the psychological state by identifying the change between each time point during the corresponding psychological counseling and the change compared to the previous psychological counseling. It is possible.

Next, the new consultation result information may be added to the existing consultation result information (S630). In the case of a counselor with an existing psychological counseling history, the existing counseling result information exists. Therefore, when providing the psychological result information, new counseling result information is added to the existing counseling result information in order to provide the information along with the existing counseling result information and continue to manage the counselor can do.

Then, the counseling result information is transmitted to the terminal of the counselee (S700). In the step of adding counseling result information (S630), the counseling result information obtained by integrating the existing counseling result information and the new counseling result information may be transmitted to the client terminal. Counseling result information transmitted to the counselee terminal may be provided by visualization so that the counselee can easily grasp reaction information, analysis information, etc. along with counseling result information for management.

According to the psychological counseling method according to the above-described embodiment, by providing a personalized image in which the covering image desired by the counselee is mapped to a base image directly selected by the counselee, the counselee can participate in the counseling with a more comfortable mind, and at the same time, brain waves, pulse, and By collecting and analyzing the reaction information of the counselee, such as motion, it is possible to grasp and track the factors and changes in the mental state. In particular, the counselee can check his or her body changes at the same time while experiencing the unfolding situation by indirectly contacting the cover person in the covering video that they want to face through the mapping video in the virtual situation in the base video. It is possible to recognize the types of psychological states that are difficult to do, change patterns of psychological states, internal and external factors, etc., and track psychological changes through more or less changes in the base image in repeated psychological counseling, and provide directions for improving mental states. You will be able to explore.

The psychological counseling method implemented by the psychological counseling system capable of tracking psychological changes through the provision of personalized video and audio according to the above embodiment may be implemented by the computing device 9000 illustrated in FIG. 7. The consultation information processing unit 3000 of FIG. 1 may include components of the computing device 9000 illustrated in FIG. 7.

The computing device 9000 may include one or more processors 9100, a memory 9200, a peripheral interface 9300, an input/output subsystem 9400, a power circuit 9500, and a communication circuit 9600. . The computing device 9000 includes a part or all of the response information measurement unit 1000, the consultation information processing unit 3000, the counselee terminal 4000, and the counselor terminal 5000, or by the input/output subsystem 9400. It may be connected to a part or all of the response information measuring unit 1000, the counseling information processing unit 3000, the counselee terminal 4000, and the counselor terminal 5000.

The memory 9200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or nonvolatile memory. The memory 9200 may include software modules, instruction sets, or other data necessary for the operation of the computing device 9000. Access to the memory 9200 from a component such as the processor 9100 or the peripheral interface 9300 may be controlled by the processor 9100.

The peripheral device interface 9300 may connect one or more of an input peripheral device and an output peripheral device of the computing device 9000 to the processor 9100 and the memory 9200. The processor 9100 may perform various functions for the computing device 9000 and process data by executing a software module or instruction set stored in the memory 9200.

The input/output subsystem 9400 may couple various input/output peripherals to the peripherals interface 9300. For example, the input/output subsystem 9400 may include a controller for coupling peripheral devices such as a monitor, keyboard, mouse, printer, touch screen, sensor, and the like to the peripheral device interface 9300. The input/output peripherals may be coupled to the peripherals interface 9300 without going through the input/output subsystem 9400.

The power circuit 9500 may supply power to all or part of the components of the terminal. For example, the power circuit 9500 may be a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator or power. It may contain any other components for creation, management, and distribution.

The communication circuit 9600 may enable communication with other computing devices using one or more external ports. The communication circuit 9600 may include an RF circuit to transmit and receive RF signals to enable communication with other computing devices.

As an example, the computing device 9000 may have a configuration or arrangement in which some illustrated components are omitted, an additional component not illustrated is further provided, or two or more components are combined. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor, and various communication methods (WiFi, 3G, LTE, Bluetooth, NFC, Zigbee, etc.) are used in the communication circuit 9600. Circuitry for RF communication may also be included. Components that may be included in the computing device 9000 may be implemented in hardware, software, or a combination of both hardware and software including one or more signal processing or application-specific integrated circuits.

Methods according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in a computer-readable medium. In particular, the program according to the present embodiment may be configured as a PC-based program or an application dedicated to a mobile terminal. An application to which the present invention is applied may be installed on a user terminal through a file provided by the file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to the request of the user terminal.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments are, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA). , A programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions, such as one or more general purpose computers or special purpose computers. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CDROMs and DVDs, and magnetic-optical media such as floptical disks. And hardware devices specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

The communication connection in the system and method according to the embodiments of the present invention may be configured regardless of a communication mode such as wired communication or wireless communication, and a local area network (LAN) or a metropolitan area communication network (MAN; Metropolitan Area) Network), and a wide area network (WAN). Preferably, the communication connection in this specification may be a publicly known Internet or World Wide Web (WWW). However, the communication connection is not necessarily limited thereto, and may include a known wired/wireless data communication network, a known telephone network, or a known wired/wireless television communication network in at least part thereof. For example, the communication connection is a wireless data communication network, such as WiFi communication, WiFi-Direct communication, Long Term Evolution (LTE) communication, Bluetooth communication (more specifically, low power Bluetooth (BLE) communication). ; Bluetooth Low Energy)), infrared communication, ultrasonic communication, and the like may be implemented in at least part of a conventional communication method. For another example, the communication connection is an optical communication network, and a conventional communication method such as LiFi (Light Fidelity) may be implemented in at least a portion thereof.

Although the embodiments of the present invention have been described in more detail with reference to the accompanying drawings, the present invention is not necessarily limited to these embodiments, and various modifications can be made without departing from the spirit of the present invention. . Accordingly, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention, but to explain the technical idea, and the scope of the technical idea of the present invention is not limited by these embodiments. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be interpreted as being included in the scope of the present invention.

1000: reaction information measuring unit
1100: pulse measurement module
1200: EEG measurement module
1300: motion detection module
3000: consultation information processing unit
4000: counselee terminal
5000: consultant terminal

Claims (3)

As a psychological counseling method that can track psychological changes through the provision of personalized video and audio,
Preparing a base image;
Receiving a covering image and audio from a target terminal;
Generating a mapping image by mapping the covering image and audio to the base image;
Transmitting the mapping image to the counselee terminal;
Receiving reaction information of a subject from a response information measuring unit while the mapping image is being reproduced in the subject terminal;
Generating counseling result information based on the response information; And
Transmitting the counseling result information to the counselee terminal;
Including,
Preparing the base image,
Collecting a plurality of base images;
Extracting image information including 3D facial coordinate information of a target person appearing in the collected base images;
Selecting a base image to be provided to the counselor from among the plurality of base images based on the existing counseling result information of the counselee;
Transmitting image information on the selected base image to a target terminal;
Receiving information on a base image selected by the counselee among the base images from the counselee terminal; And
Extracting audio information of a target person appearing in the base image selected by the counselee;
Including,
The step of generating the mapping image,
Extracting 3D facial coordinate information and audio information of a cover person appearing in the covering image;
Mapping the cover person to a target person appearing in the base image selected by the consultant based on the 3D facial coordinate information of the cover person appearing in the covering image; And
Mapping a voice of the target person based on the voice information of the cover person;
Including,
Generating the consultation result information,
Generating analysis information based on the reaction information;
Generating new consultation result information by matching image information on the mapping image with the analysis information;
Generating the consultation result information including the existing consultation result information and the new consultation result information; And
Adding the new consultation result information to the existing consultation result information;
Including,
The reaction information includes at least one of pulse information, brain wave information, and motion information of the subject,
Receiving information on the base image,
Receiving information on a target person to be mapped among the people appearing in the base image selected by the counselee; And
Receiving viewpoint information of the mapped image;
Including,
The analysis information includes abnormal pulse information and abnormal EEG information, the abnormal pulse information, or motion information during a time when the abnormal EEG information is generated, measured as a value outside a predetermined range,
The analysis information is information on the relationship between the response information and the image information according to time while the counselee views the mapping image through synchronization of the playback time of the mapping image and the reception time of the response information A psychological counseling method that includes information on the factors on the mapping image that have influenced the change of the psychological state and the change in the psychological state of the counselee between points during psychological counseling.
delete delete

Images