KR20240082748A - Method and system for analyzing Psychological state based on voice record - Google Patents

Abstract

A psychological analysis method based on voice recording includes the steps of acquiring a counseling voice signal representing a counseling conversation between a counselor and a counselee; Transmitting the counseling voice signal to a psychological analysis server; converting, in the psychological analysis server, the counseling voice included in the counseling voice signal into counseling text; Analyzing the psychological state of the counselor based on the converted counseling text; Transmitting the analyzed psychological state to a counseling terminal; and outputting the analyzed psychological state from the counseling terminal.

Description

Psychological analysis method and system based on voice recording {Method and system for analyzing Psychological state based on voice record}

It relates to a psychological analysis method and system based on voice recording. More specifically, it records a conversation between a psychological counselor and a counselor, converts the recorded voice of the counseling into text, and uses artificial intelligence to convert the converted text into the psychological state of the counselor. It relates to a method and system for analyzing .

Currently, in various counseling fields such as psychiatric counseling and youth counseling, conversations between a counselor and a counselor requesting counseling are recorded, and based on this, the counselor's situation is analyzed and used for treatment.

However, since the data generated through recording is voice, it is difficult to understand and analyze the entire consultation content just by listening to the voice. Recently, such voice has been converted into text to create a voice recording that allows for easy visual understanding of the consultation content. A recognition device is provided.

These transcripts have the advantage of being easier to analyze than audio because the contents of the consultation can be clearly checked visually as text.

However, since the conversation content that occurs during the counseling process is generally considerable, it not only takes a considerable amount of time to analyze the counselor based on the conversation content, but also due to the nature of the counseling field, there is a need for changes in the speaker's voice, such as voice tone changes or emotional changes, that occur during the counseling process. It is very important to analyze status changes along with the counseling content, but these status changes are not reflected in transcripts created using existing voice recognition devices, making it difficult to accurately analyze the counselor based on the counseling content using only simple transcripts. .

Republic of Korea Patent Publication No. 10-2193656

The purpose is to provide a psychological analysis method and system based on voice recordings. In addition, the present invention is not limited to the technical challenges described above, and other technical challenges may be derived from the following description.

A psychological analysis method based on voice recording according to an embodiment of the present invention includes the steps of acquiring a counseling voice signal representing a counseling conversation between a counselor and a counselee; Transmitting the counseling voice signal to a psychological analysis server; converting, in the psychological analysis server, the counseling voice included in the counseling voice signal into counseling text; Analyzing the psychological state of the counselor based on the converted counseling text; Transmitting the analyzed psychological state to a counseling terminal; and outputting the analyzed psychological state from the counseling terminal.

The step of analyzing the psychological state of the counselor includes extracting state expression words that express the psychological state of the counselor from the converted counseling text, and calculating the psychological state score of the counselor based on the extracted state expression words. Analyze the psychological state of the counselor.

In the step of analyzing the psychological state of the counselor, the extracted evaluation expression words are classified into negative keywords and positive keywords, and a psychological state score for the counselor is calculated from the classified negative and positive keywords.

The step of analyzing the psychological state of the counselor includes classifying the extracted evaluative expression words into negative keywords and positive keywords, calculating the number of classified positive keywords and the number of negative keywords, and calculating the number of positive keywords and negative keywords calculated. Based on the total number, the psychological state score of the counselor is calculated.

In the step of classifying the extracted evaluation expression words into negative keywords and positive keywords, the keyword list stored in the storage of the psychological analysis server includes a plurality of standard evaluation expression words, and the plurality of standard evaluation expression words include a plurality of standard positive keywords. and a plurality of standard negative keywords, wherein the psychological analysis module compares the extracted evaluation expression words with a list of keywords stored in storage, and determines that a word matching the standard positive keyword among the extracted evaluation expression words is a positive keyword. And, the word that matches the standard negative keyword is determined to be a negative keyword.

In the step of analyzing the psychological state of the counselor, the classified negative keywords are divided into two types, level 1 negative keywords and level 2 negative keywords, depending on the degree of negativity, and the psychological state score of the counselor is calculated based on the positive keywords and the differentiated negative keywords. Calculate .

A computer-readable recording medium according to another embodiment of the present invention records a program that performs a psychological analysis method based on voice recording according to an embodiment of the present invention.

The present invention recognizes the voice generated during a consultation to generate transcript information, and through analysis of the voice, event information related to the speaker's state for each text of the voice at the time a change in the speaker's state occurred is added to the transcript information. It can be added by generating counseling analysis information through analysis of the counselor's repeated speech patterns or behavior patterns based on the text information and event information included in the transcript information and providing it in addition to the transcript information. The user viewing the information analyzes the counselor through analysis of conversation content based on the text-based transcript according to the above transcript information, and the counselor's characteristic speech patterns or behavior based on the counseling analysis information added to the transcript information as additional information. It has the effect of helping to easily perform three-dimensional analysis such as accurate disease analysis or psychological analysis of the counselor based on patterns, thereby greatly improving the accuracy of the counselor's analysis of the counselor through the transcript.

In addition, the present invention analyzes the contents of the current counseling analysis for a specific counselor based on a deep learning algorithm to determine whether the current counseling progress for a specific counselor is in a good or bad direction. Predictions can be made based on the existing opinions of counselors, and through this, counselors counseling specific counselors can establish the correct counseling plan for the counselor based on these predictions, thereby increasing the success of the counseling, such as accurate treatment or psychological stability of the counselor. We can provide support to increase your odds.

1 is a diagram illustrating a psychological analysis system based on voice recording according to an embodiment of the present invention.
Figure 2 is a configuration diagram of the psychological analysis server and counseling terminal of the psychological analysis system shown in Figure 1.
FIG. 3 is a flowchart of a psychological analysis method based on voice recording performed in the psychological analysis system shown in FIG. 1.

The advantages and features of the present disclosure and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the technical idea of the present disclosure is not limited to the following embodiments and may be implemented in various different forms. The following embodiments are merely intended to complete the technical idea of the present disclosure and to be used in the technical field to which the present disclosure belongs. It is provided to fully inform those skilled in the art of the scope of the present disclosure, and the technical idea of the present disclosure is only defined by the scope of the claims.

When adding reference numerals to components in each drawing, it should be noted that identical components are given the same reference numerals as much as possible even if they are shown in different drawings. Additionally, in describing the present disclosure, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present disclosure, the detailed description will be omitted.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings that can be commonly understood by those skilled in the art to which this disclosure pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined. The terminology used herein is for the purpose of describing embodiments and is not intended to limit the disclosure. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context.

Additionally, in describing the components of the present disclosure, terms such as first, second, A, B, (a), and (b) may be used. These terms are only used to distinguish the component from other components, and the nature, order, or order of the component is not limited by the term. When a component is described as being “connected,” “coupled,” or “connected” to another component, that component may be directly connected or connected to that other component, but there is another component between each component. It will be understood that elements may be “connected,” “combined,” or “connected.”

As used in this disclosure, “comprises” and/or “comprising” refers to a referenced component, step, operation and/or element that includes one or more other components, steps, operations and/or elements. Does not exclude presence or addition.

Components included in any one embodiment and components including common functions may be described using the same names in other embodiments. Unless stated to the contrary, the components described in any one embodiment The description may be applied to other embodiments, and detailed description may be omitted to the extent of overlap or to the extent that it can be clearly understood by a person skilled in the art.

Hereinafter, several embodiments of the present disclosure will be described in detail with reference to the attached drawings.

Since the present invention can be modified in various ways and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all changes, equivalents, and substitutes included in the spirit and technical scope of the present invention.

The present invention relates to a psychological analysis method and system based on voice recording. More specifically, it relates to a method and system for acquiring voice signals of the counselor and counselee in a counseling conversation between a counselor and a counselee, converting the acquired voice signals into text, and analyzing the converted text to analyze the psychological state of the counselor. will be.

1 is a diagram illustrating a psychological analysis system based on voice recording according to an embodiment of the present invention. Referring to Figure 1, the psychological analysis system 1 includes a psychological analysis server 10 and a counseling terminal 11. The psychological analysis server 10 receives a counseling voice signal recording a counseling conversation between the counselor and the counselee transmitted from the counseling terminal 11 and analyzes the received counseling voice signal.

The counseling terminal 11 records a counseling conversation between a counselor and a counselee and generates a counseling voice signal representing the recorded counseling conversation. The counseling terminal 11 transmits the counseling voice signal generated through the communication module 1102 to the psychological analysis server 10. The consultation terminal 11 includes a smart phone with a communication function, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a tablet PC, It may include various terminals such as wearable devices (e.g., smartwatch, smart glass, head mounted display (HMD), etc.), flexible terminal, etc. .

The psychological analysis method based on voice recording performed in the psychological analysis system including the psychological counseling server 10 and the counseling terminal 11 will be described in detail below with reference to the drawings.

Figure 2 is a configuration diagram of the psychological analysis server and counseling terminal of the psychological analysis system shown in Figure 1. Referring to Figure 2, the psychological analysis server 10 includes a processor 1101, a communication module 1102, a storage 1103, a text generation module 1104, a psychological analysis module 1105, and an output module 1106. do.

The processor 1101 of the psychological analysis server 10 is the central processing unit of the psychological analysis server 10 and processes general tasks of the psychological analysis server 10.

The communication module 1102 of the psychological analysis server 10 is connected to a mobile communication base station or Wi-Fi repeater, and can transmit and receive data and messages to the counseling terminal 11 and an external server (not shown) through a wide area network such as the Internet. .

The storage 1103 of the psychological analysis server 10 stores data necessary to execute a psychological analysis method based on voice recordings. For example, storage 1103 includes a list of kiwids. The keyword list includes standard evaluation expression words that express the counselors' evaluations, and the standard evaluation expression words include a plurality of standard positive keywords and a plurality of negative keywords according to the meaning of each word. The above-mentioned evaluation expression words, positive keywords, and negative keywords will be explained in detail below.

The text generation module 1104 of the psychological analysis server 10 converts the counseling voice signal recorded from the counseling between the counselor and the counselee into text. The text generation module 1104 generates a psychological counseling text representing the psychological counseling conversation between the counselor and the counselee included in the counseling voice signal, based on the counseling voice signal transmitted from the counseling terminal 11. The specific method by which the text generation module 1104 generates psychological counseling text representing a psychological counseling conversation will be described in detail below.

The psychological analysis module 1105 of the psychological analysis server 10 analyzes the psychological state of the counselor based on the psychological counseling text. More specifically, the psychological analysis module 1105 distinguishes negative keywords and positive keywords from the extracted evaluation expression words based on the keyword list stored in the storage 1103. The keyword list stored in the storage 1103 includes a plurality of standard evaluation expression words, and the plurality of standard evaluation expression words include a plurality of standard positive keywords and a plurality of standard negative keywords. The psychological analysis module 1105 compares the extracted evaluation expression words with the keyword list stored in the storage 1103, determines that words matching the standard positive keyword among the extracted evaluation expression words are positive keywords, and selects the standard negative keyword. The word that matches is determined to be a negative keyword. The psychological analysis module 1105 classifies negative keywords and positive keywords from the evaluation expression words extracted in the above-described manner. The psychological analysis module 1105 analyzes the psychological state of the counselor based on classified keywords. The detailed method for analyzing psychological states will be described in detail below.

The output module 1106 of the psychological analysis server 10 outputs a psychological risk notification signal generated by the psychological analysis server 10. Examples of the output module 1106 include a monitor, speaker, flash, vibration actuator, etc. For example, the output module 1106 may be a monitor that outputs the counselor's request for counseling, the result of determining the counselor's suitability for counseling, etc. to the user of the psychological analysis server 10.

In the psychological analysis server 10, the text generation module 1104 and the psychological analysis module 1105 may be implemented by a dedicated processor separate from the processor 1101, or by a computer program running on the processor 1101. It could be.

The psychological analysis server 10 may further include other components in addition to the components described above. For example, the psychological analysis server 10 may further include a bus for transmitting data between each component, as shown in FIG. 2. In addition to these components, the psychological analysis server 10 may further include a power supply unit that supplies driving power to each component.

Each consultation terminal 11 includes a processor 1101, a communication module 1102, a storage 1103, an input module 1104, and an output module 1105.

The processor 1101 of the counseling terminal 11 processes general tasks executed in the counseling terminal 11.

The communication module 1102 of the counseling terminal 11 is connected to a mobile communication base station or Wi-Fi repeater, and can transmit and receive data and messages to the psychological analysis server 10 and an external server (not shown) through a wide area network such as the Internet. .

The storage 1103 of the counseling terminal 11 stores data necessary to execute a psychological analysis method based on voice recording. For example, storage 1103 stores an application or program that executes a psychological analysis method based on voice recordings. The storage 1103 of the counseling terminal 11 contains personal information data of the counselee.

The input module 1104 of the counseling terminal 11 receives voices spoken during counseling from the counselor and the counselee, who are users of the counseling terminal 11. Examples of input modules 1104 and 1304 include a keyboard, mouse, touch screen panel, and microphone.

The output module 1105 of the counseling terminal 11 outputs a psychological report, etc. transmitted from the psychological analysis server 10. Examples of the output module 1105 include a monitor, speaker, lamp, vibration actuator, etc.

The counseling terminal 11 may further include other components in addition to the components described above. For example, the consultation terminal 11 may further include a bus for transmitting data between each component, as shown in FIG. 2. In addition, the counseling terminal 11 may further include a power supply unit that supplies driving power to each component.

FIG. 3 is a flowchart of a psychological analysis method based on voice recording performed in the psychological analysis system shown in FIG. 1. The psychological analysis method based on voice recording shown in FIG. 3 is implemented on the voice recording-based psychological analysis system shown in FIG. 1, and an application or program that executes the psychological analysis method based on voice recording is pre-installed on the counseling terminal 11. Assume that it is done.

Referring to FIG. 3, in step 301, the counseling terminal 11 acquires a counseling voice signal representing a counseling conversation from the counselor and the counselee. The input module 1103 of the counseling terminal 11 acquires a counseling voice signal representing a conversation that occurred during psychological counseling between the counselor and the counselee. The input module 1103 inputs the obtained counseling voice signal to the communication module 1102.

In step 302, the counseling terminal 11 transmits the obtained counseling voice signal to the psychological analysis server 10. The communication module 1102 of the counseling terminal 11 transmits the acquired counseling voice signal to the psychological analysis server 11.

In step 303, the psychological analysis server 10 converts the counseling voice included in the counseling voice signal transmitted from the counseling terminal 11 into text. The text generation module 1104 of the psychological analysis server 10 converts the counseling voice included in the counseling voice signal into text. The text generation module 1104 divides the counseling voice included in the counseling voice signal into individual syllables and converts the plurality of divided syllables into text. More specifically, the text generation module 1104 compares the waveform of each divided syllable with the waveform of the reference syllable and converts it into text corresponding to the reference syllable with the highest similarity as a result of the comparison. The text generation module 1104 converts the counseling voice included in the counseling voice signal into text in the manner described above.

In step 304, the psychological analysis server 10 analyzes the psychological state of the counselor based on the converted text. The psychological analysis module 1105 of the psychological analysis server 10 calculates the psychological state score of the counselor based on the converted text.

More specifically, the psychological analysis module 1105 analyzes the converted text data, and the psychological analysis module 1105 extracts evaluation expression words representing the state of the counselor from the text data and analyzes the extracted evaluation expression words. The method of analyzing data related to the counselor in the psychological analysis module 1105 will be described in detail below.

The psychological analysis module 1105 extracts evaluation expression words representing psychological states from text data. The psychological analysis module 1105 analyzes the transmitted data related to the counselor through text mining and extracts evaluative expression words included in the data. Here, evaluation expression words refer to words that express the good or bad of the counselor's product or service. Examples of evaluation expression words include words that express the quality of a product or service, such as happy, sad, delicious, tasteless, good, bad, recommended, not recommended, best, worst, etc. The psychological analysis module 1105 extracts evaluation expression words from data.

The psychological analysis module 1105 calculates a psychological state score for the counselor's business based on the extracted evaluation expression words. More specifically, the psychological analysis module 1105 classifies the extracted evaluation expression words into negative keywords and positive keywords, and calculates the number of classified positive keywords and the number of negative keywords. The psychological analysis module 1105 calculates the psychological state score of the counselor based on the calculated number of positive keywords and the total number of negative keywords. Here, the psychological state score is a score provided to psychologists who want to examine the business of the counselee, and is calculated from 0 to 100. The closer to 0, the lower the psychological attractiveness, and the closer to 100, the higher the psychological attractiveness. it means.

The psychological analysis module 1105 distinguishes negative keywords and positive keywords from the extracted evaluation expression words based on the keyword list stored in the storage 1103. The keyword list stored in the storage 1103 includes a plurality of standard evaluation expression words, and the plurality of standard evaluation expression words include a plurality of standard positive keywords and a plurality of standard negative keywords. The psychological analysis module 1105 compares the extracted evaluation expression words with the keyword list stored in the storage 1103, determines that words matching the standard positive keyword among the extracted evaluation expression words are positive keywords, and selects the standard negative keyword. The word that matches is determined to be a negative keyword. The psychological analysis module 1105 classifies negative keywords and positive keywords from the evaluation expression words extracted in the above-described manner.

The psychological analysis module 1105 according to an embodiment of the present invention calculates the psychological state score of the counselor by multiplying the number of negative keywords by -1 and adding the results of multiplying the number of positive keywords by +1 to 50 points. For example, if the calculated number of negative keywords is 17 and the number of positive keywords is 12, the psychological analysis module 1105 calculates the psychological state score of the counselor as 45 points.

The psychological analysis module 1105 according to another embodiment of the present invention distinguishes the classified negative keywords into two types, first-level negative keywords and second-level negative keywords, according to the degree of negativity, and based on the positive keywords and the differentiated negative keywords, Calculate the psychological state score of the counselor. The psychological analysis module 1105 distinguishes words with a high degree of negativity as second-level negative keywords, and words that are not very negative with a level 1 negative keyword. The psychological analysis module 1105's keyword list stored in the storage 1103 includes negative keywords based on the first stage and negative keywords based on the second stage. The psychological analysis module 1105 compares the negative keywords with the keyword list stored in the storage 1103 and distinguishes the negative keywords into first-level negative keywords and second-level negative keywords.

The psychological analysis module 1105 multiplies the number of negative keywords in step 1 by -1, multiplies the number of negative keywords in step 2 by -1.5, and multiplies the number of positive keywords by +1 and adds the results to 50 points to obtain the psychological state score of the counselor. Calculate For example, if the calculated number of stage 1 negative keywords is 8, stage 2 negative keywords are 6, and the number of positive keywords is 15, the psychological analysis module 1105 calculates the psychological state score of the counselor as 48 points. do.

The psychological analysis module 1105 according to another embodiment of the present invention distinguishes negative keywords extracted from evaluative expression words into continuous negative keywords and discontinuous negative keywords, and based on the positive keywords and differentiated negative keywords, the counselor Calculate the current status score. Here, continuous negative keywords refer to keywords in which negative keywords are arranged continuously when negative keywords and positive keywords extracted from status expression words are arranged in chronological order.

The psychological analysis module 1105 multiplies the number of discontinuous negative keywords by -1, multiplies the number of continuous negative keywords by -1.5, and multiplies the number of positive keywords by +1, adding the results to 50 points to obtain the psychological state score of the counselor. Calculate For example, if the calculated number of discontinuous negative keywords is 8, the number of continuous negative keywords is 2, and the number of positive keywords is 15, the psychological analysis module 1105 calculates the psychological state score of the counselor as 54 points. do.

The psychological analysis module 1105 inputs the calculated psychological state score to the communication module 1102.

In step 305, the psychological analysis server 10 transmits the calculated psychological state score of the counselor to the counseling terminal 11. The communication module 1102 of the psychological analysis server 10 transmits the calculated psychological state score of the counselor to the counseling terminal 11.

In step 306, the counseling terminal 11 outputs the transmitted psychological state score. The output module 1106 of the counseling terminal 11 outputs the psychological state score transmitted from the psychological analysis server 10 and provides it to the counselor or counselor who is the user of the counseling terminal 11.

Meanwhile, the above-described embodiments of the present invention can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable recording medium. Additionally, the data structure used in the above-described embodiments of the present invention can be recorded on a computer-readable recording medium through various means. The computer-readable recording media includes storage media such as magnetic storage media (eg, ROM, floppy disk, hard disk, etc.) and optical read media (eg, CD-ROM, DVD, etc.). A program that performs a psychological counseling service operation method according to embodiments of the present invention is recorded on a computer-readable recording medium.

According to the above-described embodiments of the present invention, the psychological analysis method based on voice recording can quickly and objectively analyze the psychological state of the counselor by analyzing the psychological state of the counselor using an artificial neural network.

In addition, the present invention converts the voice from the counselor's counseling conversation into text in a psychological analysis server, calculates a psychological state score indicating the psychological state of the counselor based on the text, and calculates the psychological state of the counselor based on the calculated psychological state score. can be decided. Therefore, the psychological state can be determined more accurately.

The present invention extracts state expression words that express the state of the counselor from the voice signal of the counselor, classifies the state expression words into positive keywords and negative keywords, and calculates the psychological state score of the counselor from the classified positive and negative keywords. . The operation server provides the calculated psychological state score of the counselee to the psychologist, allowing the psychologist to more accurately judge the psychological state of the counselee.

So far, the present invention has been looked at with a focus on preferred embodiments. A person skilled in the art to which the present invention pertains will understand that the present invention may be implemented in a modified form without departing from the essential characteristics of the present invention. Therefore, the disclosed embodiments should be considered from an illustrative rather than a restrictive perspective. The scope of the present invention is indicated in the claims rather than the foregoing description, and all differences within the equivalent scope should be construed as being included in the present invention.

Claims (7)

In a psychological analysis method based on voice recording,
Obtaining a counseling voice signal representing a counseling conversation between a counselor and a counselee;
Transmitting the counseling voice signal to a psychological analysis server;
converting, in the psychological analysis server, the counseling voice included in the counseling voice signal into counseling text;
Analyzing the psychological state of the counselor based on the converted counseling text;
Transmitting the analyzed psychological state to a counseling terminal; and
The step of outputting the analyzed psychological state from the counseling terminal
A psychological analysis method based on voice recording, comprising: According to claim 1,
The step of analyzing the psychological state of the counselor is
Characterized by analyzing the psychological state of the counselor by extracting state expression words that express the psychological state of the counselor from the converted counseling text and calculating the psychological state score of the counselor based on the extracted state expression words. A psychological analysis method based on voice recording. According to claim 1,
The step of analyzing the psychological state of the counselor is
A psychological analysis method based on voice recording, characterized in that the extracted evaluation expression words are classified into negative keywords and positive keywords, and a psychological state score for the counselor is calculated from the classified negative keywords and positive keywords. According to claim 3,
The step of analyzing the psychological state of the counselor is
Classify the extracted evaluation expression words into negative keywords and positive keywords, calculate the number of classified positive keywords and the number of negative keywords, and calculate the psychological state score of the counselor based on the calculated number of positive keywords and the total number of negative keywords. A psychological analysis method based on voice recording, characterized in that calculating. According to claim 3,
The step of classifying the extracted evaluation expression words into negative keywords and positive keywords is
The keyword list stored in the storage of the psychological analysis server includes a plurality of standard evaluation expression words, and the plurality of standard evaluation expression words include a plurality of standard positive keywords and a plurality of standard negative keywords,
The psychological analysis module compares the extracted evaluation expression words with the keyword list stored in the storage, determines that words that match the standard positive keywords among the extracted evaluation expression words are positive keywords, and selects words that match the standard negative keywords. A psychological analysis method based on voice recordings, characterized by determining negative keywords. According to claim 5,
The step of analyzing the psychological state of the counselor is
In voice recordings, the classified negative keywords are divided into two types, level 1 negative keywords and level 2 negative keywords, depending on the degree of negativity, and the psychological state score of the counselor is calculated based on the positive keywords and the differentiated negative keywords. Based psychological analysis methods. A computer-readable recording medium on which a program for performing the method according to any one of claims 1 to 6 is recorded.