KR20210147277A - Tinnitus counseling treatment system based on user voice analysis - Google Patents

Abstract

According to an embodiment of the present invention, provided is a tinnitus counseling treatment system, which includes a server, a user device, and a counselor device. The server provides question content to a user device for tinnitus consultation, orders the recording of responses of the user to the provided question content, analyzes the recorded response to determine the tinnitus characteristics of the user, searches for explanatory data corresponding to the determined user tinnitus characteristic to provide the data to the user device, receives and plays the explanatory data related to the question content for tinnitus consultation and the response content of the user from the server, and photographs and uploads the question content and explanatory data to be provided to the user device by the counselor device.

Description

Tinnitus counseling treatment system based on user voice analysis}

The present invention relates to a tinnitus counseling treatment system based on user voice analysis.

In general, the treatment for tinnitus is a therapy that makes people feel numb through rehabilitation and psychological treatment rather than medical treatment such as drug treatment, or a general sound that does not interfere with the patient's daily life, such as the sound of a clock hanging on the wall. is being used

In particular, counseling performed to treat tinnitus can reduce anxiety about tinnitus and provide psychological stability.

For example, in the case of a patient who misunderstood that tinnitus is a precursor to a relatively serious disease such as psychosis or dementia, when receiving counseling from an expert that tinnitus is only a symptom that can be heard through the ears and not a precursor to another disease , the patient can find psychological stability.

As such, counseling treatment for tinnitus patients has great effects and benefits, but it is difficult to receive specific counseling online as in offline. In the case of online, there are not many programs for professional counseling on tinnitus, and since user responses are mainly performed through multiple-choice item checking, etc. there are many Therefore, there is a need for a method to solve the problem of online counseling.

The present invention enables the user's symptom information to be provided through the user's remarks as in offline counseling when performing online tinnitus counseling, and the user can conveniently respond to his or her tinnitus symptoms through his or her mobile device. The purpose is to make it available to you.

The tinnitus counseling treatment system according to an embodiment of the present invention comprises a server, a user device, and a counselor device, wherein the server provides question content to the user device for tinnitus counseling, and a user's response to the provided question content command to record the contents, analyze the recorded response contents to determine the user's tinnitus characteristics, search for explanatory data corresponding to the determined user's tinnitus characteristics and provide it to the user device, the user device from the server Question content for consultation and explanatory material related to the user's response are received and reproduced, and the counselor device may photograph and upload the question content and explanatory material to be provided to the user device.

The present invention can help to conduct online tinnitus counseling in a convenient way regardless of time and place.

According to the present invention, the user's tinnitus phenomenon is determined based on the user's voice response, and counseling data corresponding thereto is provided, so that the user can feel the same as performing offline counseling.

Since the present invention can specify information about the user's interests and specific tinnitus symptoms based on the user's remarks, the user's symptoms can be more accurately identified compared to the method of measuring the user's tinnitus status based on multiple-choice questions. .

1 is a diagram showing the configuration of a tinnitus counseling support system according to an embodiment of the present invention.
2 is a diagram illustrating the configuration of a server according to an embodiment of the present invention.
3 is a diagram illustrating the configuration of a question operation control unit according to an embodiment of the present invention.
4 is a diagram illustrating the configuration of a response data analysis unit according to an embodiment of the present invention.
5 is a diagram illustrating the configuration of an explanatory data providing unit according to an embodiment of the present invention.
6 is a diagram illustrating a configuration of a user device according to an embodiment of the present invention.
7 is a flowchart illustrating an operation of tinnitus counseling according to an embodiment of the present invention.
8 is a diagram illustrating a process of obtaining a user answer according to an embodiment of the present invention.
9 is a diagram for explaining an operation of analyzing a recorded file obtained according to an embodiment of the present invention.
10 is a diagram illustrating an operation in which a moving picture related to tinnitus is reproduced according to an embodiment of the present invention.
11 is a diagram illustrating an operation for estimating tinnitus according to an embodiment of the present invention.

Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only the present embodiments allow the disclosure of the present invention to be complete, and those of ordinary skill in the art to which the present invention pertains. It is provided to fully understand the scope of the present invention to those skilled in the art, and the present invention is only defined by the scope of the claims.

The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other components in addition to the stated components. Like reference numerals refer to like elements throughout, and "and/or" includes each and every combination of one or more of the recited elements. Although "first", "second", etc. are used to describe various elements, these elements are not limited by these terms, of course. These terms are only used to distinguish one component from another. Accordingly, it goes without saying that the first component mentioned below may be the second component within the spirit of the present invention.

Unless otherwise defined, all terms (including technical and scientific terms) used herein will have the meaning commonly understood by those of ordinary skill in the art to which this invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless specifically defined explicitly.

As used herein, the term “unit” or “module” refers to a hardware component such as software, FPGA, or ASIC, and “unit” or “module” performs certain roles. However, “part” or “module” is not meant to be limited to software or hardware. A “unit” or “module” may be configured to reside on an addressable storage medium or to reproduce one or more processors. Thus, as an example, “part” or “module” refers to components such as software components, object-oriented software components, class components and task components, processes, functions, properties, Includes procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. Components and functionality provided within “parts” or “modules” may be combined into a smaller number of components and “parts” or “modules” or as additional components and “parts” or “modules”. can be further separated.

Spatially relative terms "below", "beneath", "lower", "above", "upper", etc. It can be used to easily describe the correlation between a component and other components. Spatially relative terms should be understood as terms including different directions of components during use or operation in addition to the directions shown in the drawings. For example, when a component shown in a drawing is turned over, a component described as "beneath" or "beneath" of another component may be placed "above" of the other component. can Accordingly, the exemplary term “below” may include both directions below and above. Components may also be oriented in other orientations, and thus spatially relative terms may be interpreted according to orientation.

In this specification, a computer refers to all types of hardware devices including at least one processor, and may be understood as encompassing software configurations operating in the corresponding hardware device according to embodiments. For example, a computer may be understood to include, but is not limited to, smart phones, tablet PCs, desktops, notebooks, and user clients and applications running on each device.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram showing the configuration of a tinnitus counseling support system according to an embodiment of the present invention.

As shown in FIG. 1 , the tinnitus counseling support system according to an embodiment of the present invention includes a server 100 supporting the operation of a tinnitus counseling application, a tinnitus counseling request, and in response to the tinnitus counseling question content from the server 100, and It may be configured to include a user device 200 that receives explanatory data, and a counselor device 300 that receives question content and tinnitus-related explanatory data from the expert counselor, and transmits the explanatory data inputted from the counselor to the server 100 .

2 is a diagram illustrating the configuration of a server according to an embodiment of the present invention.

As shown in FIG. 2 , the server 100 according to an embodiment of the present invention includes a communication unit 110, a storage unit 120, a question operation control unit 131, a response data analysis unit 132, a tinnitus estimator 133, an explanatory data providing unit 134 and a treatment effect evaluation. 135 may be included.

The communication unit 110 may use a network for data transmission/reception between the user device and the server, and the type of the network is not particularly limited. The network may be, for example, an IP (Internet Protocol) network that provides a large-capacity data transmission/reception service through Internet Protocol (IP) or an All IP network that integrates different IP networks. In addition, the network includes a wired network, a Wibro (Wireless Broadband) network, a mobile communication network including WCDMA, a High Speed Downlink Packet Access (HSDPA) network, and a Long Term Evolution (LTE) network including a mobile communication network, LTE advanced (LTE-A) ), a mobile communication network including 5G (Five Generation), a satellite communication network, and a Wi-Fi network, or a combination of at least one or more of them.

The communication unit 110 according to an embodiment of the present invention may transmit/receive consultation-related data to and from the user device 200 and the counselor device 300 through various applications.

The storage unit may include, for example, an internal memory or an external memory. The internal memory includes, for example, a volatile memory (eg, dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM), etc.), non-volatile memory (eg, OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (such as NAND flash or NOR flash), hard drive, or a solid state drive (SSD).

External memory is a flash drive, for example, CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), XD (extreme digital), It may further include a multi-media card (MMC) or a memory stick. The external memory may be functionally and/or physically connected to the electronic device through various interfaces.

The storage unit 120 according to an embodiment of the present invention may store various question data and explanatory data (movies) registered from the counselor device 300 .

The question operation control unit 131 may perform a tinnitus related question to the user. In addition, the question operation control unit 131 may obtain and process information about a tinnitus-related question provided to the user.

Specifically, the question operation control unit 131 may receive a tinnitus-related consultation request signal from one user (tinnitus patient). For example, as the user executes the tinnitus counseling application supported by the server 100 on the user device 200 and selects a tinnitus counseling button in the execution screen, tinnitus counseling generated in the user device 200 A request signal may be transmitted to the server 100 side. In addition, the question operation control unit 131 of the server 100, which has confirmed the consultation request signal transmitted from the user device 200, retrieves consultation question information to be provided to the user in response to the consultation request signal, and sends the called question information to the user device 200 side. can be transmitted

According to various embodiments, the question operation control unit 131 may provide a question in various ways. According to an embodiment, the question operation control unit 131 may provide a user with a question written in various formats, such as video, text, and voice.

A more detailed description of the question operation control unit 131 will be described with reference to FIG. 3 .

The response data analysis unit 132 may record the user's response to the question provided for the tinnitus consultation by the question operation control unit 131, and perform an operation of analyzing the recorded response.

Specifically, the response data analysis unit 132 may include a response recording performing unit 132a and a recording file analysis unit 132b. The response data analysis unit 132 may record the user's response according to the presented question, and perform an operation of analyzing the recorded user's response.

A more detailed description of the response data analysis unit 132 will be described with reference to FIG. 4 .

The tinnitus estimator 133 may perform a series of operation processes for estimating the tinnitus sound heard by the user.

According to an embodiment, the tinnitus estimator 133 may request the user to input information on a sound most similar to the tinnitus in order to determine the characteristics of the tinnitus that the user feels. For example, as shown in 1120 of FIG. 11 , the tinnitus estimator 133 may request the user to select a sound most similar to the tinnitus experienced by the user from among the provided view items.

11 is a diagram illustrating an operation for estimating tinnitus according to an embodiment of the present invention.

As illustrated in 1120 of FIG. 11 , the example items provided during the tinnitus estimation operation may include a cricket sound, a heart sound, a whistle sound, a simple high-frequency sound, a bus sound, and the like.

Also, the tinnitus estimator 133 may directly receive a sound similar to the tinnitus from the user as shown in 1110 of FIG. 11 , and may perform a recording operation for this purpose.

When the user performs an operation of recording a sound similar to his/her own tinnitus or selects one item corresponding to a sound similar to tinnitus from among the provided sample sounds, the tinnitus estimator 133 performs the selected sound as shown in steps 1130 and 1130 . It is possible to provide an adjustment screen for

In 1130, when the user selects a whistle sound item on screen 1120, an adjustment screen for whistling sound is displayed. Items that can be adjusted on the adjustment screen may include frequency and volume. As shown in 1131, the frequency for the selected sample sound (whistle sound) can be adjusted through the arrow buttons, and as shown in 1132, the volume of the selected sample sound can also be adjusted through the arrow buttons.

Furthermore, the adjustment screen provided by the tinnitus estimator 133 may include a sound addition area 1133. Through the 'add' button, a sample sound provided as in 1120 may be selected once again to add a corresponding sound. have.

Although not shown in the drawing, an operation of adjusting the repetition period of the sample sound added through the sound addition area 1133 through the adjustment screen or adjusting the frequency and volume of the sample sound added through the 'add' button is also performed can be

The tinnitus estimator 133 may specify the sound as the tinnitus of the user through an adjustment process after being input (recorded) or selected by the user as described above. When the tinnitus estimating unit 133 specifies the tinnitus through the above process, the tinnitus estimator 133 may match an ASMR of an effective type for shielding the specified tinnitus and provide it to the user. Alternatively, when the user's tinnitus is specified, the tinnitus estimator 133 may provide the specified tinnitus file to the counselor device 300 during online consultation to provide reference for tinnitus counseling treatment.

After asking the user a question, the explanatory data providing unit 134 may determine the user's tinnitus characteristics based on a response to the question, and search and provide explanatory data (video) corresponding to the user's tinnitus characteristics.

According to an embodiment, the explanatory data providing unit 134 provides one or a plurality of explanations or counseling contents according to the user's response, and when the reproduction of the contents is finished, it is possible to inquire to the subject whether to end or continue the consultation. can When the user selects 'End', the corresponding operation is terminated. If the user selects 'Continue', questions may be sequentially followed through Step 1 to Step 2.

The explanatory data providing unit 134 may include a tinnitus characteristic determining unit 134a and a suitable data searching unit 134b. A more detailed description of the explanatory data providing unit 134 will be described with reference to FIG. 5 .

The treatment effect evaluation unit 135 may perform an operation of comparing and analyzing the response content of the user (the tinnitus subject) for each counseling session, and evaluating the user's treatment effect accordingly.

The treatment effect evaluation unit 135 may classify the terms frequently mentioned in the user's answer into big data, and may request the counselor device 300 to prepare counseling data or explanatory data related to the user's interest.

The treatment effect evaluation unit 135 determines whether the user's interest changes and the user's tinnitus symptom is alleviated based on the user's response for each counseling session, and when a change in interest or tinnitus symptom relief is detected, the changed interest information, tinnitus symptom relief information Based on the treatment effect statistics can be generated. The treatment effect evaluation unit 135 may determine the explanatory data viewed by the user whose tinnitus symptom relief or interest has changed, and give a treatment effect score for the data, so as to have priority as explanatory data to be recommended to others.

3 is a diagram illustrating the configuration of a question operation control unit according to an embodiment of the present invention.

3 , the question operation control unit 131 according to an embodiment of the present invention may include a question management unit 131a and a question execution unit 131b.

The question management unit 131a may perform an operation of classifying and processing questions. Specifically, the question manager 131a may collect question content (video, text, and voice) obtained from the counselor device 300 .

According to an embodiment, the question manager 131a may manage question content transmitted from the counselor device 300 in a Q&A format. In order to later determine whether the user's response is appropriate as an answer to one question, the question management unit 131a converts the question content including one question and the expected response that the user receiving the question can answer in a Q&A format. can manage That is, among the Q&A items, the question (Q) is the content provided to the user device 200 side, and the answer (A) may be composed of an example of the content to be input from the user device 200 side, a score given for each response content, and the like.

According to various embodiments of the present disclosure, the question manager 131a may manage information (question connection information) about a question item to be presented in a next turn to be included in one question content when the response satisfies the reference condition as shown in the flowchart.

The question manager 131a may request to register the question connection information together when a question is registered in the server by the counselor. In the question connection information, for example, if the score according to the affirmative stage of the user's answer is 0 after a question is provided to the user device (eg, negative), it leads to the second question, and the score according to the affirmation stage is 3 In the case of a point (eg, normal), it may mean a command to lead to question 3, and if the score according to the affirmative step is 5 or more (eg, affirmative), it may mean a command to lead to question 4.

The question performing unit 131b may arbitrarily select an initial question to be presented to the user from among a plurality of question items. Alternatively, the question performing unit 131b may select an initial question to be presented to the user based on the user's basic information (eg, age, gender, basic survey information, etc.) from among a plurality of question items.

Specifically, the question performer 131b may select and present one question item among a plurality of question items to the user in order to diagnose the user's tinnitus state. In this case, the method of presenting the question to the user device 200 may be, for example, transmitting a video file in which the counselor asks a question.

Also, when a question is provided and the user inputs a corresponding answer, the question performing unit 131b may select a question item to be presented later in response to the corresponding answer. The question performing unit 131b may select a question to be presented later in response to, for example, a result of the user's response to one question (eg, score for each answer; yes 10 points, don't know 5 points, no 0 points, etc.) have.

Alternatively, the question performing unit 131b may select a question item to be presented later according to the accuracy of the answer to the user's response. For example, if the question performer 131b determines that the user's response corresponding to one topic (eg, tinnitus frequency) is confirmed through one question, it corresponds to another topic (eg, tinnitus occurrence time) as a question to be presented later. You can choose which questions to ask. On the other hand, when it is determined that the user's response corresponding to one topic is not sufficiently confirmed (eg, when the user responds that he or she is not sure), the question performing unit 131b may select and present another question item in the same category. .

Alternatively, the question execution unit 131b may select a counseling environment according to various embodiments and perform a question in the selected counseling environment. For example, the question execution unit 131b may perform consultation by selecting one of a real-based counseling environment providing a video shot of an actual counselor and a virtual character-based counseling environment performing counseling based on a virtual counselor character animation. .

Specifically, in the actual counseling environment, a question may be provided to the user in such a way that a video of the actual counselor asking a question is played back on the user device 200 . And in the actual-based consultation environment, while the user answers, the user's face or the counselor's motion (eg, nodding, etc.) as if listening to the user's answer may be reproduced on the screen.

In addition, in the virtual character-based counseling environment, an action as if a character arbitrarily selected is speaking a text input question may be reproduced. Similarly, while the user answers the question in response to the question, the motion of the character as if listening to the user's answer may be reproduced on the screen.

Specifically, when the user prefers a virtual character-based counseling environment, the question performing unit 131b may select a question item to be provided to the user from a list of prepared text questions. The corresponding question list may be extracted from consultation data previously input in a Q&A format by a professional counselor. In addition, the question in the selected text format may be arbitrarily selected or may be output with the voice of a character directly selected by the user. That is, the question performing unit 131b converts a question (text) to be provided to the user into an arbitrary character voice selected through a text to sound (TTS) technique, and outputs the converted voice content. The user may feel the same effect.

In addition, the question performing unit 131b may control the character's mouth shape, hand gestures, etc. to move while the question is being provided, thereby inducing an effect such that the character directly asks the user a question.

4 is a diagram illustrating the configuration of a response data analysis unit according to an embodiment of the present invention.

As shown in FIG. 4 , the response data analysis unit 132 according to an embodiment of the present invention may record the user's response according to the presented question, and perform an operation of analyzing the recorded user's response. . The response data analysis unit 132 may include a response recording performing unit 132a and a recording file analysis unit 132b.

The response recording performer 132a may start recording the user's response voice as the question providing operation provided to the user ends. The response recording performing unit 132a may end the recording operation when it is determined that the user's voice is not detected for more than a reference time or the user selects a 'confirm' button, etc., to complete the answer. In addition, the response recording performing unit 132a may list responses obtained through recording by matching each question item.

The recorded file analysis unit 132b may perform an analysis operation on the user's response recording file obtained by the response recording performing unit 132a. The recorded file analyzer 132b may convert the response recorded content into text through a sound to text (STT) technique. According to this method, the recorded file analysis unit 132b may check the response of the user based on the text converted through the STT technique.

For example, the recording file analysis unit 132b may perform an operation of classifying the user's response according to positive steps such as 'positive, normal, negative', and may assign a score corresponding to each step. The assigned score may be referred to when determining the user's tinnitus symptoms and types of tinnitus.

Also, the recorded file analysis unit 132b may perform an operation of extracting key terms from the user's response. In addition, the recorded file analysis unit 132b may classify the extracted key terms according to characteristics. The recorded file analyzing unit 132b may transmit the extracted classification group information of the key term to the explanatory data providing unit 134 . Subsequently, the response data analysis unit 134 may select and provide counseling data suitable for the user based on the classification group information (category information) of the key term.

For example, if the user "usually can't hear the tinnitus sound, but when he tries to sleep in a 'quiet place' or 'sleep', the tinnitus sound is especially 'loud', so he can't sleep well and the tinnitus is 'concerned'" From the corresponding response, 'quiet place' is classified as a place category, 'sleep' is classified as a quality of life category, 'nerve' is classified as an emotion category, and 'loud' is classified as a sound type category. .

Specifically, as shown in FIG. 9 , the recorded file analysis unit 132b may analyze the recorded answer according to the intensity distribution by the voice analysis system.

9 is a diagram for explaining an operation of analyzing a recorded file obtained according to an embodiment of the present invention.

Referring to FIG. 9 , reference numeral 910 denotes an analysis of a file recorded as 'tinnitus', and reference numeral 920 denotes an analysis of a file recorded as 'potato'. Looking at 910, along the x-axis (time) and y-axis (energy intensity), 'Lee' maintains a small intensity for a certain period of time, and 'Myeong' shows a smaller braille after a relatively large intensity value is confirmed. . It can be seen that 920 showing the recording result of 'potato' shows a different intensity distribution from 'tinnitus' of 910.

As such, each syllable (a, bar, sa, da, front, etc.) has a different energy distribution according to its own time, so the recorded file analysis unit 132b checks and classifies the recorded answers through time-dependent energy distribution analysis can do. To analyze the recorded file, the recorded file analyzer 132b records the syllables with multiple (eg, 100 or more) voices and then sets the average range to obtain the average value of the energy distribution pattern for each syllable and run the application. The user's voice content can be more accurately distinguished by comparing the user's answer obtained through the syllable and the average value of the energy distribution pattern for each syllable. In this way, the recorded file analyzer 132b may detect energy distribution characteristics of non-verbal voices as well as specific syllables (verbal voices), and accordingly, may analyze tinnitus related information recorded by the user.

When the recorded file analysis unit 132b analyzes the recorded file and confirms the user's response, it then analyzes the tinnitus characteristics of other users on the user's response.

5 is a diagram illustrating the configuration of an explanatory data providing unit according to an embodiment of the present invention.

As shown in FIG. 5 , the explanatory data providing unit 134 according to an embodiment of the present invention asks the user a question, then determines the user's tinnitus characteristics based on the response to the corresponding question, and responds to the user's tinnitus characteristics. You can search and provide explanatory materials (videos) for

The explanatory data providing unit 134 may include a tinnitus characteristic determining unit 134a and a suitable data searching unit 134b.

The tinnitus characteristic determination unit 134a The recorded file analysis unit 132b may perform an operation of determining the user's tinnitus characteristics based on a score given in response to the user's answer or a key term extracted from the user's response result. In more detail, the tinnitus characteristic determiner 134a may calculate a response result for answers to all questions presented to the user by adding up the scores given to each question item. The tinnitus characteristic determination unit 134a performs primary classification on the user's tinnitus severity, tinnitus type, tinnitus cause, etc. in response to the summation of scores for the query results, and assigns a corresponding code (primary classification code). can

In addition, the tinnitus characteristic determination unit 134a receives the classification group information of the key term extracted from the user's answer content from the recording file analysis unit 132b, and the classification group information of the key term (eg, tinnitus time, sound type, quality of life) , place) can determine the user's tinnitus characteristics.

According to an embodiment, when determining the tinnitus characteristic, the tinnitus characteristic determiner 134a may perform a secondary classification operation of classifying the specific tinnitus characteristic of the user based on the classification group information of the key term. Specifically, the tinnitus characteristic determination unit 134a may determine the tinnitus period, the time of day during which the tinnitus is heard, etc. based on keywords (eg, 1 month, 2 months, dawn, evening, etc.) classified into the tinnitus time category. Also, the tinnitus characteristic determination unit 134a may perform specific classification, period-specific classification, and intensity-specific classification of tinnitus sounds based on keywords (eg, crickets, rain sounds, chirps, etc.) classified into sound type categories. In addition, the tinnitus characteristic determination unit 134a is configured to determine the area of the user's quality of life and the degree of deterioration in quality of life based on emotion-related words (irritability, depression, etc.) and keywords related to quality of life such as sleep, concentration, and hearing. can Also, the tinnitus characteristic determining unit 134a may perform secondary classification of the user's tinnitus place type based on keywords classified into place categories such as home, office, and quiet room. Classification group information (category) and secondary classification items may be added in addition to the types mentioned above.

For example, if the user "usually can't hear the tinnitus sound, but when he tries to sleep in a 'quiet place' or 'sleep', the tinnitus sound is especially 'loud', so he can't sleep well and the tinnitus is 'concerned'" From the corresponding response, 'quiet place' is classified as a place category, 'sleep' is classified as a quality of life category, 'nerve' is classified as an emotion category, and 'loud' is classified as a sound type category. . The tinnitus characteristic determiner 134a may perform secondary classification on the tinnitus characteristic of the user based on the key terms for each category classified as described above.

According to various embodiments, when it is assumed that codes are assigned in alphabetical order to key term categories and codes are assigned as numbers during secondary classification, the tinnitus characteristic determining unit 134a determines that the user's tinnitus period is 2 months, A code can be assigned like a02 (the 02th characteristic of category a). Similarly, when it is determined that the user's tinnitus sound corresponds to the cricket sound, the tinnitus characteristic determining unit 134a additionally assigns a code (secondary classification code) to b01 (01th characteristic of category b) as the user's tinnitus characteristic. can do.

The tinnitus characteristic determiner 134a may also determine frequency and energy distribution characteristic information for the user's tinnitus specified from the tinnitus estimator 133, and assign a tinnitus estimation code based thereon.

The suitable data search unit 134b may search for and provide suitable data based on codes assigned to one user by the tinnitus characteristic determination unit 134a. In this case, the suitable material may include an explanation video of a topic related to the characteristics of tinnitus that the user is experiencing. In addition, the data searched and provided by the suitable data search unit 134b may include a tinnitus treatment sound file that can be helpful to the user. When the explanatory video searched for by the suitable data search unit 134b is searched, the search result can be provided to the user in the form of a list, and the user can select and play it. Alternatively, according to various embodiments, the suitable data search unit 134b may select and automatically play an explanatory video of a subject most similar to the user's response.

Specifically, the suitable data search unit 134b said, “Usually, the tinnitus sound is difficult to hear, but when you try to sleep in a 'quiet place' or 'sleep', the tinnitus sound is especially 'loud', so it is difficult to 'sleep' and the tinnitus sound is 'nervous'. For users who answered 'I use it', why does my tinnitus sound 'loud' in a 'quiet place', Why does my tinnitus sound 'loud' when I try to 'sleep'? ? It is possible to search for explanatory materials that contain the same key terms, such as , or have the same code, and provide them to the user.

6 is a diagram illustrating a configuration of a user device according to an embodiment of the present invention.

As shown in FIG. 6 , the user device 200 according to an embodiment of the present invention may include a communication unit 210, a storage unit 220, an input unit 230, a display unit 240, an audio processing unit 250, a camera unit 260, and a control unit 270. In addition, the control unit 270 may be configured to include a video reproduction support unit 271 and a reaction information collection unit 272 .

The communication unit 210 according to an embodiment of the present invention may transmit and receive data required for an operation related to tinnitus consultation with the server 100 .

The storage unit 220 according to an embodiment of the present invention may store various commands and programs required to execute the tinnitus counseling application.

The input unit 230 may include, for example, a touch panel, a (digital) pen sensor, a key, or an ultrasonic input device. The touch panel may use, for example, at least one of a capacitive type, a pressure sensitive type, an infrared type, and an ultrasonic type. In addition, the touch panel may further include a control circuit. The touch panel may further include a tactile layer to provide a tactile response to the user. The (digital) pen sensor may be, for example, a part of a touch panel or may include a separate recognition sheet. A key may include, for example, a physical button, an optical key, or a keypad.

The input unit 230 according to an embodiment of the present invention may receive a user input for inputting user's personal information and the like.

The display unit 240 according to an embodiment of the present invention may display various tinnitus counseling operations performed through an application on the screen.

The audio processing unit 250 according to an embodiment of the present invention may receive a user's voice response required for tinnitus consultation through a microphone, and may output a sound file included in a consultation question and an explanatory video for tinnitus treatment.

The camera unit 260 may take a picture of the user's response to a question during tinnitus consultation.

The control unit 270 may also be referred to as a processor, a controller, a microcontroller, a microprocessor, a microcomputer, or the like. Meanwhile, the control unit may be implemented by hardware, firmware, software, or a combination thereof.

In the case of implementation by firmware or software, an embodiment of the present invention may be implemented in the form of a module, procedure, function, etc. that perform the functions or operations described above. The software code may be stored in the memory and driven by the control unit. The memory may be located inside or outside the user terminal and the server, and data may be exchanged with the controller by various known means.

The controller 270 according to an embodiment of the present invention executes an application and controls the overall process of performing the tinnitus consultation operation supported by the server 100 .

Specifically, the control unit 270 may include a video playback support unit 271 and a reaction information collection unit 272 .

The video playback support unit 271 may perform an operation required to reproduce various consultation and question related videos played in the execution screen of the application. The video playback support unit 271 may support playback of a video file in the user device 200 using a codec.

In addition, the reaction information collecting unit 272 may perform an operation of collecting the user's reaction information based on the image of the user detected through the audio processing unit 250 and the camera unit 260 . For example, when the user's voice is detected, the user device 200 may perform a recording function for inputting the user's voice (answer corresponding to a question) from the point in time. In addition, the user device 200 may automatically end the recording function when the user's speech is finished. In order to perform such a function, the reaction information collecting unit 272 may collect reaction information related to the start and end of the user's speech.

In addition, the reaction information collecting unit 272 may collect facial expression reaction information during the user's speech in order to detect that the tinnitus phenomenon occurs during the user's speech.

The user reaction information collected by the reaction information collection unit 272 may be automatically provided to the server 100 for use in determining the user's tinnitus characteristics.

7 is a flowchart illustrating an operation of tinnitus counseling according to an embodiment of the present invention.

According to an embodiment of the present invention, when operation 705 of executing an app on the user device 200 is performed, the server 100 may perform operation 710 of providing a tinnitus related question to the user device 200 side.

Thereafter, the server 100 may perform operation 715 of controlling to record the user's answer. Accordingly, the user device 100 may record the user's answer and transmit the recorded file to the server 100 .

The operations 710 and 715 are illustrated in FIG. 8 .

8 is a diagram illustrating a process of obtaining a user answer according to an embodiment of the present invention.

As shown in 810 of FIG. 8 , the server 100 according to an embodiment of the present invention may provide a video in which the counselor asks a question. In addition, the server 100 may control to perform a recording operation as illustrated in 820 after the question operation illustrated in 810 . As shown in 820, the screen displayed while the recording operation is performed is an image element ( eg, a microphone image).

Thereafter, the server 100 may perform operation 720 of analyzing the acquired recorded data.

In addition, the server 100 may determine explanatory data corresponding to the user's answer through the analysis of the recorded data, and may perform operation 725 of retrieving it and providing it to the user device 200 side.

The explanatory data may be provided on a screen as in FIG. 10 .

10 is a diagram illustrating an operation in which a moving picture related to tinnitus is reproduced according to an embodiment of the present invention.

The server 100 may perform operation 730 to determine whether a consultation termination request is received from the user device 200 . If the consultation end request is received, the server 100 may end the corresponding operation process. If the consultation end request is not received, the server 100 may perform operation 735 of preparing the next question. In addition, steps 710 and below of providing the prepared tinnitus related question may be repeatedly performed.

In short, the tinnitus counseling treatment system according to an embodiment of the present invention includes a server, a user device, and a counselor device, and the server provides question content to the user device for tinnitus counseling, and the user responds to the provided question content. command to record the response, determine the user's tinnitus characteristic by analyzing the recorded response, search for explanatory data corresponding to the determined user tinnitus characteristic and provide it to the user device, the user device is the server The question content for tinnitus consultation and explanatory data related to the user's response are received and played from the counselor device, and the counselor device may photograph and upload the question content and explanatory data to be provided to the user device.

In addition, the server may include a question operation control unit that obtains tinnitus-related question content from the counselor device and provides a tinnitus-related question to the user device. At this time, the question operation control unit categorizes and processes the obtained question content, but a question management unit that manages to include in one question content question connection information for determining a question to be presented later according to a result of a user response to one question and a question performing unit that provides question content to the user in order to diagnose the user's tinnitus status, and selects and provides a subsequent question based on the question connection information after a certain question is provided.

In addition, the server may include a response data analysis unit that records the user's response performed according to the presented question and analyzes the recorded user's response. The response data analysis unit extracts key terms from a response recording performer that starts a recording operation as the user's remark is detected after a question is provided, and a recording file in which the user's response is recorded, and classifies the extracted key terms into categories It may be configured to include a recording file analysis unit.

In addition, the server directly records a sound similar to tinnitus from the user or selects an item corresponding to a sound similar to tinnitus from among the provided sample sounds, and adjusts the selected sound through frequency adjustment, intensity adjustment, or sample sound addition operation It may include a tinnitus estimator for specifying the tinnitus by performing the tinnitus.

In addition, the server may include an explanatory data providing unit that determines the characteristics of the user's tinnitus based on a response to the question after asking the user and searches for and provides explanatory data corresponding to the characteristics of the user's tinnitus.

The explanatory data providing unit includes a tinnitus characteristic determination unit that assigns a code corresponding to the user's tinnitus characteristics based on a score result given to the user's response content or a key term extracted from the user's response content, and the tinnitus characteristic determination unit It may include a suitable data search unit that searches for explanatory data related to the characteristics of the user's tinnitus based on the code given to one user by the user and provides it to the user.

In addition, the server determines whether the user's interest changes and the user's tinnitus symptoms are alleviated based on the user's response for each consultation session, and when a change in interest or tinnitus symptom relief is detected, treatment is performed based on the changed interest information and tinnitus symptom relief information It may be configured to include a treatment effect evaluation unit for generating effect statistics.

In the tinnitus counseling treatment method based on user voice analysis according to an embodiment of the present invention, the tinnitus counseling server provides a question providing step of providing a tinnitus-related question to the user in order to determine the user's tinnitus characteristics, and the server responds to the question provided to the user. The answer recording step of recording the user's voice responding, the recording data analysis step of extracting and classifying key terms from the recorded user's response, judging the user's tinnitus characteristics according to the recorded data analysis results, and determining the user's tinnitus characteristics The treatment effect of evaluating the therapeutic effect of the explanatory material viewed by the user when the user's symptom relief is detected based on the user's response content at the stage of providing the explanatory material provided to the user's device by searching for the corresponding explanatory material It may include an evaluation step.

Although the present invention has been described in detail with reference to the above-described examples, those skilled in the art can make modifications, changes, and modifications to the examples without departing from the scope of the present invention. In short, in order to achieve the intended effect of the present invention, it is not necessary to separately include all the functional blocks shown in the drawings or follow all the orders shown in the drawings. Note that it may fall within the scope.

100 : server
110: communication department
120: storage
131: question action control
131a: Question Management Department
131b: question execution unit
132: response data analysis unit
132a: response recording execution unit
132b: Recorded file analysis unit
133: Lee Myeong-eum estimation unit
134: explanation data providing unit
134a: Tinnitus characteristic determination unit
134b: suitable data search unit
135: treatment effect evaluation unit

Claims (9)

In the counseling treatment system comprising a server, a user device, and a counselor device,
the server is
Provide question content to the user device for tinnitus consultation, command to record the user's response to the provided question content, analyze the recorded response to determine the user's tinnitus characteristics, and respond to the determined user tinnitus characteristics. retrieving corresponding explanatory material and providing it to the user device;
The user device is
Receiving and playing explanatory material related to the question content and the user's response content for tinnitus consultation from the server,
The counselor's device is
A tinnitus counseling treatment system based on user voice analysis, characterized in that it uploads the question content and explanatory material to be provided to the user's device. The method of claim 1
the server is
A question operation control unit that obtains tinnitus-related question content from the counselor device and provides a tinnitus-related question to the user device; includes;
The question operation control unit
a question management unit that classifies and processes the obtained question content, but manages to include question connection information for determining a question to be presented later in one question content according to a result of a user response to one question; and
User voice comprising: a question performing unit that provides question content to the user in order to diagnose the user's tinnitus status, and selects and provides a subsequent question based on the question connection information after a certain question is provided Analysis-based tinnitus counseling treatment system. The method of claim 1,
the server is
and a response data analysis unit that records the user's response performed according to the presented question and analyzes the recorded user's response.
The response data analysis unit
a response recording performing unit that starts a recording operation as the user's remark is sensed after a question is provided; and
A tinnitus counseling treatment system based on user voice analysis, comprising: a recording file analysis unit that extracts key terms from a recorded file in which the user's response is recorded, and classifies the extracted key terms by category. The method of claim 1
the server is
Tinnitus sound by directly recording a sound similar to tinnitus from the user or selecting an item corresponding to a sound similar to tinnitus from among the provided sample sounds, and adjusting the frequency, intensity, or adding sample sound for the selected sound. Tinnitus counseling treatment system based on user voice analysis, characterized in that it comprises; The method of claim 1,
the server is
After asking the user a question, an explanatory data providing unit that determines the user's tinnitus characteristics based on the response to the corresponding question and searches for and provides explanatory data corresponding to the user's tinnitus characteristics;
The explanatory data provider
a tinnitus characteristic determination unit that assigns a code corresponding to the user's tinnitus characteristic based on a score result given to the user's response content or a key term extracted from the user's response content;
Based on the code given to one user by the tinnitus characteristic determination unit, a suitable data search unit that searches for explanatory data related to the user's tinnitus characteristics and provides it to the user; Tinnitus Counseling Treatment System. The method of claim 1,
the server is
Based on the user's response for each consultation session, it is determined whether the user's interest changes and the user's tinnitus symptoms are alleviated, and when a change in interest or tinnitus symptom relief is detected, treatment effect statistics are generated based on the changed interest information and tinnitus symptom relief information Tinnitus counseling treatment system based on user voice analysis, characterized in that it comprises; a treatment effect evaluation unit. Provide question content to the user device for tinnitus consultation, instruct to record the user's response to the provided question content, analyze the recorded response to determine the user's tinnitus characteristics, and respond to the determined user's tinnitus characteristics. Tinnitus counseling treatment server based on user voice analysis, characterized in that the search for corresponding explanatory data is provided to the user device. a server providing a question providing step of providing a tinnitus-related question to the user in order to determine the tinnitus characteristic of the user;
The server includes an answer recording step of recording a user's voice responding to a question provided to the user;
A recording data analysis step of extracting and classifying key terms from the recorded user's response; and
User voice analysis-based tinnitus counseling comprising: determining the user's tinnitus characteristics according to the recorded data analysis result, searching for explanatory data corresponding to the user's tinnitus characteristics, and providing the explanatory data to the user device; treatment method. a server providing a question providing step of providing a tinnitus-related question to the user in order to determine the tinnitus characteristic of the user;
The server includes an answer recording step of recording a user's voice responding to a question provided to the user;
A recording data analysis step of extracting and classifying key terms from the recorded user's response;
an explanatory data providing step of determining the user's tinnitus characteristics according to the recorded data analysis result, searching for explanatory data corresponding to the user's tinnitus characteristics, and providing the explanatory data to the user device; and
Tinnitus counseling based on user voice analysis, comprising: a treatment effect evaluation step of evaluating the treatment effect on the explanatory material viewed by the user when symptom relief of the user is detected based on the user's response for each consultation session; treatment method.

Images