KR20150041281A - Method for providing health diagnosis service using voice analysis, system and apparatus thereof - Google Patents

Abstract

The present invention relates to a method for providing a health diagnosis service using analysis, a system, and an apparatus thereof. In particular, user health condition information is created and provided by comparing a sound wave pattern in relation to user voice information with a sound wave pattern that was previously stored for each condition. Therefore, the user′s voice is obtained by a microphone of a terminal and the user′s health information is extracted by analyzing the obtained data in a server so that the current health condition may be identified by the feedback information. Also, by analyzing the sound wave pattern included in the voice information of the user, the server creates the health information and provides data for predicting the future health condition using the health information for users to be prepared for the future health issues.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a method for providing a health diagnosis service using speech analysis,

The present invention relates to a method for providing a health diagnosis service using voice analysis, a system and an apparatus for the same, and more particularly, The present invention relates to a method for providing a health diagnosis service using voice analysis, and a system and an apparatus therefor.

With the development of the mobile communication network and the development of the terminal specification, the mobile communication terminal has become a necessity of modern people and has evolved into a total entertainment device beyond the conventional category of simple communication apparatus or information providing apparatus.

Particularly, a mobile communication terminal having a function of analyzing a health state of a user by inputting a voice of a user is now on the market. These mobile communication terminals are provided with a voice analysis chip capable of analyzing the voice of the user, and analyze the voice input from the user, and transmit the analyzed voice to the server through the Internet. The server of the wireless data network receiving the voice analyzed through the internet diagnoses the health state of the user using the voice analysis data stored in advance and transmits the diagnosis result to the mobile communication terminal. Accordingly, the user can simply check his / her health condition by inputting his voice to the mobile communication terminal.

However, the conventional health diagnosis method for diagnosing the health of the user by inputting the voice of the user to the mobile communication terminal must include a chip for analyzing the user's voice in the mobile communication terminal as described above.

Therefore, only the users of the mobile communication terminal equipped with the voice analysis chip can receive the health diagnosis service through the voice analysis. In addition, the mobile communication terminal used in the health diagnostic method through voice analysis has a higher manufacturing cost than other mobile communication terminals not equipped with such a function due to the built-in voice analysis chip, A separate space for embedding the chip is required.

Korean Registered Patent No. 10-0413407 B1, Registered on Dec. 18, 2003 (name: computer-readable recording medium recording speech analysis system, corresponding frequency oscillator and speech analysis program)

In order to solve such conventional problems, an object of the present invention is to provide a service device which generates health state information of a user through comparison between a sound wave pattern associated with voice information of a user recognized through a terminal and a previously stored sound wave pattern, And a system and an apparatus for the health diagnosis service providing method using the voice analysis that provides the generated health state information to the terminal.

According to an aspect of the present invention, there is provided a service apparatus including a service communication unit for communicating with at least one terminal and transmitting and receiving a plurality of data to be applied to provide a health diagnosis service using voice analysis, Extracts a sound wave pattern associated with the received sound information, compares the extracted sound wave pattern with a sound wave pattern corresponding to the current situation, generates health state information based on the comparison result, And provides the generated health state information to the terminal.

Further, the service apparatus according to the present invention may further include a storage unit including a sound wave pattern DB for storing sound wave patterns for respective situations, and a health state information DB for storing user health state information classified by users .

A terminal according to an exemplary embodiment of the present invention includes a communication unit that communicates with a service device and transmits and receives a plurality of data to be applied to provide a health diagnostic service using voice analysis, an audio processor that recognizes a user voice and transmits the voice to the controller, And a control unit for transmitting voice information on the recognized user voice to the service device, receiving health state information related to voice information from the service device, and controlling the received health state information to be output through at least one output means .

In the terminal according to the present invention, the control unit may execute a specific application, activate a health diagnosis service provided through the application, and recognize the user's voice through the audio processing unit.

Also, in the terminal according to the present invention, the control unit converts the recognized user's voice to extract the voice information, and transmits the extracted voice information to the service device.

In the terminal according to the present invention, the controller may output current and past health status information as at least one of visual data and auditory data using a table or a graph.

In the terminal according to the present invention, the controller may output predicted future health state information together with additional information based on current and past health state information.

The health diagnosis service providing system using the voice analysis according to the embodiment of the present invention recognizes the user voice, transmits the voice information of the recognized user voice to the service device, receives the health status information related to the voice information from the service device A terminal for outputting the received health state information through at least one output means, and a voice recognition unit for receiving the voice information of the user voice recognized from the terminal, extracting a sound wave pattern associated with the received voice information, And a service device for comparing the sound wave patterns corresponding to the current situation, generating health state information based on the comparison result, and providing the generated health state information to the terminal.

A method for providing a health diagnosis service using voice analysis according to an embodiment of the present invention includes the steps of: receiving voice information of a user voice recognized from at least one terminal by a service device; Comparing the extracted sound wave pattern with a current sound wave pattern corresponding to a current situation, generating a health state information based on a comparison result of the service device, And providing health status information to the terminal.

According to another aspect of the present invention, there is provided a method for providing a health diagnosis service using voice analysis, comprising the steps of: recognizing a current situation of a user by considering at least one of a time, a day, The method comprising the steps of: confirming a situation sound wave pattern based on a current state in which the service apparatus is recognized; and determining whether the service apparatus matches the extracted sound wave pattern by comparing the extracted sound wave pattern with a current sound wave pattern corresponding to the current situation .

In the method for providing the health diagnosis service using the voice analysis according to the present invention, the generating step may include determining whether the health condition is abnormal based on the result of comparing the sound wave pattern extracted from the service apparatus with the sound wave pattern corresponding to the current situation, And generating health state information based on the checked result of the service device.

A method for providing a health diagnosis service using voice analysis according to an embodiment of the present invention includes a step of recognizing a user voice by a terminal, a step of transmitting voice information on a recognized user voice to a service device, Receiving health state information related to voice information from the mobile terminal and outputting the received health state information through at least one output means.

According to another aspect of the present invention, there is provided a method of providing a health diagnostic service using voice analysis, the method comprising: requesting retransmission of voice information according to a discrepancy between a sound wave pattern corresponding to voice information transmitted from a service device and a pre- Receiving the message, re-recognizing the user's voice according to the received message, and re-transmitting the voice information on the re-recognized user voice to the service device.

As another means for solving the problem of the present invention, there is provided a computer readable recording medium on which a program for executing a method for providing a health diagnosis service using voice analysis is recorded.

According to the present invention, a user's voice can be acquired through a microphone of a terminal, the obtained data can be analyzed in a server to extract user's health information, and information about the user's health can be fed back to check the current health status.

Further, health state information can be generated in the server through the analysis of the sound wave pattern included in the voice information of the user, and data for predicting the future health state can be provided using the health state information to prepare for the health state.

1 is a block diagram of a system for providing a health check service using voice analysis according to an embodiment of the present invention.
2 is a block diagram showing the configuration of a terminal according to the present invention.
3 is a block diagram showing a configuration of a service apparatus according to the present invention.
4 is a data flow chart for explaining a method of providing a health diagnosis service using voice analysis according to an embodiment of the present invention.
5 is a flowchart illustrating an operation method of a terminal according to the present invention.
6 is a flowchart illustrating an operation method of a service apparatus according to the present invention.
7A to 7C are diagrams for explaining a process of recognizing a user voice according to an embodiment of the present invention.
8A to 8D are diagrams for explaining a process of outputting health state information generated through voice analysis of a user according to an embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

The terms and words used in the present specification and claims should not be construed to be limited to ordinary or dictionary meanings and the inventor is not limited to the concept of terminology for describing his or her invention in the best way. It should be interpreted as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible.

Hereinafter, a terminal according to an embodiment of the present invention is connected to a communication network to transmit voice information on a voice of a user to a service device, receive health state information generated according to an analysis of voice information from the service device, The terminal is not limited to the mobile communication terminal but may be applied to various terminals such as all information communication devices, multimedia terminals, wired terminals, fixed terminals and IP (Internet Protocol) terminals. Also, the terminal may be a mobile phone, a portable multimedia player (PMP), a mobile Internet device (MID), a smart phone, a desktop, a tablet PC, a notebook, And an information communication device, which can be advantageously used in a mobile terminal having various mobile communication specifications.

Hereinafter, a system for providing a health diagnosis service using voice analysis according to an embodiment of the present invention will be described.

1 is a block diagram of a system for providing a health check service using voice analysis according to an embodiment of the present invention.

Referring to FIG. 1, a system 100 for providing health using voice analysis according to the present invention comprises a terminal 10, a service device 20, and a communication network 30.

In addition, the processor mounted on the terminal 10 or the service apparatus 20 according to the present invention can process program instructions for executing the method according to the present invention. In one implementation, the processor may be a single-threaded processor, and in other embodiments, the processor may be a multi-threaded processor. Further, the processor is capable of processing instructions stored on a memory or storage device.

The communication network 30 performs a series of data transmission and reception operations for data transmission and information exchange between the terminal 10 and the service apparatus 20. [ In particular, the communication network 30 may use various types of communication networks and may be, for example, a wireless LAN (WLAN), a Wi-Fi, a Wibro, a WiMAX, HSDPA, and High Speed Downlink Packet Access) or a wireless communication method such as Ethernet, xDSL (ADSL, VDSL), Hybrid Fiber Coax (HFC), Fiber to the Curb (FTTC) A wired communication method can be used. The communication network 30 is not limited to the above-described communication system, but may include any other widely known or later-developed communication systems as well as the communication systems described above.

The terminal 10 is connected to the service device 20 through the communication network 30 to transmit and receive all data for providing a health diagnosis service using voice analysis. In particular, the terminal 10 according to the present invention recognizes the user's voice and transmits the voice information on the recognized user's voice to the service device 20. The terminal 10 receives the health status information related to the voice information from the service device 20 and outputs the received health status information through the output means.

The service device 20 is connected to the terminal 10 through the communication network 30 to transmit and receive all data for providing a health diagnosis service using voice analysis. In particular, it receives voice information for a user voice recognized from the terminal 10 according to the present invention, and extracts a sound wave pattern associated with the received voice information. Then, the service device 20 compares the extracted sound wave pattern with the sound wave pattern corresponding to the current situation.

Based on the comparison result, the service device 20 confirms the health status of the user, generates health status information based on the confirmed result, and provides the generated health status information to the terminal 10.

Accordingly, the present invention can acquire the voice of the user through the microphone of the terminal, extract the user's health information by analyzing the obtained data at the server, and feedback the information about the user to check the current health state. Further, health state information can be generated in the server through the analysis of the sound wave pattern included in the voice information of the user, and data for predicting the future health state can be provided using the health state information to prepare for the health state.

The health diagnosis service process using the voice analysis according to the embodiment of the present invention will be described in more detail with reference to FIG. 2 to FIG. 8D.

2 is a block diagram showing the configuration of a terminal according to the present invention.

Referring to FIG. 2, a terminal 10 according to the present invention includes a control unit 11, an input unit 12, a display unit 13, a storage unit 14, an audio processing unit 15, and a communication unit 16. Here, the control unit 11 includes a voice recognition module 11a, and the storage unit 13 includes health state information 14a.

The input unit 12 receives various information such as numbers and character information and transmits various signals to the control unit 11 in connection with setting various functions and controlling functions of the terminal 10. The input unit 12 may include at least one of a keypad and a touchpad that generates an input signal according to a user's touch or operation. At this time, the input unit 12 may be configured in the form of a touch panel (or a touch screen) together with the display unit 13 to simultaneously perform input and display functions. The input unit 12 may be any type of input device that can be developed in addition to an input device such as a keyboard, a keypad, a mouse, a joystick, and the like. In particular, the input unit 12 according to the present invention senses an input signal for recognizing a user voice applied to the health diagnosis service, and transmits the input signal to the control unit 11.

The display unit 13 displays information on a series of operation states, operation results, and the like that occur while the functions of the terminal 10 are performed. In addition, the display unit 13 can display menus of the terminal 10 and user data input by the user. The display unit 13 may be a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), a light emitting diode (LED), an organic light emitting diode (OLED) LEDs, active matrix organic light emitting diodes (AMOLED), active matrix OLEDs, retina displays, flexible displays, and three-dimensional displays. In this case, when the display unit 13 is configured as a touch screen, the display unit 13 may perform some or all of the functions of the input unit 12. [ In particular, the display unit 13 according to the present invention analyzes the user's voice and outputs the generated health status information.

The storage unit 14 is a device for storing data, and includes a main storage device and an auxiliary storage device, and stores an application program required for functional operation of the terminal 10. [ The storage unit 14 may include a program area and a data area. Here, when the terminal 10 activates each function in response to a request from the user, the terminal 10 executes the corresponding application programs under the control of the controller 11 to provide each function. In particular, the storage unit 14 according to the present invention stores an operating system for booting the terminal 10, a program for recognizing user's voice, a program for outputting health status information through user voice, and the like. Also, the storage unit 14 receives and stores the health state information 14a generated from the user's voice from the service device 20. [

The audio processing unit 15 transmits the audio signal input from the speaker SPK or the microphone MIC to the control unit 11 for reproducing and outputting the audio signal. The audio processor 15 converts an analog audio signal input through a microphone into a digital format and transmits the audio signal to the controller 11. The audio processing unit 15 may convert the digital audio signal output from the control unit 11 into an analog signal and output it through a speaker. In particular, the audio processing unit 15 according to the present invention recognizes the user's voice and transmits the user's voice to the control unit 11. Also, the audio processing unit 11 outputs an effect sound or an execution sound according to the execution of the application, and outputs an alarm sound or alarm for the health state information generated according to the user's voice.

The communication unit 16 performs a function of transmitting and receiving data through the communication network 30 with the service apparatus 20. [ Here, the communication unit 16 includes RF transmitting means for up-converting and amplifying the frequency of the transmitted signal, RF receiving means for low-noise amplifying the received signal and down-converting the frequency. The communication unit 16 may include at least one of a wireless communication module (not shown) and a wired communication module (not shown). When the terminal 10 uses wireless communication, the wireless communication module uses any one of a wireless network communication module, a wireless LAN communication module, and a wireless fan communication module to transmit / receive data according to a wireless communication method. Data can be transmitted and received to the service apparatus 20. [ The wired communication module is for transmitting / receiving data by wire. The wired communication module can connect to the communication network 30 via a wired line and transmit / receive data to / from the service device 20. [ In particular, the communication unit 16 according to the present invention communicates with the service device 20 to transmit / receive a plurality of data applied to provide a health diagnosis service using voice analysis.

The control unit 11 may be an operating system (OS) and a process unit for driving each configuration. In particular, the control unit 11 according to the embodiment of the present invention recognizes the user's voice and transmits the voice information on the recognized user's voice to the service device 20. [ To this end, the control unit 11 recognizes the user's voice and executes a specific application that can be transmitted to the service apparatus 20, and activates the health examination service provided through the application. Then, the control unit 11 recognizes the user's voice through the audio processing unit 15. [ Thereafter, the control unit 11 converts the recognized user's voice to extract the voice information, and transmits the extracted voice information to the service device 20. [

The control unit 11 receives the health status information related to the voice information from the service device 20. [ Then, the control unit 11 outputs the received health state information through the output means. That is, the control unit 11 outputs current and past health state information as visual data and auditory data to which a table or a graph is applied. On the other hand, the control unit 11 may output predicted future health state information together with additional information based on current and past health state information. Here, the additional information includes information on the eating habit, exercise amount, and the like generated according to the health condition information.

Meanwhile, the control unit 11 can receive a message requesting retransmission of voice information according to a discrepancy between a sound wave pattern corresponding to the transmitted voice information and a previously stored sound wave pattern from the service apparatus 20. Then, the control unit 11 re-recognizes the user's voice according to the received message, and re-transmits the voice information of the re-recognized user voice to the service apparatus 20. [

In order to perform the function of the terminal 10 more effectively, the control unit 11 includes a voice recognition module 11a. In particular, the voice recognition module 11a executes a mode for recognizing voice according to a user request, and recognizes a user voice in a voice recognition mode. At this time, the speech recognition module 11a can repeatedly request speech recognition for more accurate and reliable speech extraction.

3 is a block diagram showing a configuration of a service apparatus according to the present invention.

Referring to FIG. 3, the service apparatus 20 according to the present invention includes a service control unit 21, a service storage unit 22, and a service communication unit 23. The service control unit 21 includes a sound wave pattern extraction module 21a, a sound wave pattern comparison module 21b and a health state information generation module 21c. The service storage unit 22 includes a sound wave pattern DB 22a, And a health status information DB 22b.

The service communication unit 23 communicates with the terminal 10 through the communication network 30 to transmit and receive a plurality of data applied to provide a health diagnosis service using voice analysis.

The service storage unit 22 stores all the programs according to the execution of the functions of the service apparatus 20. [ In particular, the service storage unit 22 according to the present invention compares a program for extracting a sound wave pattern from the voice information received from the terminal 10, a program for recognizing the current situation, a sound wave pattern extracted from the extracted sound wave pattern, A program for generating health state information according to a sound wave pattern comparison, and the like. The service storage unit 22 also stores a sound wave pattern DB 22a for storing sound wave patterns for each situation and a health state information DB 11b for storing the health state information of the user by user.

The service control unit 21 may be an operating system and a process unit for driving each configuration. In particular, the service control unit 21 according to the embodiment of the present invention receives voice information on the user's voice recognized from the terminal 10. [ At this time, the service control unit 21 confirms the received voice information and extracts a sound wave pattern by converting the confirmed voice information.

The service control unit 21 recognizes the current status of the user. Here, the current status of the user is classified into a time zone (morning, lunch, dinner), day of week (weekday, weekday), date, etc. and can be classified into daily life forms such as work, exercise, , A text message sent and received, a personal schedule management, a social network service, or a personal homepage analysis. In accordance with this situation, the sound wave patterns classified for each user are grasped and managed in advance.

The service control unit 21 compares the sound wave pattern associated with the received sound information and the previously stored sound wave pattern. That is, the service control unit 21 can check a sound wave pattern of the voice information received from the terminal 10, and compare the sound wave pattern with the previously stored sound wave pattern according to the current status of the user. For example, when it is determined that the current user's situation is in the morning, the service control unit 21 compares the sound pattern set corresponding to the morning work and the sound wave pattern of the current user received from the terminal 10, Depending on whether they are matched, health problems can be identified.

Thereafter, the service control unit 21 confirms whether the health state of the user is abnormal based on the comparison result. Here, when the pattern matching is not applied to a range within a predetermined threshold value as a result of comparing the sound wave pattern extracted for the current user's voice with the current sound wave pattern corresponding to the current situation, Based on the results, it is possible to determine whether or not the health condition is abnormal. Then, the service control unit 21 generates health status information according to the comparison result. At this time, the health state information is determined based on the comparison result. The health state information can be defined by a sound wave pattern for general health classified by various stored symptoms, pain, and disease names, and the health state information is stored in a database Respectively.

Methods for recognizing a sound wave pattern for effectively performing such functions can be classified into classification by a speaker, classification by a pronunciation method, and classification by a lexical method. Here, the classification by the speaker includes speaker dependency, speaker independence, speaker adaptation, and the pronunciation classification method includes isolated word recognition, linked word recognition, continuous speech recognition, and dialogue recognition. Classification can be classified into small-capacity vocabulary recognition, large-capacity vocabulary recognition, variable vocabulary recognition, independent vocabulary recognition, and keyword recognition.

In detail, the sound wave pattern recognition technology analyzes the inputted user voice to extract the characteristics, and then measures the similarity with the sound wave patterns collected in advance and converts the similarities into characters or commands. At this time, the speech recognition technology is a kind of pattern recognition process. Since the voice, pronunciation and intonation are different for each person, it is desirable to collect voice data from as many people as possible, extract common characteristics therefrom, and generate a reference pattern.

That is, the speech pattern recognition process can be largely divided into a preprocessing process and a recognition process. In the preprocessing process, a noise component is removed by searching a region to be recognized from a voice uttered by a user, In the process, the input speech is compared with the speech database and the pattern of the most probable word is recognized as a recognition result. When recognizing a sentence other than a simple command, the pattern of the comparison word is limited using the language model, .

On the other hand, if there is no sound wave pattern matching the range within the threshold value of the comparison result, the service control unit 21 transmits a message requesting retransmission of voice information to the terminal 10.

The service control unit 21 provides the generated health status information to the terminal 10. Here, the service control unit 21 provides the current and past health status information to the terminal 10 using visual data and auditory data using tables or graphs. Meanwhile, the service control unit 21 predicts future health state information based on current and past health state information, and provides the predicted future health state information to the terminal 10 together with the additional information.

In order to more effectively perform the function of the service apparatus 20, the service control unit 21 includes a sound pattern extraction module 21a, a sound pattern comparison module 21b, and a health state information generation module 21c. In particular, the sound wave pattern extraction module 21a analyzes the sound information received from the terminal 10 to extract a sound wave pattern. The sound wave pattern comparison module 21b compares the sound wave pattern identified through the sound wave pattern extraction module 21a with the sound wave pattern according to the situation. For this purpose, the service control unit 21 preferably stores various types of sound wave patterns for each user situation. On the other hand, the health state information generation module 21c generates health state information based on the comparison result through the sound wave pattern comparison module 21b.

In addition, the service device 20 configured as described above may be implemented as one or more servers operating in a server-based computing-based manner or in a cloud-based manner. In particular, voice information, sound pattern, health status information, and the like for the health diagnosis service according to the present invention can be provided through a cloud computing function that can be permanently stored in a cloud computing device on the Internet. Here, cloud computing utilizes Internet technology in digital terminals such as desktops, tablet computers, laptops, netbooks and smart phones to provide virtualized IT (Information Technology) resources such as hardware (server, storage, (Database, security, web server, etc.), service, data, etc. on demand.

On the other hand, a memory mounted on the terminal 10 or the service apparatus 20 stores information in the apparatus. In one implementation, the memory is a computer-readable medium. In one implementation, the memory may be a volatile memory unit, and in other embodiments, the memory may be a non-volatile memory unit. In one implementation, the storage device is a computer-readable medium. In various different implementations, the storage device may comprise, for example, a hard disk device, an optical disk device, or any other mass storage device.

4 is a data flow chart for explaining a method of providing a health diagnosis service using voice analysis according to an embodiment of the present invention.

Referring to FIG. 4, in the method for providing a health diagnosis service using voice analysis according to the present invention, the terminal 10 recognizes the user voice in step S11. Then, the terminal 10 converts the recognized user's voice to extract the voice information, and transmits the extracted voice information to the service device 20 (S13 to S15). To this end, the terminal 10 recognizes the user's voice and executes a specific application that can be transmitted to the service device 20, and activates the health diagnosis service provided through the application. Then, the terminal 10 recognizes the user's voice through the audio processing unit 15.

In step S17, the service device 20 receives the voice information of the user voice recognized from the terminal 10, and confirms the received voice information. Then, the service device 20 converts the voice information identified in step S19 to extract a sound wave pattern.

The service device 20 recognizes the current status of the user in step S20. Here, the current status of the user is classified into a time zone (morning, lunch, dinner), day of week (weekday, weekday), date, etc. and can be classified into daily life forms such as work, exercise, , A text message sent and received, a personal schedule management, a social network service, or a personal homepage analysis. In accordance with this situation, the sound wave patterns classified for each user are grasped and managed in advance.

The service device 20 compares the sound wave pattern associated with the sound information received in step S21 and the previously stored sound wave pattern. That is, the service device 20 can check a sound wave pattern of the voice information received from the terminal 10, and compare the sound wave pattern with the previously stored sound wave patterns according to the current status of the user. For example, if the current state of the user is determined to be in operation at the morning, the service device 20 compares the sound pattern set corresponding to the morning work and the sound pattern of the current user received from the terminal 10, Depending on whether they are matched, health problems can be identified.

Thereafter, the service device 20 confirms whether the user's health condition is abnormal based on the comparison result. Here, when the service device 20 compares the sound wave pattern extracted for the current user's voice with the current sound wave pattern corresponding to the current situation, if there is no pattern matching the range within the preset threshold value, Based on the results of the comparison, it is possible to determine whether or not the health condition is abnormal. Then, the service device 20 generates health status information according to the comparison result in step S23. At this time, the health state information is information on the health state determined based on the comparison result. The health state information can be defined by the sound patterns classified by various stored symptoms, pain, and disease names. Such health state information is databaseized, .

On the other hand, when there is no sound wave pattern matching the range within the threshold value of the comparison result, the service device 20 transmits a message requesting the voice information retransmission to the terminal 10.

The service device 20 transmits the health state information generated in step S25 to the terminal 10. [ Here, the service device 20 provides current and past health status information to the terminal 10 using visual data and auditory data using tables or graphs. On the other hand, the service device 20 predicts future health state information based on current and past health state information, and provides the predicted future health state information together with the additional information to the terminal 10.

The terminal 10 receives the health status information related to the voice information from the service device 20 in step S27 and outputs the received health status information through the output means. Here, the additional information includes information on the eating habit, exercise amount, and the like generated according to the health condition information.

Accordingly, the present invention can acquire the user's voice through the microphone of the terminal, analyze the obtained data at the server, extract the health information on the body of the user, and check the current health state by feeding back information about the user's body . Further, health state information can be generated in the server through the analysis of the sound wave pattern included in the voice information of the user, and data for predicting the future health state can be provided using the health state information to prepare for the health state.

FIG. 5 is a flowchart for explaining an operation method of a terminal according to the present invention. FIGS. 7A to 7C are views for explaining a process of recognizing a user voice according to an embodiment of the present invention, and FIGS. 8A to 8D Is a diagram for explaining a process of outputting health state information generated through voice analysis of a user according to an embodiment of the present invention.

Referring to FIG. 5, the terminal 10 recognizes the user's voice in step S41. Then, the terminal 10 converts the recognized user's voice to extract the voice information, and transmits the extracted voice information to the service device 20 (S43 to S45). To this end, the terminal 10 recognizes the user's voice and executes a specific application that can be transmitted to the service device 20, and activates the health diagnosis service provided through the application. Then, the terminal 10 recognizes the user's voice through the audio processing unit 15.

For example, as shown in FIGS. 7A to 7C, the terminal 10 displays a message capable of recognizing the user's voice, and activates an audio function for the user's voice. When the user's voice is input, the terminal 10 outputs a message for confirming whether the voice is transmitted to the user, and transmits the voice information to the service device 20 according to the user's selection. After transmitting the voice information, the terminal 10 outputs a reply to the voice information transmission on the screen through a message.

The terminal 10 checks whether the health status information is received from the service device 20 in step S47. When the health state information is received, the terminal 10 outputs the health state information received in step S49 through the output means. Here, the additional information includes information on the eating habit, exercise amount, and the like generated according to the health condition information. That is, the terminal 10 outputs the current and past health state information as visual data and auditory data using tables or graphs. On the other hand, the terminal 10 can output predicted future health state information together with additional information based on current and past health state information.

For example, as shown in FIG. 8A, the terminal 10 outputs information on the health status of the user on the screen. The health status information includes current suspected symptoms such as a throat and a cold, And the predicted symptoms of tonsillitis that may occur in some cases. Also, as shown in FIG. 8B, the terminal 10 displays current and past health status information as visual data using a graph. Also, as shown in FIG. 8C, the terminal 10 displays current and past health status information as visual data using a table. Meanwhile, as shown in FIG. 8D, the terminal 10 can provide information on the eating habit to be improved on the basis of the current health state information.

6 is a flowchart illustrating an operation method of a service apparatus according to the present invention.

Referring to FIG. 6, the service apparatus 20 according to the present invention receives voice information of a user voice recognized from the terminal 10 in step S61. At this time, the service device 20 confirms the voice information received in step S63, and converts the confirmed voice information to extract a sound wave pattern.

The service device 20 recognizes the current status of the user in step S64. Then, the service device 20 compares the sound wave pattern associated with the sound information received in step S65 and the previously stored sound wave pattern. That is, the service device 20 can check the sound wave patterns of the voice information received from the terminal 10 and compare the sound wave patterns with the previously stored sound wave patterns according to the determined current user status.

Thereafter, the service device 20 confirms whether the user's health condition is abnormal based on the comparison result. That is, the service device 20 confirms whether there is a matching sound wave pattern. Here, if the sound wave pattern extracted from the voice of the current user is compared with the sound wave pattern corresponding to the current situation and the sound wave pattern matching the range within the predetermined threshold does not exist , And it is possible to determine whether or not the health condition is abnormal based on the comparison result. Then, the service device 20 generates health status information according to the comparison result in step S69.

If there is no sound wave pattern matching the range within the threshold value of the comparison result in step S73, the service device 20 transmits a message requesting retransmission of the voice information to the terminal 10.

The service device 20 provides the health status information generated in step S71 to the terminal 10. [ Here, the service device 20 provides current and past health status information to the terminal 10 using visual data and auditory data using tables or graphs. On the other hand, the service device 20 predicts future health state information based on current and past health state information, and provides the predicted future health state information together with the additional information to the terminal 10.

Although the present specification and drawings describe exemplary device configurations, the functional operations and subject matter implementations described herein may be embodied in other types of digital electronic circuitry, or alternatively, of the structures disclosed herein and their structural equivalents May be embodied in computer software, firmware, or hardware, including, or in combination with, one or more of the foregoing. Implementations of the subject matter described herein may be embodied in one or more computer program products, i. E. One for computer program instructions encoded on a program storage medium of the type for < RTI ID = 0.0 & And can be implemented as a module as described above. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that affects the machine readable propagation type signal, or a combination of one or more of the foregoing.

Implementations of the various techniques described herein may be implemented in digital electronic circuitry, or in computer hardware, firmware, software, or combinations thereof. Implementations may be implemented in a computer program product, such as an information carrier, e.g., a machine readable storage device, such as a computer readable storage medium, for example, for processing by a data processing apparatus, Apparatus (computer readable medium) or as a computer program tangibly embodied in a propagation signal. A computer program, such as the computer program (s) described above, may be written in any form of programming language, including compiled or interpreted languages, and may be stored as a stand-alone program or in a module, component, subroutine, As other suitable units for use in the present invention. A computer program may be deployed to be processed on one computer or multiple computers at one site or distributed across multiple sites and interconnected by a communications network.

The method steps may be performed by one or more programmable processors executing a computer program to perform functions by operating on input data and generating an output. The method steps may also be performed by special purpose logic circuitry, e.g., a field programmable gate array (FPGA) or an application-specific integrated circuit (ASIC), and the devices may be implemented as such.

Processors suitable for processing a computer program include, by way of example, both general purpose and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The elements of a computer may include at least one processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer may include one or more mass storage devices for storing data, such as magnetic, magneto-optical disks, or optical disks, or may receive data from them, transmit data to them, . ≪ / RTI > Information carriers suitable for embodying computer program instructions and data include, for example, semiconductor memory devices, for example, magnetic media such as hard disks, floppy disks and magnetic tape, compact disk read only memory A magneto-optical medium such as a floppy disk, an optical disk such as a DVD (Digital Video Disk), a ROM (Read Only Memory), a RAM , Random Access Memory), a flash memory, an EPROM (Erasable Programmable ROM), an EEPROM (Electrically Erasable Programmable ROM), and the like. The processor and memory may be supplemented or included by special purpose logic circuitry.

While the specification contains a number of specific implementation details, it should be understood that they are not to be construed as limitations on the scope of any invention or claim, but rather on the description of features that may be specific to a particular embodiment of a particular invention Should be understood. Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments, either individually or in any suitable subcombination. Further, although the features may operate in a particular combination and may be initially described as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, Or a variant of a subcombination.

Likewise, although the operations are depicted in the drawings in a particular order, it should be understood that such operations must be performed in that particular order or sequential order shown to achieve the desired result, or that all illustrated operations should be performed. In certain cases, multitasking and parallel processing may be advantageous. Also, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products It should be understood.

It should be noted that the embodiments of the present invention disclosed in the present specification and drawings are only illustrative of specific examples for the purpose of understanding and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

The present invention generates and provides health state information of a user through comparison between a sound wave pattern associated with the user's voice information and a previously stored sound wave pattern. Accordingly, the user's voice can be acquired through the microphone of the terminal, the obtained data can be analyzed by the server, the user's health information can be extracted, and the information about the user can be fed back to check the current health status. Further, health state information can be generated in the server through the analysis of the sound wave pattern included in the voice information of the user, and data for predicting the future health state can be provided using the health state information to prepare for the health state. This is not only a possibility of commercialization or sales, but also a possibility of being industrially applicable since it is practically possible to carry out clearly.

10: terminal 20: service device 30: communication network
11: control unit 12: input unit 13:
14: storage unit 15: audio processing unit 16:
21: service control unit 22: service storage unit 23: service communication unit
11a: voice recognition module 14a: health state information 21a: sound wave pattern extraction module
21b: sound wave pattern comparison module 21c: health state information generation module
22a: sound wave pattern DB 22b: health state information DB
100: Health diagnosis service using voice analysis system

Claims (14)

A service communication unit for communicating with at least one terminal and transmitting / receiving a plurality of data applied to provide a health diagnosis service using voice analysis; And
Receiving sound information of a user's voice recognized from the terminal, extracting a sound wave pattern associated with the received sound information, comparing the extracted sound wave pattern with a sound wave pattern corresponding to a current situation, Generates health state information based on the health state information and provides the generated health state information to the terminal;
Wherein the service device comprises: The method according to claim 1,
A sound wave pattern DB for storing a sound wave pattern for each situation, and a health state information DB for storing the health state information of the user separately for each user;
Further comprising: A communication unit for communicating with the service device to transmit and receive a plurality of data to be applied to provide a health diagnosis service using voice analysis;
An audio processing unit for recognizing the user's voice and transmitting the user's voice to the control unit; And
And transmitting the received health status information to at least one of the plurality of service apparatuses via the at least one output unit, The control unit controlling the output unit to output the control signal;
And a second terminal. 4. The apparatus of claim 3, wherein the control unit
A specific application is executed, a health diagnosis service provided through the application is activated, and a user voice is recognized through the audio processing unit. 4. The apparatus of claim 3, wherein the control unit
Extracts voice information by converting the recognized user voice, and transmits the extracted voice information to the service device. 4. The apparatus of claim 3, wherein the control unit
And outputs the current and past health state information as at least one of visual data and auditory data to which a table or a graph is applied. 4. The apparatus of claim 3, wherein the control unit
And outputs predicted future health state information together with additional information based on current and past health state information. Receiving the health state information related to the voice information from the service device, and transmitting the received health state information to at least one output means A terminal for outputting data; And
Receiving sound information of a user's voice recognized from the terminal, extracting a sound wave pattern associated with the received sound information, comparing the extracted sound wave pattern with a sound wave pattern corresponding to a current situation, Generates health state information based on health state information and provides the generated health state information to the terminal;
And a voice diagnosis service providing system for providing a health diagnosis service using voice analysis. The service device receiving voice information for a user voice recognized from at least one terminal;
Extracting a sound wave pattern associated with the received voice information;
Comparing the extracted sound wave pattern with a current sound wave pattern corresponding to a current situation;
Generating health state information based on the comparison result; And
Providing the generated health state information to the terminal by the service device;
Wherein the voice diagnosis service is a voice recognition service. 10. The method of claim 9,
The service device recognizing the current status of the user in consideration of at least one of a time, a day, a date, and a personal schedule;
Confirming a sound wave pattern for each situation based on the perceived current state; And
Determining whether the service apparatus matches with the extracted sound wave pattern by comparing the sound wave pattern according to the current situation;
Wherein the voice diagnosis service is a voice recognition service. 10. The method of claim 9, wherein the generating comprises:
Checking whether the health state is abnormal based on a result of comparing the extracted sound wave pattern with a sound wave pattern corresponding to a current situation; And
Generating health state information based on the confirmed result;
Wherein the voice diagnosis service is a voice recognition service. The terminal recognizing the user voice;
The terminal transmitting voice information on the recognized user voice to a service device;
The terminal receiving health status information related to the voice information from the service device; And
The terminal outputting the received health state information through at least one output means;
Wherein the voice diagnosis service is a voice recognition service. 13. The method of claim 12,
Receiving a message requesting retransmission of voice information according to a mismatch between a sound wave pattern corresponding to the voice information transmitted from the service device and a previously stored sound wave pattern;
Re-recognizing the user's voice according to the received message; And
The terminal re-transmitting voice information on the re-recognized user voice to the service device;
The method of claim 1, further comprising the steps of: A computer-readable recording medium recording a program for executing the method for providing a health examination service using the voice analysis described in any one of claims 9 to 13.

Images