KR20170045798A

KR20170045798A - System and method for voice disorder diagnosis

Info

Publication number: KR20170045798A
Application number: KR1020150145718A
Authority: KR
Inventors: 김인태
Original assignee: 김인태
Priority date: 2015-10-20
Filing date: 2015-10-20
Publication date: 2017-04-28

Abstract

The present invention relates to a system and a method for a diagnosis of a voice disorder by using a smartphone, and more specifically, to a system and a method for an early diagnosis of a voice disorder by using a smartphone which provides various contents or services corresponding to a screening result of a voice state by using a database and/or software stored in a server based on a voice inputted from a user. According to the present invention, the system comprises: a portable terminal receiving the voice of a user; and a service server analyzing the voice of the user inputted through the portable terminal to generate analysis data.

Description

[0001] SYSTEM AND METHOD FOR VOICE DISORDER DIAGNOSIS [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a system and method for early diagnosis of voice disorders using a smartphone. More particularly, the present invention relates to an early diagnosis system for voice disorders using a smartphone that provides various contents or services corresponding to screening results of voices using a database and / or software stored in a server based on voices input from a user And methods.

As a result of the recent economic development, westernization of eating habits, and excessive stress, there is an increasing trend of patients with voice and voice diseases as well as typical chronic diseases such as diabetes, hypertension, obesity and cancer. Social, and economic burdens.

On the other hand, there is a lack of services and systems for vocal-related diseases and prevention, and lack of cooperation with hospitals and related service providers in order to provide such services in Korea. The reliability of disease-related analysis data is insufficient.

Accordingly, it is an object of the present invention to provide a smart device application for securing various contents related to voices, to systemize various voice related analysis and judgment SW for service thereof, and to grow as a voice care global service.

In order to make it easy for the public to know their voice state, it is necessary to support simple screening and preventive service using smart phone and to use new data (DB) The background and necessity are as shown in Figs. 1 and 2 for the step-by-step approach to the field of medical ICT related to model creation and future voices.

More specifically, as shown in FIG. 3, the system for early diagnosis of voice disorders using a smartphone according to the present invention is configured to perform various voice therapy related know-how related to voice and voice, change width, strength, , Voicing, resonance, etc., and using the smart phone to input voices and related services, it is possible to measure and diagnose the voices of the voices, useful information on voice training and rehabilitation, entertainment contents And provides a global service for voice screening and prevention.

The object of the present invention is to solve the above-mentioned problems, and it is possible to provide information such as state and disease prevention through voice analysis.

It is also an object of the present invention to develop a voice care system for the first time in Korea through linkage with specialized medical institutions having voice-related data and create a global business model.

It is to be understood that the technical objectives of the present invention are not limited to the above-mentioned technical objects and other technical objects which are not mentioned in the following description are to be understood from the following description, It will be understood clearly by those with knowledge.

According to another aspect of the present invention, there is provided a system for early diagnosis of a voice disorder using a smartphone, the system comprising: a portable terminal for inputting a voice of a user; And a service server for analyzing voices input through the portable terminal and generating analysis data.

In this case, the portable terminal receives the analysis data from the service server, receives the user's voice through the installed application, and outputs the analysis data.

In this case, the application may include a voice storage unit for temporarily storing a voice provided by the user; And a voice filter unit for filtering the voice stored in the voice storage unit.

In this case, the service server may further include a comparison / analysis unit for comparing the voice of the user, which is input, with the software for comparison analysis to obtain a voice state of the input user.

In this case, the service server may further include a status report unit for dividing a user's voice state into a preventive state, a disease state, or a normal state on the basis of a result of the comparison and analysis unit and providing related result information.

In this case, the service server may further include a related result information transmitting unit for transmitting related result information provided by the status report unit to the portable terminal.

At this time, the comparative analyzing unit analyzes at least one of Pitch analysis, Speed analysis, Spectrogram analysis and formant analysis, strength analysis, tremor analysis, noise ratio analysis, chord analysis, frequency analysis, variation width analysis and resonance analysis . &Lt; / RTI >

In this case, the service server may include a voice database for grouping and storing various voice data by type.

At this time, the status report unit may transmit at least one of prevention related contents, entertainment contents, and other contents to the portable terminal when the comparison and analysis unit is classified as preventive or normal.

At this time, if the comparative analysis unit is classified as a disease, the status report unit may guide the 1: 1 expert phone and SMS linkage, induce location based hospital recommendation and related information, or induce other healthcare linkage services . &Lt; / RTI >

According to another aspect of the present invention, there is provided a method for early diagnosis of a voice disorder using a smartphone, the method comprising the steps of: receiving a user's voice through a portable terminal; And analyzing the user's voice through the service server to generate analysis data.

The present invention has the following effects.

According to the present invention, it is possible to provide services not only to domestic and foreign countries, but also to conduct first diagnosis through voice in the area of telemedicine including global healthcare and medical ICT field, analysis of voice condition, It is not limited to domestic patients or users, but has the effect of meeting global demand.

Further, according to the present invention, it is possible to provide information such as state and disease prevention through voice analysis.

In addition, according to the present invention, it is possible to enable the voice of the marginalized and the remote voice medical service in the future due to screening, prevention, and self-treatment of diseases related to farming and fishing villages, have.

1 is a diagram showing the necessity of development of an early voice disease diagnosis system using a smartphone according to the present invention.
2 is a diagram illustrating the background of the early diagnosis system for voice disorders using a smartphone according to the present invention.
FIG. 3 is a diagram illustrating an outline of an early voice disease diagnosis system using a smartphone according to the present invention.
FIG. 4 is a block diagram of an early detection system for voice disorders using a smartphone according to the present invention.
FIG. 5 is a diagram showing originality and conductivity of a voice disease early diagnosis system using a smartphone according to the present invention.
6 and 7 are diagrams showing the ripple effect of the voice diagnosis system using the smartphone according to the present invention.
8 is a diagram illustrating a service providing method of a voice disease early diagnosis system using a smartphone according to the present invention.
FIG. 9 is a diagram illustrating a core development factor of the voice diagnosis system using a smartphone according to the present invention.
FIG. 10 is a view showing an embodiment of a scenario of a voice disease early diagnosis system using a smartphone according to the present invention.
11 is a diagram for explaining software used to determine a state of use of a voice input by a user in an early voice system diagnosis system using a smartphone according to the present invention.
12 and 13 are diagrams for explaining an embodiment of a UI employed in the application of the present invention.
Fig. 14 is a view showing still another embodiment of the present invention.
15 is a diagram showing an example of commercialization using the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail.

It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, the same reference numerals will be used for the same constituent elements in the drawings, and redundant explanations for the same constituent elements will be omitted.

FIG. 4 is a block diagram of an early detection system for voice disorders using a smartphone according to the present invention. Referring to FIG. 4, a system 1000 for diagnosing voice disorders using a smartphone according to the present invention includes a portable terminal 100 and a service server 200. The portable terminal 100 may include one or more of a PC, a PDA (Personal Digital Assistance), a tablet computer, a netbook, a mobile phone, and a smart phone. That is, if there is a terminal device connectable to the service server 200 through the wireless network, it should be understood that the terminal device 100 belongs to the application category of the present invention. In addition, the voice recognition module installed in the vehicle may be used in place of the portable terminal 100 according to the embodiment. That is, with respect to the configuration for receiving the voice of the user, the voice recognition module is not necessarily limited to a portable terminal such as a smart phone if the voice recognition module is included.

More specifically, the portable terminal 100 includes an installed application 110, and the application 110 may include a voice storage unit 111 and / or a voice filter unit 112.

The service server 200 may include a comparison and analysis unit 210, a status report unit 220, a related result information transmission unit 230, and a voice database (DB) 240.

Each component will be described in detail as follows.

The voice storage unit 111 primarily stores voices received from a user and the voice filter unit 112 performs a function of filtering voices stored in the voice storage unit 111. [ In addition, the comparison and analysis unit 210 performs a function of deriving a voice state of the input user by performing a comparative analysis with the input user's voice in conjunction with the comparative analysis software, The related result information transmitting unit 230 performs a function of providing the related result information by dividing the voice state of the user into preventive or disease or normal based on the result of the comparison and analysis unit 210, 220 to the portable terminal (110).

More specifically, the comparison and analysis unit 210 may include a comparative analysis unit 210 for performing a Pitch analysis, a Speed analysis, a Spectrogram analysis and a formant analysis, a strength analysis, a tremor analysis, a noise ratio analysis, , A change width analysis, and a resonance analysis.

Also, the voice database 240 stores various voice data grouped by type.

According to an embodiment, the status report unit 220 may transmit at least one of prevention related contents, entertainment contents, and other contents to the portable terminal 100 when the comparison and analysis unit 210 is distinguished from the preventive or normal case If the comparison and analysis unit 210 is classified as a disease, it can induce 1: 1 expert phone and SMS linkage, induce location based hospital recommendation and related information, or induce other medical services .

In addition, the portable terminal 100 may further include a memory unit, a terminal control unit, an input unit, and a display unit. In connection with the memory unit, an application for processing and control of the terminal control unit may be stored or may be provided for temporarily storing input or output data. Various types of storage devices such as a flash memory type, a hard disk type, and the like may be used as the memory unit, and a flash memory type may be used in the embodiment of the present invention.

In addition, in connection with the terminal control unit, the terminal control unit may control the overall operation of the portable terminal 100 by controlling the operation of each configuration of the terminal. For example, when the portable terminal 100 is a smart phone, the terminal control unit may perform related control and processing for voice call, data communication, video call, and the like.

The input unit generates key input data that the user inputs to control the operation of the portable terminal 100. The input unit may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, a finger mouse, and the like. In addition, the input unit may include an operation recognition module according to an embodiment. More specifically, the module may recognize a user's movement pattern or a user's gaze processing.

In addition, the display unit displays and outputs information processed by the portable terminal (100). For example, when the portable terminal 100 is a smart phone, a UI (User Interface) or a GUI (Graphic User Interface) associated with the smartphone is displayed. In addition, the display unit may perform a function of displaying the hologram as a holographic image. In the method of displaying the holographic image, both the transmissive holography and the reflection holography are not limited.

Meanwhile, when the display unit and the input unit have a mutual layer structure to constitute a touch screen, the display unit may also serve as the input unit. When the display unit is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside, and can be connected to the inside of the portable terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the terminal control unit so as to know whether or not the touch input has occurred and which area of the touch screen is touched.

The display unit may include various display devices such as a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, and a flexible display. .

Hereinafter, the originality and the conductivity of the voice disease early diagnosis system using the smartphone according to the present invention will be described with reference to FIG.

1. Developed in cooperation with the best voice disease institution in Korea

The present invention has developed a voice diagnosis system (Web, App, management SW, Contents), and has been presently associated with voice and speech diagnosis institutes for over 13 years, And thus it is possible to provide fast, accurate and reliable information by studying how to support service with smart phone.

2. Developed the system for preventing voice diagnosis for the first time in Korea and abroad

Many apps for medical prevention and diagnosis have been released at home and abroad, Screening, prevention services, and entertainment elements have not yet been launched with the status analysis of my voice.

3. Ability to link medical diagnosis and other cognitive skills

The present invention has the advantage of providing the most basic service in the medical diagnosis from the viewpoint of using the voice, and provides a basis for diagnosing the voice naturally in addition to the case of the remote medical treatment while observing the specific region.

For example, there is a presence to the relevant App will vary on skin care, even if the services as well as measuring skin condition of the user's voice The satisfaction is improved. In addition, it is possible to connect with voice recognition and cognitive technology incidentally in medical service utilizing voices, and to support its own unique voice pattern, it is possible to recognize various voices that are not simply voice recognition, It is also possible to make a product that can be recognized as a complementary device in smart devices, which can be an opportunity to integrate into the home IoT field in the future.

4. Promotion of public health and provision of preventive medical services to the underprivileged of medical services

The number of patients suffering from pharyngeal diseases such as laryngeal cancer is increasing every year and it is emerging as a social issue. It can contribute to the health of the people by proposing preventive measures for various voice diseases by providing a simple diagnosis / treatment linkage system using smartphone .

In addition, it can contribute to improving the satisfaction of marginalized and remote medical services by screening for diseases related to farming and fishing villages that require diagnosis of voices and medical services, overseas patients, and providing preventive and self-care services.

Hereinafter, the key elements of the early voice disease diagnosis system using the smartphone according to the present invention will be described with reference to FIG. As shown in FIG. 9, the present invention can be summarized as the following core elements.

1. Developed application for smartphone support for voice care service

2. S / W development that can judge the state of input user voice

3. Establishment of related DB, establishment of linkage service environment

4. Others Voices Voice for health information development and medical treatment With DB Development of linkage, etc.

The software used in the present invention can be summarized as shown in Table 1 below.

Service Delivery App Application program for voice input, voice status information reception, and other information transmission / reception Voice analysis / judgment
Support SW Development of interworking SW with professional speech analysis software Praat for user voice Service environment construction Development of management SW (Web) and establishment of testbed environment for providing service (Server construction) Voice DB Various voice data grouped by type and DB Service DB
It is an administrator's PC SW,
Download related information SW

Hereinafter, a scenario of a voice disease early diagnosis system using a smartphone according to the present invention will be described with reference to FIG.

Referring to FIG. 10, a scenario of an early voice disease diagnosis system using a smartphone according to the present invention can be proceeded as follows. It should be noted, however, that this is merely an example and that the present invention is not necessarily limited in the following manner.

The present invention is divided into a smart phone area, a voice analysis server, and a data storage area. In the smart phone area, an UX-like part in seven stages is intensively displayed, and the application process is performed until the user's own voice is transmitted . In addition, in the analysis server area, an interworking with the comparative analysis SW is performed to derive the input voice state, and the result of the voice state is transmitted to the user again. Finally, the system is designed to store various result values in the DB by sorting by gender / age / type in order to store the result values.

Hereinafter, a description will be made of the state determination software for the user's voice inputted in the present invention with reference to FIG.

The user inputs voice data to the user's portable terminal through the application developed with respect to the step of inputting and transmitting voice, inputs specific vocabulary words of the portable terminal, compresses the inputted wave file of specific words, and transmits .

In relation to the step of analyzing the voice state, we carry out Voice analysis such as Pitch analysis, Spped measurement, Spectrogram analysis, Formant analysis, Strength measurement and analysis, Design and implementation of Praat S / W is expected to be inconvenient, and there are many problems with input parameter setting. On the other hand, here, Praat SW is a public SW dedicated to voice analysis, and is now being used for simulation in speech specialist institutions and hospital schools.

Regarding the state determination step according to the analysis data, a reference value for the abnormality of the voice analysis value is set based on the medical know-how provided by the associated medical institution, and an algorithm is used to judge the abnormality of the inputted voice . In order to deduce what kind of disease it is when there is an anomaly in the user input voice, it is determined whether or not there is a match with the DB according to the disease type provided by the related medical institutions, thereby providing the information about the disease with the highest probability and the result of the confidence level The visualization part is designed to emphasize convenience. In addition, the type of treatment of services provided, such as normal and preventive needs, sickness suspicions, is performed.

In connection with the service providing step, various kinds of services such as provision of preventive information and guidance of a medical institution are provided according to the type of processing. For example, voice management and neck management exercise tips, larynx cancer, and esophageal cancer-related information can be provided.

Hereinafter, an embodiment of a UI employed in the application of the present invention will be described with reference to FIGS. 12 and 13. FIG.

FIG. 12 is a diagram illustrating a voice input from a user's app to a function for viewing a result. In order to obtain a quick result, a specific vowel is voiced for a predetermined time and then made in a phonetically balanced voice conference The user is allowed to read and input the sentence in a comfortable state, and the process proceeds to the initial state setting of the user's voice. When it is judged that the user's voice is normal, the user is informed that the voice and the state of the voice are good, by showing numerical values of the fundamental frequency of the voice of the individual and the voice and the noise ratio of the voice, To the screen of the " preventive step " for maintenance. If the voice of the user is abnormal, it is necessary to recognize the level of voice disease and condition compared to the normal level, and since the state of telemedicine has not been proceeded yet, It will be delivered to the nearest hospitals and related information for quick treatment.

In the present invention, as contents for adding " fun ", it is possible to provide a similarity between the voice of the user and the voice of a famous singer,

It also provides an entertainment element that allows you to create another person's voice by showing how the voice's metamorphic changes when you change the frequency range or the degree of noise in your voice.

It also provides useful preventive information on voices and provides relevant content to maintain good voices in related exercise and training methods, food and lifestyle. Through the present invention, not only the necessary information is provided in the App for fast spreading but also it is possible to have interest of the users continuously, to be promoted in terms of promoting, to add entertainment elements through singer and vocal simulations, You can rank voice-like matching rates.

14, the present invention may further include a manager server for providing services. In connection with the support function, the following functions are provided: 1) a check function 2) a status measurement function 3) Content providing function 5) Additional function can be supported.

More specifically, it is possible to perform voice analysis statistics in connection with the checking function, to provide voice status information in connection with the status measurement function, and to provide related information for prevention in connection with the useful information providing function And perform entertainer voice matching in connection with the additional content providing function, introduce prevention treatment information in connection with the additional function, or perform SNS interworking.

The functional operations described herein and the embodiments of the present subject matter may be embodied in a digital electronic circuit or computer software, firmware or hardware, including combinations of structures disclosed herein and their structural equivalents, or in a combination of any of the foregoing. Do.

Embodiments of the subject matter described herein may be implemented as one or more computer program products, in other words one or more modules for computer program instructions encoded on a type of program medium for execution by, or control over, the operation of the data processing apparatus Can be implemented. The type of program medium may be a propagated signal or a computer readable medium. A propagated signal is an artificially generated signal, such as a machine-generated electrical, optical or electromagnetic signal, generated to encode information for transmission to a suitable receiver device for execution by a computer. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a combination of materials that affect the machine readable propagation type signal, or a combination of one or more of the foregoing.

A computer program (also known as a program, software, software application, script or code) may be written in any form of programming language, including compiled or interpreted language, a priori or procedural language, Components, subroutines, or other units suitable for use in a computer environment.

A computer program does not necessarily correspond to a file in the file system. The program may be stored in a single file provided to the requested program, or in multiple interactive files (e.g., a file storing one or more modules, subprograms, or portions of code) (E.g., one or more scripts stored in a markup language document).

A computer program may be deployed to run on multiple computers or on one computer, located on a single site or distributed across multiple sites and interconnected by a communications network.

Additionally, the logic flows and structural block diagrams described in this patent document describe corresponding actions and / or specific methods supported by corresponding functions and steps supported by the disclosed structural means, It can also be used to build software structures and algorithms and their equivalents.

The processes and logic flows described herein may be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output.

Processors suitable for the execution of computer programs include, for example, any one or more processors of both general purpose and special purpose microprocessors and any kind of digital computer. Generally, a processor will receive instructions and data from read-only memory, random access memory, or both.

A core element of a computer is a processor for executing instructions and one or more memory devices for storing instructions and data. In addition, the computer is generally operatively coupled to receive data from, transfer data to, or perform both of the operations of, for example, one or more mass storage devices for storing data such as magnetic, magneto-optical disks, Or will include. However, the computer need not have such a device.

The description sets forth the best mode of the invention, and is provided to illustrate the invention and to enable those skilled in the art to make and use the invention. The written description is not intended to limit the invention to the specific terminology presented.

Thus, while the present invention has been described in detail with reference to the above examples, those skilled in the art will be able to make adaptations, modifications, and variations on these examples without departing from the scope of the present invention. In other words, in order to achieve the intended effect of the present invention, all the functional blocks shown in the drawings are separately included or all the steps shown in the drawings are not necessarily followed in the order shown, It can be in the range.

1000: Early Diagnosis System of Voice Disease Using Smartphone
100: portable terminal
200: service server
110: Application
111: Voice storage unit
112: voice filter section
210:
220:
230: Related result information transmission unit
240: Voice DB

Claims

In a system for early diagnosis of voice disorders,
A portable terminal for receiving a voice of a user; And
And a service server for analyzing a user's voice inputted through the portable terminal and generating analysis data.

The method according to claim 1,
The portable terminal includes:
Receiving analysis data from the service server,
Wherein the user's voice is inputted through the installed application and the analyzed data is output.

The method of claim 2,
The application comprises:
A voice storage unit for primarily storing voices received from the user; And
And a voice filter unit for filtering the voice stored in the voice storage unit.

The method of claim 2,
The service server,
Further comprising a comparison / analysis unit for comparing the input voice of the user with the comparative analysis software to determine a voice state of the user who has input the comparison voice.

The method of claim 4,
The service server,
And a status reporting unit for classifying the voice state of the user as prevention, disease or normal based on the result of the comparison and analysis unit and providing related result information.

The method of claim 5,
The service server,
And a related result information transmitting unit for transmitting the related result information provided by the status report unit to the portable terminal.

The method of claim 4,
The comparison /
Wherein the analysis is performed using at least one of a pitch analysis, a speed analysis, a spectrogram analysis and a formant analysis, a strength analysis, a tremor analysis, a noise ratio analysis, a chord analysis, a frequency analysis, Early diagnosis system for voice disorders.

The method of claim 7,
The service server,
And a voice database for grouping and storing various voice data by type.

The method of claim 4,
The state-
If the comparison and analysis section distinguishes the prevention or normal,
Prevention contents, entertainment contents, and other contents to the portable terminal by using the smart phone.

The method of claim 4,
The state-
If the comparison and analysis unit is classified as a disease,
A system for early diagnosis of voice disorders using a smartphone, characterized by inducing a 1: 1 professional telephone and SMS connection, inducing location based hospital recommendation and related information, or inducing other medical services.

In a method for early diagnosis of voice disorders,
Receiving a user's voice through a portable terminal; And
And analyzing the user's voice input through the service server to generate analysis data.