KR101475228B1 - Voice diagnostic system and its service method using dianostic device - Google Patents

Abstract

The present invention relates to a voice diagnosis system using a diagnosis terminal and a method thereof. The voice diagnosis system according to an embodiment of the present invention includes: a diagnosis terminal; a diagnosis file DB in which a control unit searches and extracts diagnosis files selected by a control command; a voice input unit which records and stores a user′s voice according to the diagnosis files output to at least one of a voice output unit and a screen output unit; and a temporary storage unit which stores the selected diagnosis files and user′s voice as diagnosis target information.

Description

TECHNICAL FIELD [0001] The present invention relates to a voice diagnosis system and a voice diagnosis method using a diagnostic terminal,

The present invention relates to a voice diagnosis system and a method thereof, and in particular, it is possible to diagnose a voice including its singing ability, intonation or pronunciation by using various terminals easily accessible to the general public, The present invention relates to a voice diagnosis system and method using a diagnostic terminal capable of maximizing user convenience and having differentiated from other stores and contributing to increase in sales.

In situations where communication between people is highlighted as the most important aspect, the effects of the voice, such as the person's pronunciation, intonation, or singing ability, will be very large.

For example, there are many places where many people sing songs directly for various reasons such as a party, social gathering, relieving stress, and hobbies.

In addition, as the development of internet and wireless communication technology and hardware technology have developed, web sites providing karaoke services have been scattered not only in conventional karaoke rooms but also on the Internet, and car navigation services using karaoke navigation or smart phones are also provided It is true.

This trend is not uncomfortable for people who enjoy singing and have a certain level of music, but there are many who do not.

People who enjoy singing often want to improve their singing skills, but they often do not. In particular, it is very difficult for people who do not receive professional music education or who have an ordinary musical sense to improve their skills by identifying their strengths and weaknesses.

For some people, it is difficult to improve their skills by the lack of expensive lecture fees and training hours, although they sometimes try to improve their skills through lectures that are opened by visiting a professional teaching institute.

In particular, most of these problems are often caused by difficulty in understanding the exact state of the person singing, that is, the exact level. People with these problems are diagnosed with their help with the help of specialists, but they also have to pay high costs and time.

On the other hand, karaoke has been growing rapidly since it started in Busan in 1991 and has opened more than 35,000 shops nationwide in 2009.

However, as the karaoke industry has been declining since the second half of the 2000s, each karaoke company is seeking ways to increase sales through differentiated marketing.

Korea Patent Publication No. 2004-0074538

Accordingly, it is an object of the present invention to provide a diagnostic apparatus and a diagnostic apparatus that can accurately diagnose and train voices, such as the singing ability of the user, by using various types of diagnostic terminals that can be easily accessed by the general public, And a voice diagnosis system using the terminal and a method thereof.

Another object of the present invention is to provide a voice diagnosis system and method using a diagnostic terminal that can increase sales through differentiated services from other service providers (for example, a karaoke store) have.

According to an embodiment of the present invention, the above-described objects can be accomplished by the provision of a computer-readable recording medium having a key input unit to which a control command including search, selection, start, and end of a diagnostic file is input, A display output unit, a transmission / reception unit capable of connection with a network, and a control unit; A diagnostic file DB for retrieving and extracting the diagnostic file selected in accordance with the control command; A voice input unit for recording and storing voice of a user performed according to the diagnostic file outputted to at least one of the voice output unit and the screen output unit; A temporary storage unit for storing the selected diagnostic file and the voice of the user as diagnosis target information; A diagnostic server; A payment server for receiving diagnosis service costs through the diagnostic server; Wherein the controller outputs guidance information on voice diagnosis and connection information to the payment server to the screen output unit when the execution of the diagnostic file selected by the user is terminated, Receiving payment information and user terminal identification information from the payment server and requesting and receiving the diagnosis target information stored in the temporary storage unit when payment is made in the payment server through the terminal, And transmits diagnosis end information to the user terminal when the diagnosis result information is input to the voice diagnosis system.

The diagnosis file includes at least one of audio accompaniment information and image accompaniment information of a selected song when diagnosing a user's song. In case of voice diagnosis of a user's intonation, utterance, and voice, And the like.

The diagnostic terminal may be provided in any one of a karaoke system, a PC, a tablet PC, a navigation system, an IPTV, or a mobile terminal including a smart phone.

The diagnostic file DB may be provided in either the diagnostic terminal or the diagnostic server.

The diagnostic object information may be stored for each set time period for a plurality of intervals set during execution of the selected diagnostic file.

The access information may be provided in a QR code including a URL of the payment server, and the user terminal may be a smart phone capable of QR code recognition and wireless Internet access.

And a diagnostic database including a song diagnostic history, a payment means, and payment history information for each user, wherein the diagnostic server provides an application that can be installed in the user terminal, Server, and can confirm the song diagnosis history, settlement history information, and diagnosis result information requested for the song diagnosis.

Upon receiving the diagnosis end information, the user can request the diagnosis result information to be transmitted to the user terminal and receive the diagnosis result information.

Wherein the user terminal is configured to request training information on the diagnosis object information and the diagnosis result information, and when the training information is generated and stored, the diagnosis server may return to the user terminal whether to generate the training information have.

According to another embodiment of the present invention, when the user inputs a control command for the selected music through the key input unit, the controller extracts the audio accompaniment information and the video accompaniment information for the selected music from the song DB, ; Generating diagnostic target information including a voice of the user for the audio accompaniment information; Storing the diagnosis object information in a temporary storage unit; Outputting guidance information on the song diagnosis and connection information of the payment server when the performance of the selection is ended; The settlement being performed at the payment server through the user terminal; Transmitting payment information and user terminal identification information to a diagnostic server; A step of the diagnosis server requesting and receiving the diagnosis target information to the control unit; Storing diagnosis result information for the diagnosis target information; And transmitting the diagnostic end information to the user terminal.

Receiving diagnosis result information by accessing the diagnosis server through the user terminal or the computer terminal; Requesting the diagnostic server to generate training information on the diagnostic result information; And notifying completion of generation of the training information to the user terminal when the diagnosis server inputs and stores the training information.

Therefore, according to the voice diagnosis system and the method using the diagnostic terminal according to the present invention, it is possible to accurately diagnose and train voices such as the singing ability of the user by using various types of diagnostic terminals that can be easily accessed by the general public It can be done with minimal cost and time.

Also, in terms of a service provider (for example, a karaoke store), sales can be increased through differentiated services with other stores.

1 is a configuration diagram of a voice diagnosis system using a diagnostic terminal according to an embodiment of the present invention;
2 is a configuration diagram of a voice diagnosis system using a diagnostic terminal according to another embodiment of the present invention;
3 and 4 are flowcharts of a method of diagnosing a song using a karaoke system according to another embodiment of the present invention.

Hereinafter, a voice diagnosis system and method using the diagnostic terminal according to the present invention will be described in detail.

Referring to FIG. 1, a voice diagnosis system 1 using a diagnostic terminal according to the present invention includes a diagnostic terminal 100, a diagnostic file DB 110, a voice input unit, a temporary storage unit 16, A server 30, a payment server 40, and a user terminal 50.

The diagnostic terminal 100 includes a key input unit 11 for inputting various control commands including search, selection, start, and end of a diagnostic file, and a sound output unit 14 for outputting the diagnosis file selected by the control command And a screen output unit 15, a transmission / reception unit 17 capable of connection with a network, and a control unit 13. [

In the present invention, the diagnostic file may be provided as a file necessary for the user's voice diagnosis, for example, in the case of diagnosing a song, as the audio accompaniment information and the video accompaniment information of the selected song. Alternatively, in the case of diagnosing speech such as accentuation of English or Korean, pronunciation, etc., it may be screen information in which an English example sentence according to a level selected by the user, or a Korean example sentence is displayed.

The diagnostic terminal 100 may be used in various types without limitation and may be provided with various types of mobile terminals including, for example, a personal computer (PC), a tablet PC, a karaoke machine, navigation, IPTV or a smart phone.

The diagnostic file DB 110 is provided so that the control unit 13 can search for and extract the diagnostic file selected in accordance with the control command.

The diagnostic file DB 110 may be provided in the diagnostic terminal 100 itself as shown in FIG. 2, or may be provided in the diagnostic server 30 as shown in FIG. In the latter case, the control unit 13 accesses the diagnostic server 30 through the transmission / reception unit 17, searches for and extracts from the diagnostic file DB 110, and transmits the extracted data to the diagnostic terminal 100. [

The voice input unit records voice of a user performed according to the diagnostic file output to at least one of the voice output unit 14 and the screen output unit 15.

For example, in the case of the song diagnosis, the audio accompaniment information is output to the audio output unit 14, and the song lyrics and video are output to the screen output unit 15. In response to the user, The voice of the user together with the voice accompaniment information is stored in the voice input unit as the diagnosis object information.

Alternatively, in the case of the voice diagnosis, the user selects the example sentence selected in accordance with the level menu or the like, and outputs it to the screen output unit 15 as a character. When the user reads the outputted example sentence, .

The voice input unit can be provided with a conventional microphone.

Here, the diagnosis target information may be the entire voice of the user according to the execution of the diagnostic file, or may be stored only for a predetermined section.

That is, for example, in the case of the song diagnosis, a voice called by the user may be stored for the entire selected music, but it may be stored for a predetermined period of time in a selected section such as an introduction part or a paraphrase part. In the latter case, since the file size of the diagnostic information itself is reduced, there is an advantage in the management, and the trainer can diagnose intensively by selecting important parts, thereby improving the efficiency of diagnosis.

Hereinafter, the case of the song diagnosis and the case of the voice diagnosis will be described concretely.

First Embodiment (Song Diagnosis)

As shown in FIG. 2, the voice diagnosis system 1 using the diagnostic terminal according to the first embodiment of the present invention includes a karaoke machine 10, a voice input unit 20, A storage unit 16, a diagnosis server 30, a transmission / reception unit 17, a payment server 40, and a user terminal 50.

The karaoke system 10 includes a key input unit 11, a control unit 13, a sound output unit 14, and a screen output unit 15.

The key input unit 11 inputs various control commands such as song selection, song start and end, and pitch control.

The key input unit 11 may be attached to the main body of the karaoke system 10 or may be provided as a separate remote control device.

The control unit 13 extracts the audio accompaniment information and the video accompaniment information from the song DB 18 according to the control command and outputs the extracted information to the audio output unit 14 and the screen output unit 15.

The voice input unit 20 is arranged to input a user voice called by the user according to the voice accompaniment information.

The voice input unit 20 may be provided in the karaoke system by a user, and the voice accompaniment information is mixed with a user voice called by the user.

The temporary storage unit 16 stores the audio accompaniment information and the user voice as diagnostic target information for each of the tunes selected.

Here, the diagnostic object information includes the audio accompaniment information and the user voice, which are basically input through the audio input unit 20, and further may include information on the title of the selected song, the height of the pitch, and the like. Also, information on the time at which the diagnostic object information is generated, unique information of the karaoke system 10, location, and the like may be included.

The diagnostic object information may be stored in the whole of the selected song, that is, from the beginning to the end, but may be stored only for a selected section as required.

For example, it can be stored for a set time (for example, 10 seconds to 30 seconds) for the beginning of the song, the middle part (refrain or climax), and the three sections of the end.

Here, the number of the sections and the set time may be variously changed as needed.

Accordingly, when the trainees diagnose the song with the information to be diagnosed, it is not necessary to listen to the entire song, so that the time required for diagnosing the song can be shortened and the efficiency can be improved.

The transmission / reception unit 17 is provided in the karaoke system 10 and is connected to the diagnostic server 30 via a network.

According to the above configuration, when the execution of the selected song by the user is completed, the control unit 13 outputs the guide information on the song diagnosis and the connection information to the payment server 40 to the screen output unit 15.

That is, in the normal karaoke use procedure, when the selected song is performed and finished, the song score is output to the screen output unit 15 according to a self-determination criterion. At this time, And to post additional information on whether or not to receive a precise and objective song diagnosis.

In addition, in the present invention, together with the guide information, if the user wants to diagnose a song, he / she also posts connection information to the payment server 40 so that payment can proceed.

For example, mobile phone settlement, point settlement, account transfer, credit card settlement, and the like can be used.

The access information may be provided in various types, for example, a QR code including the URL of the payment server 40. [

Meanwhile, the user terminal 50 may be provided in various types, preferably a smart phone capable of QR code recognition and wireless Internet access.

Accordingly, the user can directly access the URL of the payment server 40 included in the QR code and perform payment by simply recognizing the QR code output to the screen output unit 15 using his smartphone It is very convenient.

Alternatively, the diagnosis server 30 may provide an application that can be installed in the user terminal 50. If the user downloads the application to the user terminal 50 in advance and designates a payment means, the QR code The settlement can be proceeded only by a simple step of recognizing the settlement amount.

Further, the user can access the diagnostic server 30 through the application installed in the user terminal 50 to check the song diagnosis history, payment history information, and diagnosis result information requested for the song diagnosis.

 The diagnostic server 30 may further include a diagnostic database 31 including a song diagnostic history, a payment means, and settlement history information for each user.

The payment server 40 is charged with diagnosis service cost through the diagnosis server 30. [

When the settlement server 40 makes a settlement through the user terminal 50, the diagnostic server 30 receives the settlement information and the user terminal identification information from the settlement server 40.

The payment information may include a user identification number, payment amount, settlement date, and identification information that can identify the diagnosis target information corresponding thereto.

In addition, the user terminal identification information may include a user terminal unique number of a user who has performed settlement, an electronic mail address, and the like.

On the other hand, when the payment information is received, the diagnostic server 30 transmits the diagnosis target information stored in the temporary storage unit 16 corresponding to the identification information capable of identifying the diagnosis target information to the control unit 13 And receives it.

When the diagnostic object information is received and stored in the diagnostic server 30, the professional trainer diagnoses it based on the diagnostic object information and generates diagnostic result information.

The diagnostic result information may be composed of characters, audio information including the training of the trainer in charge of diagnosis, or video information.

An example of the diagnostic result information is as follows.

1. Basic diagnosis (Singer - Kim Bumsoo) s song (title - I want to see) is sad (genre - ballad song)
Emotion control is a very important point.
The match between my tone and this song is 45% and there is a matching genre (soul, ballad)
My overall charset (culling, nurturing, natures, nonsense, chaos, soma, palsetto, husky, etc.)
I use 45% of my breathing
The utilization rate of self-talk is 70%.
Pronunciation was a result of measuring the tongue stiffness
The overall status of the pitch accuracy is 80%.
The overall rhythm accuracy is 50%.
The ability to regulate strength is unusual.
The ability of the vibrator to work is a prize.
The overall understanding and expression ability of the song is awarded ........................

More detailed diagnostics
Check it out in 5 hours ~ ^^

TOTAL 000 points A +

The diagnostic result information can be classified into basic diagnosis and fine diagnosis according to the service system or billing structure.

2. Precision diagnosis
We will inform you of the results of Kim Ji-eun's voice diagnosis.
Kim Ji-eun's voice is rich in bass and has a great harmonic voice
Strength control is excellent, and the rhythm which recognizes the concept properly at the berth and the overburden
You have. Soul is more a voice than an exciting dance beat
The slightly husky tone is more attractive.
But now I'm singing with the burdens on the vocal chords.
There is a lot of power in the muscles around the vocal cords.
As the time passes, the elasticity of the vocal cords weakens and the ground of the gate becomes unstable
It can become increasingly difficult to sing high-pitched songs.
Because the current song is close to the mosque
You can record your own voice tones and monitor them
Practicing to sing in a speaking tone will give you a much better voice
My mistake.

- Disise Vocal Vocal Fractor Dream -

When the diagnosis result information about the diagnosis target information is inputted, the diagnosis end information is transmitted to the user terminal 50. [

The diagnosis end information includes information indicating that the diagnosis of the diagnosis target information is completed and further receives information about a position where the diagnosis result information can be confirmed or the diagnosis result information directly by the user terminal 50 Or to ask whether or not it is possible.

Alternatively, or additionally, the user terminal 50 may request training information on diagnostic object information and diagnostic result information.

The training information includes information on a training method by which a trainer who has determined the diagnosis target information or a trainer related therewith can mainly improve the vulnerability of the user based on the diagnosis result information.

The training information may be provided in the form of voice or video information.

In this case, when the training information is generated and stored, the diagnostic server 30 may return whether or not the training information is generated to the user terminal 50.

Referring to FIG. 3 and FIG. 4, a method of diagnosing a song using a karaoke system according to a first embodiment of the present invention will be described.

First, when the user inputs a control command for selecting the music through the key input unit 11, the control unit 13 extracts audio accompaniment information and video accompaniment information for the selected music from the song DB 18 (S11) .

The diagnosis subject information including the user's voice is generated for the voice accompaniment information (S12).

The diagnosis target information is stored in the temporary storage unit 16 (S13).

Upon completion of selection, the guide information about the song diagnosis and the connection information of the payment server are output to the screen output unit 15 (S14).

If the user does not want the song diagnostic service, for example, if there is no input for the set time, the diagnostic target information stored in the temporary storage unit 16 is deleted (S16).

The settlement server 40 performs settlement through the user terminal 50 (S15).

The payment server 40 transmits the payment information and the user terminal identification information to the diagnosis server 30 (or receives a request from the diagnosis server 30) (S17).

The diagnostic server 30 requests the control unit 13 for the diagnosis target information and receives the diagnosis target information (S18).

Diagnostic result information on the diagnosis target information is stored in the diagnosis server 30 (S19).

Then, the diagnosis server 30 transmits the diagnosis end information to the user terminal 50 (S20).

Thereafter, the user may access the diagnostic server 30 using the user terminal 50 or a separate computer terminal, and receive and confirm the diagnosis result information (S21).

Here, the user may additionally request the diagnosis server 30 to generate the training information on the diagnosis result information (S31).

When the training information is stored (S32), the diagnostic server 30 notifies the user terminal 50 of the completion of the training information generation (S33).

Second Embodiment (Voice Diagnosis)

The voice diagnosis system 1 using the diagnostic terminal according to the second embodiment of the present invention is for diagnosing accent and pronunciation in English such as a language other than the user's song, unlike the first embodiment.

That is, in the present embodiment, the diagnostic file is an example sentence provided in the form of a character according to the level of the selected language (the length of the illustrative sentence or the level of the word). When the user reads the illustrative sentence displayed on the screen output unit, And is stored in the temporary storage unit 16 as information.

The trainer diagnoses the voice of the user based on the stored diagnosis target information and generates the diagnosis result.

Hereinafter, the overlapping description with the first embodiment will be omitted.

1: Song diagnostic system
100: Diagnostic terminal 110: Diagnostic file DB
10: karaoke machine 11: key input unit
13: control unit 14: audio output unit
15: Screen output unit 16: Temporary storage unit
17: Transmitting / receiving unit 18: Song DB
30: Diagnostic server 31: Diagnostic database
40: Payment server
50: User terminal

Claims (11)

A key input unit to which a control command including a search, a selection, a start and an end of a diagnosis file is inputted; a voice output unit and a screen output unit to output the diagnostic file selected by the control command; A diagnostic terminal including a control unit;
A diagnostic file DB for retrieving and extracting the diagnostic file selected in accordance with the control command;
A voice input unit for recording and storing voice of a user performed according to the diagnostic file outputted to at least one of the voice output unit and the screen output unit;
A temporary storage unit for storing the selected diagnostic file and the voice of the user as diagnosis target information;
A diagnostic server;
A payment server for receiving diagnosis service costs through the diagnostic server;
A diagnostic database including a song diagnostic history, a payment means, and payment history information for each user;
A user terminal,
Wherein the controller outputs guidance information on voice diagnosis and connection information to the payment server to the screen output unit when the execution of the diagnostic file selected by the user is terminated,
Wherein the diagnosis server receives payment information and user terminal identification information from the payment server when payment is made at the payment server through the user terminal and requests the diagnosis target information stored in the temporary storage from the control unit And transmits diagnostic end information to the user terminal when diagnosis result information on the diagnostic target information is input. When training information on the diagnostic target information and diagnostic result information is requested from the user terminal, And if the training information is generated and stored, returning the generation of the training information to the user terminal,
Wherein the diagnostic result information is provided in the form of a character, voice, or an image generated by a trainer who has evaluated the diagnostic object information, and includes contents evaluated according to a predetermined evaluation item for the diagnostic object information,
Wherein the training information is provided in a form of voice or image including information on a user's vulnerability improvement for each evaluation item based on the diagnosis result information,
The diagnostic server may provide an application that can be installed in the user terminal to allow a user to access the diagnostic server through an application installed in the user terminal and to transmit the diagnosis result information, The voice diagnosis system using the diagnostic terminal. The method according to claim 1,
Wherein the diagnostic file includes at least one of audio accompaniment information and image accompaniment information of a selected song when diagnosing a user's song,
Wherein the voice recognition diagnosis information includes image information in which a selected example sentence is displayed as characters in case of voice diagnosis of a user's intonation, utterance, and voice. The method according to claim 1,
Wherein the diagnostic terminal is provided in any one of a karaoke terminal, a PC, a tablet PC, a navigation terminal, an IPTV, or a mobile terminal including a smart phone. The method according to claim 1,
Wherein the diagnostic file DB is provided in one of the diagnostic terminal and the diagnostic server. The method according to claim 1,
Wherein the diagnostic object information is stored for each set time period for a plurality of sections set during execution of the selected diagnostic file. The method according to claim 1,
Wherein the connection information is provided in a QR code including a URL of the payment server,
Wherein the user terminal is a smart phone capable of QR code recognition and wireless Internet access. delete The method according to claim 1,
Wherein the user can receive the diagnostic result information by requesting the user terminal to transmit the diagnosis result information upon receipt of the diagnosis end information. delete delete delete

Images