KR20030097297A - Many languges voice recognition device and counseling service system using the same - Google Patents

Abstract

PURPOSE: A multilingual voice recognition apparatus and a system for providing a counselling service using the same are provided so that a foreigner can easily execute a call with a counsellor using his native language. CONSTITUTION: A service providing system is comprised of a call processing part(51), a counselling number information storage part(52), a data memory(53), the second database(54), and a service control part(55). The call processing part(51) provides call connection request phone number information to the service control part(55). The counselling number information storage part(52) stores country code information corresponding to phone numbers. The data memory(53) stores various information processed at the service control part(55). The second database(54) stores counsellor information according to country codes. The service control part(55) executes control to establish the call path between a counsellor terminal and a user terminal, based on the country selection information provided from a voice comparison and processing part(14).

Description

Many languges voice recognition device and counseling service system using the same}

The present invention provides a multilingual voice recognition device that enables a user to recognize a multi-language language through which the user inputs a voice, and a multi-language service that enables the user to make a call with a counselor who can consult a user in a corresponding language. It relates to a counseling service providing system using a voice recognition device.

As international exchanges are active, foreign visitors are increasing rapidly throughout the world, and foreigners who do not know the geographical and cultural knowledge of the countries they are in need of counseling through their own language. Accordingly, there is an increasing need for professionals who can use other languages.

In particular, countries that host global events such as the Olympics, Asian Games, and the World Cup will further reduce the need for multilingual professionals.

In recent years, a counseling service providing system has been developed in which a foreigner is provided with a counseling service by connecting to a specialist, for example, a counselor whenever necessary through a predetermined communication means.

That is, when a foreigner connects to a counseling service company using a wired or wireless communication terminal, the server providing the counseling service searches for a counseling member in a corresponding language and connects the counselor with the corresponding foreigner to provide counseling service. Done.

At this time, the foreigner should input the number corresponding to the authorized country from the communication terminal when selecting the language for the consultation service. In other words, the service provider outputs a voice selection message to the communication terminal of the foreigner, for example, "Country code corresponding to the language you want to consult. US is once, China is this time, Japan is 3 times". In addition, foreigners are provided with counseling services through counselors in the desired language by pressing the number corresponding to the desired country after listening to the country selection message.

However, in order to select the language of the country that the foreigner wants, it is inconvenient to listen to the corresponding voice message to the end, and the foreigner must be aware of the interpreter country, country, number, etc. of the host country, for example, Korean language. There is a need. Therefore, there is a problem that such a service is meaningless to foreigners who have no knowledge of the language of the visiting country.

Accordingly, the present invention has been made in view of the above-described circumstances, and a multilingual voice recognition device and a counseling service providing system using the same are provided so that a foreigner can easily make a call with a counselor using a language used by a foreign country. Its technical purpose is to provide it.

1 is a diagram showing a schematic configuration of a communication system to which a multilingual voice recognition apparatus according to the present invention is applied;

Figure 2 is a block diagram showing the functional separation of the internal configuration of the multilingual voice recognition device shown in FIG.

FIG. 3 is a diagram showing an example of the configuration of an information table of the character information storage unit 16 shown in FIG.

4 is a diagram for explaining the operation of the voice comparison processing unit 14 shown in FIG.

5 is a diagram showing a schematic configuration of a counseling service providing system using a multilingual voice recognition device according to the present invention;

FIG. 6 is a block diagram showing functionally separated internal structure of the service providing device 50 shown in FIG.

FIG. 7 is a diagram showing an example of the configuration of the information table of the consultation number information storage unit 52 shown in FIG.

FIG. 8 is a diagram showing an information table configuration of the second database 54 shown in FIG.

9 is a view for explaining the operation of the consultation service providing system shown in FIG.

********* Brief description of the main parts of the drawings *********

10: multilingual voice recognition device, 11: network connection,

12,51: call processing unit, 13: voice recording unit,

14: voice comparison processing unit, 15,54: database,

16: character information storage unit, 17: information message information storage unit,

18: service control unit, 50: service providing device,

52: consultation number information storage unit, 53: data memory.

Multilingual speech recognition device according to the first aspect of the present invention for achieving the above object is, the native language voice information storage unit for storing the voice information of a specific word by the native person, and the foreign voice information of the specific word by a foreigner is stored A database comprising a foreign language voice storage unit, character information storage means for storing multilingual character information for each country information, and first language information for a predetermined language by adapting foreign language voice information to local language voice information for each national language in the database. Generate the character information corresponding to the first voice information by comparing the first voice information with the second voice information applied from the user terminal, and store the country information corresponding to the text information. And a voice comparison processing unit for searching by the means.

In addition, the consultation service providing system using the multilingual voice recognition apparatus according to the second aspect of the present invention for achieving the above object is combined with a plurality of user terminals and counselor terminals through a predetermined communication network, the language selected by the user In a counseling service providing system comprising a counseling terminal capable of counseling and a service providing apparatus for controlling a call path during a user terminal period, the service providing apparatus includes a native language voice information storage unit for storing voice information of a specific word by a native person. And a database comprising a foreign language voice storage unit for storing foreign voice information of a specific word by a foreigner, a character information storage means for storing multilingual character information for each country information, and a foreign language in the native language voice information for each national language in the database. A first voice for a given language by adapting the voice information Generating the information, comparing the first voice information with the second voice information applied from the user terminal, and generating text information corresponding to the first voice information, and storing the country information corresponding to the text information. Voice comparison processing unit to search in the means, a second database for storing counseling terminal information available in the corresponding language for each country, guide message information storage unit for storing predetermined guide message information for selecting a specific word for each language, the In response to a call connection request from a user terminal, a guide message stored in the guide message information storage unit is sent to a user terminal, and the corresponding counselor terminal information is read from a second database based on national information authorized from the voice comparison processing unit. To establish a call path for the user terminal and the corresponding agent terminal period. Characterized in that it comprises a service control unit.

That is, according to the above, by speaking a language desired by a foreigner, the foreigner can easily receive counseling with a counselor who can make a call in that language. It is possible to provide services.

Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a view schematically showing the configuration of a communication system to which the multilingual voice recognition device according to the present invention is applied, and the multilingual voice recognition device 10 according to the present invention includes a plurality of user terminals 20 through a predetermined communication network 20. ), And is configured to determine a language of a desired country based on voice information in a specific national language of a foreigner, that is, a user authorized from the user terminal 20.

Here, the multilingual voice recognition device 10 transmits a predetermined guide message for selecting a language of a desired country to the user terminal 20 to the user terminal 20, and the user terminal 20 receives the desired guidance message from the user terminal 20. It is configured to analyze the language of the station.

In addition, the user terminal 30 is composed of various communication devices for performing voice communication, the communication network 20 is wired / wireless, such as PSTN / MSC network or VoIP network according to the type of communication device of the user terminal 30 It can be a net.

FIG. 2 is a block diagram illustrating the functional separation of the internal configuration of the multilingual voice recognition device 10 shown in FIG.

As shown in FIG. 2, the multilingual voice recognition device 10 sets a call path between the network connection unit 11 and the user terminal 30 for a network connection interface with the communication network 20, and a series of calls. Voice recording unit 13 for recording the voice signal applied from the call processing unit 12, the user terminal 30 for performing the processing operation, the voice signal of the selected country language in the Barge In method, recording A voice comparison processing unit 14 for comparing the voice signal of each language stored in the database 15 with the voice signal and transmitting the matching country information, and a text information storage unit for storing multilingual text information corresponding to the voice information ( 16), the voice message processing unit 14 transmits a predetermined guide message to the guide message information storage unit 17 for storing a predetermined guide message for multilingual selection, and a user terminal 30 requesting a call connection. From It is configured to include a service control unit 18 for providing a predetermined service based on the country information.

Here, as shown in FIG. 2, the database 15 includes a local language voice information storage unit for storing voice information for each word using a language of a country where the multilingual voice recognition device is installed, for example, a Korean voice having an even phonological distribution. 151 and a foreign language voice information storage unit 152 for storing voice information for each word using a foreign voice.

In this case, since the pronunciation variation of the user for each word is severe, it may be preferable to apply the same-word multiple pronunciation function to absorb the pronunciation variation. For example, the applicant for this purpose, the national language voice information storage unit 151 is composed of 11585 words / 250,000 speech collected using a wired / wireless telephone, the foreign language voice information storage unit 152 is actually using a wired / wireless telephone It consisted of 31 words / 3113 utterances used for real multilingual speech recognition collected in the environment.

Meanwhile, as shown in FIG. 3, the information table of the character information storage unit 16 in FIG. 2 stores character information corresponding to a corresponding national name of each country code (A), or a corresponding language of each country code. Character information corresponding to the English-language Korean name is stored (B), or the character information corresponding to a word having a specific meaning, for example, "Hello" in the corresponding national language for each country code, or (C), or each country code It is possible to configure (D) so that the language information, the English-language language name, and word information of a specific meaning are stored in the corresponding language.

Here, the native language voice information storage unit 151 and the foreign language voice information storage unit 152 of the database 15 are also configured to include voice information corresponding to a character as shown in FIG.

Meanwhile, in FIG. 2, the voice comparison processor 14 operates as shown in FIG. 4. That is, in operation 142, a predetermined feature vector is read from the voice signal applied from the voice recording unit 13 and the noise level is filtered. In addition, the voice comparison processing unit 14 reads voice information of a predetermined word stored in a native language stored in the local language voice information storage unit 151 (143), and the foreign voice of the multilingual word stored in the foreign language information storage unit 152. The information is read (144), and the comparison speech information (b) is generated by adapting the foreign language speech information to the native language speech information (145). In addition, the voice comparison processor 14 compares the voice information (a) of the user whose noise level is filtered with the comparison voice information (b) generated based on the database 15, and has the most similar words, that is, the highest matching ratio. Character information corresponding to the voice signal of the word is generated (146), and the character information storage unit 16 retrieves country code information corresponding to the character information (147).

Hereinafter, the operation of the multilingual voice recognition device having the above configuration will be described.

First, when a user, in particular, a foreigner, makes a predetermined connection request to the multilingual voice recognition device 10 through the user terminal 30, the multilingual voice recognition device 10 sets a call for the call, and then a predetermined guide message is provided to the user terminal. It is sent to (30).

At this time, the guidance message output to the user terminal 30 may be provided in the language of the country where it is currently located, or in English, the world's official language, and the information of the guidance message is "Hello. Thank you for using the consultation service. Speak your language, such as English, Guess, Espanyol, Guess Touges, Nihongo, Guess, and so on. ”That is, a message in each language is sent to the user terminal 30 through a message.

Thereafter, the foreigner speaks a desired language to the user terminal 30, so that the foreigner's voice information is provided to the multilingual voice recognition device 10 through the user terminal 30.

In this case, the multilingual voice recognition device 10 searches for country code information corresponding to a language corresponding to the voice information applied from the user terminal 30 in the database 15 through the voice comparison processing unit 14.

That is, according to the above embodiment, the multilingual voice recognition device 10 may recognize the language or language selected by the foreigner by analyzing the language of the foreigner.

On the other hand, the multilingual voice recognition device 10 can be implemented in a variety of applications by applying to a variety of content servers, such as multinational services, such as counseling services for foreigners, interpretation services.

5 schematically illustrates a configuration of a counseling providing system using a multilingual voice recognition apparatus according to the present invention.

As illustrated in FIG. 5, in the counseling providing system using a multilingual voice recognition apparatus, a service providing apparatus 50 providing a counseling service according to the present invention is provided with a plurality of user terminals 70 and counselors through a predetermined communication network 60. It is configured in combination with the terminal 80.

Here, the service providing device 50 is configured with a multilingual voice recognition device as described above for recognizing the language applied from the user terminal 70.

In addition, the service providing device 50 recognizes a language authorized from the user terminal 70 through the multilingual voice recognition device, searches for a counselor terminal 80 capable of counseling through the corresponding language, and searches the user terminal 70. And a call path between the counselor terminal 80.

FIG. 6 is a block diagram showing functional separation of the internal structure of the service providing apparatus 50 shown in FIG. 5, and the same reference numerals are assigned to parts performing the same functions shown in FIG. Is omitted.

That is, as shown in FIG. 6, the service providing apparatus 50 includes a network connection unit 11, a call processing unit 51, a voice recording unit 13, a voice comparison processing unit 14, and a first database 15. , The character information storage unit 16 is configured. At this time, the call processor 51 is configured to provide the call connection request phone number information input by the user to the service controller 55.

In addition, the service providing device 50 includes a consultation number information storage unit 52 for storing country code information corresponding to the telephone number as shown in FIG. That is, the service providing apparatus 50 according to the present invention sets a dedicated telephone number for each country, and a representative telephone number for providing the counseling service for a user who does not know a dedicated telephone number for a desired country. Will be set.

In addition, the service providing apparatus 50 is configured with a data memory 53 for storing various information processed by the service control unit 55 to be described later. In this case, the data memory 53 stores call path setting information between the user terminal 70 and the counselor terminal 80.

In addition, the service providing apparatus 50 is configured with a second database 54, which stores the counselor information for each country code as shown in FIG. In this case, the agent information stored in the second database 54 may be, for example, counselor terminal number information, personal information such as counselor name, age, counseling time information, counseling history information, counseling status information, and the like. Multiple agent information is stored for the country code.

In addition, the service providing device 50 transmits a predetermined guide message for selecting a multilingual counseling language to the user terminal 70, and the language of the corresponding country based on the country selection information provided from the voice comparison processing unit 14. It is configured to include a service control unit 55 for controlling to establish a call path between the counselor terminal 80 and the user terminal 70 that can be consulted through.

Next, with reference to FIG. 9 will be described the operation of the consultation service providing system as shown in FIG.

First, in order to provide the service, the operator will provide a counseling card printed with a representative phone number and a dedicated phone number for connecting a counselor in a particular country to a user, for example, a foreigner. For example, a business operator may distribute the counseling card to a foreigner (user) who enters the counseling card at a host country hosting a global event such as the World Cup. At this time, the operator distributes the counseling card printed with the exclusive telephone number corresponding to the nationality of the foreigner to the foreigner of the corresponding country. For example, the Chinese will provide a counseling card printed with a Chinese-only counseling phone number and a representative number.

In addition, the service providing device 50 previously stores the country code information corresponding to the telephone number in the consultation number information storage unit 52, and registers the agent information capable of conversation through a foreign language in the second database 54 in advance. I will leave it.

In the above state, when the foreigner enters the telephone number of the card received by the user terminal 70, such as a predetermined public pay phone or a wireless communication terminal to perform a call connection request to the service providing device 50 (ST1 ), The call processing unit 51 of the service providing device 50 provides the call control request phone number information input by the foreigner to the service control unit 55. In addition, the service control unit 55 retrieves the corresponding telephone number from the consultation number information storage unit 52 (ST2).

At this time, the service control unit 55 checks whether the country code corresponding to the telephone number received from the call processor 51 in the consultation number information storage unit 52 exists, and if the country code does not exist, the representative phone number. It is determined by the number (ST3).

If it is determined in step ST3 that the telephone number requested for the call connection is the representative number, the service controller 55 controls the call processor 51 to set a call path with the user terminal 70 that has requested the call connection (ST4). In step S5, the guide message information storage unit 17 reads out a predetermined guide message for selecting a language of the consultation request and sends it to the user terminal 70 (ST5).

At this time, the user terminal 70, for example, "Hello. Please tell us the language of the country you want. Hello, Aloe, Moshi Moshi, Wei…" Information message is sent to foreigners, the foreign language of the country you want For example, voice is inputted to the user terminal 70, for example, "Alo". That is, the voice signal of the foreigner's desired language is applied from the user terminal 70 to the service providing device 50 (ST6).

On the other hand, the service providing device 50 performs a voice recording process by providing the voice signal of the foreigner input in the step ST6 to the voice recording unit 13, and then provides it to the voice comparison processing unit 14 to perform the voice recognition process Will be done. That is, the voice comparison processing unit 14 compares the voice signal of the foreigner with the voice signal stored in the first database 15 to perform a multilingual voice recognition process, and corresponds to the matching character in the text information storage unit 17. The country code information is read and provided to the service controller 55 (ST7).

In addition, the service control unit 55 searches for counselor information currently available for counseling among counselors who can consult in a corresponding language in the second database 53 and performs counseling request processing to the corresponding counselor terminal 80 (ST8). , ST9).

At this time, when the counseling response information is received from the counselor terminal 80 to the service providing apparatus 50, the service providing apparatus 50 sets a call path between the user terminal 70 and the counselor terminal 80 that have requested consultation. Control is made to consult in this desired language (ST10). Here, the service control unit 55 stores the user terminal 70 and the counselor terminal 80 information in which the call path is formed in the data memory 53, and the counseling state information of the counselor currently consulted in the second database 54. Will be changed to the non-consultation state.

Subsequently, when the call between the foreigner and the counselor is terminated and predetermined call termination information is applied from the user terminal 70 or the counselor terminal 80 to the service providing apparatus 50, the service control unit 55 of the service providing apparatus 50 is provided. Clears the corresponding user terminal 70 and counselor terminal 80 information stored in the data memory 53, and consults the current state information of the counselor terminal 80, which is terminated in the second database 54. Change the setting to.

On the other hand, if it is determined in step ST3 that the telephone number information authorized from the user terminal 70 is not the representative number, the service control unit 50 is registered in the consultation number information storage unit 52 to correspond to the corresponding telephone number information. The code information is read out (ST11). In addition, the service providing apparatus 50 performs the operation after the above-described step ST8.

That is, according to the above embodiment, it is possible to provide a call with a counselor who can consult through the language of the corresponding country based on the voice signal corresponding to the specific national language of the foreigner.

Therefore, according to the present invention, by speaking a language desired by a foreigner, the foreigner can be easily provided with a counselor who can make a call in that language. It becomes possible to provide.

Meanwhile, the present invention is not limited to the above embodiments, and various modifications can be made without departing from the technical spirit of the present invention.

As described above, according to the present invention, by speaking a language desired by a foreigner, a foreigner can be provided with a counselor who can easily make a call in the language. It is possible to provide counseling services.

Claims (8)

A database comprising a national language voice information storage unit for storing voice information of a specific word by a native person, a foreign language voice storage unit for storing foreign voice information of a specific word by a foreigner, Character information storage means for storing multilingual character information for each country information, The foreign language voice information is adapted to the native language voice information of each country language in the database to generate first voice information for a predetermined language, and compares the first voice information with the second voice information applied from the user terminal. And a voice comparison processing unit for generating text information corresponding to the first voice information and retrieving the country information corresponding to the text information from the text information storing means. The method of claim 1, A guide message information storage unit for storing predetermined guide message information for selecting a specific word for each language; A service control unit which sends a guide message stored in the guide message information storage unit to a user terminal in response to a call connection request from a user terminal, and provides a predetermined service corresponding to national information authorized from the voice comparison processing unit; Multilingual speech recognition device, characterized in that configured. The method of claim 1, The character information storage means is multilingual voice recognition device, characterized in that for storing the corresponding country language name information corresponding to each country code. The method of claim 1, The character information storage means is a multilingual speech recognition device, characterized in that for storing the corresponding national character information of a specific word to correspond to each country code. In a counseling service providing system, comprising a counseling terminal capable of counseling in a language selected by a user, and a service providing apparatus for controlling a call path during a user terminal period, coupled with a plurality of user terminals and counseling terminals through a predetermined communication network. , The service providing apparatus includes a database comprising a native language voice information storage unit for storing voice information of a specific word by a native person, a foreign language voice storage unit for storing foreign voice information of a specific word by a foreigner; Character information storage means for storing multilingual character information for each country information, The foreign language voice information is adapted to the native language voice information of each country language in the database to generate first voice information for a predetermined language, and compares the first voice information with the second voice information applied from the user terminal. A voice comparison processing unit for generating text information corresponding to first voice information and retrieving country information corresponding to the text information from the text information storing means; A second database for storing counselor terminal information in each country's language for each country; Guide message information storage unit for storing a predetermined guide message information for selecting a specific word for each language, In response to the call connection request from the user terminal, the guide message stored in the guide message information storage unit is sent to the user terminal, and the corresponding counselor terminal information is transferred from the second database based on the national information authorized from the voice comparison processing unit. And a service control unit configured to read out and set a call path between the user terminal and the corresponding counselor terminal period. The method of claim 5, The service providing apparatus is configured to include a consultation number information storage unit for storing the country information corresponding to the call connection request phone number, The service control unit reads the corresponding counselor terminal information from the second database based on the call connection request phone number, and controls to establish a call path for the user terminal and the counselor terminal. . The method of claim 5, The text information storage means is a counseling service providing system using a multilingual voice recognition device, characterized in that the corresponding country language name information corresponding to each country code is stored. The method of claim 5, The character information storage means is a counseling service providing system using a multilingual speech recognition device, characterized in that the corresponding national character information of a specific word is stored so as to correspond to each country code.