KR20180045633A - Method for providing of voice recognition service and apparatus thereof - Google Patents

Abstract

The present invention relates to a method for providing a voice recognition service and, more specifically, to a method for providing a voice recognition service and an apparatus for the same, in which a service server recognizes a user′s voice input from an audio output device including a microphone and a speaker and provides link information of a corresponding content providing server to the audio output device so that the audio output device receives and outputs streaming data for the content using the link information.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a voice recognition service,

The present invention relates to a method of providing a voice recognition service, and more particularly, to a voice recognition service capable of recognizing a user's voice input from an audio output device including a microphone and a speaker, A service providing method and an apparatus therefor.

The contents described in this section merely provide background information on the present embodiment and do not constitute the prior art.

As technology develops, various services using voice recognition technology have been introduced in many fields. Speech recognition technology is a series of processes for understanding human speech and converting it into character information that can be handled by a computer. A speech recognition service using a speech recognition technology recognizes a user's speech, Quot; and " a "

However, there is a problem that the services using the speech recognition technology up to now recognize the user's voice and provide only a fragmentary service corresponding to the user's voice. For example, there is a voice recognition service in which a user speaks a voice for a specific word using his or her mobile phone, the mobile phone recognizes it, and provides a search result corresponding to the word through a web browser. However, There is a problem that convenience of various users can not be satisfied by interlocking and providing only the corresponding search results.

Accordingly, it is necessary to develop a speech recognition service capable of grasping a user's intention and providing various contents suitable for a user's intention in cooperation with various external content providing servers.

Korean Patent Laid-Open No. 10-2008-0083553, September 18, 2008 (Name: Image synthesis call service method and apparatus using speech recognition)

SUMMARY OF THE INVENTION The present invention has been proposed in order to solve the above-mentioned problems of the related art, and it is an object of the present invention to provide a sound output apparatus and a sound output apparatus which can recognize a user's voice input from a sound output apparatus including a microphone and a speaker, A service providing method and an apparatus therefor.

In particular, the present invention provides a sound output apparatus including a microphone and a speaker, which recognizes a user's voice, grasps the intention of the user, and outputs an appropriate sound source in cooperation with a plurality of content providing servers, The present invention provides a method for providing a speech recognition service and an apparatus therefor.

In addition, the present invention recognizes a user's voice and divides it into an entity and an intent, identifies a plurality of content providing servers through an entity, and provides a service suitable for a user's intention using an intent The present invention provides a method and a device for providing a voice recognition service that can provide a more intelligent service through an audio output device by requesting a voice recognition service.

However, the object of the present invention is not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood from the following description.

According to another aspect of the present invention, there is provided an audio output apparatus including: a voice input unit for receiving a voice of a user to be uttered; Streaming the voice signal and transmitting it to a service server; Receiving a response message generated by recognizing the voice signal from the service server and link information for accessing a specific content; Accessing a corresponding content providing server according to the link information; Receiving streaming data for the content from the content providing server; And reproducing and outputting the response information and the received streaming data.

The transmitting may include dividing the speech signal into frames of a predetermined length, and performing speech recognition on a divided frame basis. And transmitting the voice signal to the service server by streaming the voice signal on a frame-by-frame basis if it is confirmed that a predetermined wake-up word exists in a specific section as a result of voice recognition.

According to an aspect of the present invention, there is provided a service server comprising: a receiving unit configured to receive a streaming audio signal from an audio output apparatus; Recognizing the received voice signal, analyzing its meaning, and confirming a corresponding content providing server according to the analyzed result; Receiving link information for accessing a specific content from the content providing server; And generating a response message corresponding to the voice signal and transmitting the response message and the link information to the sound output device.

At this time, the verifying step may include recognizing the speech signal and classifying it into an entity and an intent and analyzing the meaning thereof; Confirming a content providing server which is a service providing entity corresponding to the entity; And requesting the content providing server for a service corresponding to the intent of the user corresponding to the intent.

In this case, if the link information is received in the step of receiving the link information, a reproduction list for the link information is generated according to a predetermined reference, and after the step of transmitting the reproduction list to the audio output apparatus, And transmitting the next link information to the sound output apparatus after a predetermined time elapses or at the request of the sound output apparatus.

Further, the present invention can provide a computer-readable recording medium on which a program for executing the above-described method is recorded.

According to an aspect of the present invention, there is provided an audio output apparatus including: a voice signal input unit for receiving a voice of a user who is ignited via a microphone and generating a voice signal; An output unit for outputting a response message and streaming data through a speaker; And transmitting the response message to the service server when the response message generated by recognizing the voice signal from the service server and the link information for accessing a specific content are received, And a device control unit connected to the corresponding content providing server according to the link information to receive the streaming data for the content and to reproduce the streaming data and output the streaming data through the output unit .

At this time, the device controller divides a voice signal input through the voice signal input unit into frames of a predetermined length, performs voice recognition on a divided frame basis, and confirms that a predetermined wakeup word exists in a specific section , The audio signal may be streamed on a frame-by-frame basis and transmitted to the service server.

According to an aspect of the present invention, there is provided a service server comprising: a server communication unit for receiving a voice signal generated by a user in a streaming manner from an audio output device; Recognizes a voice signal received through the server communication unit, analyzes the meaning, confirms a corresponding content providing server according to the analyzed result, and when link information for accessing specific contents is received from the contents providing server, And a server controller for controlling the server to transmit the response message and the link information to the audio output apparatus through the server communication unit.

And a server storage unit for storing a plurality of word strings corresponding to the entities and a plurality of word strings corresponding to the intents, wherein the server control unit recognizes the voice signals and transmits the word strings to the server storage unit Analyzing the meaning of the stored content by comparing with stored entities and intents, identifying a content providing server that is a service providing entity corresponding to the entity, requesting the content providing server for a service corresponding to the intent of the user corresponding to the intent, And receive link information for accessing specific contents.

The server control unit may generate a response message including the response information and transmit the response message to the audio output apparatus when response information other than link information is received from the content providing server.

At this time, the server control unit may convert the response message into a voice signal through a TTS (Text To Speech) engine, and then transmit the converted response message to the sound output apparatus.

The server control unit may generate a playlist for the link information according to a predetermined criterion when a plurality of pieces of link information are received from the content providing server, It is possible to control the next link information to be transmitted to the sound output device.

According to the method and apparatus for providing a voice recognition service of the present invention, a user's voice input from a sound output apparatus including a microphone and a speaker is recognized, and the user's intention is determined. Then, It is possible to provide an appropriate service by intelligently outputting the service, and it is possible to increase the satisfaction of the user.

Further, the present invention is not limited to providing only a designated service, but may be applied to a plurality of content providing servers or a user terminal in cooperation with various devices such as various applications and home management apparatus, As shown in FIG.

In addition, various effects other than the above-described effects can be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

1 is a block diagram illustrating a system for providing a voice recognition service according to an embodiment of the present invention.
2 is a data flow chart for explaining a method of providing a voice recognition service according to an embodiment of the present invention.
3 is a data flow chart for explaining a method of providing a voice recognition service according to another embodiment of the present invention.
4 is a block diagram showing a main configuration of a terminal according to an embodiment of the present invention.
5 is a block diagram showing a main configuration of an audio output apparatus according to an embodiment of the present invention.
6 is a flowchart illustrating a method of providing a voice recognition service in an audio output apparatus according to an embodiment of the present invention.
FIG. 7 is a configuration diagram illustrating a main configuration of a service server according to an embodiment of the present invention.
8 is an exemplary diagram for explaining a speech recognition process according to an embodiment of the present invention.
9 is a flowchart illustrating a method of providing a voice recognition service in a service server according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS For a more complete understanding of the nature and advantages of the present invention, reference should be made to the following detailed description taken in conjunction with the accompanying drawings, in which:

In the following description and the accompanying drawings, detailed description of well-known functions or constructions that may obscure the subject matter of the present invention will be omitted. It should be noted that the same constituent elements are denoted by the same reference numerals as possible throughout the drawings.

The terms and words used in the following description and drawings are not to be construed in an ordinary sense or a dictionary, and the inventor can properly define his or her invention as a concept of a term to be described in the best way It should be construed as meaning and concept consistent with the technical idea of the present invention. Therefore, the embodiments described in the present specification and the configurations shown in the drawings are merely the most preferred embodiments of the present invention, and not all of the technical ideas of the present invention are described. Therefore, It is to be understood that equivalents and modifications are possible.

Also, terms including ordinal numbers such as first, second, etc. are used to describe various elements, and are used only for the purpose of distinguishing one element from another, Not used. For example, without departing from the scope of the present invention, the second component may be referred to as a first component, and similarly, the first component may also be referred to as a second component.

In addition, when referring to an element as being "connected" or "connected" to another element, it means that it can be connected or connected logically or physically. In other words, it is to be understood that although an element may be directly connected or connected to another element, there may be other elements in between, or indirectly connected or connected.

Also, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. It is also to be understood that the terms such as " comprising "or" having ", as used herein, are intended to specify the presence of stated features, integers, It should be understood that the foregoing does not preclude the presence or addition of other features, numbers, steps, operations, elements, parts, or combinations thereof.

Hereinafter, a method and apparatus for providing a voice recognition service according to an embodiment of the present invention will be described.

First, a speech recognition service providing system according to an embodiment of the present invention will be described.

1 is a block diagram illustrating a system for providing a voice recognition service according to an embodiment of the present invention.

Referring to FIG. 1, the voice recognition service providing system of the present invention may include a terminal 100, an audio output apparatus 200, and a service server 300. The terminal 100 and the sound output apparatus 200 of the present invention can be connected to each other by a local area communication method to transmit and receive information. The terminal 100 and the service server 300, the sound output apparatus 200, (300) may be connected via a communication network (500).

The terminal 100 refers to a user apparatus capable of transmitting and receiving various data according to a user's request. In particular, the terminal 100 of the present invention may be connected to the sound output apparatus 200 by a short distance communication method, and may transmit various setting information for operating the sound output apparatus 200 to the sound output apparatus 200. For example, when the sound output apparatus 200 provides a notification function, the terminal 100 may receive various information for notification setting from the user and provide the information to the sound output apparatus 200.

The terminal 100 of the present invention may transmit identification information of the terminal 100 to the sound output apparatus 200 while the sound output apparatus 200 is connected to the sound output apparatus 200 by a short distance communication method, 100 to the service server 300 through the communication network 500 to support more personalized service provisioning.

In addition, the terminal 100 according to the embodiment of the present invention can set or change a wakeup word. In other words, the sound output apparatus 100 of the present invention recognizes a wakeup word in a voice signal of a user and transmits a voice signal to the service server 300 as a wakeup word is recognized or performs a specified operation The terminal 100 can perform a process of specifying or changing a wakeup word at this time.

In addition, the terminal 100 according to the embodiment of the present invention may transmit information on the content providing server 400 to the service server 300. For example, assuming that there are a plurality of content providing servers 400 serving the same content, the terminal 100 can subscribe to a service provided by a specific content providing server 400 among the plurality of content providing servers 400 And the subscription information may be transmitted to the service server 300 so that the content provided by the content providing server 400 can be used through the audio output apparatus 200.

In addition, the terminal 100 of the present invention shares or provides the setting information of various applications provided in the terminal 100 with the sound output apparatus 200 or the service server 300 to provide more intelligence in the sound output apparatus 200 Service can be performed. For example, if the user has uttered "What is the appointment today?", The sound output apparatus 200 generates a voice signal to the service server 300, the service server 300 recognizes the voice of the user, A schedule management application provided in the terminal 100 to provide a response message including the confirmed response information such as "There is a alumni meeting at 7:00 Kangnam station" to the sound output device 200).

For this purpose, the terminal 100 of the present invention must be provided with a service application for controlling the sound output apparatus 200 in advance. The service application may be downloaded and installed through the service server 300 or a separate application store, or may be used as a cloud service method by accessing the service server 300.

The sound output apparatus 200, which outputs speech recognition service of the present invention through a speaker, generates a sound signal by receiving a user's speech uttered by a user within a certain radius and transmits the generated sound signal to the service server 300 And outputs the contents provided by the various contents providing servers 400 and provides the contents. In particular, the sound output apparatus 200 of the present invention includes a microphone and receives a user's utterance voice through a microphone and generates it as a voice signal. The sound output apparatus 200 of the present invention divides a voice signal inputted through a microphone into frames of a predetermined length and performs speech recognition in units of separated frames to check whether or not a predetermined wake-up word is included. Here, the wake-up word means a word registered in advance in the sound output apparatus 200. When the wake-up word is included in the voice uttered by the user, the sound output apparatus 200 of the present invention outputs the generated voice signal To the service server 300 via the communication network 500. At this time, the sound output apparatus 200 of the present invention can delete a frame corresponding to the wake-up word from a voice signal, and then transmit the voice signal to the service server 300 300).

The sound output apparatus 200 of the present invention recognizes the voice signal and, when the response information suitable for the user's intention is received from the service server 300, the sound output apparatus 200 performs a process of outputting it as a voice signal through the provided speaker do. At this time, the sound output apparatus 200 of the present invention can receive a response message in the form of a voice signal from the service server 300, convert the received response message into an audible frequency band that can be recognized by the user, .

On the other hand, if the link information is received together with the response message from the service server 300, the sound output apparatus 200 of the present invention accesses the content providing server 400 using the link information, And receiving the contents corresponding to the corresponding link information in a streaming form and outputting the contents through the speaker. For example, when the link information is link information for the sound source A provided by the content providing server B 400b of FIG. 1, the sound output apparatus 200 connects to the content providing server B 400b via the communication network 500 And requests stream A to receive streaming data from content providing server B 400b and reproduce the streaming data. At this time, the link information may include approval information that the content providing server 400 can be connected. The sound output apparatus 200 receiving the link information may have permission to access the content providing server 400 The content providing server 400 can provide the content without any authentication process.

Meanwhile, the service server 300 refers to a service provider entity providing a voice recognition service according to an embodiment of the present invention. The service server 300 of the present invention can transmit / receive various information for providing a service in cooperation with the terminal 100. In addition, the service server 300 of the present invention can receive a voice signal generated by a user from the sound output apparatus 200 and provide a voice recognition service corresponding thereto. In particular, the service server 300 of the present invention can interoperate with a plurality of content providing servers 400 at a subsequent stage, and can receive content from a content providing server 400, and then receive the content from the content providing server 400 and provide the content to the sound output apparatus 200. At this time, the service server 300 of the present invention not only delivers the content provided by the content providing server 400 to the sound output apparatus 200, but also constructs and generates a response message according to the voice recognition service, Text to Speech) engine, and then transmits the converted voice signal to the sound output apparatus 200 in a streaming form.

The operation of the audio output apparatus 200 and the service server 300 of the present invention will be described in more detail with reference to the accompanying drawings. (CP) that performs a function of transmitting a service or information to the service server 300. [ In particular, the content providing server 400 of the present invention can transmit different types of responses according to the type of the query of the service server 300 or the type of the content provided by the service server 300 itself. For example, if the content providing server A 400a is a content providing server 400 capable of providing a streaming service for a sound source, the service providing server A 400a can transmit link information capable of streaming the corresponding sound source according to the request. On the other hand, if the content providing server B 400b is a server capable of providing specific contents such as weather and temperature, it can provide only the specific information (current weather, current temperature, etc.) have.

In addition, the content according to the present invention is a concept that refers to all application programs that perform specific functions such as movies, music, and the like, such as specific information such as weather, time, game application, and schedule management application. Such contents can be transmitted to the audio output apparatus 200 or to the service server 300 in the form of streaming data.

The communication network 500 supporting the above-described processes may be used not only for an IP-based wired communication network such as the Internet, but also for various types of wireless networks such as a long term evolution (LTE) network, a mobile communication network such as a WCDMA network, The backbone network, and the Internet network. However, since a variety of known technologies can be applied to the specific configuration and operation of the communication network, Are omitted.

In addition, the communication network 500 of the present invention may include a cloud computing network capable of storing computing resources such as hardware and software, and providing the computing resources required by the client to the terminals. Here, cloud computing refers to a computer environment in which information is permanently stored on a server on the Internet and temporarily stored in a client terminal such as a desktop, a tablet computer, a notebook, a netbook, or a smart phone. Cloud computing, Refers to a computer environment access network that stores information on a server on the Internet and makes the information available anytime and anywhere through various IT devices. At this time, the terminal 100 of the present invention can access the service application provided by the service server 300 for accessing the service server 300 by using a cloud computing method.

The main constitution of each device for the embodiment of the present invention has been outlined above. A processor mounted on each device according to an embodiment of the present invention may process program instructions for executing the method according to the present invention. In one implementation, the processor may be a single-threaded processor, and in other embodiments, the processor may be a multithreaded processor. Further, the processor is capable of processing instructions stored on a memory or storage device.

Hereinafter, a method for providing a voice recognition service in a voice recognition service providing system according to an embodiment of the present invention will be described in more detail.

Particularly, in the voice recognition service providing system of the present invention, the service server 300 constructs a response message according to the voice recognition result and transmits the response message to the sound output apparatus 200, Lt; / RTI > may be accomplished around an embodiment that transmits link information for the mobile station.

First, a description will be given of a method of providing a speech recognition service according to the present invention, with reference to an embodiment in which a response message is constructed and transmitted to the sound output apparatus 200.

2 is a data flow chart for explaining a method of providing a voice recognition service according to an embodiment of the present invention.

Referring to FIG. 2, the sound output apparatus 200 of the present invention is basically in a standby state. In a standby state, the audio output apparatus 200 applies power to only some modules, such as a microphone for receiving user's voice, and disconnects unnecessary modules such as a communication module for communication with the service server 300 .

The standby state of the present invention can be collectively referred to as a state before speech recognition is started. In other words, even if a plurality of users are ignited near the sound output apparatus 200 or there is noisy noise and the voice signal is continuously recognized through the microphone, the voice signal input until the wake-up word is input is continuously deleted, It may mean a state of controlling not to be transmitted to the server 300.

In this state, the sound output apparatus 200 of the present invention receives a voice transmitted from a user within a predetermined radius through a microphone and generates it as a voice signal (S101). At this time, the sound output apparatus 200 of the present invention receives a voice of a user through a microphone in real time, converts it into a digital voice signal, separates the converted voice signal into frames of a predetermined length, (S103). At this time, the sound output apparatus 200 of the present invention can perform a process of recognizing a voice signal for a predefined initial period. For example, if the speech signal for the initial 10 frames is set to be recognized, the section for the 10 frames can be recognized. For this purpose, the sound output apparatus 200 of the present invention can store an input voice signal in a device storage unit, and it is determined whether there is a word corresponding to a wake up result (S105) If there is no word corresponding to the wakeup, the voice signal stored in the device storage unit is deleted, and if it exists, the voice signal separated into frames in real time may be streamed and transmitted to the service server 300 (S107).

The service server 300 receiving the audio signal to be streamed performs a process of recognizing the audio signal on a frame basis (S109). At this time, the service server 300 of the present invention extracts a speech feature vector from the received speech signal and confirms a phoneme corresponding to the extracted speech feature vector. Here, a phoneme refers to the smallest unit (eg, a, d, ㅓ, ㅕ, ㅁ) that distinguishes meaning. In phonemic recognition, a process of converting into a set of such units can be performed. Thereafter, the service server 300 of the present invention constructs a sentence composed of word strings having meaning using the set of recognized phonemes, and analyzes the meaning using the word sequence (S111).

The service server 300 of the present invention analyzes a sentence composed of a word string to check whether each word string corresponds to an intent that corresponds to an entity (S113). Here, the entity may mean a predefined proper noun such as the name of a specific service desired by the user. For example, it is possible to extract a proper noun that has been promised in advance such as 'weather', 'latest song', 'pop song', 'time', 'appointment' On the other hand, an intent means a word string including a user's intention. For example, the intent may correspond to a word string for expressing a user's intention except an entity such as 'play', 'what time is' have.

For example, when the user has uttered "Tell me music ", the service server 300 can analyze the 'music' as an entity and the 'tell me' intent. In addition, if the user has uttered "Turn on air purifier ", the service server 300 can analyze the 'air purifier' as an entity and the 'turn on' intent. In addition, the service server 300 of the present invention can store information on the service providing entity corresponding to each entity in the form of a table, and can identify the service providing entity, that is, the content providing server using the analyzed entity (S119). At this time, if there is no separate content providing server, the service server 300 may be a service providing entity.

In addition, the service server 300 of the present invention can store and manage information on a user's intention in the form of a table corresponding to the intent, accurately confirm the intention of the user using the analyzed intent, The service providing server 400 may request the service by requesting it (S121). For example, the intention of the user corresponding to the tent of 'Tell me' can be confirmed by 'Play', and the service request for the playback can be transmitted to the corresponding content providing server 400. The intention of the user corresponding to the ' 'So that the corresponding content providing server 400 or the service server 300 can directly execute the device corresponding to the entity.

In another example, if the entity is 'weather' and the intent of 'how' is 'inquiry', the service server 300 transmits a content providing server a 400a capable of providing the weather content And requests the contents providing server 400a to inquire about the weather. At this time, the service server 300 of the present invention confirms the identification information of the sound output apparatus 200, confirms information on the current position and time of the sound output apparatus 200, 400). ≪ / RTI > For example, when the current location of the sound output apparatus 200 is 'Seoul City', the service server 300 can query the weather for the current time in Seoul, 300, and transmits the response to the service server 300 (S119).

Thereafter, the service server 300 of the present invention constructs a response message using the received response (S121). That is, since the service server 300 of the present invention receives only the response information about the content from the content providing server 400, the service server 300 can perform a process of transmitting the response information to the sound output device 200.

First, if response information 'rain' is received from the content providing server 400, the service server 300 may construct a series of sentences including the contents. At this time, the series of sentences may be configured in consideration of the current position and the current time of the sound output apparatus 200. In the above example, if the current location of the sound output apparatus 200 is referred to as a city of Seoul, and the current time is assumed to be 2:00, the service server 300 includes the information as " &Quot;, < / RTI > When constructing the response message, the service server 300 of the present invention can construct a response message in consideration of the information set by the user. For example, when the setting information of the user for constituting the response message is transmitted from the terminal 100, a response message can be configured based on the setting information. When the user selects the type of the language as English, It is possible to convert the content transferred from the providing server 400 and construct a response message. In addition, if the user sets the style to 'friendly', the response message can be constructed with a familiar style, and if the user is set to the honorific language, the response message can be configured with a vernacular style.

The service server 300 of the present invention performs a process of converting the response message into an audio signal in order to output a response message configured through the audio output apparatus 200 (S123), and transmits a response message converted into an electrical audio signal And transmits it to the sound output apparatus 200 in a real-time streaming format (S125). That is, when the response message converted into the voice signal is composed of 10 frames, the voice message is transmitted to the sound output apparatus 200 in real time on a frame-by-frame basis, and the sound output apparatus 200 outputs the response message through the speaker (S127).

Meanwhile, when the service server 300 of the present invention can not construct a response message for various reasons, for example, a response is not transmitted from the content providing server 400 in step S119, or the meaning can be analyzed in step S111 When it is not possible to construct a response message, such as when it is absent, it may transmit a basic response message, for example, "is an unsupported service" to the sound output apparatus 200.

Meanwhile, the audio output apparatus 200 of the present invention may receive and output data directly from the content providing server 400 using the link information transmitted from the service server 300.

This will be described with reference to FIG.

3 is a data flow chart for explaining a method of providing a voice recognition service according to another embodiment of the present invention.

Referring to FIG. 3, the sound output apparatus 200 of the present invention is basically in a standby state. In a standby state, the audio output apparatus 200 applies power to only some modules, such as a microphone for receiving user's voice, and disconnects unnecessary modules such as a communication module for communication with the service server 300 .

In this state, the sound output apparatus 200 of the present invention receives a voice transmitted from a user within a certain radius through a microphone and generates it as a voice signal (S201). At this time, the sound output apparatus 200 of the present invention receives a voice of a user through a microphone in real time, converts it into a digital voice signal, separates the converted voice signal into frames of a predetermined length, (S203). At this time, the sound output apparatus 200 of the present invention can recognize the voice signal for the predefined initial section first.

Thereafter, it is determined whether there is a word corresponding to the wake-up as a result of voice recognition for the initial section (S205). If a word corresponding to the wakeup exists, a voice signal separated into frames in real- To the service server 300 (S207).

The service server 300 receives the voice signal and recognizes the voice signal (S209). At this time, the service server 300 of the present invention extracts a speech feature vector from the received speech signal and confirms a phoneme corresponding to the extracted speech feature vector. Here, a phoneme refers to the smallest unit (eg, a, d, ㅓ, ㅕ, ㅁ) that distinguishes meaning. In phonemic recognition, a process of converting into a set of such units can be performed. Thereafter, the service server 300 of the present invention constructs a sentence composed of word strings having meaning by using the set of recognized phonemes and analyzes the meaning using the word sequence (S211).

Then, the service server 300 of the present invention identifies the word sequence in the semantic analysis and confirms whether the divided word sequence corresponds to an entity or an intent (S213). Here, the entity may mean a predefined proper noun such as the name of a specific service desired by the user. For example, it is possible to extract a proper noun that has been promised in advance, such as weather, latest song, pop song, time, appointment, etc., as an entity. On the other hand, an intent means a word string including a user's intention. For example, the intent may correspond to a word string for expressing a user's intention except an entity such as 'play', 'what time is' have.

For example, the present invention matches a word string corresponding to an intent of a user and stores the word string. When a word string 'what' exists in a voice uttered by the user, the word string is confirmed by an intent It is possible to confirm the user's intention 'query' corresponding to the intent, and to inquire the entity after confirming the entity to be queried in the sentence.

For example, if the sentence for the recognized speech signal is "Give the latest song", the service server 300 of the present invention constructs the speech recognition result in the form of the sentence, Since there is a word sequence of 'word', it is recognized as an entity, and since there is a word sequence 'play', it can be recognized by processing it as 'playback'.

Thereafter, the service server 300 of the present invention confirms the content providing server 400 through the entity (S215). The service server 300 can query the service corresponding to the intent (S217). In the above example, when the entity is the 'latest song' and the intent corresponding to the intent is 'play', the service server 300 transmits a content providing server b 400b ), And requests the corresponding content providing server b 400b to reproduce the latest music. At this time, the service server 300 of the present invention can confirm the identification information of the sound output apparatus 200 and provide more customized information by checking the information of the subscriber of the sound output apparatus 200. [ In other words, it is possible to request a sound source reflecting the user's tendency of the latest music to the contents providing server b 400b.

Then, the content providing server 400 confirms corresponding contents according to a query request of the service server 300, and then transmits a URL, which is link information that can access the corresponding content, to the service server 300 (S219) When the link information is received from the content providing server 400, the server 300 configures a response message to provide the link information to the sound output apparatus 200 (S221).

For example, the service server 300 according to the present invention transmits the link information for accessing the content to the audio output apparatus 200, We can construct various response messages in a predefined manner, such as "Let's hear it first".

At this time, when constructing the response message, the service server 300 of the present invention can construct a response message in consideration of the information set by the user. For example, when the setting information of the user for constituting the response message is transmitted from the terminal 100, a response message can be configured based on the setting information. When the user selects the type of the language as English, It is possible to convert the content transferred from the providing server 400 and construct a response message. In addition, if the user sets the style to 'friendly', the response message can be constructed with a familiar style, and if the user is set to the honorific language, the response message can be configured with a vernacular style.

The service server 300 of the present invention performs a process of converting a response message configured through the sound output apparatus 200 into a speech signal (S223), and outputs a response message converted into an electrical speech signal To the sound output apparatus 200 in the form of a live streaming (S225). That is, when the response message converted into the voice signal is composed of 10 frames, the response message is transmitted to the sound output apparatus 200 in units of one frame in real time. In particular, the service server 300 of the present invention transmits link information for accessing the content transmitted from the content providing server 400, that is, the URL of the content, to the sound output apparatus 200 when transmitting the response message, After outputting the response message received from the service server 300 in step S227, the output apparatus 200 confirms that the link information is received from the service server 300 in step S229, And then request the contents of the URL (S231).

The contents providing server 400 confirms that the access path of the sound output apparatus 200 is the link information provided by the sound output apparatus 200 and transmits the corresponding contents In a streaming form (S233).

The audio output apparatus 200 receiving the streaming data can receive and reproduce the streaming data transmitted from the content providing server 400 in real time.

Meanwhile, when the service server 300 receives a plurality of pieces of link information for contents from the contents providing server 400, the service server 300 may sequentially transmit the link information to the sound output apparatus 200. For example, if it is assumed that the content requested by the user is the latest song TOP 100, the service server 300 can receive a list of URLs for the latest song TOP 100 from the content providing server 400, (Step S237). The sound output apparatus 200 receives the information on the URL (step S239). Then, the sound output apparatus 200 requests the contents providing server 400 for contents in the same process and receives the streaming data (S241 to S245).

Meanwhile, the service server 300 may process a list of URLs received from the content providing server 400 and edit the URLs, collect URLs from different content providing servers 400, To the device 200. In this case, the content providing server 400 accessed by the sound output apparatus 200 in step S231 and the content providing server 400 accessed in step S241 may be different from each other.

Meanwhile, when the service server 300 of the present invention can not construct a response message for various reasons, for example, a response is not transmitted from the content providing server 400 in step S219, or the meaning can be analyzed in step S211 When it is not possible to construct a response message, such as when it is absent, it may transmit a basic response message, for example, "is an unsupported service" to the sound output apparatus 200.

The operation in the voice recognition service providing system according to the embodiment of the present invention has been described above.

Hereinafter, a method for providing a voice recognition service according to an embodiment of the present invention will be described in more detail with reference to the drawings.

4 is a configuration diagram illustrating a main configuration of a UE according to an embodiment of the present invention.

1 and 4, a terminal 100 according to an embodiment of the present invention includes a communication unit 10, an input unit 20, a control unit 30, an output unit 40, and a storage unit 40 Lt; / RTI >

First, the communication unit 10 plays a role of supporting transmission and reception of various information to and from the audio output apparatus 200 and the service server 300. Particularly, the communication unit 10 according to the embodiment of the present invention is connected to the sound output apparatus 200 through short-range communication and transmits various information related to the setting of the sound output apparatus 200 to the sound output apparatus 200 Can be performed. The communication unit 10 of the present invention can transmit the setting of the sound output apparatus 200 or the service subscription information to the service server 300 through the communication network 500.

The communication unit 10 may transmit the identification information about the sound output apparatus 200 to the service server 300 through the communication network 500 and may set the sound output apparatus 200 corresponding to the user of the terminal 100 , The service server 300 can provide information to identify the user's sound output apparatus 200 through the identification information of the sound output apparatus 200. [

The input unit 20 transmits various information such as numbers and character information input from the user, various functions, and signals inputted in relation to the function control of the terminal 100, to the control unit 30. [ In particular, the input 20 of the present invention may support user input to execute the service application 51. [ In addition, the input unit 20 of the present invention can support user input of various information necessary for setting up the sound output apparatus 200.

As described above, the input unit 20 includes a key input unit such as a keyboard and a keypad, a touch input unit such as a touch sensor or a touch pad, a voice input unit, a gyro sensor, a geomagnetism sensor, an acceleration sensor and a proximity sensor, And gesture input means including at least one or more gesture input means. In addition, it can include all forms of input that are currently under development or can be developed in the future.

The control unit 30 performs overall control of the terminal 100 and may be an operating system (OS) and a process unit for driving each configuration, for example, a central processing unit (CPU) .

The control unit 30 of the present invention is operatively connected to each component. That is, the control unit 30 may include a communication unit 10, an input unit 20, an output unit 40, and a storage unit 50.

In particular, the controller 30 according to the embodiment of the present invention controls the entire process of executing the service application provided by the service server 300 according to the request of the user. In addition, the control unit 30 can control the process of outputting various service application execution screens through the output unit 40 according to the user interface information provided by the service server 300. Also, the control unit 30 according to the embodiment of the present invention can set various control information related to the sound output apparatus 200 through the service application 51. [ For example, the alarm information can be set according to a user's request, and the process of transmitting information described in another application (for example, a schedule management application) to the sound output apparatus 200 or the service server 300 can be controlled. In addition, the control unit 30 of the present invention can perform a process of setting a wakeup word that can wake up the sound output apparatus 200 in a standby state.

The output unit 40 displays information on a series of operation states, operation results, and the like that occur during the performance of the function of the terminal 100. In particular, the output unit 40 of the present invention can display various information generated during execution of a service application. The output unit 40 may be implemented as one touch panel (or touch screen) together with the input unit 20 as described above. When the output unit 40 is implemented together with the input unit 20, Can be displayed.

In addition, the storage unit 50 may temporarily store various data generated during execution of the application program, including an application program required for the functional operation according to the embodiment of the present invention. In particular, the storage unit 50 according to the embodiment of the present invention may store in advance a service application 51 capable of setting various information related to the sound output apparatus 200. [ Meanwhile, when the service application 51 is serviced in a cloud computing manner according to circumstances, the storage unit 50 temporarily stores information related to driving the service application, and then, according to the service end, May be deleted.

The storage unit 50 may include a program area and a data area. The program area stores related information for driving the terminal 100, such as an operating system (OS) for booting the terminal 100. [ The data area is an area in which data generated according to the use of the terminal 100 is stored. As described above, the service application and various information generated during execution of the service application, in particular, information on the user interface can be stored. The storage unit 50 may be a flash memory, a hard disk, a memory of a multimedia card micro type (e.g., SD or XD memory), a RAM, a ROM ROM), and the like.

In addition, although the service application and the like stored in the storage unit 50 are described as an example in the embodiment of the present invention, the present invention is not limited thereto. The service application server 300 may operate in conjunction with the service server 300 according to the cloud service system 300).

Thus, the main components of the terminal 100 have been described with reference to FIG. However, not all of the components shown in FIG. 2 are essential components, and the terminal 100 may be implemented by more components than the illustrated components, and the terminal 100 may be implemented by fewer components . It should be understood that the location of the major components of the terminal 100 shown in FIG. 2 may be changed for convenience or for other reasons.

The main configuration and operation method of the terminal 100 according to the embodiment of the present invention have been described above. The terminal 100 of the present invention can be implemented in various forms. For example, the terminal 100 described in the present specification may be a mobile terminal such as a smart phone, a tablet PC, a PDA (personal digital assistant), a portable multimedia player (PMP) , A smart TV, a desktop computer, etc. may be used.

Hereinafter, the main configuration and operation of the sound output apparatus 200 according to the embodiment of the present invention will be described.

FIG. 5 is a configuration diagram illustrating a main configuration of an audio output apparatus according to an embodiment of the present invention, and FIG. 6 is a flowchart illustrating a method of providing a voice recognition service in an audio output apparatus according to an embodiment of the present invention.

5, an audio output apparatus 200 according to the present invention includes a voice signal input unit 210, a device control unit 220, a device communication unit 230, an output unit 240, and a device storage unit 250 And the like.

First, the voice signal input unit 210 of the present invention includes a plurality of multi-channel microphones 211 and an ADC 212 for converting an analog voice signal input through the microphone 211 into an electrical signal . In particular, the voice signal input unit 210 of the present invention receives voice generated through user's utterance through a plurality of multi-channel microphones 211. At this time, the input voice may include surrounding noise and echo generated through a multi-channel microphone. The ADC 212 of the present invention converts the analog voice including the noise and the echo into an electrical voice signal and transmits the voice signal to the device controller 220.

The device control unit 220 of the present invention may include a voice recognition module 221, a wakeup determination module 222, a signal processing module 223, and a service processing module 224.

At this time, the voice recognition module 221 may perform various processes for recognizing a voice signal in the form of an electrical signal transmitted through the ADC 212 of the voice signal input unit 210. In particular, the speech recognition module 221 of the present invention can extract a feature vector in units of frames by dividing a speech signal in the form of an electrical signal into frames of a predetermined length. At this time, the voice recognition module 221 of the present invention may extract voice signal information such as noise, echo, and direction existing in the voice signal.

In addition, the speech recognition module 221 of the present invention extracts spectral information by performing Fourier transform on a speech signal on a frame-by-frame basis, and calculates a filter bank energy for a spectrum. That is, the frequency band can be divided into several filter banks, and the logarithmic function can be applied to the energy in each bank to calculate the log filter bank energy. And the phoneme corresponding to the calculated log filter bank energy is confirmed through the voice recognition information 251 of the device storage unit 250. Then, the speech recognition module 221 of the present invention constructs a set of phonemes and constructs a word sequence according to the word sequence, thereby completing the speech recognition process.

This process can be performed in real time on a frame-by-frame basis. The voice recognition module 221 performs voice recognition on an initial section of a voice signal input through the voice recognition module 221 to determine whether to perform an operation for wake- (222).

If the voice signal is recognized in real time, the wake-up determination module 222 can determine whether or not there is a wake-up word for wake-up. If the wakeup word exists, the wakeup determination module 222 of the present invention can control power to be applied to the standby module such as the device communication unit 230, the output unit 240, and the like.

The service processing module 223 of the present invention can transmit a subsequent voice signal to the service server 300 through the service interworking module 231 of the device communication unit 230 and can transmit a response When the message is transmitted, the message is transmitted to the output unit 240. In particular, if the service processing module 223 of the present invention includes link information for accessing contents through the service interworking module 231 of the device communication unit 230, the service processing module 223 may access the content providing server 400 through the link information And can control the process of receiving the streaming data for the corresponding content from the content providing server 400 through the service interworking module 231 and outputting the received streaming data through the output unit 240. [

The device communication unit 230 includes a service interlock module 231 and a terminal interlock module 232. The service interlock module 231 communicates with the service server 300 or the content providing server 400 via the communication network 500, Lt; RTI ID = 0.0 > and / or < / RTI > Meanwhile, the terminal interworking module 232 can exchange information with the terminal 100 through short-range communication.

The output unit 240 includes a DAC (Digital to Analog Converter) 241 for converting an audio signal, which is an electrical signal, into an analog form, and a speaker 242 for outputting a voice signal output through the DAC 241 And the like.

The device storage unit 25 stores and manages various information related to the driving of the audio output apparatus 200 according to the embodiment of the present invention. In particular, the device storage unit 250 of the present invention may include voice recognition information 251 for recognizing an input voice signal in real time, and may store and manage information 252 related to wakeup. That is, it can be used to compare whether or not the recognized word sequence corresponds to the wakeup word stored in the wakeup information 252. In addition, various information 253 related to the service process can be stored and managed.

The operation of the sound output apparatus 200 according to the embodiment of the present invention will be described with reference to FIG.

Referring to FIG. 6, the sound output apparatus 200 of the present invention can maintain a standby state until a wake-up word is recognized (S301). In a standby state, the audio output apparatus 200 applies power to only some modules, such as a microphone for receiving user's voice, and disconnects unnecessary modules such as a communication module for communication with the service server 300 .

In this state, the sound output apparatus 200 of the present invention receives a voice transmitted from a user within a predetermined radius through a microphone and generates it as a voice signal (S303). At this time, the sound output apparatus 200 of the present invention receives a voice of a user through a microphone in real time, converts it into a digital voice signal, separates the converted voice signal into frames of a predetermined length, (S305). At this time, the sound output apparatus 200 of the present invention can recognize the voice signal for the predefined initial section first.

Thereafter, it is determined whether there is a word corresponding to the wake-up as a result of voice recognition for the initial section (S307). If there is a word corresponding to the wakeup, a voice signal separated into frames in real- To the service server 300 (S309).

The service server 300 receiving the voice signal recognizes the voice signal and recognizes the intention of the user, and can generate a response message for the voice signal that the user has uttered.

Then, the service server 300 transmits the generated response message to the sound output apparatus 200, and the sound output apparatus 200 of the present invention receives the response message converted into the voice signal, which is an electrical signal, from the service server 300 If it is received (S311), it can be output through the provided speaker (S313). At this time, the sound output apparatus 200 of the present invention can perform a process of converting a response message into an analog form, and output a response message converted to analog.

When receiving the response message and the URL, which is link information for content access, from the service server 300 (S315), the sound output apparatus 200 of the present invention transmits the URL to the content providing server 400 using the link information If it is possible to connect (S317), the streaming data corresponding to the link information is received (S319), and the streaming data corresponding to the link information can be reproduced (S321).

The main configuration and operation of the sound output apparatus 200 according to the embodiment of the present invention have been described above.

Hereinafter, the main configuration and operation of the service server 300 according to the embodiment of the present invention will be described.

FIG. 7 is a configuration diagram illustrating a main configuration of a service server according to an embodiment of the present invention, and FIG. 8 is an exemplary diagram illustrating a speech recognition process according to an embodiment of the present invention. 9 is a flowchart illustrating a method of providing a voice recognition service in a service server according to an embodiment of the present invention.

7, a service server 300 according to an exemplary embodiment of the present invention includes a server communication unit 310, a server storage unit 320, a server control unit 330, a conversion unit 340, (350).

The server communication unit 310 of the present invention can perform the function of transmitting and receiving information to and from the terminal 100 and the sound output apparatus 200. [ In particular, the server communication unit 310 of the present invention can receive various user setting information related to the control of the sound output device 200 and the voice recognition service of the present invention from the terminal 100 via the communication network 500. In addition, it can receive the identification information of the sound output apparatus 200 from the terminal 100 and receive the subscriber information of the terminal 100. In addition, the server communication unit 310 of the present invention can receive a voice signal uttered by the user from the sound output apparatus 200, and the server control unit 330 generates A response message and link information can be transmitted.

The server storage unit 320 may store and manage various information related to the operation of the service server 300 of the present invention. In particular, the server storage unit 320 of the present invention can store and manage various kinds of information necessary for speech recognition and semantic analysis. For example, the server storage unit 320 can store and manage an acoustic model for voice recognition, You can store and manage information about entities and intents.

Describing the entities and intents of the present invention in more detail, the entities of the present invention may refer to predefined proper nouns, such as the name of a particular service a user desires. For example, it can mean a proper noun to be controlled, such as weather, latest song, pop song, time, appointment, timer, purifier, mobile phone, and the like. In addition, the server storage unit 320 of the present invention can store and manage information on a subject that can process the entity.

Service provider Entity Content providing server A Weather, temperature, humidity Content providing server B Latest Songs, Pop Songs, K-Pop, Pop, Latest Songs Service server Schedule, appointment, timer

That is, as shown in Table 1, the server storage unit 320 of the present invention can store and manage information on a service providing entity that can process a specific entity.

The intent that can store and manage a word string corresponding to an intent is a word string including an intention of a user. For example, the server storage unit 320 may store ' The user may correspond to a word sequence for expressing a desired intention to an entity such as 'how many times', 'how about', 'tell me', 'turn on', 'tell me'

Intent Intent play Let me play, I hear it, I want to hear it, Play it, stop Stop, stop, stop, stop. vaginal Check it out.

That is, as shown in Table 2, the server storage unit 320 can store and manage a word string indicative of a user's intent as an intent.

In addition, the server storage unit 320 of the present invention can store and manage various information related to the provision of the voice recognition service according to the embodiment of the present invention.

The server control unit 330 manages the overall operation of the service server 300 according to the embodiment of the present invention and includes a preprocessing module 331, a voice recognition module 332, a semantic analysis module 333, 334).

The preprocessing module 331 performs a preprocessing step before voice recognition in a voice signal transmitted from the sound output apparatus 200 through the server communication unit 310. [ For example, a preprocessing process such as removing noise from a speech signal can be performed.

The voice recognition module 332 recognizes the voice signal transmitted through the preprocessing module 331. For example, the speech recognition module 332 of the present invention extracts a speech feature vector from the received speech signal and confirms a phoneme corresponding to the extracted speech feature vector. Here, a phoneme refers to a minimum unit (eg, a, d, ㅓ, ㅕ, ㅁ) that distinguishes meaning, and a phoneme recognition corresponding phonetic feature vector can be converted into a set of such units . Thereafter, the speech recognition module 332 of the present invention constructs a sentence composed of word strings having meaning using the set of recognized phonemes, and transmits the sentence to the meaning analysis module 333.

The semantic analysis module 333 analyzes each word string in a sentence transmitted through the speech recognition module 332 and analyzes whether the analyzed word string corresponds to a tent corresponding to the entity. 8A, it is assumed that the user has uttered the phrase "EYE, now the weather is good" near the sound output apparatus 200. [ In this sentence, 'EYE' is a wakeup word, and when the sound output device 200 determines that the corresponding wakeup word exists in the user's voice, (300). The service server 300 removes echo, noise, etc. through the preprocessing module 331, and the voice recognition module 332 recognizes the voice as shown in FIG. 8A and forms a sentence. Then, the meaning analysis module 333 analyzes the word sequence of the sentence to analyze the word sequence of 'now', the word sequence of 'how', and the word sequence corresponding to 'weather' as an entity. At this time, the semantic analysis module 333 of the present invention analyzes semantics referring to Table 1 and Table 2, and transmits the analyzed result to the service processing module 334.

The service processing module 334 first identifies the service providing entity corresponding to the entity. In FIG. 8A, (2) means an entity, so that the content providing server A 400a corresponding to the weather can be identified as a service providing entity. Then, as indicated by (3) and (4), the content providing server A 400a queries the weather information of the current time using the intent. At this time, the service processing module 334 of the present invention confirms the identification information of the sound output apparatus 200 and confirms the service subscription information corresponding to the identification information through the server storage unit 320. According to the confirmed information, the current position of the sound output apparatus 200 can be confirmed, and the weather information at the identified position can be inquired.

When the corresponding content is delivered from the content providing server 400a through the content server interworking unit 350, the service processing module 334 composes a response message including the corresponding content. In other words, if content called 'rain' is delivered through the content server interworking unit 350, the service processing module 334 includes the current location and time information of the user, and the response information transmitted from the content providing server A 400a , And a response message in the form of a sentence such as "It is raining in Seoul at 2 o'clock ".

The service processing module 334 of the present invention converts the response message into a voice signal through the TTS engine 341 of the conversion unit 341. Thereafter, when the converted response message is transmitted from the converting unit 340, the service processing module 334 can transmit the converted response message to the sound output apparatus 200 through the server communication unit 310. [

The service processing module 334 of the present invention receives the link information for content connection from the content providing server 400 through the content server linking unit 350 and transmits the received link information to the server communication unit 310 to the audio output apparatus 200 via the audio output apparatus 200.

That is, as shown in FIG. 8B, it is assumed that the user has uttered a sentence of "play the latest song." In this case, similarly, 'EYE' is a wake-up word, and the sound output apparatus 200 of the present invention recognizes the 'EYE' and outputs the audio signal to the service server 300 in real- And the service server 300 recognizes the voice signal transmitted in the real-time streaming manner, and confirms that the user has uttered the phrase "play the latest song." The service processing module 334 identifies the service providing subject content providing server b 400b corresponding to the latest song, and transmits the content to the content providing server b 400b And requests service provision through the content server interface unit 350. That is, the word sequence corresponding to the intent in the sentence is 'play' and the intention of the user corresponding to 'play' means playback, so that the service processing module 334 transmits the intention to the content providing server b 400b A message requesting playback of the latest song can be generated and transmitted.

At this time, the content providing server b 400b, which can be interlocked with the service server 300 of the present invention, does not transmit the content to the service server 300 immediately but transmits link information for accessing the corresponding content. At this time, if the service requested by the user is the latest TOP 100, link information for each sound source corresponding to the TOP 100 can be transmitted.

Upon receipt of the response message including the link information, the service processing module 334 receiving the response message can construct a response message in the form of "Let's hear the latest TOP 100. " Then, the response message is converted into a voice signal through the TTS engine of the conversion unit 340 and transmitted to the sound output apparatus 200 through the server communication unit 310.

Thereafter, the sound output apparatus 200 outputs a response message "Let's hear the latest song TOP 100" received from the service server 300 through the speaker, and transmits the response message to the contents providing server 300 according to the link information received from the service server 300. [ b 400b to receive streaming data for a sound source, and can reproduce the streaming data.

The process of providing the voice recognition service in the service server 300 according to the present invention will be described again with reference to a flowchart.

9 is a flowchart illustrating a main operation of the service server 300 according to an embodiment of the present invention. The service server 300 receives a voice signal from the sound output apparatus 200 (S501).

Thereafter, the service server 300 of the present invention performs a process of recognizing a voice signal (S503). At this time, the service server 300 of the present invention extracts a speech feature vector from the received speech signal and confirms a phoneme corresponding to the extracted speech feature vector. Here, a phoneme refers to the smallest unit (eg, a, d, ㅓ, ㅕ, ㅁ) that distinguishes meaning. In phonemic recognition, a process of converting into a set of such units can be performed. Thereafter, the service server 300 of the present invention constructs a sentence composed of word strings having meaning by using the set of recognized phonemes, and analyzes the meaning using the sentence structure (S505).

In step S507, the service server 300 of the present invention identifies the word sequence in the semantic analysis and confirms whether the divided word sequence corresponds to an entity or a tent. Here, the entity may mean a predefined proper noun such as the name of a specific service desired by the user. For example, it is possible to extract a proper noun that has been promised in advance, such as weather, latest song, pop song, time, appointment, etc., as an entity. On the other hand, an intent means a word string including a user's intention. For example, the intent may correspond to a word string for expressing a user's intention except an entity such as 'play', 'what time is' have.

If the sentence is taken as an example, if the user has uttered the sentence "Give me the latest music," the phrase 'up-to-date music' in the above sentence means an entity and 'play' means an intent.

The service server 300 of the present invention can identify the service providing entity for the latest music entity and the content providing server 400 for providing the latest music in operation S509. Then, a service corresponding to the intent is inquired to the content providing server (S511). In the above example, 'play' is an intent, and the service server 300 can check the intention table corresponding to the user 'intention' and know that the intent of the user is 'play'. Thereafter, the service server 300 queries the content providing server for a playback service for 'latest music'.

Thereafter, the content providing server 400 transmits a URL, which is link information on the latest music, in response to a request from the service server 300 (S513), and the service server 300 receives the link information, (S515), a reproduction list (URL list) can be generated.

At this time, the service server 300 of the present invention can check the subscriber information based on the identification information of the sound output device 200, and can dynamically change the play list considering the preference and taste of the subscriber.

When the reproduction list (URL list) is generated through this process, the service server 300 composes a response message to be transmitted together with the reproduction list (S519).

The response message may be a response message to a voice signal input by the user, for example, to generate a response message "Let me hear the latest music ".

The service server 300 converts the generated response message into a form of a voice signal that the sound output apparatus 200 can output (S521), and transmits the converted response message to the sound output apparatus 200 (S523 ).

In particular, the service server 300 of the present invention can sequentially transmit all the link information in the play list, rather than transmit the link information to the sound output apparatus 200 at a time. If the next link information exists (S525) The next link information may be further transmitted (S527).

The time required for transmitting the next link information may be set in consideration of the playback time of the content corresponding to the link information. In other words, after transmitting the first link information to the sound output apparatus 200, the second link information may be transmitted again after 3 minutes considering the reproduction time corresponding to the first link information.

At this time, when a voice signal of the "next song" is transmitted from the audio output apparatus 200, the service server 300 recognizes the voice signal and confirms that the next song is reproduced. Information can be transmitted to the sound output apparatus 200.

The method for providing the voice recognition service according to the embodiment of the present invention has been described above.

The method of providing a speech recognition service of the present invention as described above may be provided in the form of a computer-readable medium suitable for storing computer program instructions and data.

In particular, the computer program of the present invention includes the steps of generating a voice signal by receiving a voice of a user to be uttered, transmitting the voice signal to a service server, receiving a response message Receiving link information for accessing a specific content, accessing a corresponding content providing server according to the link information, receiving streaming data for the content from the content providing server, Reproducing the streaming data and outputting the streaming data, or receiving the audio signal streamed from the audio output apparatus, analyzing the meaning of the received audio signal, analyzing the meaning of the received audio signal, The content providing server Receiving link information for accessing a specific content from the server, generating a response message corresponding to the voice signal, and transmitting the response message and the link information to the sound output apparatus.

Such computer-readable media suitable for storing computer program instructions and data include, for example, magnetic media such as hard disks, floppy disks and magnetic tape, compact disk read only memory (CD-ROM) Optical media such as a DVD (Digital Video Disk), a magneto-optical medium such as a floppy disk, and a ROM (Read Only Memory), a RAM , Random Access Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically Erasable Programmable ROM). The processor and memory may be supplemented by, or incorporated in, special purpose logic circuits.

The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. The functional program for implementing the present invention and the related code and code segment may be implemented by programmers in the technical field of the present invention in consideration of the system environment of the computer that reads the recording medium and executes the program, Or may be easily modified or modified by the user.

In addition, a computer program recorded on a computer-readable recording medium as described above includes instructions for performing the functions as described above, distributed and distributed through a recording medium, read and installed in a specific device, a specific computer, Thereby performing the above-described functions.

While the specification contains a number of specific implementation details, it should be understood that they are not to be construed as limitations on the scope of any invention or claim, but rather on the description of features that may be specific to a particular embodiment of a particular invention Should be understood. Certain features described herein in the context of separate embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments, either individually or in any suitable subcombination. Further, although the features may operate in a particular combination and may be initially described as so claimed, one or more features from the claimed combination may in some cases be excluded from the combination, Or a variant of a subcombination.

Likewise, although the operations are depicted in the drawings in a particular order, it should be understood that such operations must be performed in that particular order or sequential order shown to achieve the desired result, or that all illustrated operations should be performed. In certain cases, multitasking and parallel processing may be advantageous. Also, the separation of the various system components of the above-described embodiments should not be understood as requiring such separation in all embodiments, and the described program components and systems will generally be integrated together into a single software product or packaged into multiple software products It should be understood.

The present invention relates to a method of providing a voice recognition service, and more particularly, to a voice recognition service capable of recognizing a user's voice input from an audio output device including a microphone and a speaker, A service providing method and an apparatus therefor.

According to the present invention, it is possible to recognize a user's voice input from a sound output apparatus including a microphone and a speaker, to grasp a user's intention, and then output an appropriate sound source in cooperation with a plurality of content providing servers, The present invention can be applied to various industries such as speech recognition, artificial intelligence, multimedia contents industry, and the like.

100: terminal 200: sound output device
210: audio signal input unit 220:
230: device communication unit 240: output unit
300: service server 310: server communication unit
320: server storage unit 330: server control unit
340: conversion unit 350: content server interface unit
400: Content providing server 500:

Claims (13)

The sound output device comprises:
Generating a voice signal by receiving a voice of a user to be ignited;
Streaming the voice signal and transmitting it to a service server;
Receiving a response message generated by recognizing the voice signal from the service server and link information for accessing a specific content;
Accessing a corresponding content providing server according to the link information;
Receiving streaming data for the content from the content providing server; And
Reproducing the response information and the received streaming data and outputting the response information;
And generating a voice recognition service. The method according to claim 1,
The transmitting step
Dividing the speech signal into frames of a predetermined length and performing speech recognition on a divided frame basis; And
Transmitting the voice signal to the service server by streaming the voice signal on a frame-by-frame basis if it is determined that a predetermined wake-up word exists in a specific section as a result of voice recognition;
And generating a voice recognition service. The service server,
The method comprising: receiving a voice signal streamed from an audio output device;
Recognizing the received voice signal, analyzing its meaning, and confirming a corresponding content providing server according to the analyzed result;
Receiving link information for accessing a specific content from the content providing server; And
Generating a response message corresponding to the voice signal, and transmitting the response message and the link information to the sound output device;
And generating a voice recognition service. The method of claim 3,
The verifying step
Recognizing the voice signal and classifying the voice signal into an entity and an intent and analyzing the meaning;
Confirming a content providing server which is a service providing entity corresponding to the entity; And
Requesting a service according to a user's intention corresponding to the intent to the content providing server;
And generating a voice recognition service. The method of claim 3,
In the step of receiving the link information
Generates a playlist for the link information according to a predetermined criterion when a plurality of the link information are included,
After the step of transmitting to the sound output device,
Transferring the next link information to the audio output device after a predetermined time elapses or according to the request of the audio output device according to the reproduction list;
Further comprising the steps of: A computer-readable recording medium storing a program for executing the method for providing a speech recognition service according to any one of claims 1 to 5. A voice signal input unit for receiving a user's voice generated through a microphone and generating a voice signal;
An output unit for outputting a response message and streaming data through a speaker; And
The control unit controls the receiving unit to output the response message through the output unit when the response message generated by recognizing the voice signal from the service server and the link information for accessing the specific content are received, A device control unit connected to the corresponding content providing server according to the link information to receive streaming data for the content, to reproduce the streaming data, and to output the streaming data through the output unit;
And a sound output unit for outputting sound. 8. The method of claim 7,
The device control unit
A voice signal input through the voice signal input unit is divided into frames of a predetermined length, voice recognition is performed on a divided frame basis, and if it is determined that a predetermined wakeup word exists in a specific section, And controls the streaming unit to transmit the streaming data to the service server. A server communication unit for receiving a voice signal generated by a user in a streaming manner from an audio output apparatus; And
Recognizes a voice signal received through the server communication unit, analyzes the meaning, confirms a corresponding content providing server according to the analyzed result, and when link information for accessing specific contents is received from the contents providing server, A server controller for controlling the server to transmit the response message and the link information to the sound output device through the server communication unit;
The service server comprising: 10. The method of claim 9,
A server storage unit for storing a plurality of word strings corresponding to the entities and a plurality of word strings corresponding to the intents;
Lt; / RTI >
The server control unit
Recognizes the speech signal and compares the extracted speech signal with an entity and an intent stored in the server storage unit in terms of a word string to analyze the meaning and confirms a content providing server that is a service providing entity corresponding to the entity, And receives link information for accessing the specific content by requesting a service corresponding to the intent of the user corresponding to the intent. 10. The method of claim 9,
The server control unit
And generates a response message including the response information when the response information other than the link information is received from the contents providing server, and controls the response message to be delivered to the sound output apparatus. 10. The method of claim 9,
The server control unit
Converts the response message to a voice signal through a TTS (Text To Speech) engine, and controls the converted response message to be delivered to the sound output device. The method of claim 3,
The server control unit
And generating a playlist for the link information according to a predetermined criterion when a plurality of pieces of link information are received from the content providing server, Information to be transmitted to the sound output apparatus.

Images