JP6069157B2 - Information processing apparatus, control method, and program - Google Patents

Description

  The present invention relates to an information processing apparatus, a control method, and a program.

  In recent years, it has become possible to interact with humans and computers in various forms by inputting, outputting, and processing multimedia such as characters, sounds, graphics, and images. In particular, recently, due to the dramatic improvement in memory capacity and processing capacity of personal computers (hereinafter also referred to as PCs), PCs that can handle multimedia have been developed, and various applications have been developed. It is coming. All of these are simply for putting in and out various multimedia, and have not yet achieved an organic fusion of various multimedia.

  On the other hand, language data including characters has become common instead of conventional numerical data, and black and white image data has been expanded to handle colorization, graphics, animation, 3D graphics, and even moving images. . In addition to voice signal level input / output, voice recognition and voice synthesis functions are being researched and developed for voice and audio signals. However, its performance is unstable for use as a man-machine interface, and its practical use is limited to limited fields.

  As described above, the above-described character, text, voice, graphic data, and the like continue to develop from conventional input / output processing (recording and playback) to various media and generation functions. In other words, for the purpose of handling the content, structure, and semantic content of the media from the surface processing of each media, and making conversations between humans and PCs more natural and comfortable, such as voice and graphics The construction of a dialogue system that uses media fusion and generation is being studied.

  Here, the voice search used in the dialogue system refers to a technology or service that can be searched by speaking with a voice to be spoken instead of a character string. In recent years, Siri (registered trademark) installed in Apple (registered trademark) iOS and Google (registered trademark) voice search are known. In addition, recently, car navigation systems that can be operated by voice, TVs that can be operated by voice and program search, which are released by some manufacturers, mobile phones and smartphones that translate into a specified language when spoken are also available. Thus, in recent years, services using voice analysis technology have appeared.

  By the way, since voice search does not require typing a character string with a keyboard or a touch panel, information can be accessed even when both hands are closed, and an intuitive approach of speaking is possible. If a search result corresponding to a search result can be obtained by a voice using a PC, the future is expected for the reason that it becomes possible to easily retrieve desired information from the Internet through dialogue.

  However, at present, voice search using the Internet is not so popular. One of the reasons why voice search is not widespread is the difficulty of voice recognition in search services and its versatility. That is, it is sufficient for the voice recognition installed in the television to be able to recognize basically the things related to the program and the person, such as the name of the television program and the performer, and the things related to the television operation. Similarly, in the case of a car navigation system, it is basically only necessary to be able to recognize things related to map information such as addresses and facility names.

  For example, the address to be entered in the car navigation system is standardized as in Tokyo, Tokyo, etc. △△ Town, etc., so it is only necessary to be able to identify the words that enter OO, △△ when recognizing continuous speech. As a result, accuracy is improved. As described above, in the case of a specific purpose device, the range and context to be recognized can be narrowed down to some extent, that is, candidates can be limited. However, this is not the case with general-purpose search services.

  As described above, speech recognition has progressed from single word recognition to continuous word recognition and continuous speech recognition, and is being developed in a direction in which application is limited for practical use. In such application situations, understanding speech utterances is more important than speech character recognition as a speech dialogue system. For example, research on speech understanding systems that use knowledge of application fields based on keyword spotting Has been.

  On the other hand, the understanding and generation of media such as voice is unavoidable in the absence of information and errors that occur during media conversion, unlike simple data input / output. That is, speech understanding is a process of extracting speech utterance content and speaker's intention from speech pattern data with a large amount of information, and speech recognition errors and ambiguity occur in the process of compressing information. Therefore, as a speech dialogue system, in order to deal with the above-mentioned speech recognition imperfections such as recognition errors and ambiguities, appropriate questions and confirmations are made to the user from the PC side, and the dialogue proceeds smoothly through dialogue control. There is a need to.

  Then, in the spoken dialogue system, as a result of performing a question or confirmation to the user from the PC side, when an answer different from the answer required from the user side is received, the PC side asks the user again. Or it notifies that it is different from the required answer. However, even if the PC asks the user again or notifies the user that the answer is different from the required answer, if the user cannot get an accurate answer, the answer from the user may be ignored. is there.

  Patent Document 1 describes a voice recognition device that outputs a message that prompts another voice input if a plurality of voice-recognized candidates do not belong to a designated category that is voice-input by a user. Yes.

JP 2001-109492 A

  As described above, a conventional speech dialogue system using speech recognition and speech synthesis technology is a simple combination of speech recognition, speech synthesis, and screen display technologies developed separately. There is a problem that sufficient consideration is not given from the viewpoint of dialogue. In other words, the speech recognition function has recognition errors and ambiguity, and the speech synthesis function has poorer clarity than human utterance and insufficient control of intonation, resulting in insufficient ability to transmit intentions and emotions. And there is a fundamental problem of lack of naturalness.

  Moreover, although the recognition rate of the speech recognition apparatus has been improved, it becomes difficult to avoid misrecognition as the number of vocabulary increases. Then, as a response to the case of erroneous recognition, there is a “return” operation. This is to discard the misrecognition and input again. However, with this method, even if the same recognition target as the first time is re-recognized, the recognition rate is not significantly improved, and as a result, there are many possibilities that the user cannot recognize the intended word. high. And since the same word will be generated many times with respect to misrecognition, there exists a problem that a recognition rate is felt low and a user's trust is lost.

  In the technique described in Patent Literature 1, when an answer corresponding to a message input by voice by the user cannot be obtained, a new search for re-searching is performed without searching for the message. A message that the user wants to input speech is output to the user, and a candidate similar to the new speech input is searched again, and the message input by the user cannot be flexibly handled. There's a problem.

  Accordingly, the present invention has been made in view of the above-described conventional problems, and even if an inappropriate answer is given to a question required for continuing a search, the intention of the inappropriate answer is drawn. An object of the present invention is to provide an information processing apparatus, a control method, and a program capable of following and continuing a search.

In order to solve the above-mentioned problem, the information processing apparatus according to the present invention described in claim 1 is provided with means for converting input speech information into text information, means for segmenting the converted text information, and externally provided. An attribute obtained from the segmented text information based on the information stored in advance in the database that stores in advance information on what attribute each of the plurality of servers has. And means for associating each of the servers holding the information corresponding to the attribute, and means for temporarily storing the correspondence between the segmented text information and the attribute obtained from the text information , information when searching for information corresponding to a predetermined attribute from the being correspondence server, that clause text information corresponds to any attribute If it is determined that there is an element that does not determine the attribute in the phrased text information, the voice information for determining the attribute is requested, and the element that does not determine the attribute exists in the phrased text information. If it is determined not to identify the server having information corresponding to the attribute obtained from the phrased text information, and to determine the attribute of the phrased text information even if the voice information is requested Is determined based on the correspondence between the text information segmented in the past stored in the means for temporarily storing and the attributes obtained from the text information segmented in the past. A server having information corresponding to the attribute is specified .

The information processing apparatus according to the present invention is the information processing apparatus according to claim 1, wherein when searching for information corresponding to a predetermined attribute using the identified server, the phrased text information is searched. In order to replenish the essential items that are not satisfied, if it is determined whether or not all of the essential items for the search are satisfied, and it is determined that the phrased text information does not satisfy all the required items for performing the search And when it is determined that the segmented text information satisfies all the required items for performing the search, the search is started using the specified server, and the voice information is requested. However, if it is determined that speech information for satisfying all the required items for performing the search cannot be obtained, the stored text information can be temporarily stored. Using a server that holds information corresponding to an attribute estimated based on a correspondence relationship between text information segmented in the past stored in the text and attributes obtained from the text information segmented in the past The search is started .

Furthermore, the information processing apparatus according to the present invention is the information processing apparatus according to claim 2, wherein, as a result of the search being started, whether or not an information amount of information corresponding to a predetermined attribute is equal to or greater than a predetermined threshold value. If it is determined that the information amount of the information corresponding to the predetermined attribute is equal to or greater than the predetermined threshold, the audio information for narrowing the information amount of the information corresponding to the predetermined attribute to less than the predetermined threshold When the request is made and it is determined that the amount of information corresponding to the predetermined attribute is less than the predetermined threshold, a search result obtained by executing the search is output .

Further, in order to solve the above-mentioned problem, the control method of the information processing apparatus according to the present invention described in claim 4 is that each of a plurality of servers provided outside has information corresponding to what attribute. A method for controlling an information processing apparatus having a database for storing information in advance, the step of converting input speech information into text information, the step of segmenting the converted text information, and the database stored in the database A step of associating an attribute obtained from the segmented text information with a server having information corresponding to the attribute based on the information, and the segmented text information and the text information a step of temporarily store the correspondence between the attribute information corresponding to the predetermined attribute from the server that is associated with the said associating step When searching the steps of clause text information is determined and determining whether the information corresponding to any attribute, whether the clauses are elements that do not confirm the attribute in the text information exists, the determination If it is determined that there is an element that does not determine the attribute in the phrased text information, the step of requesting voice information for determining the attribute, and the step of determining include the attribute in the phrased text information. The voice information is requested by the step of identifying a server having information corresponding to the attribute obtained from the sentenced text information and the step of requesting the voice information. However, if it is determined that the voice information for determining the attribute of the text information that has been phrased cannot be obtained, the temporary storage process is performed. Identifying a server which holds information corresponding to the inferred attributes based on the correspondence relationship of the text information segment in the past is stored, and an attribute obtained from the text information segmented in the past by And a process.

The information processing apparatus control method according to the present invention is the information processing apparatus control method according to claim 4, wherein when searching for information corresponding to a predetermined attribute using the server specified by the specifying step, Determining whether the phrased text information satisfies all the required items for performing the search, and determining the required items for the phrased text information to perform the search by the determining step. If it is determined that all of the required items are not satisfied, the step of requesting voice information for replenishing the required items that are not satisfied and the step of determining determine all the required items for the text information segmented to perform a search. If it is determined that the voice information is satisfied, the voice information is obtained by starting a search using the specified server and requesting the voice information. If it is determined that the speech information for satisfying all the required items for performing the search cannot be obtained even if the text information segmented is requested, the segmented text information is segmented into the past stored by the temporarily storing step. Starting a search using a server having information corresponding to the attribute estimated based on the correspondence between the text information obtained and the attribute obtained from the text information segmented in the past. It is characterized by that.

The information processing apparatus control method according to the present invention is the information processing apparatus control method according to claim 5, wherein as a result of the search being started by the search starting step, information corresponding to a predetermined attribute is stored. If the information amount corresponding to the predetermined attribute is determined to be greater than or equal to the predetermined threshold by the step of determining whether the information amount is equal to or greater than the predetermined threshold and the step of determining, the predetermined amount The information amount of information corresponding to the predetermined attribute is less than the predetermined threshold by the step of requesting audio information for narrowing the information amount of information corresponding to the attribute to less than the predetermined threshold and the determining step. And a step of outputting a search result obtained by executing the search .

Furthermore, in order to solve the above-described problem, the program according to the present invention described in claim 7 stores in advance information indicating what attribute each of a plurality of externally provided servers has. Based on the information stored in the database, the processing for converting speech information input to the text information into the computer of the information processing apparatus having a database, the processing for segmenting the converted text information, A process for associating each attribute obtained from the text information with a server having information corresponding to the attribute, and temporarily storing the correspondence between the segmented text information and the attribute obtained from the text information a process for, when searching for information corresponding to a predetermined attribute from a correspondence server by the associating process By the process of determining what attribute the phrased text information corresponds to, the process of determining whether there is an element that does not determine the attribute in the phrased text information, and the process of determining If it is determined that there is an element that does not determine the attribute in the phrased text information, the attribute is determined in the phrased text information by the process of requesting voice information necessary for determining the attribute and the determination process. If it is determined that there is no element to be requested, the voice information is requested by the process of specifying a server that holds information corresponding to the attribute obtained from the sentenced text information and the process of requesting the voice information. However, if it is determined that voice information for determining the attribute of the phrased text information cannot be obtained, the temporary storage processing is performed. Processing for specifying a server that holds information corresponding to attributes that are estimated based on the correspondence between the text information segment in the past is stored, and an attribute obtained from the text information segmented in the past And realizing the above.

The program according to the present invention is the program according to claim 7, wherein when searching for information corresponding to a predetermined attribute using the server specified by the specified process, the phrased text information is searched. If it is determined by the process for determining whether or not all the required items for the search are satisfied and the determined text information does not satisfy all the required items for performing the search, If it is determined that the segmented text information satisfies all of the required items for performing the search by the process of requesting voice information for supplementing the required non-required items and the process of determining, the specified Even if the voice information is requested by the process of starting a search using a server and the process of requesting the voice information, If it is determined that the voice information for satisfying all the required items for executing the search cannot be obtained, the text information segmented in the past and the past segmented text information stored by the temporary storage processing And a process of starting a search using a server having information corresponding to an attribute estimated based on a correspondence relationship with the attribute obtained from the text information .

The program according to the present invention is the program according to claim 8, wherein, as a result of the search being started by the process of starting the search, an information amount of information corresponding to a predetermined attribute is greater than or equal to a predetermined threshold value. If it is determined that the information amount of the information corresponding to the predetermined attribute is greater than or equal to the predetermined threshold by the process of determining whether or not and the determining process, the information amount of the information corresponding to the predetermined attribute is If it is determined that the amount of information corresponding to the predetermined attribute is less than the predetermined threshold by the process of requesting voice information for narrowing down below the predetermined threshold and the determination, the search is performed. And a process of outputting the obtained search result .

  According to the present invention, even if an unreasonable answer is given to a question required for continuing the search, it is possible to continue the search by following the intention of the inappropriate answer. Information processing apparatus, control method, and program can be obtained.

It is a schematic block diagram explaining the structure of the information processing apparatus in embodiment of this invention. It is a schematic block diagram explaining the structure of the principal part of the information processing apparatus in embodiment of this invention. It is a functional block diagram explaining the software function of the information processing apparatus in the embodiment of the present invention. It is a figure explaining the screen display at the time of starting of the information processing apparatus in the embodiment of the present invention (the 1). It is a figure explaining the screen display (the 2) at the time of starting of the information processing apparatus in embodiment of this invention. It is a figure explaining the screen display (the 3) at the time of starting of the information processing apparatus in embodiment of this invention. It is a figure explaining the specific operation | movement (the 1) of the information processing apparatus in embodiment of this invention. It is a figure explaining the specific operation | movement (the 2) of the information processing apparatus in embodiment of this invention. It is a figure explaining the specific operation | movement (the 3) of the information processing apparatus in embodiment of this invention. It is a flowchart explaining operation | movement of the information processing apparatus in embodiment of this invention. It is a figure explaining the screen display when the user interface of the information processing apparatus in embodiment of this invention is minimized.

  Next, embodiments for carrying out the present invention will be described in detail with reference to the drawings. In addition, in each figure, the same code | symbol is attached | subjected to the part which is the same or it corresponds, The duplication description is simplified thru | or abbreviate | omitted suitably. The contents of the present invention will be briefly described. Means for converting input speech information into text information, means for segmenting the converted text information, and each of a plurality of externally provided servers have any attribute. A database that stores in advance information indicating whether or not the corresponding information is held, an attribute obtained from the segmented text information based on the information stored in the database, and a server that holds the information corresponding to the attribute; Obtained by searching, means for temporarily storing the correspondence between segmented text information and attributes obtained from the text information, means for retrieving information corresponding to the attributes from the associated server, and Means for determining whether the information amount of information corresponding to the given attribute is equal to or greater than a predetermined threshold, and determining that the information amount is equal to or greater than the predetermined threshold And means for requesting speech information for narrowing down the amount of information, and even if speech information that cannot narrow down the amount of information is acquired, the speech information is converted based on the correspondence and obtained from segmented text information Means for identifying the server holding the information corresponding to the attribute, and searching for information having a predetermined amount of information corresponding to the attribute from the server. Even if an unreasonable answer is given to a question, the search can be continued following the intention of the unreasonable answer.

  First, the configuration of the information processing apparatus according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is a schematic block diagram illustrating the configuration of an information processing apparatus according to an embodiment of the present invention. Referring to FIG. 1, an information processing apparatus 100 according to an embodiment of the present invention is an information processing apparatus using an electronic information terminal, a PDA, a notebook PC, a tablet PC, or the like as a specific example.

  1, an information processing apparatus (hereinafter also referred to as a personal computer (PC)) 100 according to an embodiment of the present invention includes a microphone 101, a voice recognition unit 102, a ROM (Read Only Memory) 103, and a RAM (Random). (Access Memory) 104, speaker 105, voice synthesis unit 106, CPU (Central Processing Unit) 107, display unit 108, input unit 109, power supply unit 110, network connection unit 111, HDD (Hard Disk Drive) 112).

  The microphone 101 converts the user's voice into voice data (electrical signal). The voice recognition unit 102 recognizes the user's voice converted into voice data by the microphone 101. The ROM 103 stores a program for controlling the operation of the entire PC 100. The RAM 104 is a storage area where the program stored in the ROM 103 is expanded. The speaker 105 converts audio data output from the concierge of the PC 100 described later into audio. The voice synthesizer 106 synthesizes voice data output from the concierge of the PC 100 so that it is converted into desired voice. The CPU 107 controls the operation of the entire PC 100, loads a control program stored in the ROM 103, and develops various data obtained by the operation of the PC 100 in the RAM 104.

  The display unit 108 is a display screen composed of an LCD (Liquid Crystal Display) or the like, and displays a result of an application executed by the PC 100 or a TV program received by a TV tuner (not shown). Configure the device. The input unit 109 is an input device for the PC 100, such as a keyboard, a mouse, a touch panel, etc., which is used by the user to give instructions to the PC 100. The power supply unit 110 supplies AC (Alternative Current: AC) or DC (Direct Current: DC) power to the PC 100. The network connection unit 111 is connected to a network network (not shown) typified by the Internet, and serves as an interface with the network network. The HDD 112 stores application software of the PC 100 and records content such as a TV program received by a TV tuner (not shown). The display unit 108 and the input unit 109 may be a touch panel display in which an LCD and a touch panel are integrated. In this case, instead of an input device such as a keyboard or a mouse, an operation such as data input or command input can be performed by directly writing a character by bringing a finger or a stylus pen (not shown) into contact with the touch panel display.

  Next, the configuration of the main part of the information processing apparatus according to the embodiment of the present invention will be described with reference to FIG. FIG. 2 is a schematic block diagram illustrating the configuration of the main part of the information processing apparatus according to the embodiment of the present invention.

  In FIG. 2, the PC 100 according to the embodiment of the present invention converts the user's voice input from the microphone 201 into voice data (electrical signal), which is interpreted by the voice signal interpretation unit 202, and the result is Recognized by the client-type speech recognition unit 203. The client type voice recognition unit 203 passes the recognized voice data to the client application unit 204.

  The client application unit 204 checks whether an answer to the inquiry from the user is stored in the local content unit 208 in the offline state. If the answer is stored in the local content unit 208, the inquiry from the user Is output from the speaker 211 via the text reading unit 209 and the client-type speech synthesizer 210, which will be described later.

  If the answer to the inquiry from the user is not stored in the local content unit 208, it means that the PC 100 alone does not have an answer, so the network connection unit 206 connected to the network network 207 such as the Internet is used. An answer to the inquiry from the user is searched using a search engine or the like on the Internet, and the obtained search result is output as voice from the speaker 211 via the text reading unit 209 and the client type speech synthesizer 210.

  The client application unit 204 converts the answer obtained from the local content unit 208 or the network 207 into text (character) data and passes it to the text reading unit 209. The text reading unit 209 reads the text data and passes it to the client-type speech synthesizer 210. The client-type voice synthesizer 210 synthesizes voice data with voice data that can be recognized by a human and passes the voice data to the speaker 211. The speaker 211 converts audio data (electrical signal) into audio. In addition, in accordance with the sound emitted from the speaker 211, detailed information related to the sound is displayed on the display unit.

  Next, the software function of the information processing apparatus in the embodiment of the present invention will be described. FIG. 3 is a functional block diagram illustrating software functions of the information processing apparatus according to the embodiment of this invention.

  As shown in FIG. 3, the PC 100 according to the embodiment of the present invention is connected to a plurality of servers 701, 702,..., 70N provided outside via a network 313. Each of the servers 701, 702,..., 70N has information corresponding to various attributes described later.

  Then, the PC 100 receives a microphone 301 for inputting a voice uttered by the user, a voice input input from the microphone 301 as a voice signal (voice information), amplifying the voice input unit 302, and the voice input unit 302. The input speech information is converted into text information, and the text analysis unit 303 for segmenting the converted text information for each predetermined syllable, and the attribute of the segmented text information is determined to correspond to information. And an element attribute determination unit 304 that acquires an attribute from the segmented text information. The element attribute determination unit 304 also has a function of temporarily storing the correspondence between segmented text information and attributes obtained from the text information.

  Furthermore, the PC 100 stores in advance a server API (Application Programming Interface) database 307 that stores information indicating which of the servers 701, 702,..., 70N has information corresponding to what attribute. And the attribute obtained from the segmented text information corresponds to the attribute held by any of the servers 701, 702,..., 70N having information corresponding to various attributes. A server specifying unit 305 that specifies whether the information is associated with the server, and a search unit that accesses the specified server and searches for information corresponding to the attribute from the server corresponding to the attribute obtained from the segmented text information 306.

  Then, the PC 100 generates a sentence generation unit 310 that generates the result searched by the search unit 306 as a sentence (text information), and displays text information (such as a search result) generated by the sentence generation unit 310 on the display unit 205 (FIG. 2). ), A voice output unit 311 for converting a search result obtained from the text information into a voice signal (voice information) to be output from the speaker 312, and a voice converted by the voice output unit 311. And a speaker 312 for outputting a signal.

  Further, as will be described later, one attribute may be obtained from a plurality of pieces of text information similar to each other as well as a certain piece of text information. Therefore, even if the segmented text information is a plurality of pieces of text information similar to each other, it is required to obtain the same attribute. Therefore, the PC 100 has a term database 308, and the term database 308 holds in advance a synonym dictionary in which similar text information is collected.

  Next, screen display at the time of starting the information processing apparatus according to the embodiment of the present invention will be described. 4 to 6 are diagrams for explaining screen display when the information processing apparatus is activated in the embodiment of the present invention.

  The concierge 400, 500, 600 of the PC 100 according to the embodiment of the present invention can make various greetings according to the time zone and day of the week at the time of activation. For example, when the startup is in the morning time zone, as shown in FIG. 4, the concierge 400 displays related information on the display unit 205 (FIG. 2) as it says “Good morning!” . Similarly, if the daytime time zone during start-up, as shown in FIG. 5, concierge 500, say "Hello!", As shown in FIG. 6 if the time zone of the night, concierge 600 Say "Good evening!" In addition to the time zone, utterances according to the days of the week such as weekdays and holidays can be performed.

  Next, a specific operation of the information processing apparatus according to the embodiment of the present invention will be described. 7 to 9 are diagrams illustrating specific operations of the information processing apparatus according to the embodiment of the present invention.

  When the PC 100 is activated as shown in FIG. 4 to FIG. 6, when the user asks the PC 100 for information he / she wants to know and information to search for, the PC 100 answers the question. For example, as shown in FIG. 7, when the user 800 asks the PC 100 “Charlie! I want to open a girls' association in Shibuya”, the PC 100 displays the input voice information as “Joshikai Oshibu Yadehiraki”. A server API database that converts information into text information called “Thai” and segments information into “Joshikai”, “Shibuya”, and “Hirakitai”, and stores information corresponding to attributes obtained from the segmented text information. It specifies for every text information based on 307 (FIG. 3).

  However, since the PC 100 cannot specify the server that holds the information corresponding to the attribute of the text information “Joshikai” (it does not exist in the server API database 307), the PC100 specifies the attribute of the text information “Joshikai”. For this reason, the user 800 is asked an additional question, “Where there was a close one (party / banquet, enjoy with friends / colleagues / family)? Then, the user 800 inputs the voice information “Friend!” So that the PC 100 can specify the attribute of the text information “Joshikai”.

  The important thing in the exchange of this question and answer is that the PC 100 responds to the voice of “Charlie” in “Charlie! I want to open a girls' association in Shibuya”, which is voice information issued by the user 800, The voice uttered following this voice is recognized, and the dialogue with the user 800 is started. That is, the PC 100 converts this into text information based on the voice information issued from the user 800, and a predetermined keyword (a keyword “Charlie” in this embodiment) is included in the converted text information. If it is determined whether or not a keyword is included, a dialogue with the user 800 is started. After this keyword, voice information (question) issued from the user 800 is converted into predetermined text information. Then, a command requested by the user (for example, an answer to a question uttered by the user) specified based on the converted predetermined text information is executed. It is assumed that the user determines in advance what this keyword should be.

  In the above example, the PC 100 reacts to specific audio information issued from the user 800, recognizes the audio information issued following this audio information as text information, and executes a predetermined command. The PC 100 recognizes the text information by the voice recognition unit 102 (FIG. 1), and the trigger for executing the predetermined command is not limited to the specific voice information issued from the user 800, but by the voice recognition unit 102. Of course, any sound source may be used as long as it is voice information capable of recognizing text information.

  Since the PC 100 cannot identify the server that holds the information corresponding to the attribute obtained from the “girls' association” that is the content of the question from the user 800, that is, the text information “Joshikai”, the search using the server is not performed. I can't do it. Therefore, in order to specify the attribute of the text information “Joshikai”, the PC100 has an additional question, “Why did you have something close (party / banquet, enjoy with friends / colleagues / family)? In order to identify what attribute the text information “Joshikai” has, the user 800 is re-listened to request voice input.

  Then, at a stage where the user 800 utters a voice “Friend!” So that the text information “Joshikai” can be identified, what attribute the text information “Joshikai” has? Servers that have information corresponding to the attribute of a party to enjoy with "friends" again because it is understood that the "girls' association" has the attribute of a party to enjoy with "friends" Is specified. Then, as shown in FIG. 8, “Such a shop has been found” is replied, and the list is displayed on the display unit 205 (FIG. 2).

  However, as a result of searching using a server having information corresponding to the attribute of a party to enjoy with friends, there are a plurality of candidate shops. That is, since the amount of information obtained by the search is greater than a predetermined threshold value, the PC 100 asks the user 800 “How many dishes should I have?” To narrow down the amount of information. Do reverse questions dynamically. In short, as a result of searching based on the attribute of a party to be enjoyed with friends issued by the user 800, there are many search results, and the final candidates are narrowed down from these many search results. In order to narrow down the amount of information to be less than a predetermined threshold, the PC 100 makes an inverse question to the user 800 “What dish should I cook?” And requests audio information to narrow down the amount of information. is there.

  Then, as shown in FIG. 9, the user 800 is obtained by searching for an answer “Italian food is about 4000 yen”, that is, “how many dishes should I have?” Requested by the PC 100. Since the amount of information is equal to or greater than a predetermined threshold value, the user 800 requests a keyword necessary for narrowing down the amount of information, whereas the user 800 adds “Italian cuisine” to the voice. “Sound about 4000 yen”. In other words, what is the required keyword, such as adding a keyword “about 4000 yen” to a budget to a keyword related to the type of cuisine other than the keyword “restaurant” that is commonly attached to a lot of shop information? Keywords related to free conditions that are not directly related are also issued. And even if the keyword about the budget is added to the keyword about the kind of dish, the PC 100 analyzes the keyword issued by the user 800 and says, “This kind of shop is found. And a list of shops is displayed on the display unit 205 (FIG. 2).

  In the example of FIG. 9, the user 800 issues a keyword related to the type of cooking and a keyword related to the budget, but the user 800 does not say “Italian cuisine”, which is a keyword related to the type of cooking. Even if it is a keyword related to the budget, “It is about 4000 yen”, the PC 100 replies “What kind of shop was found. A list of shops is displayed in 205 (FIG. 2).

  The PC 100 according to this embodiment is installed with a software application program for the voice interaction system. However, it is possible to select in advance whether the software application program is set to the resident mode or the non-resident mode. When the resident mode is selected, it starts from the start-up from the next start-up. Furthermore, in the resident mode, the sound is constantly monitored to immediately determine whether it is noise or sound.

  In the resident mode, only the presence / absence of a predetermined keyword such as “Charlie” is recognized from the speech-recognized text information, and when the predetermined keyword is recognized, the speech-recognized text is stored. To move to the routine to analyze the context.

  In the PC 100 according to the present embodiment, a single response and a time during which the result continues, specifically, when the current topic is related to the weather, the general response to the weather and a search result related to the weather are displayed. The concept of a standby time consisting of a predetermined time is used as the remaining time. This waiting time is determined when the user 800 takes some action, for example, when the user 800 asks a question to change the topic from the one related to the weather to another topic, or when the user 800 requests it. For example, when the user 800 asks a question different from the weather-related topic, and the PC 100 responds to the question, the user 800 resets at any timing. The waiting time is immediately counted immediately after a certain search result is answered to the user 800.

  During this waiting time, all information, that is, all information exchanged with the user 800, specifically, a keyword before the waiting time elapses, and a search performed based on the keyword. , And search results are stored and used as history information. Then, when a new question and / or command is issued from the user 800 within the waiting time, the retained history information is used. That is, a matter common to the history information held is extracted, and a search is performed as a keyword together with a matter specifying the new question and / or command. When the standby time elapses, the history such as the keyword, the search performed based on the keyword and the search result held before the standby time elapses is deleted.

  When this standby time has elapsed, the PC 100 releases a session (connection) with a server on the network 207 connected via the network connection unit 206 (FIG. 2). At this time, the information obtained from the server that has been stored in the PC 100 is discarded. In order to indicate that the standby time has passed (the mode of the PC 100 has been changed) so that the user 800 does not interfere with other operations using the PC 100, a window of the display unit 108 (FIG. 1) of the PC 100 is displayed. The mode (user interface) is shifted to a compact window mode as shown in FIG. FIG. 11 is a diagram illustrating screen display when the user interface of the information processing apparatus in the embodiment of the present invention is minimized.

  Then, the PC 100 waits for the next command issued from the user 800. In this state, since the standby time for holding the keyword, the search performed based on the keyword, and the history information of the search result has already passed, the predetermined keyword (this embodiment) is added to the voice information emitted from the user 800. In the case of the form, it is determined whether or not the keyword “Charlie” is included. If it is determined that the keyword is included, the question included in the text information recognized from the speech information input from the user 800 is The search is performed as a keyword, and the search result is output.

  In addition to the recognition of the predetermined keyword (a wake-up word to be described later, “Charlie” in the present embodiment) as an opportunity to wake up the PC 100 after the standby time has elapsed, for example, it is displayed on the display unit 205 (FIG. 2). It goes without saying that any method may be used such as clicking a predetermined button with the mouse pointer, pressing a hardware button of the PC 100, or recognizing a voiceprint by a voice uttered by the user 800.

  Then, if a question issued from the user 800 can be answered with the information stored in the local content unit 208, the question can be answered without connecting to the network 207 and need to be accessed to the network 207. For example, the session is connected, and the answer to the question is searched in a new state, that is, in a state where there is no history information.

  In this way, as long as the PC 100 is in an activated state, the user can then perform normal work (reading, etc.) that is currently being performed, that is, work that is not related to the PC 100. Even if you use the PC 100 or do something else, if you ask the PC 100 in a natural way without touching the PC 100, the PC 100 will answer. Even if there are a plurality of candidates, the PC 100 guides you. Therefore, it is possible to obtain information easily and comfortably by voice alone in a natural conversation without inputting all keywords for search from the beginning of the conversation.

  As described above, the PC 100 has the local content unit 208 (FIG. 2) in an offline state, and whether or not the answer to the question made by the user 800 is stored in the local content unit 208. If the content is stored in the local content unit 208, a response is made from the speaker 211 (FIG. 2) to the user without connecting to the network 207 via the network connection unit 206 (FIG. 2). . In short, if the network network 207 is connected and searched as necessary, and the response is completed with the information stored in the local content unit 208, the network network 207 is not connected.

  Next, in order to identify what attribute the question made by the user 800 is, the PC 100 makes an additional question, while the PC 100 can identify what attribute the question has. Answer again, and the PC 100 specifies what attribute the question has, and as a result of the search, there are a plurality of candidates, and keywords for narrowing down the final candidates from the plurality of candidates are selected. The requesting PC 100 presents a search result including a plurality of attributes derived based on the keyword (“Such a shop has been found. How many dishes do you want to cook?”), And the user 800 has certain specific attributes. When requesting a keyword necessary for narrowing down the search result consisting of the user 800, the keyword consisting of a specific attribute is changed from another attribute to the keyword. Even if a keyword consisting of another attribute is not mentioned without saying a keyword consisting of a certain attribute, the PC 100 does not use the attribute said by the user 800. The contents of specific speech analysis performed by the PC 100, such as answering a search result based on the keyword, will be described.

  From the search results including a plurality of attributes, the PC 100 requests the user 800 for a keyword necessary for narrowing down the search results including a specific attribute, and the user 800 changes the keyword to a keyword including a specific attribute. When a keyword consisting of another attribute is added, or when a keyword consisting of another attribute is said without saying a keyword consisting of a specific attribute, the PC 100 sends all the messages issued by the user 800 Keyword analysis for the words. This is the same even when the PC 100 requests the user 800 to select one of a plurality of search results.

At this time, the correspondence between the text information segmented so far temporarily stored in the element attribute determination unit 304 (FIG. 3) and the attribute obtained from the text information is referred to. -ing That is, all the words uttered by the user 800 are segmented, and the segmented text information is temporarily stored in the element attribute determination unit 304 .
Based on the correspondence between the text information segmented so far and the attribute obtained from this text information, it is specified what attribute it corresponds to, and information corresponding to this specified attribute is present. The server is identified, and information is retrieved from the identified server.

  Accordingly, when the user 800 adds a keyword having another attribute to a keyword having a certain attribute, or does not say a keyword having a certain attribute, the keyword having another attribute is used. (In the above example, if you issued a keyword related to the type of dish and a keyword related to the budget, such as “Italian food is about 4000 yen,” or “It is about 4000 yen.” Even if a keyword related to the budget is issued), the keyword analysis is performed on the spoken words, such as the keyword of the budget (attribute) = 4000 yen, and the condition corresponding to the attribute of the keyword is set. It can be buried. Furthermore, since the PC 100 performs keyword analysis for all words uttered by the user 800, in the case of the above example, even if a topic is suddenly swung about "weather" Can do it.

  In this way, in response to a keyword request for narrowing a search result consisting of a certain attribute among search results including a plurality of attributes, a keyword consisting of another attribute is added to a keyword consisting of a specific attribute. Even if it says, or even if it says a keyword consisting of another attribute without saying a keyword consisting of a specific attribute, the PC 100 keeps on following the search based on the intention of the answer It can be done.

  Next, the operation of the information processing apparatus in the embodiment of the present invention will be described. FIG. 10 is a flowchart for explaining the operation of the information processing apparatus according to the embodiment of the present invention.

  In FIG. 10, in the process of step (hereinafter referred to as “S”) 1001, first, sound is input from the microphone 301 (FIG. 3) of the PC 100. The input voice is handled as a voice signal (voice information) in the voice input unit 302, and after amplification or the like, the process proceeds to S1002. In the processing of S1002, the text analysis unit 303 converts the speech information into text information and segments and analyzes it for each predetermined syllable. In the process of S1003, the element attribute determination unit 304 determines what attribute the segmented text information corresponds to, and the process proceeds to S1004.

  In the process of S1004, by referring to the server API database 307 (FIG. 3), the attributes obtained from the segmented text information do not correspond to the attributes held by the servers 701, 702,. It is determined whether there is an element, that is, an element (text information) whose attribute is not fixed. If it is determined that there is an element whose attribute is not fixed (S1004: YES), the process proceeds to S1010. If it is determined that there is no element whose attribute is not fixed (S1004: NO), the process proceeds to S1005.

  In the process of S1010, an inquiry is made to request audio information for determining the attribute of the segmented text information. When the requested voice information is input, the process of S1001 is performed again. When there is no element whose attribute is not fixed (S1004: NO), or as a result of converting the voice information requested in the process of S1010 into text information, an attribute can be obtained from the text information. When there is not (S1004: NO), the server specifying unit 305 (FIG. 3) specifies a server that holds information corresponding to the attribute obtained from the text information in the process of S1005.

  In the process of S1006, when the search is executed using the server specified in the process of S1005, whether the segmented text information satisfies all the essential items (essential requirements) for executing the search (the missing items are Whether or not) is determined. If it is determined that there is a missing item (S1006: YES), the process proceeds to S1011. If it is determined that there is no missing item (S1006: NO), the process proceeds to S1007.

  In the process of S1011, a request for supplementing the deficient item, that is, input of voice information is requested. When the requested voice information is input, the process of S1001 is performed again. When it is determined that there is no missing item (S1006: NO), or the voice information requested in the processing of S1011 is converted into text information, the missing item for search performed based on the attribute obtained from the text information is supplemented. If it is determined that there is no missing item (S1006: NO), in the process of S1007, the search using the server specified in the process of S1005 is started.

  In the process of S1008, as a result of the search performed in the process of S1007, whether the information amount of the search result (information corresponding to a certain attribute) is equal to or greater than a predetermined threshold (the information amount of the search result is less than the predetermined threshold). Is judged. If it is determined that the value is equal to or greater than the predetermined threshold (less than the predetermined threshold) (S1008: NO), the process proceeds to S1012. If it is determined that the value is less than the predetermined threshold (S1008: YES), the process of S1009 is performed. Migrate to The predetermined threshold value can be set to an arbitrary value according to the attribute to be searched.

  In the process of S1012, a request for narrowing the information amount of the search result (information corresponding to a certain attribute) to less than a predetermined threshold, that is, input of voice information is requested. When the requested voice information is input, the process of S1001 is performed again. When it is determined that the information amount of the search result is less than the predetermined threshold (S1008: YES), or the speech information requested in the processing of S1012 is converted into text information, and based on the attribute obtained from the text information When it is determined that the information amount of the search result to be performed is less than the predetermined threshold (S1008: YES), the process proceeds to S1009. In the process of S1009, the search result is output from the speaker 211 (FIG. 2) and displayed on the display unit 205 (FIG. 2).

  In the above embodiment, when the information amount of the search result is equal to or larger than the predetermined threshold in the process of S1008 in FIG. 10 (S1008: NO), the search is performed in response to the voice information request made in the process of S1012. Although a case has been described where audio information for narrowing down the amount of information to be less than a predetermined threshold has not been obtained, the embodiment of the present invention is not limited to this case.

That is, in the processing of S1004, by referring to the server API database 307 (FIG. 3), among the attributes obtained from the segmented text information, the attributes held by the servers 701, 702,. If it is determined that there is a non-corresponding element (S1004: YES), the attribute of the segmented text information is set in response to the voice information request for determining the attribute of the segmented text information made in the process of S1010. Even when voice information for confirmation is not obtained, the text information segmented so far temporarily stored in the element attribute determination unit 3 04 (FIG. 3) and the text information obtained from the text information are obtained. By referring to the correspondence relationship with the attribute, the voice information emitted from the user 800 is converted into text information, segmented, and the segmented text information is converted. But those which are temporarily stored in element attribute determination unit 3 04, a text information segmented so far, based on the correspondence between the attribute obtained from the text information corresponds to any attribute A server corresponding to the estimated attribute is identified and information is retrieved from the identified server.

In the process of S1006, when the search is executed using the server specified in the process of S1005, the segmented text information does not satisfy all the essential items (essential requirements) for executing the search (S1006). : YES), element attribute determination is performed even when voice information for supplementing the missing item is not obtained in response to the voice information request for supplementing the missing item made in the processing of S1011. Audio information issued from the user 800 with reference to the correspondence between the text information segmented so far and the attribute obtained from the text information, which is temporarily stored in the section 3 04 (FIG. 3) the converted to text information, and segmented, the segmented text information are temporarily stored in element attribute determination unit 3 04, which is segmented so far text Based on the correspondence relationship between the information and the attribute obtained from the text information, it is estimated what attribute it corresponds to, the server corresponding to the estimated attribute is specified, and the specified server's Searching for information from within.

  In addition, each operation | movement of each functional block which comprises the information processing apparatus 100 in embodiment of this invention shown in FIG. 10 can also be made to perform the program on a computer. That is, the processing is performed by the CPU 107 of the information processing apparatus 100 loading a program stored in a storage unit including the ROM 103, the RAM 104, and the like, and sequentially executing each processing step of the program.

  As described above, according to the present invention, means for converting input speech information into text information, means for segmenting the converted text information, and each of a plurality of servers provided outside, A database that stores in advance information on what attribute information is held, an attribute obtained from segmented text information based on the information stored in the database, and information corresponding to the attribute Means for associating each server with each other, means for temporarily storing the correspondence between the segmented text information and the attribute obtained from the text information, means for retrieving information corresponding to the attribute from the associated server, Means for determining whether or not the information amount of information corresponding to the attribute obtained by the search is greater than or equal to a predetermined threshold, and the information amount is greater than or equal to the predetermined threshold If it is determined, the voice information for narrowing down the amount of information and the voice information that cannot narrow down the amount of information are acquired, but the voice information is converted based on the correspondence and obtained from the segmented text information. And a means for searching for information having a predetermined amount of information corresponding to the attribute from the server, by identifying a server that holds information corresponding to the attribute to be required to continue the search. Even if an unreasonable answer is given to the question, the search can be continued following the intention of the unreasonable answer.

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments thereof, various modifications and changes can be made to these embodiments without departing from the broader spirit and scope of the invention as defined in the claims. is there.

100 Information processing equipment (PC)
101, 201, 301 Microphone 102 Voice recognition unit 103 ROM
104 RAM
105, 211 Speaker 106 Speech synthesis unit 107 CPU
108 Display Unit 109 Input Unit 110 Power Supply Unit 111 Network Connection Unit 112 HDD
202 Speech signal interpretation unit 203 Client type speech recognition unit 204 Client application unit 205 Display unit 206 Network connection unit 207, 313 Network 208 Local content unit 209 Text reading unit 210 Client type speech synthesis unit 211, 312 Speaker 302 Speech input unit 303 Text Analysis unit 304 Element attribute determination unit 305 Server identification unit 306 Search unit 307 Server API database 308 Term database 309 Display unit 310 Text generation unit 311 Audio output unit 400, 500, 600, 900 Concierge 701, 702, ..., 70N server 800 users

Claims (9)

Means for converting input voice information into text information;
Means for segmenting the converted text information;
A database that stores in advance information on what attributes each of the plurality of servers provided outside has, and
Means for associating attributes obtained from the segmented text information with a server having information corresponding to the attributes based on the information stored in the database;
Means for temporarily storing a correspondence relationship between the segmented text information and an attribute obtained from the text information ,
When searching for information corresponding to a predetermined attribute from the associated server , it is determined what attribute the phrased text information corresponds to,
If it is determined that there is an element that does not determine the attribute in the sentenced text information, the voice information for determining the attribute is requested,
If it is determined that there is no element that does not determine the attribute in the phrased text information, a server having information corresponding to the attribute obtained from the phrased text information is identified,
If it is determined that the speech information for determining the attribute of the segmented text information cannot be obtained even if the speech information is requested, the previously segmented text information stored in the temporary storage unit and An information processing apparatus that identifies a server that holds information corresponding to an attribute estimated based on a correspondence relationship with an attribute obtained from text information segmented in the past . When searching for information corresponding to a predetermined attribute using the specified server, it is determined whether or not the phrased text information satisfies all required items for performing the search, and the phrased text is determined. If it is determined that the information does not satisfy all the required items for performing the search, the audio information for supplementing the required items that are not satisfied is requested,
When it is determined that the segmented text information satisfies all the required items for performing the search, the search is started using the specified server,
If it is determined that even if the speech information is requested, the speech information for satisfying all the required items for performing the search cannot be obtained, the past text stored in the temporary storage means To start a search using a server having information corresponding to an attribute estimated based on a correspondence relationship between the text information segmented in the past and the attribute obtained from the text information segmented in the past. The information processing apparatus according to claim 1 . As a result of the search being started, it is determined whether the information amount of information corresponding to the predetermined attribute is greater than or equal to a predetermined threshold, and the information amount of information corresponding to the predetermined attribute is greater than or equal to the predetermined threshold. If it is determined that there is an audio information for narrowing the information amount of the information corresponding to the predetermined attribute to less than the predetermined threshold, the information amount of the information corresponding to the predetermined attribute is less than the predetermined threshold 3. The information processing apparatus according to claim 2, wherein if it is determined that there is a search result, a search result obtained by executing the search is output . A method of controlling an information processing apparatus having a database that stores in advance information on what attribute each of a plurality of servers provided outside has.
Converting the input speech information into text information;
Segmenting the converted text information;
Correlating the attribute obtained from the segmented text information with a server having information corresponding to the attribute, based on the information stored in the database;
Temporarily storing the correspondence between the segmented text information and the attribute obtained from the text information;
A step of determining what attribute the text information segmented is information corresponding to when searching for information corresponding to a predetermined attribute from the server associated by the associating step ;
Determining whether there is an element whose attribute is not fixed in the sentenced text information;
If it is determined in the determining step that there is an element that does not determine the attribute in the phrased text information, requesting voice information for determining the attribute; and
If it is determined in the determining step that there is no element whose attribute is not determined in the phrased text information, a step of identifying a server that holds information corresponding to the attribute obtained from the phrased text information; ,
If it is determined that the voice information for determining the attribute of the phrased text information is not obtained even if the voice information is requested by the step of requesting the voice information, the voice information is stored by the step of temporarily storing. Identifying a server having information corresponding to an attribute estimated based on a correspondence relationship between text information segmented in the past and attributes obtained from the text information segmented in the past ;
The control method characterized by including. A step of determining whether or not the phrased text information satisfies all essential items for performing a search when searching for information corresponding to a predetermined attribute using the server specified by the specifying step; ,
When the determining step determines that the phrased text information does not satisfy all the required items for performing a search, requesting voice information for supplementing the unrequired required items;
When the determining step determines that the phrased text information satisfies all the required items for performing a search, starting the search using the specified server;
Even if the voice information is requested by the step of requesting the voice information, the temporary storage is performed when it is determined that the phrased text information does not provide voice information for satisfying all necessary items for performing the search. A server that holds information corresponding to the attribute estimated based on the correspondence between the text information segmented in the past stored in the process and the attribute obtained from the text information segmented in the past Using the process to start the search ,
The control method according to claim 4, further comprising: Determining whether the amount of information corresponding to a predetermined attribute is equal to or greater than a predetermined threshold as a result of the search being started by the step of starting the search;
When the determining step determines that the information amount of the information corresponding to the predetermined attribute is equal to or greater than the predetermined threshold, the information amount of the information corresponding to the predetermined attribute is reduced to less than the predetermined threshold. Requesting voice information;
When the determining step determines that the amount of information corresponding to the predetermined attribute is less than the predetermined threshold, outputting a search result obtained by executing a search ;
The control method according to claim 5, further comprising: A computer of an information processing apparatus having a database that stores in advance information on what attribute each of a plurality of servers provided outside possesses information corresponding to,
A process for converting input voice information into text information;
Processing to segment the converted text information;
Based on the information stored in the database, a process of associating the attribute obtained from the segmented text information with a server that holds information corresponding to the attribute;
A process of temporarily storing the correspondence between the segmented text information and the attribute obtained from the text information;
A process of determining what attribute the text information segmented is information corresponding to when retrieving information corresponding to a predetermined attribute from the server associated by the associating process ;
A process of determining whether there is an element whose attribute is not fixed in the sentenced text information;
When determining that there is an element that does not determine the attribute in the sentenced text information by the determining process, a process of requesting voice information necessary to determine the attribute;
A process for identifying a server having information corresponding to an attribute obtained from the phrased text information when it is determined that there is no element whose attribute is not determined in the phrased text information by the judgment process; ,
Even if the voice information is requested by the process for requesting the voice information, if it is determined that the voice information for determining the attribute of the phrased text information cannot be obtained, the voice information is saved by the temporary saving process. A process of identifying a server having information corresponding to an attribute estimated based on a correspondence relationship between text information segmented in the past and attributes obtained from the text information segmented in the past ;
A program to realize A process of determining whether or not the phrased text information satisfies all essential items for performing a search when searching for information corresponding to a predetermined attribute using a server specified by the specified process; ,
If it is determined by the process to determine that the phrased text information does not satisfy all the required items for performing a search, a process of requesting voice information for supplementing the required items that are not satisfied;
When it is determined that the segmented text information satisfies all the required items for performing a search by the determining process, a process of starting a search using the specified server;
Even if the voice information is requested by the process of requesting the voice information, the temporary storage is performed when it is determined that the phrased text information cannot obtain the voice information for satisfying all the essential items for executing the search. A server having information corresponding to the attribute estimated based on the correspondence between the text information segmented in the past stored by the processing and the attribute obtained from the text information segmented in the past Using the process to start the search ,
The program of Claim 7 for implement | achieving. A process of determining whether or not the amount of information corresponding to a predetermined attribute is equal to or greater than a predetermined threshold as a result of the search being started by the process of starting the search;
If it is determined that the information amount of information corresponding to the predetermined attribute is greater than or equal to the predetermined threshold by the determining process, the information amount of information corresponding to the predetermined attribute is reduced to less than the predetermined threshold. Processing to request voice information;
A process of outputting a search result obtained by executing a search when determining that the amount of information corresponding to the predetermined attribute is less than the predetermined threshold by the determining process;
The program of Claim 8 for implement | achieving.

Images