CN104871240A

CN104871240A - Information processing device, information processing method and program

Info

Publication number: CN104871240A
Application number: CN201380067142.3A
Authority: CN
Inventors: 武村知昭; 桝永慎哉; 藤田孝次; 石绵克利; 池永健一; 楠元克敏
Original assignee: Sony Corp
Current assignee: Sony Corp
Priority date: 2012-12-28
Filing date: 2013-11-20
Publication date: 2015-08-26
Also published as: US10424291B2; US20230267920A1; BR112015014830A2; US11676578B2; US20210358480A1; US20150310854A1; EP2940683A4; WO2014103568A1; EP2940683A1; US20190348024A1; EP3896596A1; JP6603754B2; CN110889265B; CN110889265A; US11100919B2; JP2018170015A; JPWO2014103568A1; BR112015014830B1

Abstract

The invention provides an information processing device that includes: an analysis part that analyzes character strings that show an utterance content obtained as a result of speech recognition; and a display control part that causes a display screen to display the character strings that show the utterance content and the result of the analysis.

Description

Messaging device, information processing method and program

Technical field

The disclosure relates to messaging device, information processing method and program.

Background technology

Manufacture and a kind ofly can identify that voice are to perform the equipment of process.Also developed a kind of technology using phonetic entry.Such as, as the technology using phonetic entry and another input, there is the technology described in patent documentation 1 below.

Reference listing

Patent documentation

Patent documentation 1:JP 2001-166914A

Summary of the invention

Technical matters

Such as, can identify that voice are to perform the equipment that is pre-existing in of process (hereinafter, also be called for short " being pre-existing in equipment ") in, such as, use the situation of the technology described in patent documentation 1, user does not know that part of the content of the speech be identified for performing process.Therefore, when use is pre-existing in equipment, there is the possibility of the situation reducing user's usability, such as, the situation of " behavior performed by device responds speech utterance can not be transferred to user satisfactorily ".

The disclosure is proposed a kind of messaging device, information processing method and a kind of program, and wherein often kind is all new, improved and can improves the usability of user.

The problem solved

According to the disclosure, a kind of messaging device is provided, comprises: analytic unit, be configured to the character string that analytical table is shown as the content of the speech obtained for the result of speech recognition; And indicative control unit, the character string and the analysis result that are configured to the content by representing speech show on the display screen.

According to the disclosure, a kind of information processing method is provided, comprises: analytical table is shown as the step of the character string of the content of the speech obtained for the result of speech recognition; With character string and the analysis result display step on the display screen of the content by representing speech.

According to the disclosure, provide a kind of program, this program is used for making computing machine perform the following step: analytical table is shown as the step of the character string of the content of the speech obtained for the result of speech recognition; With character string and the analysis result display step on the display screen of the content by representing speech.

The advantageous effects of invention

According to the disclosure, the usability of user can be improved.

Accompanying drawing explanation

[Fig. 1] Fig. 1 shows the exemplary plot of the overview of the process relevant with information processing method according to the present embodiment.

[Fig. 2] Fig. 2 shows the process flow diagram of the first example of the process relevant with information processing method according to the present embodiment.

[Fig. 3] Fig. 3 shows the process flow diagram of the second example of the process relevant with information processing method according to the present embodiment.

[Fig. 4] Fig. 4 shows the exemplary plot of the embodiment of the dictionary for motion analysis according to the present embodiment.

[Fig. 5] Fig. 5 shows the exemplary plot of the embodiment of analysis result according to the present embodiment and the application and service of correspondence.

[Fig. 6] Fig. 6 shows the process flow diagram of the 3rd example of the process relevant with information processing method according to the present embodiment.

[Fig. 7] Fig. 7 shows the exemplary plot of the embodiment of the dictionary adjusted for score (score) according to the present embodiment.

[Fig. 8] Fig. 8 shows the exemplary plot of the embodiment of the dictionary for tense analysis according to the present embodiment.

[Fig. 9] Fig. 9 shows the block diagram of the embodiment of the configuration of messaging device according to the present embodiment.

[Figure 10] Figure 10 shows the exemplary plot of the embodiment of the hardware configuration of messaging device according to the present embodiment.

[Figure 11] Figure 11 shows the exemplary plot of the embodiment of information handling system according to the present embodiment.

[Figure 12] Figure 12 shows the exemplary plot of the embodiment of the process of information handling system according to the present embodiment.

Embodiment

Hereinafter, the preferred embodiment of the present invention is described in detail with reference to accompanying drawing.It should be noted that in the present description and drawings, represent the element with roughly the same function and structure with same reference numerals, and save duplicate explanation.

Hereinafter, will be described according to following order.

1. according to the information processing method of embodiment

2. according to the messaging device of embodiment

3. according to the information handling system of embodiment

4. according to the program of embodiment

(information processing method according to embodiment)

Before describing the configuration according to the messaging device of embodiment, first the information processing method according to embodiment is described.Hereinafter, information processing method according to the present embodiment will be described, thus illustration wherein messaging device according to the present embodiment perform the situation of the process relevant with information processing method according to the present embodiment.

[1] according to the overview of the information processing method of embodiment

As mentioned above, when using the equipment of preexist, user does not know which part of the content of the speech used when identifying and perform process.Therefore, when using the equipment be pre-existing in, there is the possibility that the situation reducing user's workability occurs, such as, the situation of " behavior that device responds speech utterance can not be performed transfers to user satisfactorily ".

Given this, the character string of the content of the speech that messaging device according to the present embodiment obtains the result as speech recognition is analyzed (hereinafter, being also called for short " character string of the content of speech ") (analyzing and processing).Therefore, messaging device according to the present embodiment by the character string of the content of speech and analysis result display on the display screen (display and control process).

Herein, such as, messaging device according to the present embodiment performs the process relevant with the speech recognition about the speech data showing the content of making a speech, thus obtains the character string of the content of processed speech.But the method obtaining the character string of the content of processed speech is according to the present embodiment not limited to above-described embodiment.Such as, messaging device according to the present embodiment can obtain the data of the character string of the content showing the speech obtained because of the process relevant with the speech recognition external unit from external units such as such as servers, thus obtains the character string of the content of processed speech.

The embodiment of the process relevant with speech recognition according to the present embodiment comprises the process of Using statistics method and uses the process of hidden Markov model.But the process relevant with speech recognition is according to the present embodiment not limited to above-described embodiment.Such as, the external units such as messaging device according to the present embodiment or such as server can use any process, by this process, can obtain the character string of the content of speech from the speech data of the content of display speech.

According to the present embodiment impelled by messaging device the character string of the content of display speech and the embodiment of display screen of analysis result comprise the display unit (described) that equipment of itself (messaging device according to the present embodiment) comprises below.But impelled by the messaging device character string of content of display speech and the display screen of analysis result are according to the present embodiment not limited to above-described embodiment.Such as, the character string of the content of speech and analysis result can be presented on the display screen of the display device that the external unit that is connected via wired or wireless network comprises by messaging device according to the present embodiment.

Because the character string display of the content of the speech that the result as speech recognition obtains by messaging device according to the present embodiment on the display screen, how to make speech through voice recognition processing so the user performing speech can visually understand.

Because messaging device according to the present embodiment shows the character string of the analysis result of the character string of the content of speech and the content of speech together, how speech is analyzed so the user performing this speech can visually understand.Therefore, the user performing this speech can respond that part that this speech understands the content being identified as the speech used when performing process in equipment (such as, messaging device according to the present embodiment or the equipment by messaging device controller action according to the present embodiment).

As the process relevant with information processing method according to the present embodiment, messaging device according to the present embodiment performs (1) analyzing and processing and (2) display and control process, and can improve the usability of user thus.

Fig. 1 is showed the exemplary plot of the overview of the process relevant with information processing method according to the present embodiment and shows the embodiment being shown screen on the display screen by messaging device according to the present embodiment.

A in Fig. 1 shows the embodiment of the selection screen of the application about television receiver, and the A1 in Fig. 1 represents the embodiment of the icon of the application used for selecting user to perform speech recognition.

Such as, as shown in the B in Fig. 1, when being selected the icon represented by the A1 in Fig. 1 on the screen shown in the A in Fig. 1 by user operation, display user performs the execution screen of the application that speech recognition uses.

When user performs speech to voice-input devices such as the microphones on the screen shown in the B in such as Fig. 1, messaging device according to the present embodiment performs the process (1) (molecule process) relevant with information processing method according to the present embodiment based on the character string of the content of display speech.Then, such as, as shown in the C in Fig. 1, messaging device according to the present embodiment performs the process (2) (display and control process) relevant with information processing method according to the present embodiment and the character string of the content of speech and analysis result is presented on screen thus.

Herein, the C in Fig. 1 shows the embodiment of the screen shown when user sends " Ashita no XXX ga mitai " (I wishes the XXX watching tomorrow).As shown in the C1 in Fig. 1, such as, messaging device display according to the present embodiment represents the character string of the content " Ashita noXXX ga mitai " (I wishes to watch the XXX of tomorrow) of speech and display analysis result further.

C in Fig. 1 shows wherein messaging device according to the present embodiment and strengthens the embodiment of the analysis result of the character string of the content representing speech by using quotation marks.But the method for display analysis result is according to the present embodiment not limited to above-described embodiment.Such as, messaging device according to the present embodiment can show the analysis result of the character string of the content supporting speech, to make to utilize any means strengthening analysis result that visually can change character, such as, below character, underline or change color or the font of character.

Such as, as shown in the C2 in the C in Fig. 1, messaging device according to the present embodiment can perform the process (2) (display and control process) relevant with information processing method according to the present embodiment, thus will correspond to the application of the content of speech and/or show on the display screen corresponding to the service of the content of speech.

Herein, the embodiment corresponding to the application of the content of speech according to the present embodiment comprises various application, such as, for show the listing of television broadcasting application, with the relevant application of viewing television broadcasting, for show the list of record content application, and recording medium on the relevant application of the play content that records and the application for the connection that is established to the networks such as such as home network.The embodiment corresponding to the service of the content of speech according to the present embodiment comprises the various services such as such as Video service, music service, the service provided by image uploading website and the search service that provided by search site.

Such as, as shown in the D in Fig. 1, shown in the C2 in the C in selection Fig. 1 " TV program ", display corresponds to the screen of the application and selction equipment selected.

Such as, as shown in the C1 in the C in Fig. 1, the character string and analysis result that represent the content of speech show on the display screen by messaging device according to the present embodiment.Therefore, such as, how the user of the screen shown in C in viewing Fig. 1 makes speech through voice recognition processing if visually can understanding based on the character string of the content representing speech, and because show the analysis result utilizing the strengthenings such as quotation marks, how speech is analyzed so also can visually understand.

Therefore, messaging device according to the present embodiment can improve the usability of user.Without the need to many speeches, the screen shown by the process relevant with information processing method according to the present embodiment by messaging device is according to the present embodiment not limited to the embodiment shown in the C in Fig. 1, and the embodiment shown in D in B and Fig. 1 in the screen shown by messaging device is according to the present embodiment not limited in Fig. 1 A, Fig. 1.

[2] with the embodiment according to the relevant process of the information processing method of embodiment

Then, by the process relevant with information processing method according to the present embodiment in the messaging device that more specifically describes according to the present embodiment.As mentioned above, such as, as the process relevant with information processing method according to the present embodiment, messaging device according to the present embodiment performs process (1) (analyzing and processing) and process (2) (display and control process).

(1) analyzing and processing

The character string that messaging device his-and-hers watches are according to the present embodiment shown as the content of the speech obtained for the result of speech recognition is analyzed.

Such as, messaging device according to the present embodiment uses the dictionary for semantic analysis be stored in storage unit (described) or external recording medium to perform morphological analysis, so that the string segmentation of the content representing speech is become the such as word such as noun and verb below.Herein, such as, dictionary according to the present embodiment can be database format data or can be Table data.

Such as, messaging device according to the present embodiment can use the character string of dictionary to the content representing speech for semantic analysis be stored in storage unit (described) or external recording medium to perform semantic analysis (or conceptual analysis) further below.

It should be noted that process (1) (analyzing and processing) is according to the present embodiment not limited to above-described embodiment.

Such as, messaging device according to the present embodiment can based on represent speech content character string syntactic analysis result or the score of the character string of the content representing speech is set based on the syntactic analysis result of character string of content and semantic analysis result that represent speech.

Herein, such as, messaging device is according to the present embodiment arranged through morphological analysis and the score of each word split.More specifically, such as, messaging device according to the present embodiment arranges the score of each divided word and adjusts each score setting splitting word, thus arranges the score corresponding to each segmentation word.The embodiment arranging relevant process with score according to the present embodiment will be described below.

Such as, according to the present embodiment below employ in process (1) (analyzing and processing) in described execution process set by score.Description arranged the embodiment of relevant process with score according to the present embodiment below and wherein use the embodiment of the process that score is set.

Such as, messaging device according to the present embodiment can to perform an action analysis to the character string of the content representing speech.Such as, determine whether comprise the word represented for the action of registering in the dictionary of motion analysis in word split by morphological analysis etc. by using the dictionary for motion analysis be stored in storage unit (below described) or external recording medium, messaging device is according to the present embodiment to representing that the character string of the content of making a speech performs an action analysis.

Such as, the result employing the motion analysis in process (1) (analyzing and processing) in (2) (display and control process) is processed.The embodiment of the process wherein processing the motion analysis result used in (2) (display and control process) will be described below.

Such as, messaging device according to the present embodiment can perform tense analysis to the character string of the content representing speech.Such as, by the word using the dictionary for tense analysis be stored in storage unit (described) or external recording medium to determine whether to comprise in the word split by morphological analysis etc. the tense registered in the dictionary of expression for tense analysis below, the character string of messaging device according to the present embodiment to the content representing speech performs tense analysis.

Such as, according to the present embodiment below employ the result of the tense analysis in process (1) (analyzing and processing) in described execution process.Below by describe wherein according to the present embodiment below described by execution process in the embodiment of the process of tense analysis result that uses.

In some cases, there is the fluctuation of speech recognition in the word of the segmentation by morphological analysis etc.Such as, the fluctuation of speech recognition according to the present embodiment refers to " word (Kanji) originally should expressed by concrete Chinese character is really expressed (Hiragana) by Japanese syllabary " and " wherein send the abbreviation title of word but not the situation of its formal name, divided word becomes title of abridging ".Such as, when there is speech recognition recited above fluctuation, in execution process described below according to the present embodiment, there is the possibility that normally can not perform process or the result that user wishes can not be obtained.

Given this, such as, the fluctuation of messaging device recoverable speech recognition according to the present embodiment, to prevent the said circumstances that normally can not perform process.Such as, messaging device is according to the present embodiment replaced by the use dictionary for fluctuation absorption (fluctuation absorption) be stored in storage unit (described) or external recording medium the word split by morphological analysis etc. below and corrects the fluctuation of speech recognition.

At messaging device according to the present embodiment when processing correction speech recognition fluctuation in (1) (analyzing and processing), to represent on the screen that the character string display of the content (wherein, having corrected the fluctuation of speech recognition) of speech is shown in process (2) (display and control process).

Such as, as analyzing and processing according to the present embodiment, messaging device according to the present embodiment performs one or two or multiple process among above-mentioned process.Without the need to many speeches, analyzing and processing is according to the present embodiment not limited to the embodiment of described process above.

(2) display and control process

The character string and analysis result that represent the content of speech show on the display screen by messaging device according to the present embodiment in process (1) (analyzing and processing).Herein, such as, as shown in the C1 in the C in Fig. 1, messaging device display according to the present embodiment represents character string and the analysis result of the content of speech, to strengthen analysis result.

Such as, messaging device according to the present embodiment can will represent the character string display of the content of speech on the display screen, and therefore, character string can be edited.Such as, in messaging device according to the present embodiment, can edit representing the whole character string of content of speech or to represent speech content character string in each word split by morphological analysis etc. edit.

Herein, such as, messaging device according to the present embodiment allows user to use the virtual input device such as the input equipments such as such as keyboard or such as software keyboard to be edited by the character string of input operation to the content representing speech.It should be noted that editor according to the present embodiment represents that the method for the character string of the content of speech is not limited to above-described embodiment.Such as, messaging device according to the present embodiment allows user to be edited by the character string of speech to the content representing speech of user.

Such as, when performing the process relevant with speech recognition, due to wrong identification, in voice identification result, mistake may be there is.In the equipment be pre-existing in, when the result not based on wrong identification do anything suitable perform this process and need this process of retry thus, when retry, user needs again to perform speech.In addition, as mentioned above, when using the equipment be pre-existing in, that part of the content of the speech used when user can not be known and be identified as performing this process.And even if again perform speech in the equipment be pre-existing in, also may make a mistake identification again, and the situation reducing user's usability may occur thus, such as, user needs multiple exercise to make a speech with the situation realizing the action that user wishes.

As mentioned above, on the contrary, messaging device according to the present embodiment will represent the character string display of the content of speech on the display screen, and therefore, the user performing this speech visually can understand the wrong identification of speech recognition.Messaging device according to the present embodiment will represent the character string display of the content of speech on the display screen, therefore, character string can be edited, therefore, such as, even if there is mistake in the character string of the content of the speech obtained as the result of speech recognition, user's also correctable error and messaging device according to the present embodiment (or external unit) can be made to perform described belowly perform process.

Therefore, such as, the character string of the content of speech is represented by display, to make character string to edit, messaging device according to the present embodiment can encourage user correct the content of speech and equipment of itself (messaging device according to the present embodiment) or external unit can be made more adequately to perform this process.In addition, such as, represented the character string of the content of speech by display, to make character string to edit, prevent user to need multiple exercise to make a speech with the situation realizing the action that user wishes, and thus provide the usability of user.

Such as, as shown in the C2 in the C in Fig. 1, messaging device according to the present embodiment will can correspond to the application of the content of speech and/or show on the display screen corresponding to the service of the content of speech based on the analysis result processed in (1) (analyzing and processing).

Herein, such as, messaging device is according to the present embodiment based on the candidate item of service shown in the candidate item of application shown on performance information determination display screen and/or display screen.Therefore, such as, messaging device according to the present embodiment selects the application of the analysis result corresponded to process (1) (analyzing and processing) and/or service and by the application selected and/or service display on the display screen from the application candidate item determined and/or the service candidate item determined.

The embodiment of performance information according to the present embodiment comprises the data (such as, the data of the data of function that have of display device and the performance of each function of display) of the performance that display device has.Herein, the embodiment of performance information that messaging device according to the present embodiment uses in this process comprises the performance information of equipment of itself (messaging device according to the present embodiment) or the external unit by messaging device controller function according to the present embodiment.Hereinafter, correspond to the equipment of the performance information that messaging device according to the present embodiment uses in this process, that is, the equipment controlling its function by messaging device according to the present embodiment is also referred to as " equipment that will control ".

Such as, messaging device according to the present embodiment can determine the candidate item of service shown on the candidate item of application shown on display screen and/or display screen from the application of analysis result corresponded to process (1) (analyzing and processing) and/or the list of service based on performance information.In these cases, messaging device according to the present embodiment by the application candidate item determined and/or the service candidate item determined display on the display screen.

Such as, as shown in the C2 in the C in Fig. 1, when the application of display wherein corresponding to the content of speech and/or the service corresponding to the content of speech, messaging device according to the present embodiment can show this application and/or this service, to make to strengthen this application and/or this service.

Herein, as the method for this application of strengthening according to the present embodiment and/or service, such as, adjust the DISPLAY ORDER of this application and this service, to make the front of the application be reinforced and/or service being placed the application and service list shown in the C2 in C in FIG.It should be noted that the method for this application of strengthening according to the present embodiment and/or service is not limited to above-described embodiment.Such as, messaging device according to the present embodiment can show this application and/or service, to make to utilize any means that visually can change this application and/or service to strengthen this application and/or service.Such as, any means be to provide the application relevant with the analysis result of the content of speech and/or service when representing this application and/or service icon (such as, microphone icon), the icon representing and recommend this application and/or this service or change character color or font is provided.

Such as, when process in (1) (analyzing and processing) to the character string of the content representing speech perform an action analyze, the application on the result strengthening display screen of the motion analysis that messaging device according to the present embodiment comprises based on analysis result and/or service.

More specifically, when the result analyzed that performs an action to the character string of the content representing speech represents such as viewing actions such as " wanting viewing ", messaging device according to the present embodiment enhances and watches relevant application and service, such as, for show the listing of television broadcasting application, with the relevant application of viewing television broadcasting, the application relevant with the play content that stores in recording medium, Video service and the service etc. that provided by image uploading website.When to represent the character string of content of speech perform an action the result analyzed represent that such as " wanting to listen to " etc. listens to action, the sclerosis that messaging device strengthening is according to the present embodiment relevant with playing voice (comprising music) and service, such as, relevant with music service with the play content stored in the recording medium application etc.

Such as, when to represent the character string of content of speech perform an action the result analyzed do not represent any concrete action, messaging device according to the present embodiment can strengthen services such as arranging application or the search service that such as provided by search site.

As mentioned above, such as, shown application and/or service on messaging device strengthening display screen according to the present embodiment.

It should be noted that with the application strengthened according to the present embodiment and/or serve relevant process and be not limited to above-described embodiment.Such as, when arranging the goodness of every application and service according to the present embodiment, messaging device according to the present embodiment can show the application and/or service with higher goodness, to make more clearly to strengthen application among the application and service that is reinforced and/or service.

Such as, messaging device according to the present embodiment performs above-mentioned process, as display and control process according to the present embodiment.Without the need to many speeches, display and control process is according to the present embodiment not limited to the embodiment of process described above.

Such as, as the process relevant with information processing method according to the present embodiment, messaging device according to the present embodiment performs process described above (1) (analyzing and processing) and process (2) (display and control process).

It should be noted that the process relevant with information processing method is according to the present embodiment not limited to process (1) (analyzing and processing) and process (2) (display and control process).

Such as, messaging device according to the present embodiment can perform the application of content of make a speech with corresponding to that screen is selected and corresponding to the relevant process of the service of the content of making a speech, such as, on display screen, display corresponds to the application of the content of speech and corresponds to the service (performing process) of the content of making a speech.

More specifically, such as, as execution process according to the present embodiment, process (a) described below messaging device according to the present embodiment performs, process (b) or process (c).It should be noted that below by the specific embodiment of description execution process according to the present embodiment.

A () is according to the first example of the execution process of embodiment

Such as, when process in (1) (analyzing and processing) to the character string of the content representing speech perform score arrange, messaging device according to the present embodiment based on arrange that reference value and the comparative result arranged between score determine the character string representing the content of make a speech part or all as perform corresponding to the content of making a speech application or to perform and corresponding to the character string used during the process that the service of the content of making a speech is relevant.Then, messaging device according to the present embodiment utilizes the character string determined to perform the application of the content corresponding to speech or the process relevant with the service corresponding to the content of making a speech.

Herein, such as, reference value according to the present embodiment can be the fixed value that arranges in advance or can be the variable value changed based on user operation etc.

More specifically, such as, in the character string of content representing speech, there is not the score being greater than reference value and (or be equal to or greater than the score of reference value; Be equally applicable to following description) when, messaging device according to the present embodiment uses the whole character string of the content representing speech in this process.Simultaneously, such as, exist when being greater than the score of reference value in the character string of content representing speech, messaging device according to the present embodiment uses one or two or multiple part in the character string representing the content of making a speech with the character string of large score in this process.

B () is according to the second example of the execution process of embodiment

Such as, when processing the character string execution tense analysis to the content of expression speech in (1) (analyzing and processing), the word of the tense that messaging device according to the present embodiment optionally uses expression character string (representing the content of making a speech) to comprise based on tense analysis result in this process.More specifically, in these cases, when tense analysis result represents the word of the tense that character string (representing the content of speech) comprises, messaging device according to the present embodiment uses the word representing the tense that character string (representing the content of speech) comprises in this process.

C () is according to the 3rd example of the execution process of embodiment

Such as, messaging device according to the present embodiment also can perform the process wherein will be combined with according to the process of the second example according to the process of the first example.

Such as, as execution process according to the present embodiment, messaging device according to the present embodiment performs process (a) described above, process (b) or process (c).

The process relevant with information processing method is according to the present embodiment not limited to " process (1) (analyzing and processing) and process (2) (display and control process) " with " process (1) (analyzing and processing), process (2) (display and control process) and perform process ".

Such as, the analysis result in process (1) (analyzing and processing) can be recorded as daily record (log recording control treatment) by messaging device according to the present embodiment.

Herein, the object instance of the messaging device log according to the present embodiment external unit that comprises storage unit (described) below, be connected to the external recording medium of messaging device according to the present embodiment and can communicate via network (or directly).The embodiment of network according to the present embodiment comprise such as cable network, the such as WLAN (wireless local area network) such as LAN (Local Area Network) (LAN) or wide area network (WAN) (WLAN) or via base station the wireless network such as wireless wide area network (WWAN) and use the Internet of the communication protocols such as such as transmission control protocol/Internet Protocol (TCP/IP).

Such as, because analysis result is recorded as daily record by messaging device according to the present embodiment, for performing the equipment of the process relevant with speech recognition (such as, the external units such as messaging device according to the present embodiment or such as server) this daily record can be used, to improve the accuracy of speech recognition or to improve the behavior of application.

[3] with the instantiation according to the relevant process of the information processing method of embodiment

Then, the instantiation of the process relevant with information processing method according to the present embodiment will be described.Hereinafter, describe supposition and perform the process relevant with information processing method according to the present embodiment by messaging device according to the present embodiment.

(A) with the first example according to the relevant process of the information processing method of embodiment

Fig. 2 shows the process flow diagram of the first example of the process relevant with information processing method according to the present embodiment.Herein, such as, the process of the step S104 shown in Fig. 2 and S106 corresponds to process (1) (analyzing and processing), and the process of the step S108 shown in Fig. 2 corresponds to process (2) (display and control process).Fig. 2 shows the wherein messaging device according to the present embodiment speech data to the content of display speech and performs the embodiment of the process relevant with speech recognition.It should be noted that as mentioned above, in the external units such as such as server, the process relevant with speech recognition can be performed to the speech data of the content of display speech.

Messaging device according to the present embodiment determines whether to detect voice (S100).Such as, when messaging device receives the speech data of the content of the speech that display is transmitted from voice-input devices such as such as microphones, messaging device according to the present embodiment detects voice.

In the step s 100, when uncertain whether detection voice, messaging device according to the present embodiment does not continue this process, until it determines to detect voice.

In the step s 100, when determining to detect voice, messaging device according to the present embodiment performs the process (S102) relevant with speech recognition to speech data.Such as, as the process relevant with speech recognition, messaging device according to the present embodiment performs the process of Using statistics method or uses the process of hidden Markov model.

The character string of messaging device according to the present embodiment to the content representing the speech obtained from the process of step S102 is analyzed (S104).Herein, such as, the messaging device according to the present embodiment character string to the content representing speech performs syntactic analysis and semantic analysis.

When performing the process of step S104, messaging device according to the present embodiment corrects the fluctuation (S016) of speech recognition.Such as, messaging device is according to the present embodiment replaced by the use dictionary for fluctuation absorption be stored in storage unit (described) etc. the word split by morphological analysis etc. below and corrects the fluctuation of speech recognition.

When performing the process of step S106, the content of speech in messaging device display expression step S104 according to the present embodiment on display screen and the character string (S108) of analysis result.Such as, as shown in the C1 in the C in Fig. 1, messaging device display according to the present embodiment represents the analysis result of the character string of the content of speech, to make the analysis result of the character string strengthening the content representing speech.

Such as, as the process relevant with information processing method according to the present embodiment, messaging device according to the present embodiment performs process as shown in Figure 2.Such as, by performing the process shown in Fig. 2, achieving process (1) (analyzing and processing) relevant with information processing method according to the present embodiment and processing (2) (display and control process).

Therefore, such as, by performing the process shown in Fig. 2, messaging device according to the present embodiment can improve the usability of user.

It should be noted that the process relevant with the information processing method of the first example is according to the present embodiment not limited to the example shown in Fig. 2.

Such as, messaging device according to the present embodiment might not need the process of step S106 in Fig. 2.Such as, even if when not performing the process of step S106, messaging device according to the present embodiment also can perform process (1) (analyzing and processing) relevant with information processing method according to the present embodiment and process (2) (display and control process).Therefore, such as, even if when not performing the process of step S016, messaging device according to the present embodiment also can improve the usability of user.

(B) with the instantiation according to the relevant process of the information processing method of embodiment

The process relevant with information processing method is according to the present embodiment not limited to the process according to the first example.Such as, as shown in the C2 in the C in Fig. 1, in process (2) (display and control process) according to the present embodiment, messaging device according to the present embodiment will such as can correspond to the application of the content of speech and/or show further on the display screen corresponding to the service of the content of speech based on the analysis result in process (1) (analyzing and processing).

Fig. 3 shows the process flow diagram of the second example of the process relevant with information processing method according to the present embodiment.Fig. 3 shows the example of the process performed when the application corresponding to the content of speech and/or the service of content that corresponds to speech show on the display screen by messaging device according to the present embodiment further.Herein, such as, the process of the step S208 in Fig. 3 corresponds to process (1) (analyzing and processing), and the process of step S210 in Fig. 3 corresponds to process (2) (display and control process).Such as, according to the process of the second example shown in Fig. 3 can with according to the process executed in parallel of the first example shown in Fig. 2 or can perform after performing according to the process of the first example shown in Fig. 2.

Messaging device according to the present embodiment determines whether the performance information (S200) obtaining the equipment that will control.When determining the performance information obtaining the equipment that will control in step s 200, messaging device according to the present embodiment performs the process of described step S204 below.

Uncertain when whether obtaining the performance information of the equipment that will control in step s 200, messaging device according to the present embodiment obtains performance information (S202) from the equipment that will control.Such as, when the equipment that will control according to the present embodiment is equipment of itself (messaging device according to the present embodiment), messaging device according to the present embodiment generates performance information, to obtain performance information.Simultaneously, such as, when the equipment that will control according to the present embodiment is external unit, the performance information of the transmission command of the command comprised about performance information transmission request is transferred to external unit, to obtain performance information by messaging device according to the present embodiment.

Such as, when determining the performance information obtaining the equipment that will control in step s 200, or when obtaining the performance information of the equipment that will control in the process of step S202, messaging device according to the present embodiment specifies the application or service (S204) that correspond to the equipment that will control in application and service list based on performance information.

Messaging device according to the present embodiment determines whether the character string (S206) obtaining the content representing speech.Such as, uncertain when whether obtaining the character string of content representing speech in step S206, messaging device according to the present embodiment does not continue this process, until determine the character string obtaining the content representing speech.

When determining to obtain the character string of content representing speech in step S206, the character string of messaging device according to the present embodiment to the content representing speech performs an action analysis (S208).Such as, determine whether comprise the word represented for registration action in the dictionary of motion analysis in word split by the morphological analysis in the process of the step S104 in Fig. 2 etc. by using the dictionary for motion analysis be stored in storage unit (below described), messaging device according to the present embodiment can to perform an action analysis to representing the character string of the content of making a speech.

Fig. 4 shows the exemplary plot of the embodiment of the dictionary for motion analysis according to the present embodiment.Herein, in the diagram, represent word with " keyword " and represent action with " type ".A shown in Fig. 4 shows table format (wherein, english and action are associated with each other) in for the embodiment of the dictionary of motion analysis, and the B shown in Fig. 4 show table format (wherein, day cliction and action be associated with each other) in for the embodiment of the dictionary of motion analysis.Fig. 4 show wherein for each word in the dictionary of motion analysis all with represent the embodiment that the information of phonological component is associated.

Such as, messaging device according to the present embodiment determines whether to comprise in the word split by morphological analysis the word of the action of registering in the dictionary represented for the motion analysis shown in Fig. 4.When determining comprising this word, by correspond to the action of this word be appointed as the action that represented by character string (representing the content of speech) and thus to represent speech content character string in action analyze.

Without the need to many speeches, according to the present embodiment with to representing that the relevant process of motion analysis that the character string of the content of making a speech performs is not limited to above-described embodiment and the dictionary for motion analysis is according to the present embodiment not limited to the embodiment shown in Fig. 4.

Referring back to Fig. 3, the second example of the process relevant with information processing method is according to the present embodiment described.When performing the process in step S208, the application that messaging device display is according to the present embodiment corresponding or service, to make application corresponding based on the result strengthening of motion analysis in the process of step S208 or service (S210).

Such as, in step S208 to represent the character string of content of speech perform an action the result analyzed represent such as viewing actions such as " wanting viewing ", the application that messaging device strengthening is according to the present embodiment relevant with viewing and/or service, such as, for showing the application etc. of the listing of television broadcasting.In step S208 to represent the character string of content of speech perform an action the result analyzed represent that such as " wanting to listen to " etc. listens to action, the application that messaging device strengthening is according to the present embodiment relevant with playing voice (comprising music) and/or service, such as, relevant with the play content stored in recording medium application.In step S208 to represent the character string of content of speech perform an action the result analyzed do not represent any concrete operations, messaging device according to the present embodiment can strengthen services such as arranging application or the search service that such as provided by search site.

Such as, in step S208, the application and service be displayed by priority can be set to representing that the character string of content of speech performs an action in the result analyzed.

Fig. 5 shows the exemplary plot of the embodiment of analysis result according to the present embodiment and the application and service of correspondence.Herein, in Figure 5, represent analysis result with " tense or type of action ", and represent service with " high priority classification ".Fig. 5 shows the embodiment of the form that wherein analysis result and application and service are associated with each other.A shown in Fig. 5 shows the result of tense analysis and the embodiment of the application and service of the result analyzed corresponding to tense.B in Fig. 5 shows the result of motion analysis and the embodiment of the application and service of the result corresponding to motion analysis.C shown in Fig. 5 shows and neither to comprise in the character string of the content representing speech tense does not comprise again action as the correspondence application of result of tense analysis and motion analysis or the embodiment of service.

Such as, by reference to the form shown in Fig. 5, messaging device according to the present embodiment specifies the application and/or service that correspond to the motion analysis result performed by the character string of the content representing speech in step S208.Therefore, such as, messaging device according to the present embodiment by the application of specifying and/or service priority display on the display screen.

Such as, as the process relevant with information processing method according to the present embodiment, messaging device according to the present embodiment can the process shown in parallel processing Fig. 3 with according to the process of the first example shown in Fig. 2, or the process shown in Fig. 3 can be performed after execution is according to the process of the first example shown in Fig. 2.

Therefore, such as, as shown in the C2 in the C in Fig. 1, by performing the process shown in Fig. 3, messaging device according to the present embodiment will can correspond to the application of the content of speech and/or show further on the display screen corresponding to the service of the content of speech based on the analysis result in process (1) (analyzing and processing).Without the need to many speeches, the process relevant with the information processing method of the second example is according to the present embodiment not limited to the embodiment shown in Fig. 3.

(C) with the 3rd example according to the relevant process of the information processing method of embodiment

It should be noted that the process relevant with information processing method is according to the present embodiment not limited to according to the process of the first example or the process according to the second example.Such as, can to perform according to the present embodiment further described above performs process for messaging device according to the present embodiment.

Fig. 6 shows the process flow diagram of the 3rd example of the process relevant with information processing method according to the present embodiment.As execution process according to the present embodiment, Fig. 6 shows wherein messaging device according to the present embodiment and utilizes the character string of the content representing speech to perform the embodiment of the process relevant with search content.In figure 6, the embodiment of content of being searched for by messaging device according to the present embodiment comprises content-data, television program and the various information obtained via the search service in network and the data such as view data in recording mediums such as being such as stored in recording medium (such as, CD or disk) and speech data.

Herein, such as, the process of the step S308 to S318 in Fig. 6 corresponds to process (1) (analyzing and processing), and the process of step S314 in Fig. 6 and S320 to S324 corresponds to and performs process.Such as, the process according to the 3rd example shown in Fig. 6 can with the process executed in parallel according to the first example shown in Fig. 2, or can to perform after the process performing the first example shown in Fig. 2.Such as, the process according to the 3rd example alternately, shown in Fig. 6 can with the process executed in parallel according to the second example shown in Fig. 3.

Messaging device according to the present embodiment determines whether the performance information (S300) obtaining the equipment that will control.When determining the performance information obtaining the equipment that will control in step S300, messaging device according to the present embodiment performs the process of step S304 described below.

Uncertain when whether obtaining the performance information of the equipment that will control in step S300, messaging device according to the present embodiment obtains performance information (S302) with the same way of the step S202 in Fig. 3 from the equipment that will control.

When determining the performance information obtaining the equipment that will control in step S300, or when determining the performance information obtaining the equipment that will control in the process of step S302, messaging device according to the present embodiment specifies the application and/or service (S304) that correspond to the equipment that will control from the list of application and service based on performance information.

Messaging device according to the present embodiment determines whether the character (S306) obtaining the content representing speech.Such as, uncertain when whether obtaining the character string of content representing speech in step S306, messaging device according to the present embodiment does not continue this process, until determine the character string obtaining the content representing speech.

When determining the character string obtaining the content representing speech in step S306, messaging device according to the present embodiment arranges the reference score (S308) of the character string of the content representing speech.Herein, in the process of messaging device step S104 in fig. 2 according to the present embodiment, the reference score of each segmentation word split by morphological analysis etc. is set to " 1 ".Such as, when the character string (or having corrected the character string of fluctuation of speech recognition) of the content representing speech is " Ashita no XXX ga mitai " (I wants the XXX watching tomorrow) shown in C in Fig. 1, each reference score in word " Ashita "/" no "/" XXX "/" ga "/" mi "/" ta "/" i " is set to " 1 " by messaging device according to the present embodiment.Without the need to many speeches, reference score is according to the present embodiment not limited to " 1 ".

When arranging in step S308 with reference to score, the reference score (S310) set by messaging device adjustment according to the present embodiment.Such as, messaging device according to the present embodiment utilize be stored in storage unit (described below) or external recording medium for score adjustment dictionary adjustment set by reference score.

Fig. 7 shows the exemplary plot of the embodiment of the dictionary for score adjustment according to the present embodiment.Herein, in the figure 7, represent word with " keyword ", and represent the adjusted value for adjusting score with " added value ".A shown in Fig. 7 shows table format (wherein, english and adjusted value are associated with each other) in the embodiment of dictionary that adjusts for score, and the B shown in Fig. 7 show table format (wherein, day cliction and adjusted value be associated with each other) in the embodiment of dictionary that adjusts for score.

Such as, specify in the process by reference to the dictionary step S104 in fig. 2 for score adjustment shown in Fig. 7 of messaging device according to the present embodiment and correspond to the pass morphological analysis etc. and the adjusted value of each word of segmentation.Therefore, such as, messaging device according to the present embodiment specifies the adjusted value of word add in reference the score of equivalent the reference score set by adjusting to by corresponding to each.

Such as, when the character string (or wherein having corrected the character string of fluctuation of speech recognition) of the content representing speech is " Ashita no XXX ga mitai " (I wants the XXX watching tomorrow) shown in C in Fig. 1, the score of messaging device adjustment corresponding words " Ashita "/" no "/" XXX "/" ga "/" mi "/" ta "/" i " according to the present embodiment.Refer to the embodiment of adjustment score below.Without the need to many speeches, adjustment score is not limited to the following example.

The score of " Ashita ": " 1.3 "

The score of " no ": " 1 "

The score of " XXX ": " 2 "

The score of " ga ": " 1 "

The score of " mi ": " 0.5 "

The score of " ta ": " 1 "

The score of " i ": " 1 "

Without the need to many speeches, adjust relevant process with the score set by the character string of the content of making a speech for expression according to the present embodiment and be not limited to above-described embodiment, and the dictionary for score adjustment is according to the present embodiment not limited to the embodiment shown in Fig. 7.

Referring back to Fig. 6, the 3rd example of the process relevant with information processing method according to the present embodiment will be described.When performing the process in step S310, messaging device according to the present embodiment determines whether there is the score (S314) being greater than and arranging reference value in the character string of the content representing speech.

Such as, uncertain when whether there is the score being greater than and arranging reference value in step S314, messaging device according to the present embodiment utilizes the whole character string search content (S314) of the content representing speech.

Such as, when determining to there is the score being greater than and arranging reference value in step S314, messaging device is according to the present embodiment based on arranging score determination search word (S316).

Such as, messaging device according to the present embodiment determines to have a part for the character string of maximum score as search word in the character string of the content representing speech.Such as, in the embodiment of the adjustment score described above obtained when the character string (or having corrected the character string of fluctuation of speech recognition) of the content representing speech is " Ashita no XXX ga mitai " (I wants the XXX watching tomorrow) shown in C in Fig. 1, the score of " XXX " is the maximal value in adjustment score.Therefore, such as, in these cases, messaging device according to the present embodiment determines that " XXX " is as search word.Herein, in step S316, " XXX " is defined as search word and below performing, then perform each process after described step S318 the embodiment of screen that shows on the display screen be the screen shown in C in Fig. 1.Without the need to many speeches, when in step 316 " XXX " being defined as search word and then performing each process after described step S318 below performing, the screen shown on the display screen is not limited to the screen shown in C in Fig. 1.

Such as, messaging device according to the present embodiment can determine to have multiple parts of the character string of large score as search word in the character string of the content representing speech.Such as, when using multiple part of character string, messaging device is according to the present embodiment search content by the multiple parts execution AND search to character string or the multiple parts execution OR search to character string.

When performing the process in step S316, the character string of messaging device according to the present embodiment to the content representing speech performs tense analysis (S318).Such as, by the word using the dictionary for tense analysis be stored in storage unit (described) to determine whether to comprise in the word split by morphological analysis etc. the tense registered in the dictionary for tense analysis below, the character string of messaging device according to the present embodiment to the content representing speech performs tense analysis.

Fig. 8 shows the exemplary plot of the embodiment of the dictionary for tense analysis according to the present embodiment.Herein, in fig. 8, represent word with " keyword ", and represent corresponding tense with " type ".A shown in Fig. 8 shows table format (wherein, the tense of english and correspondence is associated with each other) in the embodiment of dictionary analyzed of tense, and the B shown in Fig. 8 shows the embodiment of the dictionary analyzed for tense in table format (wherein, day cliction is associated with each other with corresponding tense).

Such as, messaging device according to the present embodiment determines whether to comprise in the word split by morphological analysis etc. the word of the tense registered in the dictionary represented for tense analysis in the process of the step S104 of Fig. 2 by reference to the dictionary for tense analysis shown in Fig. 8.Such as, when the word split by morphological analysis etc. comprises the word representing tense, messaging device according to the present embodiment determines that the tense corresponding to this word is as representing the tense that the character string of the content of making a speech comprises.Such as, when not comprising the word representing tense in the word split by morphological analysis etc., messaging device is according to the present embodiment determined not comprise the character string representing tense in the character string of the content representing speech.

Without the need to many speeches, according to the present embodiment with to representing that the relevant process of tense analysis that the character string of the content of making a speech performs is not limited to above-described embodiment, and the dictionary for tense analysis is according to the present embodiment not limited to the embodiment shown in Fig. 8.

Referring back to Fig. 6, the 3rd example of the process relevant with information processing method according to the present embodiment will be described.When performing the process in step S318, messaging device according to the present embodiment determines whether there is the character string (S320) representing tense in the character string of the content representing speech.Such as, when determining that in step S318 the character string of the content representing speech comprises tense, messaging device according to the present embodiment determines to there is the character string representing tense in the character string of the content representing speech.

Exist when representing the character string of tense in the character string of the content of uncertainty representation speech in step s 320, messaging device is according to the present embodiment used in the search word search content (S322) determined in step S316.

When determining to there is the character string representing tense in the character string of the content representing speech in step s 320, messaging device is according to the present embodiment by being set to parameter by the tense determined in step S318 and utilizing the search word search content determined in step S316.

Such as, when determining that tense is past tense, the content-datas (context implementation) such as the view data that messaging device according to the present embodiment search is such as stored in the recording medium such as CD or disk and speech data.Meanwhile, such as, when determining that tense is future tense, the program (context implementation) of messaging device searching television broadcast according to the present embodiment.

Such as, as the process relevant with information processing method according to the present embodiment, messaging device according to the present embodiment can the process shown in executed in parallel Fig. 6 with according to the process of the first example shown in Fig. 2 or perform the process shown in Fig. 6 after the process performing the first example shown in Fig. 2, or can the process shown in executed in parallel Fig. 6 and the process according to the second example shown in Fig. 3 further.

Therefore, such as, by performing the process shown in Fig. 6, messaging device according to the present embodiment can perform the application of content of make a speech with corresponding to that screen is selected or corresponding to the relevant process of the service of the content of making a speech, such as, screen shown in C in Fig. 1, the service of the application corresponding to the content of speech and the content corresponding to speech is shown on the screen.

It should be noted that the process relevant with the information processing method of the 3rd example is according to the present embodiment not limited to the embodiment shown in Fig. 6.Such as, messaging device according to the present embodiment can not perform the process relevant with the step S318 in Fig. 6, the tense in S312 and S324.

Such as, as the process relevant with information processing method according to the present embodiment, messaging device according to the present embodiment performs the process of the process of the first example described in basis (A), the process of the second example described in basis (B) and the 3rd example described in (C).Without the need to many speeches, the process relevant with information processing method is according to the present embodiment not limited to above-mentioned process.

(messaging device according to embodiment)

Then, the example that can perform with the configuration of the messaging device according to the present embodiment according to the relevant process of the information processing method of embodiment described above will be described.

Fig. 9 shows the block diagram of the embodiment of the configuration of messaging device 100 according to the present embodiment.Such as, messaging device 100 comprises communication unit 102 and control module 104.

Such as, messaging device 100 can comprise read-only memory (ROM; Not shown), random access memory (RAM; Not shown), the operating unit (not shown) of storage unit (not shown), user-operable and show the display unit (not shown) of each screen on the display screen.Such as, in messaging device 100, connect above-mentioned element by the bus being used as data transfer path.

Herein, ROM (not shown) stores the control data such as program or such as algorithm parameter used by control module 104.RAM (not shown) stores the program performed by control module 104 temporarily.

Storage unit (not shown) is included in storage unit in messaging device 100 and stores the such as various data such as various dictionary and application.Herein, the embodiment of storage unit (not shown) comprises the Nonvolatile memory such as the magnetic recording medias such as such as hard disk and such as flash memory.Storage unit (not shown) can be detachably mounted on messaging device 100.

The embodiment of operating unit (not shown) comprises the operation described input equipment below, and the display device that the embodiment of display unit (not shown) is described below comprising.

[example of the hardware configuration of messaging device 100]

Figure 10 shows the exemplary plot of the embodiment of the hardware configuration of messaging device 100 according to the present embodiment.Such as, messaging device 100 comprises MPU 150, ROM 152, RAM154, recording medium 156, input and output interface 158, operation input apparatus 160, display device 162 and communication interface 164.Such as, in messaging device 100, connect to form element by the bus 166 being used as data transfer path.

Such as, MPU 150 comprises microprocessing unit (MPU) and each treatment circuit and is used as to control the control module 104 of whole messaging device 100.Such as, in messaging device 100, MPU 150 is used as described analytic unit 110, indicative control unit 112, log recording control module 114 and processing unit 116 below.

ROM 152 stores the control data such as calculating parameter and program that such as MPU 150 uses.Such as, RAM 154 stores the program performed by MPU 150 temporarily.

Recording medium 156 is used as storage unit (not shown) and stores the such as various data such as various dictionary and application.Herein, the embodiment of recording medium 156 comprises the Nonvolatile memory such as the magnetic recording medias such as such as hard disk and such as flash memory.Recording medium 156 can be detachably mounted on messaging device 100.

Such as, input and output interface 158 attended operation input equipment 160 or display device 162.Operation input apparatus 160 is used as operating unit (not shown), and display device 162 is used as display unit (not shown).Herein, the embodiment of input and output interface 158 comprises USB (universal serial bus) (USB) terminal, Digital Visual Interface (DVI) terminal, HDMI (HDMI) (registered trademark) terminal and each treatment circuit.Such as, operation input apparatus 160 to be included in messaging device 100 and the input and output interface 158 be connected in messaging device 100.The embodiment of operation input apparatus 160 comprises the rotary type selector switch such as button, directionkeys, such as scroll button and combination thereof.Such as, display device 162 to be included in messaging device 100 and the input and output interface 158 be connected in messaging device 100.The embodiment of display device 162 comprises liquid crystal display (LCD) and organic electroluminescent (EL) display (being also referred to as Organic Light Emitting Diode (OLED) display).

Without the need to many speeches, the external unit that input and output interface 158 can be used as messaging device 100 is connected to the external units such as such as operation input apparatus (such as, keyboard or mouse), display device.The embodiment of display device 162 can be the equipment such as the such as touch-screen of display user operation.

Communication interface 164 is the communication units 102 being included in the communication unit in messaging device 100 and the Wireless/wired communication as external units such as the equipment performed via network (or direct) and such as will control.Herein, the embodiment of communication interface 164 comprises communication antenna and radio frequency (RF) circuit (radio communication), IEEE 802.15.1 port and transmission and receiving circuit (radio communication), IEEE802.11b port and transmission and receiving circuit (radio communication) and LAN (Local Area Network) (LAN) terminal and transmits and receiving circuit (wire communication).

Such as, messaging device 100 comprises the configuration shown in Figure 10 and performs the process relevant with information processing method according to the present embodiment.The hardware configuration of messaging device 100 is according to the present embodiment not limited to the configuration shown in Figure 10.

Such as, during the external device communications such as the external communication device connected through such as input and output interface 158 at messaging device 100 and the equipment that such as will control or server, messaging device 100 might not comprise communication interface 164.

Such as, messaging device 100 also can be configured to not comprise operating equipment 160 or display device 162.

Such as, messaging device 100 can comprise the voice-input devices such as such as microphone and the amplifier circuit for amplifying the voice signal from voice-input device transmission further.

Referring back to Fig. 9, by the embodiment of the configuration of descriptor treatment facility 100.Communication unit 102 is included in communication unit in messaging device 100 and performs the wired and radio communication with the external unit such as the equipment that such as will control and server via network (or directly).Such as, the communication of communication unit 102 is controlled by control module 104.

Herein, the embodiment of communication unit 102 comprises communication antenna and RF circuit and LAN terminal and transmission and receiving circuit.The configuration of communication unit 102 is not limited to above-mentioned configuration.Such as, communication unit 102 can have that correspond to can the configuration of any standard of executive communication, such as, and usb terminal and transmission and receiving circuit or can via any configuration of network and external device communication.

Such as, control module 104 comprises MPU and controls whole messaging device 100.Such as, control module 104 comprises analytic unit 110, indicative control unit 112, log recording control module 114 and processing unit 116 and initiatively performs the process relevant with information processing method according to the present embodiment.

Analytic unit 110 initiatively performs process (1) (analyzing and processing) and his-and-hers watches are shown as the result of speech recognition and the character string of the content of speech that obtains is analyzed.Herein, obtain the character string of the content of the treated speech represented according to the present embodiment in such a way, such as, the element (such as, control module 104) be included in messaging device 100 performs and the process relevant to the speech recognition of the speech data showing the content of making a speech.But the method obtaining the character string of the content of treated speech is according to the present embodiment not limited to above-described embodiment.Such as, as mentioned above, messaging device 100 can obtain the data of the character string of the content showing the speech obtained because of the process relevant with the speech recognition external unit from external units such as such as servers, thus obtains the character string of the content of treated speech.

Such as, by using the dictionary for fluctuation absorption be stored in storage unit (not shown) to replace the word split by morphological analysis etc., the fluctuation of analytic unit 110 recoverable speech recognition.

Such as, analytic unit 110 can use dictionary to analyze and tense analysis representing that the character string of the content of making a speech performs an action.

In addition, such as, analytic unit 110 also can arrange the score of the character string of the content representing speech based on analysis result.Such as, analytic unit 110 arranges score by the step S308 in execution Fig. 6 and the process in step S310.

Indicative control unit 112 initiatively performs process (2) (display and control process) and is shown on the display screen by the analysis result in the character string of the content of expression speech and analytic unit 110.

Such as, indicative control unit 112 can show the character string of content representing speech, to make the whole character string of the content representing speech or to represent that each word split by morphological analysis etc. in the character string of the content of making a speech can be edited.

Such as, when correcting the fluctuation of speech recognition in analytic unit 110, indicative control unit 112 shows the character string of the content representing speech, wherein, has corrected the fluctuation of speech recognition.

Such as, as shown in the C2 in the C in Fig. 1, the service of the application corresponding to the content of speech and/or the content corresponding to speech can show on the display screen, to make to strengthen this application and/or this service based on the analysis result in analytic unit 110 by indicative control unit 112.

More specifically, such as, in analytic unit 110 to represent the character string of content of speech perform an action analyze, shown application and/or service on the result strengthening display screen of the motion analysis that indicative control unit 112 comprises based on the analysis result of analytic unit 110.

Such as, application in the content by corresponding to speech and/or the service corresponding to the content of speech show on the display screen, indicative control unit 112 can based on service candidate item shown on application candidate item shown on the performance information determination display screen of the equipment that will control and/or display screen.

Log recording control module 114 initiatively execution journal record controls process and the analysis result in analytic unit 110 is used as daily record.The target embodiment of log recording control module 114 log comprises storage unit (not shown), external recording medium and the external unit via network communicable.Such as, when by log recording in external unit, log recording control module 114 makes communication unit 102 that daily record data is transferred to external unit.

Processing unit 116 initiatively performs process and performs with the application of the selection corresponding to the content of making a speech or corresponding to the relevant process of the service of the selection of the content of making a speech.

Such as, when arranging score in analytic unit 110, processing unit 116 can based on arranging reference value and the comparative result arranged between score by determining performing the application that corresponds to the content of make a speech or to perform and the character string that uses in the process relevant corresponding to the service of the content of making a speech performs this process.More specifically, such as, in the process that there is not the score being greater than reference value, processing unit 116 uses the whole character string of the content representing speech in this process.Meanwhile, when exist be greater than the score of reference value, processing unit 116 uses one or two or multiple part in the character string representing the content of making a speech with the character string of large score in this process.

Such as, as shown in the step S324 in Fig. 6, in analytic unit 110, perform tense analysis and the result of tense analysis in analytic unit 110 represents that the character string of the content of display speech comprises the word representing tense, processing unit 116 can use the word representing the expression tense that the character string of the content of making a speech comprises in this process.

Such as, control module 104 comprises analytic unit 110, indicative control unit 112, log recording control module 114 and processing unit 116, and initiatively performs the process relevant with information processing method according to the present embodiment thus.

Such as, by the configuration shown in Fig. 9, messaging device 100 perform the process relevant with information processing method according to the present embodiment (such as, process (1) (analyzing and processing), process (2) (display and control process), perform process and log recording control treatment).

Therefore, such as, by the configuration shown in Fig. 9, messaging device 100 can improve the usability of user.In addition, such as, by the configuration shown in Fig. 9, messaging device 100 can be applied through the effect performed with obtaining according to the relevant process of the information processing method of embodiment described above.

It should be noted that the configuration of messaging device 100 is according to the present embodiment not limited to the configuration shown in Fig. 9.

Such as, messaging device 100 according to the present embodiment might not comprise two or in log recording control module 114 and processing unit 116.Even if when messaging device 100 according to the present embodiment does not comprise in log recording control module 114 and processing unit 116 two or one, messaging device 100 according to the present embodiment also initiatively can perform process (1) (analyzing and processing) relevant with information processing method according to the present embodiment and process (2) (display and control process).

Therefore, even if when messaging device 100 according to the present embodiment does not comprise in log recording control module 114 and processing unit 116 two or one, messaging device 100 according to the present embodiment also can improve the usability of user.

Such as, in messaging device 100 according to the present embodiment, can provide separately one or two or multiple unit in (such as, can be realized by each treatment circuit) analytic unit 110 shown in Fig. 9, indicative control unit 112, log recording control module and processing unit 116, with control module 104.

Such as, when messaging device 100 is according to the present embodiment via external communication device and the external device communication such as the equipment that such as will control or server, messaging device 100 might not comprise communication unit 102.

As mentioned above, such as, as the process relevant with information processing method according to the present embodiment, messaging device according to the present embodiment performs process (1) (analyzing and processing) and process (2) (display and control process).

Herein, in process (2) (display and control process) using the character string display of the content of speech that obtains as the result of speech recognition on the display screen, and the user performing this speech thus visually can understand and how to make speech through voice recognition processing messaging device according to the present embodiment.In process (2) (display and control process), the analysis result of character string of content of the speech of messaging device according to the present embodiment together in Graphics Processing (1) (analyzing and processing) and the character string of the content of speech, and the user performing this speech thus visually can understand and how to analyze speech.

Therefore, messaging device according to the present embodiment can improve the usability of user.

Such as, messaging device according to the present embodiment will represent the character string display of the content of speech on the display screen, can edit to make the character string in process (2) (display and control process).

Therefore, such as, the character string of the content of speech is represented by display, to make the character string in process (2) (display and control process) to edit, messaging device according to the present embodiment can encourage user correct the content of speech and equipment of itself (messaging device according to the present embodiment) or external unit can be made thus to perform this process more accurately.In addition, such as, represented the character string of the content of speech by display, to make the character string in process (2) (display and control process) to edit, prevent user to need multiple exercise speech to realize the situation of the action desired by user.

Therefore, represent the character string of the content of speech by display in process (2) (display and control process), to make character string to edit, messaging device according to the present embodiment also can further improve the usability of user.

Such as, as shown in the C2 in the C in Fig. 1, in process (2) (display and control process), messaging device according to the present embodiment corresponds to the service of the application of the content of speech and/or the content corresponding to speech based on the analysis result display in process (1) (analysis result) on display screen.In addition, such as, messaging device according to the present embodiment, by corresponding to the application of the content of speech and/or showing on the display screen corresponding to the service of the content of speech, therefore, enhances this application and/or this service.

As mentioned above, such as, by corresponding to the application of the content of speech based on the analysis result display on display screen and/or corresponding to the service of the content of making a speech, can realize being more suitable for the display for the equipment that will control.Messaging device is not according to the present embodiment in one format but with the analysis result of content of more suitable form display speech, and Absorbable rod speech ambiguity and user can find out new content thus.

Therefore, by will correspond to the application of the content of speech based on the analysis result processed in (2) (display and control process) and show on the display screen corresponding to the service of the content of speech, messaging device according to the present embodiment can further improve the usability of user.

In the foregoing description, the embodiment of exemplary information treatment facility has been described.But present embodiment is not limited to this embodiment.Present embodiment is applicable to the communication facilitiess such as such as panel computer equipment, such as cellular and smart phones, voice/music playback equipment (or video/music record and playback equipment), the various equipment such as computing machine and remote controllers such as game machine, such as personal computer (PC).Such as, present embodiment is also applicable to the process integrated circuit (IC) that can be integrated in the said equipment.

(information handling system according to the present embodiment)

As mentioned above, messaging device according to the present embodiment also can be shown as the character string of the content of the speech obtained for the result treatment of speech recognition by processing list in the external units such as such as server.Given this, then, can be shown as describing wherein messaging device according to the present embodiment as the result treatment of speech recognition and the embodiment of the information handling system according to the present embodiment of the character string of the content of speech that obtains by processing list in external unit.

Figure 11 shows the exemplary plot of the embodiment of information handling system 1000 according to the present embodiment.

Such as, information handling system 1000 comprise messaging device 100, voice recognition processing equipment 200, by messaging device 100 controller function the equipment 300A that will control, 300B ... (being usually also referred to as " equipment 300 that will control " below).Such as, messaging device 100 and voice recognition processing equipment 200 communicate with one another via network 400.The embodiment of network 400 comprise the cable networks such as such as LAN or WAN, such as via base station the wireless network such as WLAN or wireless WAN and use the Internet of the communication protocols such as such as TCP/IP.

It should be noted that the embodiment that Figure 11 shows information handling system 1000 and comprises multiple equipment 300 that will control.But information handling system is according to the present embodiment not limited to above-described embodiment.Such as, information handling system according to the present embodiment can comprise in check individual equipment 300.Such as, when controlling the target of its function by messaging device 100, information handling system according to the present embodiment might not comprise the equipment 300A that will control shown in Figure 11,300B ...

The speech data of voice recognition processing equipment 200 to the content of display speech performs the process such as utilizing the process such as statistical method or utilize the process of hidden Markov model etc. relevant with speech recognition.The data of the character string showing the content of the speech obtained because of the process relevant with the speech recognition performed speech data are transferred to messaging device 100 by voice recognition processing equipment 200.

Such as, voice recognition processing equipment 200 manages the data relevant with dictionary (hereinafter, being referred to as " dictionary data ") according to the present embodiment.It should be noted that in information handling system according to the present embodiment, such as another equipment ALARA Principle dictionary data such as server.Such as, by managing the dictionary in such as external unit such as voice recognition processing equipment 200 grade, the behavior in process (1) (analyzing and processing) of messaging device 100 can more easily be changed.Hereinafter, description voice recognition processing equipment 200 is managed the embodiment of dictionary data.

In addition, such as, voice recognition processing equipment 200 admin log data.It should be noted that in information handling system according to the present embodiment, such as another equipment ALARA Principle daily record data such as server or messaging device 100 ALARA Principle daily record data.Hereinafter, the embodiment of wherein voice recognition processing equipment 200 admin log data will be described.

Herein, such as, voice recognition processing equipment 200 has the hardware configuration shown in Figure 10.But the hardware configuration of voice recognition processing equipment 200 is not limited to above-described embodiment.

Messaging device 100 performs and the process relevant according to the information processing method of embodiment described above the data of the character string of the content of the speech that display is transmitted from voice recognition processing equipment 200.

Such as, the equipment 300 that control is based on the control command execution process transmitted from messaging device 100 and by messaging device 100 controller function.Herein, such as, the equipment 300 that control has the hardware configuration shown in Figure 10.But the hardware configuration of the equipment 300 that will control is not limited to above-described embodiment.

Such as, information handling system can be realized by the configuration shown in Figure 11, wherein, messaging device 100 can process the character string of the content representing the speech obtained because of the voice recognition processing of execution in voice recognition processing equipment 200 (example of external unit).

Then, by the embodiment of the process in descriptor disposal system 1000.Figure 12 shows the exemplary plot of the embodiment of the process of information handling system 1000 according to the present embodiment.Herein, the process of the step S414 in Figure 12 corresponds to process (1) (analyzing and processing), and the process of step S418 in Figure 12 corresponds to process (2) (display and control process).Step S416 in Figure 12 and S420 represents the embodiment of execution process according to the present embodiment, and the step S422 in Figure 12 corresponds to log recording control treatment according to the present embodiment.

Messaging device 100 and the equipment 300 that will control perform connection handling (S400).Herein, such as, perform the process in step S400 in such a way, that is, connection request is transferred to the equipment 300 that will control based on the attended operation of user by messaging device 100.

When in step S400 when link information treatment facility 100 and the equipment 300 that will control, messaging device 100 specifies the performance (S402) of the equipment 300 that will control.Such as, based on the performance information transmitted from the equipment 300 that will control, the performance information transmission request being used for the command of performance information is transferred to the equipment 300 that will control and specifies the performance of the equipment 300 that will control messaging device 100 by response performance information transmission request.

Such as, dictionary is upgraded inspection request and transfers to Tonghua identifying processing equipment 200 (S404) by messaging device 100.

The voice recognition processing equipment 200 receiving the dictionary renewal inspection request transmitted from messaging device 100 is in step s 404 tested to the dictionary data etc. be stored in recording medium 156.When upgrading dictionary data, dictionary data is transferred to messaging device 100 (S406) by voice recognition processing equipment 200.Such as, by performing the process in step S406, the dictionary be stored in the storage unit (not shown) that messaging device 100 comprises according to the present embodiment is upgraded.Herein, such as, voice recognition processing equipment 200 can transmit the dictionary data that shows whole dictionary or only can transmit the data corresponded to as the renewal part of dictionary data.

When obtain speech speech data time, messaging device 100 by voice data transmission to voice recognition processing equipment 200 (S408).

The voice recognition processing equipment 200 pairs of speech datas receiving the speech data transmitted from messaging device 100 in step S408 perform the process (S410) relevant with speech recognition.Then, the data of the character string showing the content of the speech obtained because of the process relevant with speech recognition are transferred to messaging device 100 by voice recognition processing equipment 200.

The messaging device 100 of the data of the character string of the content of the speech that display is transmitted from voice recognition processing equipment 200 is received to the data execution analysis process (S414) of the character string of the content of display speech in step S412.

Messaging device 100 is based on the analysis result search content (S416) in step S414.Herein, the embodiment of being searched for the target of its content by messaging device 100 comprises the external recording mediums such as storage unit (not shown), such as CD and the external units such as identifying processing equipment 200 of such as making a speech.

As specific embodiment, such as, messaging device 100 combines content searching engine in such as external unit such as voice recognition processing equipment 200 grade and performs program searching to the television receiver (embodiment of the equipment 300 that will control) connected or perform search to the mobile image of the collaboration services on the Internet and music.In addition, such as, messaging device 100 communicates with the television receiver be connected (embodiment of the equipment 300 that will control) and the application etc. of record header content in searching television receiver, television receiver.And, such as, messaging device 100 communicates with the PC (embodiment of the equipment 300 that will control) in home network and searches for the view data (showing the data of mobile image and rest image), music data etc. that are stored in recording medium that PC comprises.In addition, such as, messaging device 100 performs web search.Such as, messaging device 100 also can search for the dish (embodiment of the equipment 300 that will control) be inserted in dish player.

Messaging device 100 by the analysis result display in the character string of the content of speech and step S414 on the display screen (S418).In addition, such as, as shown in the C2 in the C in Fig. 1, messaging device 100 will can correspond to the application of the content of speech and/or show on the display screen corresponding to the service of the content of speech based on the analysis result in step S414 and the Search Results in step S416.

Such as, when application shown on screen in step S418 or service execution operation (operation for making the equipment 300 that will control perform an action) being detected, the control command corresponding to this operation is transferred to the equipment 300 (S420) that will control by messaging device 100.

Such as, the daily record of the analysis result in step S414 or the daily record data of daily record shown in each process are also transferred to voice recognition processing equipment 200 (S422) by messaging device 100.

Such as, in information handling system 1000, the process shown in Figure 12 is performed.Herein, even if when performing the process shown in Figure 12, messaging device 100 also can perform the process relevant with the information processing method of embodiment described above.Therefore, such as, by performing the process shown in Figure 12, the information handling system that can improve user's usability is achieved.Without the need to many speeches, the process of information handling system 1000 is according to the present embodiment not limited to the process shown in Figure 12.

Describe the foregoing description of illustration as the voice recognition processing equipment 200 of the element of information handling system according to the present embodiment.But present embodiment is not limited to this embodiment.Present embodiment is applicable to the various equipment such as the computing machine such as comprising PC and server.Such as, present embodiment is also applicable to be integrated into the processing IC in the said equipment.

(or communication between devices) system being connected to multiple equipment of the networks such as such as cloud computing by comprising supposition can realize the process relevant with voice recognition processing equipment 200 according to the present embodiment.

Describe the foregoing description of illustration as the equipment 300 that will control of the element of information handling system according to the present embodiment.But present embodiment is not limited to this embodiment.Present embodiment is applicable to such as television receiver, the such as computing machine such as PC and server, the various equipment such as video/music player devices (or video/music record and playback equipment) and game machine.Such as, present embodiment is also applicable to be integrated into the processing IC in the said equipment.

(program according to embodiment)

Perform for making computing machine travel the program of the function of messaging device according to the present embodiment (such as in a computer, the program of the process relevant with information processing method according to the present embodiment can be performed, such as, " process (1) (analyzing and processing) and process (2) (display and control process) ", " process (1) (analyzing and processing), process (2) (display and control process), and perform process ", " process (1) (analyzing and processing), process (2) (display and control process), and log recording control treatment ", " process (1) (analyzing and processing), process (2) (display and control process), perform process, and log recording control treatment ").

Thus make it possible to the usability improving user.In addition, because perform the program for making computing machine be used as messaging device according to the present embodiment in a computer, so the effect performed with obtaining according to the relevant process of the information processing method of embodiment described above can be applied through.

As long as one skilled in the art will appreciate that in the scope of claims or its equivalent, need and other factors according to design, various distortion, combination, sub-portfolio and change can be made.

Such as, the program (computer program) making computing machine be used as messaging device is according to the present embodiment provided above.But present embodiment also can provide the recording medium storing said procedure.

Configuration described above is the embodiment of present embodiment, certainly belongs to the technical scope of embodiment of the present disclosure.

In addition, this technology also can be configured to as follows.

(1) messaging device, comprising:

Analytic unit, analytic unit is configured to the character string that his-and-hers watches are shown as the content of the speech obtained for the result of speech recognition and analyzes; With

Indicative control unit, indicative control unit is configured to the character string and analysis result that represent the content of making a speech to show on the display screen.

(2) messaging device Gen Ju (1),

Wherein, indicative control unit represents the character string of the content of speech with editable state display.

(3) according to (1) or the messaging device described in (2),

Wherein, analytic unit corrects the fluctuation of speech recognition; And

Wherein, indicative control unit display represents the character string of the content of speech, wherein corrects fluctuation.

(4) according to the messaging device according to any one of (1) to (3),

Wherein, indicative control unit will correspond to the application of the content of speech based on analysis result to strengthen the mode applied and/or serve and/or show on the display screen corresponding to the service of the content of making a speech.

(5) messaging device Gen Ju (4),

Wherein, analytic unit is to representing that the character string of content of speech performs an action analysis; And

Wherein, this application and/or this service show on the display screen in the mode strengthening application and/or service by the motion analysis result that indicative control unit comprises based on analysis result.

(6) according to (4) or the messaging device described in (5),

Wherein, the performance information of the performance that indicative control unit has based on indication equipment, to determine on display screen the candidate item of service shown on the candidate item of shown application and/or display screen.

(7) according to the messaging device according to any one of (4) to (6), comprise further:

Processing unit, processing unit be configured to perform with correspond to the selection of content of making a speech application or corresponding to the relevant process of the service of the selection of the content of making a speech.

(8) messaging device Gen Ju (7),

Wherein, analytic unit is based on the syntactic analysis result performed the character string of the content representing speech or the score arranging the character string of the content representing speech based on the semantic analysis result performed the result of syntactic analysis and the character string of the content of expression speech; And

Wherein, processing unit

When there is not the score that is greater than reference value or there is not the score being equal to or greater than reference value, in this process, use the whole character string of the content representing speech; And

When exist be greater than the score of reference value or existence be equal to or greater than the score of reference value, in this process, use one or two or multiple part among the character string of the content representing speech with the character string of large score.

(9) according to (7) or the messaging device described in (8),

Wherein, the character string of analytic unit to the content representing speech performs tense analysis; And

Wherein, represent that the character string of the content of speech comprises the word representing tense at tense analysis result, then processing unit uses the word representing the expression tense that the character string of the content of making a speech comprises in this process.

(10) according to the messaging device according to any one of (1) to (9), comprise further:

Log recording control module, log recording control module is configured to analysis result to be recorded as daily record.

(11) information processing method, comprising:

Analytical table is shown as the step of the character string of the content of the speech obtained for the result of speech recognition; With

Character string and the analysis result display step on the display screen of the content of speech will be represented.

(12) a kind of program for making computing machine perform the following step:

Analyze the result as speech recognition and the step of the character string of the content of speech that obtains; With

Reference sign list

100 messaging devices

102 communication units

104 control modules

110 analytic units

112 indicative control units

114 log recording control modules

116 processing units

200 voice recognition processing equipment

The equipment that 300,300A, 300B will control

400 networks

1000 information handling systems

Claims

1. a messaging device, comprising:

Analytic unit, is configured to the character string that his-and-hers watches are shown as the content of the speech obtained for the result of speech recognition and analyzes; With

Indicative control unit, the described character string and the analysis result that are configured to the described content by representing described speech show on the display screen.

2. messaging device according to claim 1,

Wherein, described indicative control unit represents the described character string of the described content of described speech with editable state display.

3. messaging device according to claim 1,

Wherein, described analytic unit corrects the fluctuation of described speech recognition; And

Wherein, described indicative control unit display represents the described character string of the described content of described speech, has wherein corrected described fluctuation.

4. messaging device according to claim 1,

Wherein, described indicative control unit in the mode strengthening application and/or service based on described analysis result will correspond to the application of the described content of described speech and/or show on the display screen corresponding to the service of the described content of described speech.

5. messaging device according to claim 4,

Wherein, described analytic unit is to representing that the described character string of described content of described speech performs an action analysis; And

Wherein, described application and/or described service are presented on described display screen in the mode strengthening described application and/or described service by the result of described motion analysis that described indicative control unit comprises based on described analysis result.

6. messaging device according to claim 4,

Wherein, described indicative control unit, based on representing the performance information of performance that described equipment has, determines the candidate item of the described service that the candidate item of the described application that described display screen shows and/or described display screen show.

7. messaging device according to claim 4, comprises further:

Processing unit, described processing unit is configured to perform with the application of the selection of the described content corresponding to described speech or corresponding to the relevant process of the service of selection of the described content of described speech.

8. messaging device according to claim 7,

Wherein, described analytic unit is based on the result of the syntactic analysis performed the described character string of the described content representing described speech or based on the score described result of described syntactic analysis and the result of the semantic analysis of the described character string execution of the described content of the described speech of expression being arranged to the described character string about the described content representing described speech; And

Wherein, described processing unit

When there is not the score that is greater than reference value or there is not the score being equal to or greater than described reference value, in described process, use the whole character string of the described content representing described speech; And

When exist be greater than the score of described reference value or existence be equal to or greater than the score of described reference value, in described process, use one or two or the multiple part that to have among the described character string of the described content representing described speech in the described character string of large score.

9. messaging device according to claim 7,

Wherein, the described character string of described analytic unit to the described content representing described speech performs tense analysis; And

Wherein, the result analyzed at described tense represents that the described character string of the described content of described speech comprises the word representing tense, then institute's predicate of the described processing unit expression tense that uses the described character string of the described content of the described speech of expression to comprise in described process.

10. messaging device according to claim 1, comprises further:

Log recording control module, is configured to described analysis result to be recorded as daily record.

11. 1 kinds of information processing methods, comprising:

Analytical table is shown as the step of the character string of the content of the speech obtained for the result of speech recognition; And

Described character string and the analysis result display step on the display screen of the described content of described speech will be represented.

12. 1 kinds of programs for making computing machine perform the following step: