TWI752437B - At least two phoneme-based voice input operation method and computer program product - Google Patents

Abstract

A method for operating a speech input based on at least two phonemes includes, encoding a plurality of reference phonemes to define a plurality of phoneme labels respectively associated with a plurality of operation options, each of which comprises at least a first selected from the reference phonemes and the second reference phoneme; when the first and second reference phonemes contained in the voice signal collected from the user are confirmed according to the stored voice recognition data associated with these reference phonemes or the user's personal phoneme data and using voice or voiceprint recognition technology After the second phoneme is similar to the first and second target reference phonemes, respectively, a target phoneme label is determined from the phoneme labels, and the first and second reference phonemes contained in the first and second reference phonemes are the same as the first and second target reference phonemes, respectively. phoneme; and activating a target action option associated with the target phoneme tag of one of the action options.

Description

At least two phoneme-based voice input operation method and computer program product

The present invention relates to speech input, in particular to a speech input operation method and computer program product based on at least two phonemes.

Voice input has been widely used to replace tedious manual input. In application, the computer device can usually recognize the words, operation instructions or applications related to the speech from the collected speech through the speech recognition engine using the language model and the acoustic model, and then the computer device can Display the relevant word, or execute the relevant command or application.

However, for patients with dysarthria, they are often unable to produce specific speech sounds, and the speech sounds are often slurred, hoarse, monotonous, intermittent, too loud or otherwise abnormal. In this case, because the existing speech recognition technology cannot successfully recognize the speech uttered by the patients with dysarthria, the patients with dysarthria cannot use the existing voice input operation methods, such as the voice input function provided by the tablet computer as a voice communication device, and external communication.

Therefore, in order to enable patients with dysarthria to use voice input to operate electronic devices or communicate with the outside world, how to develop a voice input operation technology suitable for patients with dysarthria has become an important issue at present.

Therefore, the purpose of the present invention is to provide a voice input operation method and computer program product based on at least two phonemes, which can overcome at least one disadvantage of the prior art.

Therefore, the present invention provides a voice input operation method based on at least two phonemes, which utilizes a computer system with voice and voiceprint recognition technology to perform, and includes the following steps: (A) storing a plurality of reference phonemes that are different from each other. Associated speech recognition data and personal phoneme data corresponding to a user, the personal phoneme data comprising the voice content of a plurality of voices issued by the user and corresponding to the reference phonemes respectively; (B) the reference Phoneme encoding to define a plurality of phoneme labels that are different from each other, wherein each phoneme label at least includes a first reference phoneme selected from one of the reference phonemes and a first reference phoneme selected from one of the reference phonemes Two reference phonemes; (C) respectively associate these phoneme labels with a plurality of operation options different from each other; (D) after collecting the speech signal from the user and containing at least the continuous first phoneme and the second phoneme, Confirming whether the first phoneme is similar to one of the reference phonemes and confirming whether the second phoneme is similar to the (E) after confirming the first target reference phoneme similar to the first phoneme and the second target reference phoneme similar to the second phoneme, according to the first target reference phoneme and For the second target reference phoneme, a target phoneme label is determined from the phoneme labels, and the first reference phoneme and the second reference phoneme contained in the target phoneme label are respectively the same as the first target reference phoneme and the second reference phoneme. a target reference phoneme; and (F) activating a target action option associated with the target phoneme tag of one of the action options.

In the voice input operation method based on at least two phonemes of the present invention, each reference phoneme is a vowel or a syllable.

In the voice input operation method based on at least two phonemes of the present invention, each operation option is one of a symbol, a character, a text content, an operation command, an application program and a file. When the target operation option is a symbol, the computer system activates the target operation option by displaying the symbol. When the target operation option is a character, the computer system activates the target operation option by displaying the character. When the target operation option is a text content, the computer system activates the target operation option at least by displaying the text content. When the target operation option is an operation command, the computer system activates the target operation option by executing the operation command. When the target operation option is an application program, the computer system activates the target operation option by executing the application program. When the target operation option is a file, the computer system activates the target operation option by opening or playing the file.

In the voice input operation method based on at least two phonemes of the present invention, between steps (C) and (D), the following steps are further included: (G) displaying a plurality of images representing the operation options respectively, and The phoneme labels associated with the operation options are displayed adjacent to the images.

In the voice input operation method based on at least two phonemes of the present invention, when the target operation option is a text content, the computer system not only displays the text content, but also plays a voice content corresponding to the text content by playing a way to activate the target action option.

In the voice input operation method based on at least two phonemes of the present invention, the computer system includes a user terminal for executing steps (B), (C), (E), (F) and (G), and a user terminal that can be connected with The identification server that communicates with the user terminal and is used for performing steps (A) and (D) further includes the following steps: before step (A), (H) using the user terminal to collect the personal phoneme data. Send to the identification server; between step (C) and step (D), (1) collect the voice signal through the use terminal, and send an identification request including the voice signal and related to the user to the identification server, so that the identification server executes step (D) in response to the identification request; and between steps (D) and (E), (J) by the identification server, when it is confirmed that the first When a target reference phoneme and the second target reference phoneme are present, an identification reply containing the first target reference phoneme and the second target reference phoneme is sent to the user terminal, so that the user terminal performs the steps in response to the identification reply (E).

Therefore, a computer program product provided by the present invention is stored in a computer-readable medium, and includes a plurality of program instructions, and when a computer device executes the program instructions, it can complete the above-mentioned at least diphone-based program. Voice input operation method.

The effect of the present invention is: because the voice recognition data for voice recognition and the personal phoneme data corresponding to the user for voiceprint recognition are stored first, not only for users with normal articulation, but also for users with dysarthria The limited speech uttered can be accurately recognized. In addition, the encoding method based on at least two phones can define a relatively large number of phoneme labels, and these phoneme labels can be widely used to establish associations with a relatively large number of operation options. Therefore, compared with the existing speech recognition technology using a relatively complex language model and an acoustic model, it is relatively easy and fast to recognize the speech input issued by the user that contains at least two phonemes, so as to determine the target operation option to be activated.

Before the present invention is described in detail, it should be noted that in the following description, similar elements are designated by the same reference numerals.

Referring to FIG. 1 , a computer system is shown implemented as a computer device 100 such as a smart phone or a tablet computer, which is used to implement at least double-phoneme-based voice input according to the first embodiment of the present invention The operation method includes a voice collection module 1 (eg, a microphone module) for collecting external voices, a touch display module 2 used as a display and a user operating interface, a storage module 3, a A speaker module 4 and a processing unit 5 electrically connected to the voice collection module 1 , the touch display module 2 , the storage module 3 and the speaker module 4 . In this embodiment, the processing unit 5 supports voice and voiceprint recognition technology.

Hereinafter, referring to FIG. 1 and FIG. 2 , how the computer device 100 executes the voice input operation method of the first embodiment will be exemplarily described. Generally speaking, the voice input operation method may include the following steps S20-S28.

First, in step S20 , the computer device 100 stores the speech recognition data associated with a plurality of different reference phonemes in the storage module 3 . In this embodiment, each reference phoneme may be a vowel (Vowel) or a syllable (Syllable). More specifically, the computer device 100 obtains the speech recognition data for recognizing the reference phonemes according to the speech content collected from a plurality of (normally articulated) users uttering the reference phonemes and using, for example, acoustic model training. For example, the reference phonemes have, for example, four vowels and four syllables, as shown in Representation 1 below. Table 1 reference phoneme vowel syllable a u e o ha hu he ho Then, in step S21, usually in a registration stage, the computer device 100 stores personal phoneme data corresponding to a user, and the personal phoneme data includes a plurality of reference phonemes uttered by the user and corresponding to a plurality of different reference phonemes respectively. The voice content of a voice. More specifically, before starting the voice recording, the processing unit 5 may, for example, enable the touch display module 2 to display the reference phonemes for the user to use as an instruction about the vocalization of the reference phonemes, but not limited thereto. Therefore, during the voice recording, the voice collection module 1 transmits the voice content of a plurality of voices corresponding to the reference phonemes uttered by the user to the processing unit 5, and the processing unit 5 uses the voice content as Corresponding to the personal phoneme data of the user, and storing the personal phoneme data in the storage module 3 .

It should be noted that, in order to record the distinguishable voices to create personal voice data conforming to the characteristics of personal voiceprints, the selection of the reference phonemes may depend on the user's articulation ability. In other words, the user does not need to pronounce each reference phoneme (ie, vowel or syllable) of the standard, as long as the user can pronounce the speech corresponding to each reference phoneme that is distinguishable from each other.

Then, in step S22, the processing unit 5 encodes the reference phonemes to define a plurality of phoneme labels that are different from each other. In this embodiment, each phoneme tag only includes a first reference phoneme selected from one of the reference phonemes, and a second reference phoneme selected from one of the reference phonemes. According to the example of Table 1 above, the phoneme tags can be defined as the following Table 2: Table 2 phoneme label aa ua ea oa ha a hu a he a ho a au uu eu ou ha u hu u he u ho u ae ue ee oe ha e hu e he e ho e ao uo eo oo ha o hu o he o ho o a ha u ha e ha o ha ha ha hu ha he ha ho ha a he u he e he o he ha he hu he he he ho he a ho u ho e ho o ho ha ho hu ho he ho ho ho a hu u hu e hu o hu ha hu hu hu he hu ho hu

It is worth noting that, in other implementation aspects, if the number of distinguishable reference phonemes is relatively small due to the user's poor articulation ability, in order to define a considerable number of phoneme labels, the processing unit Each phoneme tag defined in 5 can also contain three or more reference phonemes.

Next, in step S23, the processing unit 5 associates the defined phoneme labels with a plurality of operation options that are different from each other, and can store the association relationship between the phoneme labels and the operation options in the storage Module 3. In this embodiment, each operation option can be a symbol, a character, a text content, an operation command, an application program or a file, and the symbol, character and operation command can be the touch display module 2 any symbol, any character and any operation command contained in a virtual keyboard displayed, and the application program and file therein may be the application program contained in any window displayed by the touch display module 2 and any text, graphics, audio or multimedia files. It should be noted that, in actual use, the phoneme tags can be applied to establish associations with the operation options in different display windows provided by the touch display module 2 .

Then, during use of the computer device 100, in step S24, the processing unit 5 causes the display window currently provided by the touch display module 2 to display a plurality of images representing the phoneme labels and the operation options respectively. More specifically, depending on the display window currently provided by the touch display module 2, there will be corresponding image display contents. In the following, examples will be given for different use cases.

Referring to FIG. 3, the illustrated example is a virtual keyboard displayed in a display window provided by the touch display module 2, and the virtual keyboard displays images of a plurality of (editing candidates) characters (such as "I", "good"...etc) and a plurality of phoneme tags (such as "aa", "ai"...etc.), a plurality of (editing candidates) near the image of the characters and associated with the characters respectively An image of a phonetic symbol (such as "ㄅ", "ㄆ"...etc.) and a plurality of phoneme tags (such as "ia", "eo") near the image of the phonetic symbol and associated with the phonetic symbol respectively "... etc.), an (editing candidate) image of a mathematical symbol (eg ">") and a phoneme label (eg "a hu") near and associated with the image of the mathematical symbol, and multiple (Edit candidate) The image of the operation instruction (such as "123" representing the numeric key switching instruction, "Space" representing the input space instruction, and "Transfer" representing the transmission instruction) and a plurality of images of these operation instructions respectively Phoneme tags (eg, "ha e", "ha he", "ha ha") that are nearby and are respectively associated with these operating instructions.

Referring to FIG. 4, the illustrated example is the “desktop” display window provided by the touch display module 2, which contains a plurality of different application programs (such as “YouTube”, “EVA Facial Mouse”, “Mi home”, etc.) and a number of phoneme tags (e.g., “aa”, “au”, “ae”, etc.) that are in the vicinity of and respectively associated with the images of those applications, and A plurality of images respectively representing a plurality of operation instructions (such as "My File", "Phone", "Contacts", etc.) and a plurality of images respectively adjacent to the images of the operation instructions and respectively associated with the operation instructions Associated phoneme tags (eg "o ha", "ha a", "ha u"...etc).

Referring to FIG. 5, the illustrated example is the display window provided by the touch display module 2 after the computer device 100 executes the “YouTube” application program, which contains a plurality of windows respectively representing a plurality of different multimedia files (such as video 1~ Video 10) images (such as images 1 to 10) and a plurality of phoneme tags (such as "ue", "eu") that are respectively near the images of the multimedia files and are respectively associated with the multimedia files , "ee", etc.) and multiple images representing multiple operation instructions (such as "home page", "fever video", "subscription content"...etc.) and multiple images adjacent to the images respectively of these operation instructions And the phoneme tags (such as "ha a", "ha u", "ha e", etc.) associated with these operation instructions respectively.

Referring to FIG. 6, the illustrated example is a display window provided by the touch display module 2 after the computer device 100 executes a community communication application, which contains a plurality of images ( such as "I need help", "I want to urinate", etc.) and a number of phoneme tags (such as "aa", "ai"... etc.) and a plurality of images respectively representing a plurality of operation instructions (such as "clear", "transfer and pronunciation", "storage", etc.) and a plurality of images respectively adjacent to and respectively associated with the images of the operation instructions The phoneme label associated with the operation instruction (eg "u ha", "u hi", "u he"...etc).

In this embodiment, in this case, the user can issue the phoneme label associated with the desired operation option according to the operation option contained in the current display window of the touch display module 2 and the phoneme label associated therewith related first and second phonemes. However, in other embodiments, if each phoneme tag contains three or more reference phonemes, the user must utter a plurality of phonemes related to the phoneme tag associated with the desired operation option, the number of which should be equal to The number of reference phonemes contained in each phoneme label is the same.

Therefore, when the processing unit 5 receives the voice signal collected by the voice collection module 1 from the user and containing the continuous first phoneme and the second phoneme, in step S25, the processing unit 5 can store the voice signal according to the The voice recognition data stored in the module 3 uses voice recognition technology, or according to the personal phoneme data stored in the storage module 3 and voiceprint recognition technology is used to confirm whether the first phoneme is similar to one of the reference phonemes and confirms whether the second phoneme is similar to one of the reference phonemes. If the processing unit 5 identifies a first target reference phoneme similar to the first phoneme and a second target reference phoneme similar to the second phoneme, the process proceeds to step S26. Otherwise, the flow proceeds to step S28. It should be noted that, when step S25 is actually executed, the processing unit 5 may, for example, first perform the confirmation operation of the first phoneme and the second phoneme according to the speech recognition data and using the speech recognition technology, and if the confirmation fails to be successful At the time, the personal phoneme data and the voiceprint recognition technology are used to perform the confirmation operation of the first phoneme and the second phoneme, but not limited to this.

In step S26, the processing unit 5, according to the first target reference phoneme and the second target reference phoneme and the association stored in the storage module 3, selects the phoneme tags (that is, the currently displayed window in step S24) from the phoneme tags contains the phoneme label) to determine a target phoneme label. The first reference phoneme and the second reference phoneme contained in the target phoneme tag are respectively the same as the first target reference phoneme and the second target reference phoneme.

Next, in step S27, the processing unit 5 associates one of the operation options (that is, the operation options contained in the currently displayed window in step S24) with the target phoneme label according to the association relationship stored in the storage module 3 The associated target action option (ie, the desired action option) is activated.

When the processing unit 5 confirms that one of the first phoneme and the second phoneme is not similar to each of the reference phonemes, in step S28 , the processing unit 5 makes the touch display module 2 A recognition failure message is displayed. Therefore, after the user re-utters the first phoneme and the second phoneme containing the voice tag associated with the desired operation option, the computer device 100 re-executes the operation of step S25 until it can confirm that the first phoneme is similar to the first phoneme until the reference phoneme of the second phoneme.

Hereinafter, the manner of how the processing unit 5 activates the target operation option will be further exemplified in terms of the actual form of the target operation option.

If the target operation option is a symbol (mathematical symbol ">" in the virtual keyboard as shown in FIG. 3 ), the processing unit 5 displays the symbol in an editing area (Fig. not shown) to activate the target operation option. Similarly, if the target operation option is a character (the character “I” in the virtual keyboard shown in FIG. 3 ), the processing unit 5 displays the character through a way to activate the target action option. If the target operation option is a text content (“I need help” in the display window as shown in FIG. 6 ), the processing unit 5 not only displays the text content in a communication record area through a touch display panel 2 (the communication record area shown in FIG. 6 ), the target operation option is also activated by making the speaker module 4 play a voice content corresponding to the text content. If the target operation option is an operation command (such as the operation command "telephone" in the display window as shown in FIG. 4 ), the processing unit 5 executes the operation command in a manner (for example, the touch display module 2 Switch from the original desktop display window to the display window related to the "phone") to activate the target operation option. If the target operation option is an application (the application “YouTube” in the display window as shown in FIG. 4 ), the processing unit 5 activates the target operation option by executing the application, and makes the The touch display module 2 switches from the original display window (as shown in FIG. 4 ) to the display window related to the application (as shown in FIG. 5 ). If the target operation option is a file, the processing unit 5 activates the target operation option by opening or playing the file.

It is worth noting that, the voice input operation method of the above-mentioned first embodiment can be programmed as a computer program product including a plurality of program instructions, and the computer program product is stored in a computer-readable medium (for example, the storage module). group 3). When the computer device 100 executes the program instructions, the computer device 100 can implement the voice input operation method based on at least two phonemes as described above.

Referring to FIG. 7 , another computer system shown not only includes the computer device 100 serving as a user terminal, but also includes an identification server 200 . The computer device 100 cooperates with the recognition server 200 to implement the voice input operation method based on at least double-phoneme according to the second embodiment of the present invention. In this embodiment, the identification server 200 can communicate with the computer device 100 via a communication network 300 and supports voice and voiceprint identification technology.

Hereinafter, referring to FIG. 7 and FIG. 8 , how the computer system executes the voice input operation method of the second embodiment will be exemplarily described. Generally speaking, the voice input operation method of this embodiment is a modified embodiment of the voice operation method of the above-mentioned first embodiment, and may include the following steps S80-S91.

First, in step S80, the recognition server 200 pre-stores the voice recognition data.

In step S81, in the registration stage, the computer device 100 transmits the voice content of the voices corresponding to the reference phonemes uttered by the voice collection module 1 to the recognition server via the communication network 300. end 200.

Then, in step S82, the recognition server 200 stores the voice content from the computer device 100 as the personal phoneme data corresponding to the user. It is worth mentioning that, in actual use, the identification server 200 can also be used as a cloud server for personal phoneme data, and widely collects and stores personal phoneme data of a large number of other users (such as users with abnormal pronunciation). This large amount of data is further analyzed by artificial intelligence or machine learning can be used as a speech database (not shown) for recognition of special speech (such as speech made by users with dysarthria).

Next, the computer device 100 executes steps S83 to S85 in sequence. Since the operation details of the computer device 100 in steps S83 to S85 are respectively the same as all the operation details of the above-mentioned steps S22 to S24 ( FIG. 2 ), the details are not repeated here.

Afterwards, when the processing unit 5 of the computer device 100 receives the voice signal from the user collected by the voice collection module 1 and including the continuous first phoneme and the second phoneme, the computer device 100 passes through the communication network. 300. Send an identification request including the voice signal and related to the user to the identification server 200 (step S86).

Then, when the recognition server 200 receives the recognition request from the computer device 100, it can use the voice recognition technology according to the stored voice recognition data, or use the stored personal phoneme data corresponding to the user. And use voiceprint recognition technology (or according to the above-mentioned speech database for special speech recognition and use speech recognition technology), confirm whether the first phoneme is similar to one of these reference phonemes and confirm whether the second phoneme is Similar to one of the reference phonemes (step S87). If the identification server 200 identifies a first target reference phoneme similar to the first phoneme and a second target reference phoneme similar to the second phoneme (ie, the identification is successful), the process proceeds to step S88. Otherwise, the flow proceeds to step S91.

In step S88 , the identification server 200 transmits an identification reply including the first target reference phoneme and the second target reference phoneme to the computer device 100 via the communication network 300 .

Then, in step S89, the processing unit 5 of the computer device 100, according to the first target reference phoneme and the second target reference phoneme included in the identification reply, and the association stored in the storage module 3, from the The equal phoneme label determines a target phoneme label. The first reference phoneme and the second reference phoneme contained in the target phoneme tag are respectively the same as the first target reference phoneme and the second target reference phoneme.

Then, the processing unit 5 of the computer device 100, similar to the above-mentioned step S27 (FIG. 2), according to the association stored in the storage module 3, one of the operation options is associated with the target operation of the target phoneme tag The option (ie, the desired operation option) is activated (step S90).

When the identification server 200 confirms that one of the first phoneme and the second phoneme is not similar to each of the reference phonemes (ie, the identification fails), in step S91, the identification server 200 passes the The communication network 300 transmits the identification failure message to the computer device 100 . Therefore, the processing unit 5 of the computer device 100 can display the identification failure message from the identification server 200 on the touch display module 2 for the user to view. Therefore, after the user re-utters the first phoneme and the second phoneme related to the voice tag associated with the desired operation option, the computer system re-executes the operations of step S86 and step S87 until it can confirm that the first phoneme and the second phoneme are similar to the first phoneme. A phoneme and the reference phoneme of the second phoneme.

To sum up, since the speech recognition data for speech recognition and the personal phoneme data corresponding to the user for voiceprint recognition are stored first, not only the speech uttered by users with normal articulation, but also for patients with dysarthria. The limited speech uttered by the users can be accurately recognized. In addition, the encoding method based on at least two phones can define a relatively large number of phoneme labels, and these phoneme labels can be widely used to establish associations with a relatively large number of operation options. Therefore, compared with the existing speech recognition technology using a relatively complex language model and an acoustic model, it is relatively easy and fast to recognize the speech input issued by the user and containing at least two phonemes, so as to determine the target operation option to be activated. . Therefore, the object of the present invention can indeed be achieved.

However, the above are only examples of the present invention, and should not limit the scope of the present invention. Any simple equivalent changes and modifications made according to the scope of the application for patent of the present invention and the content of the patent specification are still within the scope of the present invention. within the scope of the invention patent.

100: Computer Devices 1: Voice collection module 2: touch display module 3: storage module 4: Speaker module 5: Processing unit 200: Identify the server 300: Communication Network S20~S28: Steps S80~S91: Steps

Other features and effects of the present invention will be clearly presented in the embodiments with reference to the drawings, wherein: FIG. 1 is a block diagram exemplarily illustrating a structure of a computer system for implementing the at least diphone-based voice input operation method according to the first embodiment of the present invention; FIG. 2 is a flow chart illustrating how the computer system of FIG. 1 implements the first embodiment of the present invention; 3 is a schematic diagram exemplarily depicting a virtual keyboard displayed by a touch display module of the computer system and containing phoneme labels; 4 to 6 are schematic diagrams, exemplarily illustrating display windows provided by the touch display module and containing phoneme labels under different usage conditions of the computer system; 7 is a block diagram exemplarily illustrating another architecture of a computer system for implementing the at least diphone-based voice input operation method of the second embodiment of the present invention; and FIG. 8 is a flow chart illustrating how the computer system of FIG. 7 implements the second embodiment of the present invention.

S20-S28: Steps

Claims (7)

A voice input operation method based on at least two phonemes is implemented by a computer system with voice and voiceprint recognition technology, and includes the following steps: (A) storing speech recognition data associated with a plurality of reference phonemes different from each other, and personal phoneme data corresponding to a user, the personal phoneme data including a plurality of reference phonemes uttered by the user and corresponding to the reference phonemes respectively the voice content of the voice; (B) encoding the reference phonemes to define a plurality of mutually different phoneme labels, wherein each phoneme label at least includes a first reference phoneme selected from one of the reference phonemes, and a first reference phoneme selected from the reference phonemes a second reference phoneme of one of the reference phonemes; (C) respectively associating the phoneme labels with a plurality of operation options that are different from each other; (D) After collecting the voice signal from the user and including at least the first phoneme and the second phoneme in succession, according to the voice recognition data and using the voice recognition technology, or according to the personal phoneme data and using the voiceprint recognition technology, confirming whether the first phoneme is similar to one of the reference phonemes and confirming whether the second phoneme is similar to one of the reference phonemes; (E) After confirming the first target reference phoneme similar to the first phoneme and the second target reference phoneme similar to the second phoneme, according to the first target reference phoneme and the second target reference phoneme, automatically The phoneme labels determine a target phoneme label, and the first reference phoneme and the second reference phoneme contained in the target phoneme label are the same as the first target reference phoneme and the second target reference phoneme, respectively; and (F) Activating a target operation option associated with the target phoneme tag of one of the operation options. The voice input operation method based on at least two phonemes according to claim 1, wherein, in step (A), each reference phoneme is a vowel or a syllable. The voice input operation method based on at least two phonemes as described in claim 1, wherein: In step (C), each operation option is one of a symbol, a character, a text content, an operation command, an application program and a file; and In step (F), when the target operation option is a symbol, the computer system activates the target operation option by displaying the symbol, When the target operation option is a character, the computer system activates the target operation option by displaying the character, When the target operation option is a text content, the computer system activates the target operation option at least by displaying the text content, When the target operation option is an operation command, the computer system activates the target operation option by executing the operation command, when the target operation option is an application, the computer system activates the target operation option by executing the application, and When the target operation option is a file, the computer system activates the target operation option by opening or playing the file. The voice input operation method based on at least two phonemes as described in claim 3, between step (C) and step (D), further comprising the following steps: (G) displaying a plurality of images respectively representing the operation options, and displaying the phoneme labels associated with the operation options near the images. According to the voice input operation method based on at least two phonemes according to claim 4, in step (F), when the target operation option is a text content, the computer system not only displays the text content, but also plays a The target operation option is activated in a manner corresponding to the speech content of the text content. The voice input operation method based on at least two phonemes according to claim 5, the computer system comprising a user terminal for executing steps (B), (C), (E), (F) and (G), and An identification server that can communicate with the user terminal and is used for performing steps (A) and (D), further comprising the following steps: Before step (A), (H) send the collected personal phoneme data to the identification server through the user terminal; Between step (C) and step (D), (1) collect the voice signal by the user terminal, and transmit an identification request including the voice signal and related to the user to the identification server, so that the The identification server performs step (D) in response to the identification request; and Between the step (D) and the step (E), (J) by the identification server, when the first target reference phoneme and the second target reference phoneme are confirmed, a file containing the first target reference phoneme and the identification reply of the second target reference phoneme is sent to the user terminal, so that the user terminal performs step (E) in response to the identification reply. A computer program product, stored on a computer-readable medium, comprising a plurality of program instructions, and when a computer system executes the program instructions, can complete the at least dual-based method as described in any one of claims 1 to 5. Phoneme voice input operation method.

Images