TW201733376A - Instant communication method and instant communication system based on voice recognition - Google Patents

Abstract

An instant communication method and an instant communication system based on voice recognition. The instant communication method comprises: receiving voice information sent by a sending terminal; performing voice recognition on the voice information to generate text information; sending the voice information to a receiving terminal; and sending the text information to the receiving terminal. The instant communication method and system overcome the obstacle that a receiving terminal cannot listen to voice information after receiving same on certain occasions, thereby avoiding the problem of privacy leaks of a user.

Description

Instant messaging method based on speech recognition and instant communication system

The present invention relates to the field of instant messaging technologies, and more particularly to a voice communication based instant messaging method and an instant messaging system.

The social app intercom chat through mobile phone or tablet is a convenient function commonly used by many softwares, such as Tencent's WeChat, Ali's nail, Alipay, Taobao, etc. all have such a function. At present, the main implementation of such functions is that the transmitting terminal records its own message through voice, and the receiving party clicks on the received information and listens through the handset or externally.

Such a function brings a certain obstacle to the receiving terminal while facilitating the transmitting terminal. The main disadvantage is that the receiving terminal can't see the information content at a glance like the text information. You need to tap and hold the phone or tablet to the ear to listen to it, or use the speaker of the mobile phone or tablet to put it on, in many occasions ( For example, there are other people in the meeting or next to it. This is very inconvenient, and there may be problems with privacy leaks.

In view of the above problems, embodiments of the present invention have been proposed in order to provide a gram. A speech recognition based instant messaging method and an instant messaging system that address the above problems or at least partially solve the above problems.

To solve the above problem, the present invention discloses a voice communication-based instant messaging method, including: receiving voice information sent by a transmitting terminal; performing voice recognition on the voice information to generate text information; transmitting the voice information to a receiving terminal; The text message is sent to the receiving terminal.

Another embodiment of the present invention provides a voice communication-based instant messaging method, including: recording voice information and transmitting it to a server; receiving text information generated by identifying the voice information, and displaying the text information; receiving a corrective operation instruction After that, enter the interface for editing the text information; display the edited text information, and send the edited text information to the server.

A further embodiment of the present invention provides a method for instant messaging based on voice recognition, comprising: receiving voice information sent by a server; receiving text information generated by the server after identifying the voice information; and displaying and marking the text information.

An embodiment of the present invention provides an instant messaging system based on speech recognition The system includes: a voice information receiving module, configured to receive voice information sent by the sending terminal; and a text information generating module, configured to perform voice recognition on the voice information to generate text information; the first sending module, And the second sending module is configured to send the text information to the receiving terminal.

Another embodiment of the present invention provides an instant messaging system based on voice recognition, comprising: a voice information recording and transmitting module for recording voice information and transmitting to a server; and a text information receiving and displaying module for receiving the voice recognition The text information generated by the information, and the text information is displayed; the editing module is used to enter the interface for editing the text information after receiving the correct operation instruction; the display sending module is used to display the edited text information, and after editing Text messages are sent to the server.

Another embodiment of the present invention provides an instant messaging system based on voice recognition, comprising: a voice information acquiring module, configured to receive voice information sent by a server; and a text information acquiring module, configured to receive the voice sent by the server to identify the voice Text information generated after the information; The text information display tag module is used to display and mark the text information.

The embodiment of the present invention has at least the following advantages: the voice recognition-based instant messaging method and the instant messaging system provided by the embodiments of the present invention transmit voice information and text information to the receiving terminal through the voice recognition function, thereby overcoming the receiving terminal. The barriers to information facilitate the use of users and avoid the problem of privacy leaks.

S101, S102, S103, S104‧‧‧ method steps

S201, S202, S203, S204, S205, S206, S207, S208, S209‧‧‧ method steps

S301, S302, S302a, S302b, S303, S304‧‧‧ method steps

S401, S402, S402a, S403, S404, S405‧‧‧ method steps

500‧‧‧ instant messaging system

501‧‧‧Voice Information Receiver Module

502‧‧‧Text Information Generation Module

503‧‧‧First Sending Module

504‧‧‧second transmission module

600‧‧‧ instant messaging system

601‧‧‧Voice information receiving module

602‧‧‧Text Information Generation Module

603‧‧‧First Sending Module

604‧‧‧second transmission module

605‧‧‧The third sending module

606‧‧‧Information Transceiver Module

607‧‧‧First storage module

608‧‧‧fourth transmission module

609‧‧‧Information Transceiver Module

610‧‧‧Text Information Association Module

700‧‧‧ instant messaging system

701‧‧‧Voice Information Recording and Sending Module

702‧‧‧Text information receiving display module

703‧‧‧editing module

704‧‧‧Display Sending Module

705‧‧‧Auxiliary modification information receiving module

706‧‧‧Voice Information Player Module

800‧‧‧ instant messaging system

801‧‧‧Voice Information Acquisition Module

802‧‧‧Text Information Acquisition Module

803‧‧‧Text information display tag module

804‧‧‧Marking Information Acquisition Module

805‧‧‧Voice Information Playback Module

806‧‧‧ Receiving display module

1 is a flow chart of a voice recognition based instant messaging method according to a first embodiment of the present invention.

2 is a flow chart of a voice recognition based instant messaging method in accordance with a second embodiment of the present invention.

3 is a flow chart of a voice recognition based instant messaging method in accordance with a third embodiment of the present invention.

4 is a flow chart of a voice recognition based instant messaging method according to a fourth embodiment of the present invention.

Figure 5 is a block diagram of an instant messaging system corresponding to the voice recognition based instant messaging method of the first embodiment of the present invention.

Figure 6 is a block diagram of an instant messaging system corresponding to a voice recognition based instant messaging method in accordance with a second embodiment of the present invention.

Figure 7 is a block diagram of an instant messaging system corresponding to a voice recognition based instant messaging method in accordance with a third embodiment of the present invention.

Figure 8 is a speech recognition based on a fourth embodiment of the present invention A block diagram of an instant messaging system for time communication methods.

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention are within the scope of the present invention.

One of the core ideas of the present invention is to provide an instant communication method and an instant communication system, which use voice recognition to identify voice information, and display text information directly on the screen of the transmitting terminal and the receiving terminal through the server, thereby facilitating reception. The terminal receives the information and overcomes the obstacle that the receiving terminal cannot listen after receiving the voice information in some occasions, thereby avoiding the problem of user privacy leakage.

First embodiment

The first embodiment of the present invention provides a voice communication based instant messaging method. FIG. 1 is a flowchart of a voice recognition based instant messaging method according to a first embodiment of the present invention. The instant messaging method in the first embodiment of the present invention is applied to a server, and includes the following steps:

S101: Receive voice information sent by the sending terminal. In this step, the sending terminal may record voice information in an instant communication interface (such as a chat interface), and after the recording is completed, the mark or button is released, and the recording is completed. After that, the sending terminal sends the voice information through the network. Send to the server.

S102: Identify the voice information as text information. In this step, after receiving the voice information sent by the party, the server recognizes the voice information as text information through voice recognition technology. Speech recognition technology is a commonly used technology in the art and will not be described here.

S103. Send the voice information to the receiving terminal. In this step, the server sends the voice information received in step S101 to the receiving terminal.

It should be noted that step S103 may be performed simultaneously with step S102 or sequentially, and when executed sequentially, the sequence of steps of step S102 and step S103 is not particularly limited.

S104: Send the text information generated after the identification to the receiving terminal; in this step, the server sends the text information generated after the voice recognition processing to the receiving terminal. Preferably, in this step, the server sends a specified mark while transmitting the text information, for distinguishing the text information converted from the voice information and the text information directly input by the sender in a text manner.

It should be noted that, when step S103 is performed after step S102, step S104 may be performed simultaneously with step S103, or step S104 may be performed before or after step S103, and the present invention is not particularly limited.

In an embodiment, step S103 may be performed first, and the voice information received in step S101 is sent to the receiving terminal, and then step S102 is performed, and the voice information is subjected to voice recognition to generate text information, and then the steps are performed. S104: Send the text information generated after the identification to the receiving terminal. In another embodiment, step S102 may be performed first, and the voice information received in step S101 is voice-recoordinated to generate text information, and then step S103 is performed simultaneously or sequentially. And in step S104, the voice information and the text information generated after the identification are sent to the receiving terminal.

In summary, the first embodiment of the present invention provides a voice communication-based instant messaging method, which generates voice information through recognition, and transmits voice information and text information to a receiving terminal through a server. The instant communication method provided by the embodiment facilitates the receiving terminal to receive information, overcomes the obstacle that the receiving terminal cannot listen after receiving the voice information in some occasions, and avoids the problem of user privacy leakage.

Second embodiment

A second embodiment of the present invention provides a voice communication based instant messaging method. FIG. 2 is a flowchart of a voice recognition based instant messaging method according to a second embodiment of the present invention. The instant messaging method in the first embodiment of the present invention is applied to a server, and includes the following steps:

S201. Receive voice information sent by the sending terminal.

S202, identifying the voice information as text information;

S203. Send the voice information to the receiving terminal.

S204. Send the text information generated after the identification to the receiving terminal.

The above steps S201 to S204 are the same as or similar to the steps S101 to S104 in the first embodiment, and are not described herein.

In a preferred embodiment, after step S202, the method may also To include

S205. Send the text information generated after the identification to the sending terminal. In this step, the server sends the text information generated in step S202 to the sending terminal.

The execution order of the step S205, the step S204, and the step S203 is not limited, and the three may be executed at the same time or sequentially in any order, and the present invention is not particularly limited.

In addition, after the step S202, the method may further include:

S206, storing the text information generated after the identification in the database; in this step, the server sends the text information generated after the identification to the database connected to the server for use. This step S206 can be performed simultaneously with any of steps S203 to S205 or sequentially in any order, and the present invention is not particularly limited.

After the step S202, the method may further include:

S207, the auxiliary error correction information is sent to the sending terminal; this step may be performed simultaneously with any one of steps S203 to S205 or in any order, and the present invention is not particularly limited. Preferably, step S207 can be performed simultaneously with step S205, that is, while transmitting the text information generated after the identification to the transmitting terminal, the error assisting correction information is simultaneously sent to the transmitting terminal, and the transmitting terminal modifies the recognized text information.

In the speech recognition process, a word graph and a multi-candidate candidate information will be generated. In step S207, an algorithm may be used according to the information in the word map, and an alternative error correction word may be recommended to the user. selected. This information can be used to assist in more efficient recognition of text through the return transmission terminal. Make error corrections. For example, when the user of the sending terminal selects an error correction and clicks on a word identifying the error, other candidate words of the word can be obtained through the auxiliary correction information, and displayed on the virtual keyboard, the user can click through the correct word. Candidates efficiently perform error correction. Specifically, for example, the user says: "I want to buy a yellow one", the speech recognition error is recognized as "I want to buy red", when the user clicks on the word "red", the algorithm can prompt according to the word map information. The second candidate for "yellow" is for the user to click. When the user clicks "yellow", the replacement error correction operation is completed, which is very simple and fast.

Thereafter, the method may further include:

Step S208: Receive the edited text information sent by the sending terminal, and send the information to the receiving terminal. In this step, after the user of the sending terminal completes the correction, the sending terminal sends the edited text information to the server, and the server receives the error. The edited text message is sent to the receiving terminal.

Preferably, after step S208, the present invention may further include:

In step S209, the edited text information is sent to the database.

In this step, the corrected automatic speech recognition result is of high value and is particularly important. It prompts: 1) the server fails to correctly recognize the speech information; 2) the correct text information of the speech information has been The user gives it by correcting it. For such post-editing text information, the speech recognition system's training algorithm can be used to record the erroneous text content, the corresponding speech content and the correct speech content, so as to avoid making similar mistakes thereafter. The function of this type of error correction data for the self-evolution of the speech recognition system is Other information is unmatched.

In summary, the second embodiment of the present invention provides a voice communication-based instant messaging method, which generates voice information through recognition, transmits voice information and text information to a receiving terminal through a server, and sends text information. To the transmitting terminal, after sending to the transmitting terminal, the auxiliary modification information is provided, and the information can be used to enable the user of the transmitting terminal to modify it efficiently. The instant communication method provided by the embodiment facilitates the receiving terminal to receive information, overcomes the obstacle that the receiving terminal cannot listen after receiving the voice information in some occasions, avoids the problem of user privacy leakage, and further ensures that the receiving terminal receives the information. The accuracy of the information.

Third embodiment

A third embodiment of the present invention provides a voice communication based instant messaging method. FIG. 3 is a flowchart of a voice recognition based instant messaging method according to a third embodiment of the present invention. The instant messaging method in the third embodiment of the present invention is applied to the information sending terminal, and includes the following steps:

S301, recording voice information and sending to the server; in this step, the sending terminal can record voice information in an instant communication interface (such as a chat interface), for example, pressing and holding a specified mark or button of the input block to start recording, When the mark or button is released after the recording is completed, the recording is completed. After the recording is completed, the instant messaging interface can be preset to be sent directly, or the transmitting terminal can click another tag or button to send the information to the server via the network.

S302. Receive text generated after the server recognizes the voice information. Information, and display the text information; in this step, the server sends the voice information sent by the terminal for voice recognition to generate text information and returns it to the transmitting terminal, and the transmitting terminal receives the recognized text information and displays it. For example, in the chat interface, the sending terminal sends the recorded voice information to the server in step S301. In this step S302, the sending terminal can receive the text generated by the server after the identification of the voice information in the same chat interface. Information and displayed in the chat interface.

S303, after receiving the correct operation instruction, open the error correction interface, and enter an interface for editing the text information; in this step, when the user of the sending terminal considers that the content of the text information generated after the voice recognition is inconsistent with the voice information, The error correction interface can be opened by issuing a corrective action command. For example, the correct operation instruction may press the text information for the user, and the sending terminal receives the instruction and opens the error correction interface to enter the edit text state, and the correction interface may display an input interface such as a virtual keyboard or a handwriting keyboard for the user. Correct the error. The user can add or delete text information through a virtual keyboard or the like.

Thereafter, the method can further include:

S304: Display the edited text information, and send the edited text information to the server.

In this step, the edited text information after the user of the sending terminal is edited is displayed on the sending end, and the text information is simultaneously uploaded by the sending terminal to the server, and sent by the server to the receiving party and synchronized. The present invention will not be described again.

In a preferred embodiment, after step S302, the method may further include:

Step S302a, receiving the auxiliary modification information sent by the server; in this step, sending the word graph and the recognition word multi-candidate information generated in the speech recognition process to the transmitting terminal, which can assist the transmitting terminal user to further Efficiently correct errors in recognized text.

In step S303, the error correction interface can display not only the text information into the editing interface, the virtual keyboard or the handwriting keyboard, but also the auxiliary modification information sent by the server in step S302a, for example, after the server considers the voice recognition. If a certain sentence or a certain word in the generated text information does not conform to the grammatical composition, the dotted bottom line may be added to the sentence or the word, and the server may send the other position (such as the input interface) of the sending terminal display interface. The auxiliary modification information included in the auxiliary modification information is for the user to select the correct candidate word. Or, when the sender selects an error correction and clicks on a word identifying the error, other candidate words of the word can be obtained through the auxiliary correction information, and displayed on the virtual keyboard, the user can click the correct candidate to efficiently Make error corrections.

In a preferred embodiment, after step S302, the method further includes:

S302b, after receiving the command to play the voice information, playing the voice information; in this step, if the user of the sending terminal issues a voice message command by clicking the displayed text information, the sending terminal may The voice information recorded in step 3101 is played through the earpiece or speaker.

In summary, the third embodiment of the present invention provides an instant messaging method based on voice recognition, which generates voice information through recognition and provides error correction function, so that the user of the transmitting terminal can modify the recognized text information. . The instant communication method provided by the embodiment facilitates the receiving terminal to receive information, overcomes the obstacle that the receiving terminal cannot listen after receiving the voice information in some occasions, avoids the problem of user privacy leakage, and ensures that the receiving terminal receives the information. The accuracy.

Preferably, the third embodiment of the present invention can also receive the auxiliary modification information sent by the server, so that the user can modify the text information efficiently, thereby further improving the accuracy and timeliness of the information.

Fourth embodiment

A fourth embodiment of the present invention provides a voice communication based instant messaging method. FIG. 4 is a flowchart of a voice recognition based instant messaging method according to a fourth embodiment of the present invention. The instant messaging method in the fourth embodiment of the present invention is applied to a receiving terminal of information, and includes the following steps:

S401: Receive voice information sent by the server; in this step, the sending terminal records the voice information and sends the voice information to the server, where the voice information is sent by the server to the receiving terminal;

S402, receiving text information generated by the server after identifying the voice information; in this step, the server sends the voice information to the text message after being voice-recognized, and then sent to the receiving terminal, and the receiving terminal receives the knowledge. Don't generate this textual information.

It should be noted that the step S401 and the step S402 can be performed simultaneously or sequentially, that is, the receiving terminal can receive the voice information and the generated text information simultaneously or sequentially, and the present invention is not particularly limited. Preferably, after the server converts the voice information into text information, the voice information and the text information are simultaneously sent to the receiving terminal, and the receiving terminal simultaneously receives the voice information and the text information.

S403, displaying and marking the text information; in this step, the receiving terminal can display the text information on the interface of the instant messaging. Since the text information is generated after the voice information is identified, in order to distinguish it from the text information directly input by the sender in the text, the text information can be marked, for example, by setting a special background color, font, and marking a special word. Meta (such as "voice recognition" or "ASR") to distinguish between plain text information and speech recognition text information.

In the marking of the text information, a possible way is that when the receiving terminal receives the voice information and the text information corresponding to the voice information, the receiving terminal marks the text information to distinguish it from the server. The text information input by the sending terminal directly in the form of text; another possible way is that the server simultaneously sends a mark when transmitting the text information, and the mark and the text information are simultaneously displayed on the display interface of the receiving terminal. In this case, after step S402, the method further includes:

S402a, receiving the tag information sent by the server.

In this step, the mark information can be, for example, a special background color, a font, a special character (such as "speech recognition" or "ASR") and so on.

Preferably, after step S403, the method may further include:

S404, when receiving the instruction of the user to play the voice information, playing the voice information; in this embodiment, the instruction for playing the voice information may be the user clicking the text information, when the user clicks on the displayed text information. How the receiving terminal plays the voice information received in step S401 through the earpiece or the speaker; Preferably, after step S403, the method may further include:

S405, receiving the edited text information sent by the server, and displaying the edited text information; in this step, after the sending terminal performs error correction on the text information, the sending terminal sends the corrected text information to the server, and the server Sended to the receiving terminal, the receiving terminal receives the edited text information and displays it. Preferably, the receiving terminal can overwrite the text information before modification with the edited text information.

In summary, the fourth embodiment of the present invention provides a voice communication-based instant messaging method, which generates voice information through recognition and provides an error correction function, so that the user of the receiving terminal can directly receive the voice-recognized text. Information, and can be clear whether the text information is sent by the sending terminal directly in text form or after speech recognition. The instant communication method provided by the embodiment facilitates the receiving terminal to receive information, overcomes the obstacle that the receiving terminal cannot listen after receiving the voice information in some occasions, and avoids the problem of user privacy leakage.

FIG. 5 shows an instant messaging system corresponding to the voice recognition based instant messaging method according to the first embodiment of the present invention. As shown in FIG. 5, the instant messaging system 500 in this embodiment includes the following module: a voice information receiving module. The group 501 is configured to receive voice information sent by the sending terminal, and the text information generating module 502 is configured to perform voice recognition on the voice information to generate text information. The first sending module 503 is configured to send the voice information to the receiving. The terminal and the second sending module 504 are configured to send the text information to the receiving terminal.

FIG. 6 shows an instant messaging system 600 corresponding to the voice recognition based instant messaging method according to the second embodiment of the present invention. As shown in FIG. 6, in a preferred embodiment, in addition to the voice information receiving module 601, In addition to the text information generating module 602, the first sending module 603, and the second sending module 604, the system 600 further includes: a third sending module 605, configured to send the text information to the sending terminal.

In addition, the system 600 further includes: an information transceiver module 606, configured to receive the edited text information sent by the sending terminal, and send the information to the receiving terminal.

In a preferred embodiment, the system further includes: a first storage module 607, configured to store the text information in a database.

In a preferred embodiment, the system further includes: The fourth sending module 608 is configured to send the auxiliary error correction information to the sending terminal, and the information sending and receiving module 609 is configured to receive the edited text information sent by the sending terminal, and send the information to the receiving terminal.

In a preferred embodiment, the system further includes: a text information association module 610, configured to send the edited text information to the database, and associate with the text information before correction.

In a preferred embodiment, the auxiliary error correction information includes a word map and a candidate word for a specified word, word or sentence of the text information.

In a preferred embodiment, the word map and candidate words of the specified word, word or sentence are obtained from the database.

In a preferred embodiment, the first sending module and the second sending module are simultaneously executed, and the voice information and the text information are simultaneously sent to the receiving terminal.

FIG. 7 shows an instant messaging system corresponding to the voice recognition based instant messaging method according to the third embodiment of the present invention. As shown in FIG. 7, the instant messaging system 700 in this embodiment includes the following module: voice information recording and sending. The module 701 is configured to record voice information and send it to the server; the text information receiving display module 702 is configured to receive text information generated by identifying the voice information, and display the text information; and the editing module 703 is configured to After receiving the correct operation instruction, enter the interface for editing the text information; the display sending module 704 is configured to display the edited text information, and The edited text message is sent to the server.

In a preferred embodiment, the system further includes: an auxiliary modification information receiving module 705, configured to receive auxiliary modification information sent by the server.

In a preferred embodiment, the auxiliary error correction information includes a word map and a candidate word for a specified word, word or sentence of the text information, and the candidate word is displayed in the interface of the edited text information. .

In a preferred embodiment, the interface for editing text information includes an input interface.

In a preferred embodiment, the system further includes: a voice information playing module 706, configured to play the voice information after receiving the command to play the voice information.

In a preferred embodiment, the playing voice information command is generated by the user clicking the text message.

8 is an instant messaging system corresponding to the voice recognition based instant messaging method according to the fourth embodiment of the present invention. As shown in FIG. 8, the instant messaging system 800 in this embodiment includes the following module: a voice information acquisition module. The group 801 is configured to receive voice information sent by the server, and the text information obtaining module 802 is configured to receive text information generated by the server after the voice information is recognized, and the text information display mark module 803 is configured to display and mark The text information.

In a preferred embodiment, the system further includes: The tag information obtaining module 804 is configured to receive tag information sent by the server.

In a preferred embodiment, the text information acquisition module and the mark information acquisition module are simultaneously executed, and the text information and the mark information are simultaneously acquired.

In a preferred embodiment, the text information display tag module is configured to display the text information, and mark the text information by using the tag information.

In a preferred embodiment, the system further includes: a voice information playing module 805, configured to play the voice information when receiving an instruction of the user to play the voice information.

In a preferred embodiment, the instruction to play the voice message is generated by the user clicking the text message.

In a preferred embodiment, the system further includes: a receiving display module 806, configured to receive the edited text information sent by the server, and display the edited text information.

In a preferred embodiment, the edited text information is displayed in a manner that covers the pre-edit text information.

For the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

In summary, the voice recognition based instant messaging method and the instant messaging system proposed by the embodiments of the present invention have at least the following advantages:

(1) Voice recognition based instant messaging proposed by the embodiment of the present invention In the method and the instant communication system, the voice recognition function overcomes the obstacle of obtaining information by the receiving terminal, which is convenient for the user to use and avoids the problem of privacy leakage.

(2) The voice recognition-based instant messaging method and the instant messaging system according to the embodiment of the present invention enable the transmitting terminal to correct the error of the voice recognition system through the error modification function;

(3) The voice recognition-based instant messaging method and the instant messaging system according to the embodiment of the present invention obtain real identification error data through the data collection function to improve the performance of the voice recognition system.

(4) In the voice communication-based instant messaging method and the instant messaging system according to the embodiment of the present invention, the error correction step facilitates the transmission terminal to perform error correction;

(5) In the voice communication-based instant messaging method and the instant messaging system according to the embodiment of the present invention, the step of information marking is convenient for the receiving terminal to recognize whether the received information is virtual keyboard input or voice information;

(6) In the voice communication-based instant communication method and the instant communication system according to the embodiment of the present invention, if it is voice information, the receiving terminal can select the text information generated after the voice information is recognized, and replay the original voice information.

The various embodiments in the present specification are described in a progressive manner, and each embodiment focuses on differences from other embodiments, and the same similar parts between the various embodiments can be referred to each other.

Those skilled in the art will appreciate that embodiments of the embodiments of the invention may be provided as a method, apparatus, or computer program product. Therefore, the present invention The embodiment may take the form of a completely hard embodiment, a fully software embodiment, or an embodiment combining soft and hardware aspects. Moreover, embodiments of the present invention may employ computer program products implemented on one or more computer usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) including computer usable code. form.

In a typical configuration, the computer device includes one or more processors (CPUs), input/output interfaces, a network interface, and memory. The memory may include non-permanent memory, random access memory (RAM) and/or non-volatile memory in computer readable media, such as read only memory (ROM) or flash memory ( Flash RAM). Memory is an example of a computer readable medium. Computer readable media including both permanent and non-permanent, removable and non-removable media can be stored by any method or technology. The signals can be computer readable instructions, data structures, modules of programs, or other materials. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), and other types of random access memory (RAM). Read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM only, digitally versatile A compact disc (DVD) or other optical storage, magnetic cassette, magnetic tape storage or other magnetic storage device or any other non-transportable medium can be used to store signals that can be accessed by the computing device. As defined herein, computer readable media does not include transitory computer readable media, such as modulated data signals and carrier waves.

Embodiments of the invention are described with reference to flowchart illustrations and/or block diagrams of a method, a terminal device (system), and a computer program product according to an embodiment of the invention. It will be understood that each flow and/or block of flowcharts and/or block diagrams, and combinations of flow and/or blocks in the flowcharts. These computer program instructions can be provided to a processor of a general purpose computer, a special purpose computer, an embedded processor or other programmable data processing terminal device to generate a machine for execution by a processor of a computer or other programmable data processing terminal device The instructions generate means for implementing the functions specified in one or more flows of the flowchart or in a block or blocks of the block diagram.

The computer program instructions can also be stored in a computer readable memory that can boot a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer readable memory include the manufacture of the instruction device. The instruction means implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device to perform a series of operational steps on a computer or other programmable terminal device to produce computer-implemented processing for use on a computer or other programmable computer. The instructions executed on the design terminal device provide steps for implementing the functions specified in one or more flows of the flowchart or in a block or blocks of the flowchart.

While a preferred embodiment of the present invention has been described, it will be apparent that those skilled in the art can make various changes and modifications to the embodiments. Therefore, the scope of the attached patent application is intended All changes and modifications that come within the scope of the embodiments of the invention are intended to be included.

Finally, it should also be noted that in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these entities. There is any such actual relationship or order between operations. Furthermore, the terms "comprises" or "comprising" or "comprising" or any other variations are intended to encompass a non-exclusive inclusion, such that a process, method, article, or terminal device that includes a plurality of elements includes not only those elements but also Other elements that are included, or include elements inherent to such a process, method, article, or terminal device. An element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, article, or terminal device that comprises the element, without further limitation.

The above is a detailed description of a voice recognition-based instant messaging method and an instant messaging system provided by the present invention. The principles and implementations of the present invention are described in detail herein. The description of the above embodiments is only used for To help understand the method of the present invention and its core idea; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in specific embodiments and application scopes. It should not be construed as limiting the invention.

Claims (32)

An instant messaging method based on voice recognition, comprising: receiving voice information sent by a sending terminal; performing voice recognition on the voice information to generate text information; transmitting the voice information to a receiving terminal; and transmitting the text information To the receiving terminal. The instant messaging method of claim 1, wherein after the voice information is voice-recognized to generate text information, the method further comprises: transmitting the text information to the transmitting terminal. The instant messaging method of claim 2, wherein after the text information is sent to the transmitting terminal, the method further comprises: receiving the edited text information sent by the transmitting terminal, and transmitting the information to the receiving terminal. The instant messaging method according to claim 3, wherein after the voice information is voice-recognized to generate text information, and after receiving the edited text information sent by the transmitting terminal, and transmitting to the receiving terminal, The method further includes transmitting the auxiliary error correction information to the transmitting terminal, the auxiliary error correction information including a word map and a candidate word for the specified word, word or sentence of the text information. The instant messaging method as described in claim 2, After the voice information is voice-recognized and the text information is generated, the method further includes: storing the text information in the database; after performing the voice recognition on the voice information to generate the text information, the method further includes: The auxiliary error correction information is sent to the sending terminal; the edited text information sent by the sending terminal is received and sent to the receiving terminal; and after the edited text information sent by the sending terminal is sent to the receiving terminal, the method further includes: The edited text message is sent to the database and associated with the text message before correction. The instant messaging method of claim 5, wherein the auxiliary error correction information comprises a word map and a candidate word for a specified word, word or sentence for the text information, the word of the specified word, word or sentence. Figures and candidate words are obtained from this database. An instant communication method based on voice recognition, comprising: recording voice information and transmitting to a server; receiving text information generated by identifying the voice information, and displaying the text information; after receiving the correct operation instruction, entering Edit the interface of the text message; display the edited text message and send the edited text message to the server Server. The instant messaging method of claim 7, wherein after receiving the text information generated by identifying the voice information and displaying the text information, the method further comprises: receiving the auxiliary modification information sent by the server, where The auxiliary error correction information includes a word map and a candidate word for a specified word, word or sentence of the text information, and the candidate word is displayed in the interface of the edited text information. The instant messaging method of claim 7, wherein after receiving the text information generated by the recognized voice information and displaying the text information, the method further comprises: after receiving the instruction to play the voice information, playing Voice information. The instant messaging method of claim 9, wherein the playing voice information command is generated by the user clicking the text message. An instant messaging method based on voice recognition, comprising: receiving voice information sent by a server; receiving text information generated by the server after identifying the voice information; and displaying and marking the text information. The instant messaging method of claim 11, wherein the method further comprises: receiving the tag information sent by the server. An instant messaging method as described in claim 12, The step of displaying and marking the text information includes: displaying the text information, and marking the text information by using the mark information. The instant messaging method of claim 11, wherein after the step of displaying and marking the text information, the method further comprises: when receiving the user's instruction to play the voice information, playing the voice information, The instruction to play the voice message is generated by the user clicking the text message. The instant messaging method of claim 11, wherein after the step of displaying and marking the text information, the method further comprises: receiving the edited text information sent by the server, and displaying the edited text information. The instant messaging method of claim 15, wherein the edited text information is displayed in a manner covering the pre-edit text information. An instant messaging system based on voice recognition, comprising: a voice information receiving module, configured to receive voice information sent by a sending terminal; and a text information generating module, configured to perform voice recognition on the voice information to generate text information a first sending module, configured to send the voice information to the receiving terminal; And a second sending module, configured to send the text information to the receiving terminal. The instant messaging system of claim 17, wherein the system further comprises: a third sending module, configured to send the text information to the transmitting terminal. The instant messaging system of claim 18, wherein the system further comprises: an information transceiving module, configured to receive the edited text information sent by the transmitting terminal, and send the information to the receiving terminal. The instant messaging system of claim 19, wherein the system further comprises: a fourth sending module, configured to send the auxiliary error correction information to the sending terminal, the auxiliary error correcting information including the text information Specify word and candidate words for words, words, or sentences. The instant messaging system of claim 18, wherein the system further comprises: a first storage module, wherein the text information is stored in a fourth sending module of the database, for sending auxiliary error correction information to a sending terminal; the information receiving and receiving module is configured to receive the edited text information sent by the sending terminal, and send the information to the receiving terminal; and the text information associating module, configured to send the edited text information to the database, and before the correction The text information is associated. The instant messaging system of claim 21, wherein the auxiliary error correction information includes a specified word for the text information, A word map and a candidate word for a word or sentence from which the word map and candidate words of the specified word, sentence or sentence are obtained. An instant messaging system based on voice recognition, comprising: a voice information recording and transmitting module, configured to record voice information and sent to a server; and a text information receiving display module, configured to receive the voice information generated by the voice information Text information, and display the text information; the editing module is used to enter the interface for editing the text information after receiving the correct operation instruction; and the display sending module is used to display the edited text information, and the edited text information is Send to the server. The instant messaging system of claim 23, wherein the system further comprises: an auxiliary modification information receiving module, configured to receive auxiliary modification information sent by the server, the auxiliary error correction information including the text information A word map and a candidate word of a word, a word, or a sentence are displayed, and the candidate word is displayed in the interface of the edited text information. The instant messaging system of claim 23, wherein the system further comprises: a voice information playing module, configured to play the voice information after receiving the instruction to play the voice information. The instant messaging system of claim 25, wherein the playing voice information command is clicked by the user to click the text information product Health. An instant messaging system based on voice recognition, comprising: a voice information acquiring module, configured to receive voice information sent by a server; and a text information acquiring module, configured to receive a voice information sent by a server to generate the voice information Text information; and a text message display tag module for displaying and tagging the text message. The instant messaging system of claim 27, wherein the system further comprises: a tag information acquisition module, configured to receive tag information sent by the server. The instant messaging system of claim 28, wherein the text information display tag module is configured to display the text information, and use the tag information to mark the text information. The instant messaging system of claim 27, wherein the system further comprises: a voice information playing module, configured to: when receiving an instruction of the user to play the voice information, play the voice information, and play the The voice message command is generated by the user clicking the text message. The instant messaging system of claim 27, wherein the system further comprises: a receiving display module, configured to receive the edited text sent by the server Message, and display the edited text information. The instant messaging system of claim 31, wherein the edited text information is displayed in a manner that covers pre-edit text information.