WO2021128880A1 - Procédé et dispositif de reconnaissance vocale - Google Patents

Procédé et dispositif de reconnaissance vocale Download PDF

Info

Publication number
WO2021128880A1
WO2021128880A1 PCT/CN2020/110037 CN2020110037W WO2021128880A1 WO 2021128880 A1 WO2021128880 A1 WO 2021128880A1 CN 2020110037 W CN2020110037 W CN 2020110037W WO 2021128880 A1 WO2021128880 A1 WO 2021128880A1
Authority
WO
WIPO (PCT)
Prior art keywords
personalized
vocabulary
users
user
similarity
Prior art date
Application number
PCT/CN2020/110037
Other languages
English (en)
Chinese (zh)
Inventor
郑宏
Original Assignee
北京搜狗科技发展有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京搜狗科技发展有限公司 filed Critical 北京搜狗科技发展有限公司
Publication of WO2021128880A1 publication Critical patent/WO2021128880A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems

Definitions

  • This application relates to the field of computer technology, and in particular to a voice recognition method, device, and device for voice recognition.
  • Voice recognition technology is a technology that allows machines to convert voice signals into corresponding texts or commands through the process of recognition and understanding.
  • speech recognition technology has been developed rapidly, the accuracy of speech recognition has been continuously improved, and the application in the field of human-computer interaction is gradually expanding.
  • the embodiments of the present application provide a voice recognition method, device, and device for voice recognition, which can improve the accuracy of voice recognition.
  • an embodiment of the present application discloses a voice recognition method, and the method includes:
  • the personalized vocabulary being established based on historical input content generated during the user's use of the input method
  • the speech recognition result corresponding to the speech information is determined.
  • an embodiment of the present application discloses a voice recognition device, which includes:
  • the voice receiving module is used to receive the voice information input by the user
  • Thesaurus acquisition module configured to acquire the user's personalized thesaurus, the personalized thesaurus is established based on the historical input content generated during the user's use of the input method;
  • a weight determination module configured to determine the decoding path weight corresponding to the voice information according to the personalized vocabulary
  • the result determining module is configured to determine the voice recognition result corresponding to the voice information according to the decoding path weight.
  • an embodiment of the present application discloses a device for speech recognition, including a memory, and one or more programs, wherein one or more programs are stored in the memory and configured to be composed of one or more programs.
  • the execution of the one or more programs by the above processor includes instructions for performing the following operations:
  • the personalized vocabulary being established based on historical input content generated during the user's use of the input method
  • the speech recognition result corresponding to the speech information is determined.
  • an embodiment of the present application discloses a machine-readable medium with instructions stored thereon, which when executed by one or more processors, cause the device to execute one or more of the aforementioned voice recognition methods.
  • the embodiment of the application After receiving the voice information input by the user, the embodiment of the application obtains the user's personalized vocabulary, and determines the decoding path weight corresponding to the voice information according to the personalized vocabulary, and according to the decoding path weight To determine the voice recognition result corresponding to the voice information. Since the personalized thesaurus is established based on the historical input content generated during the user’s use of the input method, the personalized dictionary conforms to the user’s input habits, and can be based on the user’s input in the process of decoding the voice information input by the user. The personalized vocabulary of ”performs real-time weighting on the speech decoding path, so that the final recognition result tends to the user’s input habits, thereby improving the accuracy of speech recognition.
  • Fig. 1 is a flowchart of steps of an embodiment of a speech recognition method of the present application
  • Fig. 2 is a structural block diagram of an embodiment of a speech recognition device of the present application
  • FIG. 3 is a block diagram of a device 800 for speech recognition according to the present application.
  • Fig. 4 is a schematic diagram of the structure of a server in some embodiments of the present application.
  • Step 101 Receive voice information input by a user
  • Step 102 Obtain a personalized vocabulary of the user, where the personalized vocabulary is established based on historical input content generated when the user uses the input method;
  • Step 103 Determine the decoding path weight corresponding to the voice information according to the personalized vocabulary
  • Step 104 Determine a voice recognition result corresponding to the voice information according to the decoding path weight.
  • the voice recognition method in the embodiments of this application can be applied to electronic devices, including but not limited to: servers, smart phones, tablets, e-book readers, MP3 (Moving Picture Experts Compression Standard Audio Level 3, Moving Picture Experts) Group Audio Layer III) Players, MP4 (Moving Picture Experts Group Audio Layer IV) Players, laptop portable computers, car computers, desktop computers, set-top boxes, smart TVs, wearables Equipment and so on.
  • electronic devices including but not limited to: servers, smart phones, tablets, e-book readers, MP3 (Moving Picture Experts Compression Standard Audio Level 3, Moving Picture Experts) Group Audio Layer III) Players, MP4 (Moving Picture Experts Group Audio Layer IV) Players, laptop portable computers, car computers, desktop computers, set-top boxes, smart TVs, wearables Equipment and so on.
  • the voice recognition method of the embodiment of the present application can be used to automatically recognize the voice information input by the user, and convert the voice information into corresponding text information.
  • the voice information may be a continuous voice, such as a sentence, a sentence, and so on. It can be understood that the embodiment of the present application does not limit the source of the voice information.
  • the voice information may be a voice segment collected in real time through the recording function of the electronic device.
  • the obtaining the voice information input by the user may specifically include: obtaining the voice information input or sent or received by the user through an instant messaging application.
  • the instant messaging application is an application program that implements online chat and communication through instant messaging technology.
  • the voice information acquired by the embodiment of the present application may include: voice information input by the user through an instant messaging application, voice information sent by the user to the communication peer through the instant messaging application, and voice information received by the user from the communication peer through the instant messaging application.
  • the voice information input by the user may be divided into multiple frames of voice segments according to the preset window length and frame shift.
  • the window length can be used to represent the duration of each frame of speech segment
  • the frame shift can be used to represent the time difference between adjacent frames. For example, when the window length is 25ms and the frame is shifted by 15ms, the first frame of speech segment is 0-25ms, the second frame of speech segment is 15-40ms, and so on.
  • the specific window length and frame shift can be set according to actual needs, which is not limited in the embodiment of the present application.
  • the electronic device may also perform noise reduction processing on the voice information, so as to improve the subsequent system's ability to process the information.
  • this embodiment of the application pre-establishes a personalized vocabulary for users.
  • the personalized vocabulary is established based on the historical input content generated during the user's use of the input method, and can reflect the user's input. habit.
  • the embodiment of this application establishes its own personalized word database for each user based on the historical input content generated by each user in the process of using the input method.
  • the personalized word database conforms to the user's input habits and is based on the user's personalized word database.
  • the decoding path weight corresponding to the voice information input by the user can be determined, and then the speech recognition result corresponding to the speech information can be determined according to the decoding path weight.
  • the historical input content generated during the user's use of the input method may specifically include: text content that has been on the screen before the current cursor position, or text content copied by the user.
  • the historical input content may also be text content input by the user in an instant messaging application and sent to the communication peer, or may also be text content input by the user in an input environment such as a browser, document, microblog, and mail; It can be understood that the embodiment of the present application does not limit the specific source of the historical input content.
  • the voice decoder when the "libing" voice information input by user A is received, the voice decoder combines user A's personalized vocabulary in the process of decoding user A's voice information. It is known that the historical input content generated during the input method of user A often contains "Li Bing". Therefore, additional weight can be added to the decoding path containing "Li Bing", so that the decoding path is preferentially selected, and user A's voice is obtained. The voice recognition result of the message is "Li Bing".
  • the voice decoder can automatically load the user’s personalized vocabulary, and then decode the personalized vocabulary that hits the personalized vocabulary during the decoding process.
  • the path is weighted in real time, so that the final recognition result is inclined to the user's input habits, which can improve the accuracy of speech recognition.
  • the method may further include:
  • Step S11 Collect historical input content generated by the user in the process of using the input method
  • Step S12 preprocessing the historical input content to obtain preprocessed historical input content
  • Step S13 Filter non-personalized words in the preprocessed historical input content to obtain personalized words
  • Step S14 Establish a personalized vocabulary of the user according to the personalized vocabulary.
  • the embodiment of the present application can save the historical input content generated by the user through the input method when the user uses the input method, and establish the user's personalized vocabulary based on the historical input content.
  • the historical input content can be stored in the user's terminal device, or can be stored in a cloud server.
  • the embodiment of the present application may preprocess the user's historical input content, for example, perform data cleaning on the historical input content, remove noise data, etc., to obtain the preprocessed historical input content.
  • filter the non-personalized vocabulary in the preprocessed historical input content to obtain the personalized vocabulary.
  • the non-personalized vocabulary may include conjunctions, prepositions, function words and so on.
  • the personalized vocabulary may include common person names, place names, organization names, personal idioms, domain interest vocabulary, internet hot words, etc. It can be understood that the type of the personalized vocabulary can be preset according to actual needs, and the embodiment of the present application does not limit the type of the personalized vocabulary.
  • the personalized vocabulary can be used as a kind of portrait description of the user.
  • the personalized vocabulary can be stored in the user's terminal device, or can be stored in a cloud server, and the user's personalized vocabulary has a one-to-one correspondence with the user's identity information. For example, the correspondence relationship between the user identification and the user's personalized vocabulary can be established, or the correspondence between the user's voiceprint characteristics and the user's personalized vocabulary can also be established.
  • the user identification of the user such as a login account
  • voiceprint recognition of the voice input by the user can be performed to obtain the voiceprint characteristics of the user.
  • the user’s personalized vocabulary can be loaded from the cloud server.
  • the weight of the decoding path that hits the personalized vocabulary It can be enhanced in real time, so that the final voice recognition result tends to the personalized vocabulary in the user's personalized vocabulary, which conforms to the user's input habits.
  • the user's personalized vocabulary can be updated periodically. For example, after the user’s personalized vocabulary is established, the input content generated by the user through the input method can be obtained in real time, and the input content can be preprocessed and filtered to obtain personalized vocabulary, which is added to the user’s existing personalized vocabulary In this way, the user’s personalized vocabulary can be continuously updated to adapt to the user’s new input habits and preferences.
  • the method may further include:
  • Step S21 Calculate the similarity between the personalized word databases of at least two users
  • Step S22 If it is determined that the similarity satisfies the preset condition, merge the personalized vocabulary of the at least two users to obtain a combined personalized vocabulary.
  • the embodiment of the present application calculates the similarity of the personalized vocabulary of different users to determine whether the user has similar input habits, and merges the personalized vocabulary of users with similar input habits to realize the personality of the user.
  • the lexicon is expanded.
  • the personalized vocabulary of the at least two users can be merged , Get the merged personalized vocabulary.
  • obtaining the personalized vocabulary of the user may specifically include: obtaining the merged personalized vocabulary.
  • the merged personalized vocabulary N(uv) can be loaded, and the decoding path weight corresponding to the voice information can be determined according to the personalized vocabulary in N(uv).
  • the merged personalized vocabulary N(uv) can be loaded, and the decoding path corresponding to the voice information can be determined according to the personalized vocabulary in N(uv) Weights.
  • the calculating the similarity between the personalized vocabulary of at least two users may specifically include:
  • Step S31 Calculate the cosine distance between the personalized word databases of the at least two users according to the common vocabulary included in the personalized word databases of the at least two users;
  • Step S32 Calculate the similarity between the personalized vocabulary of the at least two users according to the cosine distance.
  • the embodiment of the present application can calculate the similarity between users through the common personalized vocabulary included in the user personalized vocabulary.
  • the embodiment of the present application may calculate the cosine distance between the personalized word databases of at least two users according to the common vocabulary included in the personalized word databases of the at least two users.
  • the common vocabulary refers to the number of common personalized vocabulary.
  • N(u) denote user U’s personalized vocabulary, including user U’s personalized vocabulary
  • N(v) denote user V’s personalized vocabulary, including user V Personalized vocabulary.
  • the similarity W UV between N(u) and N(v) can be calculated by the cosine distance, as follows:
  • Step S22 determines that the similarity between the personalized vocabularies of the at least two users meets a preset condition, which may specifically include: if the cosine distance between the personalized vocabularies of the at least two users is less than a preset threshold, It is determined that the similarity between the personalized word databases of the at least two users meets the preset condition. That is, if W UV is less than the preset threshold, it can be determined that the similarity between user U's personalized vocabulary N(u) and user V's personalized vocabulary N(v) satisfies the preset condition, and N(u ) And N(v) can be combined.
  • a preset condition may specifically include: if the cosine distance between the personalized vocabularies of the at least two users is less than a preset threshold, It is determined that the similarity between the personalized word databases of the at least two users meets the preset condition. That is, if W UV is less than the preset threshold, it can be determined that the similarity between user U's personalized vocabulary
  • the method may further include:
  • Step S41 Classify the personalized vocabulary according to the field corresponding to the personalized vocabulary in the personalized vocabulary;
  • Step S42 Perform statistics on the personalized vocabulary corresponding to different fields in the personalized vocabulary, and determine the personalized label corresponding to the personalized vocabulary.
  • the field to which the personalized vocabulary belongs in the user's personalized vocabulary can also be determined, and then the user's personalized vocabulary can be marked with a personalized label indicating the field tendency.
  • the user’s personalized vocabulary contains personalized words such as “hot pot”, “western food”, “net celebrity restaurant”, etc., since these personalized words correspond to “food”, the user’s personalization can be determined
  • the personalized labels corresponding to the thesaurus are “food”, “food”, etc.
  • the user’s personalized vocabulary contains personalized words such as “blockchain”, “face recognition”, and “cloud computing”, since the corresponding field of these personalized words is "IT technology”, it can be determined
  • the personalized tags corresponding to the user's personalized vocabulary are "IT Engineer", “IT Technology”, etc.
  • personalized vocabulary corresponding to different fields can be preset, and the personalized vocabulary corresponding to different fields in the user's personalized vocabulary can be counted, and the personalized label corresponding to the personalized vocabulary can be determined.
  • the user's personalized vocabulary can be labeled with multiple different personalized tags.
  • the personalized vocabulary corresponding to different fields in a user’s personalized vocabulary is counted, and the user’s personalized vocabulary includes the fields of "finance", "judicial", and "medical health”.
  • the personalized vocabulary of the user can be labeled with multiple personalized labels such as “financial”, “judicial”, and “medical health” for the user's personalized vocabulary.
  • Step S22 determines that the similarity between the personalized vocabularies of the at least two users meets a preset condition, which may specifically include: if the personalized vocabularies of the at least two users have the same personalized tag, determining that all the personalized vocabularies of the at least two users have the same personalized tag. It is stated that the similarity between the personalized word databases of at least two users meets the preset condition.
  • two users have the same personalized tag, it means that the two users have the same field tendency. For example, the two users may be engaged in the same profession or have the same hobbies. Therefore, if it is determined that the personalized vocabularies of at least two users have the same personalized label, it can be determined that the similarity between the personalized vocabularies of the at least two users meets the preset condition, and the at least two user The personalized vocabulary of each user is merged.
  • the merging of the personalized vocabulary of the at least two users in step S22 to obtain the merged personalized vocabulary may specifically include:
  • the vocabulary that meets the matching condition in the personalized vocabulary of the at least two users is merged to obtain a merged personalized vocabulary.
  • the personalized vocabulary of the at least two users may be merged, and two solutions may be adopted for the merging.
  • all vocabularies in the personalized vocabulary to be merged can be combined.
  • N(u) denote user U's personalized vocabulary, which includes user U's personalized vocabulary
  • N(v) represents user V's personalized vocabulary, which includes user V's personalized vocabulary. If the similarity between N(u) and N(v) meets the preset condition, all words in N(u) and all words in N(v) can be merged.
  • de-duplication can be performed after merging. After processing, the merged personalized vocabulary is obtained.
  • the matching conditions may include: belonging to the same field, having the same personalized label, and so on. It can be understood that those skilled in the art can set the matching conditions according to actual needs. For example, in the above example, after determining that the similarity between N(u) and N(v) meets a preset condition, the words that meet the matching condition can be further determined in N(u) and N(v), such as determining N( U) and N(v) belong to the same field vocabulary, and then only the words belonging to the same field in N(u) and N(v) are merged. Of course, after the merge, you can perform de-duplication and other processing to obtain the merged Personalized thesaurus.
  • the determining the decoding path weight corresponding to the voice information according to the personalized vocabulary may specifically include:
  • Step S51 matching the word sequences corresponding to each decoding path of the voice information with the personalized word database
  • Step S52 Determine the weight of the decoding path corresponding to the matched vocabulary according to the word frequency information corresponding to the matched vocabulary of the word sequence in the personalized vocabulary.
  • the voice segment corresponding to the voice information may be scored by the acoustic model and the language model by the frame by frame through a preset decoding network, so as to obtain a voice recognition result.
  • the basic structure of the decoding network is a directed graph composed of nodes and arcs. Each arc can save an entry and its acoustic model information and/or language model information.
  • acoustic model information is generally expressed as acoustic model scores
  • language model information is generally expressed as language model scores.
  • Speech recognition is the process of finding an optimal path on this directed graph based on the input speech data.
  • the acoustic model is used to calculate the probability from speech to syllable
  • the language model is used to calculate the probability from syllable to word.
  • Both the acoustic model score and the language model score can be obtained through pre-model training.
  • the electronic device on which the voice recognition method runs can obtain the voice recognition result according to the final score result after performing acoustic model scoring and language model checking on the voice segment frame by frame. Specifically, after the acoustic model scoring and the language model checking are performed, the scores of all nodes on each decoding path in the decoding network can be added to form the score of the decoding path. Then, the one or more decoding paths with the highest scores are backtracked, and the word sequence corresponding to the corresponding decoding path can be obtained. In this way, the phrase or sentence composed of the obtained word sequence can be used as the result of speech recognition.
  • Step 104 determining the voice recognition result corresponding to the voice information according to the decoding path weight, may specifically include: determining the voice information corresponding to the weight of the decoding path corresponding to the matching vocabulary in the word sequence of each decoding path The result of speech recognition.
  • the word sequence corresponding to each decoding path is matched with the user's personalized vocabulary, if one or more of the word sequences have matching words in the personalized vocabulary ,
  • the weight of the decoding path corresponding to the matched vocabulary is determined according to the word frequency information corresponding to the matched vocabulary. For example, for the user U, who often inputs "Li Bing" through the input method, his personalized vocabulary may include the personalized vocabulary "Li Bing" and the word frequency corresponding to the personalized vocabulary.
  • the voice decoder will match the word sequence corresponding to each decoding path with the user's personalized vocabulary.
  • the method may further include:
  • Step S61 Acquire context information of the matched vocabulary in the speech recognition result
  • Step S62 Perform error correction on the speech recognition result according to the context information, and obtain an error-corrected speech recognition result.
  • the personalized vocabulary in the user's personalized vocabulary can reflect the user's input habits, only determining the weight of the decoding path based on the personalized vocabulary may cause some false incentives. For example, if the voice information input by a user is "lijiewansui" (Long live understanding), since the user's personalized vocabulary contains the personalized vocabulary "Sister Li” with a high word frequency, it may be recognized as “Long live Lijie” result. However, according to the context information, it can be known that the result that the user wants to output may be “Long Live Understanding", which leads to an error in the recognition result.
  • the context information of the matched vocabulary in the voice recognition result can also be obtained, and based on the context information, the voice recognition result Perform error correction and obtain the speech recognition result after error correction.
  • the voice recognition result can be determined as "Long live Sister Li” according to the user's personalized vocabulary.
  • the context information of the matching vocabulary "Sister Li” in the voice recognition result can be obtained. If the voice recognition result of the obtained voice information is "Long live Sister Li, Silian is not guilty", according to the following information "Silian is not guilty", it can be determined that the voice recognition result is wrong, and the voice recognition result can be corrected.
  • the word sequence with the second highest weight in the decoding path corresponding to the voice information can be obtained.
  • the embodiment of the present application can obtain the user's personalized vocabulary, and determine the decoding path weight corresponding to the voice information according to the personalized vocabulary, and The decoding path weight determines the voice recognition result corresponding to the voice information. Since the personalized thesaurus is established based on the historical input content generated during the user’s use of the input method, the personalized dictionary conforms to the user’s input habits, and can be based on the user’s input in the process of decoding the voice information input by the user.
  • the personalized vocabulary of ” performs real-time weighting on the speech decoding path, so that the final recognition result tends to the user’s input habits, thereby improving the accuracy of speech recognition.
  • FIG. 2 a structural block diagram of an embodiment of a speech recognition device of the present application is shown, and the device may specifically include:
  • the voice receiving module 201 is used to receive voice information input by the user;
  • the lexicon acquisition module 202 is configured to acquire a personalized lexicon of the user, and the personalized lexicon is established based on the historical input content generated during the process of using the input method by the user;
  • the weight determination module 203 is configured to determine the decoding path weight corresponding to the voice information according to the personalized vocabulary
  • the result determining module 204 is configured to determine the voice recognition result corresponding to the voice information according to the decoding path weight.
  • the device may further include:
  • a data collection module which is used to collect historical input content generated by the user in the process of using the input method
  • the data processing module is used to preprocess the historical input content to obtain the preprocessed historical input content
  • the data filtering module is used to filter the non-personalized vocabulary in the pre-processed historical input content to obtain the personalized vocabulary
  • the vocabulary establishment module is used to establish the personalized vocabulary of the user according to the personalized vocabulary.
  • the device may further include:
  • the similarity calculation module is used to calculate the similarity between the personalized vocabulary of at least two users
  • the database merging module is configured to merge the personalized lexicons of the at least two users if it is determined that the similarity between the personalized lexicons of the at least two users meets a preset condition to obtain the merged personality
  • the vocabulary acquisition module is specifically configured to obtain the merged personalized vocabulary.
  • the similarity calculation module may specifically include:
  • the distance calculation submodule is configured to calculate the cosine distance between the personalized word databases of the at least two users according to the common vocabulary included in the personalized word databases of the at least two users;
  • a similarity calculation sub-module configured to calculate the similarity between the personalized vocabularies of the at least two users according to the cosine distance
  • the database merging module may specifically include:
  • the first determining sub-module is configured to determine that if the cosine distance between the personalized vocabularies of the at least two users is less than a preset threshold, determine that the similarity between the personalized vocabularies of the at least two users meets the preset threshold Set conditions.
  • the device may further include:
  • the vocabulary classification module is used to classify the personalized vocabulary according to the field corresponding to the personalized vocabulary in the personalized vocabulary;
  • the label establishment module is configured to perform statistics on the personalized vocabulary corresponding to different fields in the personalized dictionary, and determine the personalized label corresponding to the user;
  • the database merging module may specifically include:
  • the first merging sub-module is used to merge all the words in the personalized vocabulary of the at least two users to obtain a merged personalized vocabulary
  • the first merging sub-module is used to merge the vocabulary that meets the matching condition in the personalized vocabulary of the at least two users to obtain a merged personalized vocabulary.
  • the database merging module may specifically include:
  • the second determining sub-module is configured to determine that the similarity between the personalized vocabularies of the at least two users meets a preset condition if the personalized vocabularies of the at least two users have the same personalized tag.
  • the weight determination module may specifically include:
  • the lexicon matching sub-module is used to match the word sequence corresponding to each decoding path of the voice information with the personalized lexicon;
  • a weight determination submodule configured to determine the weight of the decoding path corresponding to the matched vocabulary according to the word frequency information corresponding to the matched vocabulary of the word sequence in the personalized vocabulary;
  • the result determination module is specifically configured to determine the speech recognition result corresponding to the speech information according to the weight of the decoding path corresponding to the matching vocabulary in the word sequence of each decoding path.
  • the device may further include:
  • a context acquisition module configured to acquire context information of the matched vocabulary in the speech recognition result
  • the result error correction module is configured to perform error correction on the speech recognition result according to the context information to obtain the speech recognition result after the error correction.
  • the description is relatively simple, and for related parts, please refer to the part of the description of the method embodiment.
  • An embodiment of the application provides a device for speech recognition, including a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors
  • the one or more programs include instructions for performing the following operations: receiving voice information input by a user; acquiring a personalized vocabulary of the user, and the personalized vocabulary is generated according to the process of using the input method by the user
  • the historical input content is established; according to the personalized vocabulary, the decoding path weight corresponding to the speech information is determined; according to the decoding path weight, the speech recognition result corresponding to the speech information is determined.
  • Fig. 3 is a block diagram showing a device 800 for speech recognition according to an exemplary embodiment.
  • the device 800 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.
  • the device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, And the communication component 816.
  • the processing component 802 generally controls the overall operations of the device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations.
  • the processing element 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing method.
  • the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components.
  • the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.
  • the memory 804 is configured to store various types of data to support operations in the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc.
  • the memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
  • SRAM static random access memory
  • EEPROM electrically erasable programmable read-only memory
  • EPROM erasable and Programmable Read Only Memory
  • PROM Programmable Read Only Memory
  • ROM Read Only Memory
  • Magnetic Memory Flash Memory
  • Magnetic Disk Magnetic Disk or Optical Disk.
  • the power supply component 806 provides power to various components of the device 800.
  • the power supply component 806 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the device 800.
  • the multimedia component 808 includes a screen that provides an output interface between the device 800 and the user.
  • the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from users.
  • the touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation.
  • the multimedia component 808 includes a front camera and/or a rear camera. When the device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
  • the audio component 810 is configured to output and/or input audio signals.
  • the audio component 810 includes a microphone (MIC), and when the device 800 is in an operation mode, such as a call mode, a recording mode, and a voice information processing mode, the microphone is configured to receive external audio signals.
  • the received audio signal may be further stored in the memory 804 or transmitted via the communication component 816.
  • the audio component 810 further includes a speaker for outputting audio signals.
  • the I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module.
  • the above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: home button, volume button, start button, and lock button.
  • the sensor component 814 includes one or more sensors for providing the device 800 with various aspects of status assessment.
  • the sensor component 814 can detect the on/off status of the device 800 and the relative positioning of components.
  • the component is the display and the keypad of the device 800.
  • the sensor component 814 can also detect the position change of the device 800 or a component of the device 800. , The presence or absence of contact between the user and the device 800, the orientation or acceleration/deceleration of the device 800, and the temperature change of the device 800.
  • the sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact.
  • the sensor component 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications.
  • the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
  • the communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices.
  • the device 800 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof.
  • the communication component 816 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel.
  • the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication.
  • the NFC module can be implemented based on radio frequency information processing (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.
  • RFID radio frequency information processing
  • IrDA infrared data association
  • UWB ultra-wideband
  • Bluetooth Bluetooth
  • the apparatus 800 may be implemented by one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing equipment (DSPD), programmable logic devices (PLD), field programmable A gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
  • ASIC application specific integrated circuits
  • DSP digital signal processors
  • DSPD digital signal processing equipment
  • PLD programmable logic devices
  • FPGA field programmable A gate array
  • controller microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.
  • non-transitory computer-readable storage medium including instructions, such as the memory 804 including instructions, which may be executed by the processor 820 of the device 800 to complete the foregoing method.
  • the non-transitory computer-readable storage medium may be ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
  • Fig. 4 is a schematic diagram of the structure of a server in some embodiments of the present application.
  • the server 1900 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (CPU) 1922 (for example, one or more processors) and a memory 1932, one or one
  • the above storage medium 1930 (for example, one or one storage device with a large amount of storage) for storing application programs 1942 or data 1944.
  • the memory 1932 and the storage medium 1930 may be short-term storage or permanent storage.
  • the program stored in the storage medium 1930 may include one or more modules (not shown in the figure), and each module may include a series of command operations on the server.
  • the central processing unit 1922 may be configured to communicate with the storage medium 1930, and execute a series of instruction operations in the storage medium 1930 on the server 1900.
  • the server 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input and output interfaces 1958, one or more keyboards 1956, and/or, one or more operating systems 1941 , Such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM and so on.
  • a non-transitory computer-readable storage medium when instructions in the storage medium are executed by a processor of a device (server or terminal), the device can execute the voice recognition method shown in FIG. 1.
  • a non-transitory computer-readable storage medium When the instructions in the storage medium are executed by the processor of the device (server or terminal), the device can execute a voice recognition method, the method comprising: receiving user input Acquire the user’s personalized vocabulary, the personalized vocabulary is established based on the historical input content generated during the user’s use of the input method; determine the voice according to the personalized vocabulary The decoding path weight corresponding to the information; and the speech recognition result corresponding to the speech information is determined according to the decoding path weight.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing terminal equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the instruction device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing terminal equipment, so that a series of operation steps are executed on the computer or other programmable terminal equipment to produce computer-implemented processing, so that the computer or other programmable terminal equipment
  • the instructions executed above provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Machine Translation (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

La présente invention concerne un procédé et un dispositif de reconnaissance vocale (800). En particulier, le procédé consiste : à recevoir des informations vocales entrées par un utilisateur (101) ; à obtenir un vocabulaire personnalisé de l'utilisateur, le vocabulaire personnalisé étant établi en fonction d'un contenu d'entrée historique généré selon un procédé au cours duquel l'utilisateur utilise un procédé d'entrée (102) ; selon le vocabulaire personnalisé, à déterminer un poids de trajet de décodage correspondant aux informations vocales (103) ; et selon le poids de trajet de décodage, à déterminer un résultat de reconnaissance vocale correspondant aux informations vocales (104). Le procédé et le dispositif décrits (800) peuvent améliorer la précision de la reconnaissance vocale.
PCT/CN2020/110037 2019-12-26 2020-08-19 Procédé et dispositif de reconnaissance vocale WO2021128880A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911369489.9A CN111145756B (zh) 2019-12-26 2019-12-26 一种语音识别方法、装置和用于语音识别的装置
CN201911369489.9 2019-12-26

Publications (1)

Publication Number Publication Date
WO2021128880A1 true WO2021128880A1 (fr) 2021-07-01

Family

ID=70520583

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/110037 WO2021128880A1 (fr) 2019-12-26 2020-08-19 Procédé et dispositif de reconnaissance vocale

Country Status (2)

Country Link
CN (1) CN111145756B (fr)
WO (1) WO2021128880A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114327355A (zh) * 2021-12-30 2022-04-12 科大讯飞股份有限公司 语音输入方法、电子设备以及计算机存储介质

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111145756B (zh) * 2019-12-26 2022-06-14 北京搜狗科技发展有限公司 一种语音识别方法、装置和用于语音识别的装置
CN111627438A (zh) * 2020-05-21 2020-09-04 四川虹美智能科技有限公司 语音识别方法及装置
CN113808593A (zh) * 2020-06-16 2021-12-17 阿里巴巴集团控股有限公司 语音交互系统、相关方法、装置及设备
CN112735428A (zh) * 2020-12-27 2021-04-30 科大讯飞(上海)科技有限公司 一种热词获取方法、语音识别方法及相关设备
CN112700764B (zh) * 2021-03-19 2021-06-08 北京沃丰时代数据科技有限公司 热词语音识别方法、装置、电子设备及存储介质
CN113593566A (zh) * 2021-06-08 2021-11-02 深圳双猴科技有限公司 语音识别处理方法及系统
CN113436614B (zh) * 2021-07-02 2024-02-13 中国科学技术大学 语音识别方法、装置、设备、系统及存储介质
CN113744740A (zh) * 2021-09-03 2021-12-03 北京烽火万家科技有限公司 基于边缘计算超算AIpass的语音识别方法、装置及系统
CN113963695A (zh) * 2021-10-13 2022-01-21 深圳市欧瑞博科技股份有限公司 一种智能设备的唤醒方法、装置、设备及存储介质

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5937383A (en) * 1996-02-02 1999-08-10 International Business Machines Corporation Apparatus and methods for speech recognition including individual or speaker class dependent decoding history caches for fast word acceptance or rejection
US20010039492A1 (en) * 2000-05-02 2001-11-08 International Business Machines Corporation Method, system, and apparatus for speech recognition
US20110066434A1 (en) * 2009-09-17 2011-03-17 Li Tze-Fen Method for Speech Recognition on All Languages and for Inputing words using Speech Recognition
CN105448292A (zh) * 2014-08-19 2016-03-30 北京羽扇智信息科技有限公司 一种基于场景的实时语音识别系统和方法
CN108717851A (zh) * 2018-03-28 2018-10-30 深圳市三诺数字科技有限公司 一种语音识别方法及装置
CN109243468A (zh) * 2018-11-14 2019-01-18 北京羽扇智信息科技有限公司 语音识别方法、装置、电子设备及存储介质
CN109377998A (zh) * 2018-12-11 2019-02-22 科大讯飞股份有限公司 一种语音交互方法及装置
CN110211576A (zh) * 2019-04-28 2019-09-06 北京蓦然认知科技有限公司 一种语音识别的方法、装置和系统
CN111145756A (zh) * 2019-12-26 2020-05-12 北京搜狗科技发展有限公司 一种语音识别方法、装置和用于语音识别的装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8532994B2 (en) * 2010-08-27 2013-09-10 Cisco Technology, Inc. Speech recognition using a personal vocabulary and language model
CN103065630B (zh) * 2012-12-28 2015-01-07 科大讯飞股份有限公司 用户个性化信息语音识别方法及系统
KR20180074210A (ko) * 2016-12-23 2018-07-03 삼성전자주식회사 전자 장치 및 전자 장치의 음성 인식 방법
CN109243430B (zh) * 2017-07-04 2022-03-01 北京搜狗科技发展有限公司 一种语音识别方法及装置
CN108831439B (zh) * 2018-06-27 2023-04-18 广州视源电子科技股份有限公司 语音识别方法、装置、设备和系统

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5937383A (en) * 1996-02-02 1999-08-10 International Business Machines Corporation Apparatus and methods for speech recognition including individual or speaker class dependent decoding history caches for fast word acceptance or rejection
US20010039492A1 (en) * 2000-05-02 2001-11-08 International Business Machines Corporation Method, system, and apparatus for speech recognition
US20110066434A1 (en) * 2009-09-17 2011-03-17 Li Tze-Fen Method for Speech Recognition on All Languages and for Inputing words using Speech Recognition
CN105448292A (zh) * 2014-08-19 2016-03-30 北京羽扇智信息科技有限公司 一种基于场景的实时语音识别系统和方法
CN108717851A (zh) * 2018-03-28 2018-10-30 深圳市三诺数字科技有限公司 一种语音识别方法及装置
CN109243468A (zh) * 2018-11-14 2019-01-18 北京羽扇智信息科技有限公司 语音识别方法、装置、电子设备及存储介质
CN109377998A (zh) * 2018-12-11 2019-02-22 科大讯飞股份有限公司 一种语音交互方法及装置
CN110211576A (zh) * 2019-04-28 2019-09-06 北京蓦然认知科技有限公司 一种语音识别的方法、装置和系统
CN111145756A (zh) * 2019-12-26 2020-05-12 北京搜狗科技发展有限公司 一种语音识别方法、装置和用于语音识别的装置

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114327355A (zh) * 2021-12-30 2022-04-12 科大讯飞股份有限公司 语音输入方法、电子设备以及计算机存储介质

Also Published As

Publication number Publication date
CN111145756B (zh) 2022-06-14
CN111145756A (zh) 2020-05-12

Similar Documents

Publication Publication Date Title
WO2021128880A1 (fr) Procédé et dispositif de reconnaissance vocale
CN111460150B (zh) 一种分类模型的训练方法、分类方法、装置及存储介质
CN107291690B (zh) 标点添加方法和装置、用于标点添加的装置
CN106971723B (zh) 语音处理方法和装置、用于语音处理的装置
CN107102746B (zh) 候选词生成方法、装置以及用于候选词生成的装置
CN107221330B (zh) 标点添加方法和装置、用于标点添加的装置
CN107436691B (zh) 一种输入法进行纠错的方法、客户端、服务器及装置
CN105489220B (zh) 语音识别方法及装置
WO2018076450A1 (fr) Procédé et appareil d'entrée, et appareil pour entrée
CN107564526B (zh) 处理方法、装置和机器可读介质
CN111128183B (zh) 语音识别方法、装置和介质
CN108399914B (zh) 一种语音识别的方法和装置
CN107291704B (zh) 处理方法和装置、用于处理的装置
CN107274903B (zh) 文本处理方法和装置、用于文本处理的装置
CN108073303B (zh) 一种输入方法、装置及电子设备
CN108345581A (zh) 一种信息识别方法、装置和终端设备
CN108628819B (zh) 处理方法和装置、用于处理的装置
CN105139848B (zh) 数据转换方法和装置
CN107424612B (zh) 处理方法、装置和机器可读介质
CN111369978B (zh) 一种数据处理方法、装置和用于数据处理的装置
WO2021046958A1 (fr) Procédé et appareil de traitement d'informations vocales, et support de stockage
WO2023078414A1 (fr) Procédé et appareil de recherche d'articles apparentés, dispositif électronique et support de stockage
CN111640452B (zh) 一种数据处理方法、装置和用于数据处理的装置
CN108803890A (zh) 一种输入方法、输入装置和用于输入的装置
CN111739535A (zh) 一种语音识别方法、装置和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20906001

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20906001

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 14.02.2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20906001

Country of ref document: EP

Kind code of ref document: A1