WO2008022581A1

WO2008022581A1 - Method and device for obtaining the new words and input method system

Info

Publication number: WO2008022581A1
Application number: PCT/CN2007/070419
Authority: WO
Inventors: Qi Guo; Zijian Tong; Lei Yang
Original assignee: Beijing Sogou Technology Development Co., Ltd.
Priority date: 2006-08-09
Filing date: 2007-08-06
Publication date: 2008-02-28
Also published as: CN1924858A; CN1924858B

Abstract

A method for obtaining the new words is disclosed, and comprises the following steps: obtaining the words selected by user during user inputting; comparing the word selected by user with the current words, and obtaining the user personality words according to the result of the comparison; collecting the personality words of every user; and obtaining the new words according to the personality words. The method for generating the lexicon is disclosed also, and comprises the following steps: collecting input action information of every user which composed of the selected words during the user inputting and the user words frequency corresponding to the selected words; weighting and repairing each user words frequency corresponding to the selected words and computing the user accumulation words frequency for each words; generating the lexicon which includes the words and the user accumulation words frequency corresponding to the words. The invention provides a distributed architecture, analyzes the obtained new words with the common meaning from each user personality words, provides the solution from the view of the user input, it can obtain the accurate new words with the common meaning in a convenient way.

Description

Method and device for acquiring new words and input method system The present application claims to be submitted to the Chinese Patent Office on August 9, 2006, and the application number is 200610109732.X, and the invention name is "a method and device for acquiring new words" The priority of the Chinese Patent Application, the entire disclosure of which is incorporated herein by reference.

Technical field

The present invention relates to the field of Internet information processing, and in particular, to a method for acquiring a new word, a new word acquisition system, a new word acquisition device, and an input method system.

Background technique

The emergence of the Internet is largely a revolution in the development of language and characters. The dramatic increase in the content of texts and the emergence of new content have made the language and text undergo a major transformation. People not only read articles in newspapers and magazines, but also read articles on the Internet. As time goes by, the text content on the Internet is becoming more and more abundant, which is already unmatched by the text information of traditional newspapers and magazines. Moreover, as information dissemination accelerates, new words spread on the Internet at an extraordinary rate, and a large number of new words appear in a short period of time. In the past, it was very difficult for individuals to publish articles in newspapers and magazines. In the era of Internet, everyone can express their opinions on the Internet, and the input text will become more and more personalized. With the increasing number of Internet users, personal The text of the article is also increasing, and new and personalized words are constantly emerging. For example, "Internet" was not a word a few years ago, but it is now widely used as a word.

Since words are the most basic analysis elements in many language processing technologies, it is necessary to obtain new and emerging words in a timely and effective manner to ensure the accuracy of language processing technology. For example, vocabularies with different attributes are the basis for natural language understanding, machine translation, automatic writing of abstracts, and so on. In order to retrieve information, words are always used as search units to reduce the redundancy of search results. In speech recognition, words are usually used as the lowest level of linguistic information, and language models are built based on words to solve the acoustic uncertainty at the word level.

However, as new words continue to appear and are scattered in a complex corpus, it is difficult to distinguish new words in a timely and effective manner. The prior art generally employs a method of manually collecting new words and adding them to an existing vocabulary.

For example, new words are manually collected by the administrator of the search site and then added to the custom vocabulary used by the site; or manually collected by the lexicon developer and then included in the system dictionary used by the next generation (usually For use in fields such as input methods; or set up a common vocabulary (for example, Violet), and then manually collect new words by netizens or other publics, and join the public vocabulary to gather a lot of artificial power. However, these methods are very time consuming, labor intensive, labor intensive, and inefficient. Therefore, there is an urgent need for a method that can effectively acquire new words in a timely and efficient manner from the use of complex languages. Summary of the invention

The technical problem to be solved by the present invention is to provide a method and system for acquiring new words, which can acquire some new words frequently used by users in a simple, convenient, timely and effective manner; and can effectively remove interfering words and provide relatively accurate new word output. .

Another object of the present invention is to provide an input method system that can automatically and automatically acquire the personalized words of the user in a timely, convenient and effective manner, and acquire new words by collecting the individual words of the plurality of users.

Another object of the present invention is to provide a new word acquisition apparatus which can provide a relatively accurate new word output with high efficiency.

Another object of the present invention is to provide a vocabulary generating method and a vocabulary generating apparatus which can provide a relatively accurate vocabulary or a new vocabulary with high efficiency.

To solve the above technical problem, the present invention provides a method for acquiring a new word, comprising the steps of: acquiring a word selected by a user during a user input process; comparing a word selected by the user with an existing word, according to the comparison As a result, the user's personal words are obtained; the individual words of each user are collected; new words are obtained according to the personalized words.

Preferably, the user word frequency is also recorded during the user input process, and the user word frequency is the frequency information of the user inputting the word.

The comparison may be: recording a word selected by the user to the user vocabulary, storing the existing word in the input system vocabulary, comparing the user lexicon with the input method system vocabulary; or directly comparing the user each time selected Words and existing words.

The following steps may be used to obtain the user's personalized words: determining whether the selected word of the user exists in the existing word; if not, determining that the word is the user's individual word.

The following steps can also be used to obtain the user's personalized words: determine whether the selected word of the user exists in the existing word; if not, further determine the corresponding word frequency of the word; if the word corresponding to the user word frequency If it is greater than or equal to the predetermined threshold, it is determined that the word is a personalized word.

The following steps can also be used to obtain the user's personal words: judge the user's selected words in the existing Whether there is a word; if it does not exist, it is determined that the word is a user's personality word; if it exists, the user's word frequency and system word frequency of the word are further compared, and the system word frequency is pre-prescribed in the input method system vocabulary The word frequency information corresponding to the existing word is set; if the ratio of the user word frequency to the system word frequency is greater than or equal to the predetermined threshold, the word is determined to be a personalized word.

Preferably, the user's personalized word can be obtained by the following steps: determining whether the selected word of the user exists in the existing word; if not, further determining the corresponding word frequency of the word; if the word corresponds If the user word frequency is greater than or equal to the predetermined threshold, the word is determined to be a personality word; if present, the user word frequency and the system word frequency of the word are further compared, and the system word frequency is preset in the input method system vocabulary The word frequency information corresponding to the existing word; if the ratio of the user word frequency to the system word frequency is greater than or equal to the predetermined threshold, the word is determined to be a personalized word.

Preferably, the method for acquiring a new word further includes: counting a number of times the personalized word appears in a preset internet page database; if the number of occurrences of the personalized word is greater than or equal to a preset threshold, The word is output as a new word. The preset Internet page database is obtained by the following steps: weighting the Internet page; storing the Internet page whose weight value is greater than or equal to the preset threshold to the Internet page database.

The collecting in the method for acquiring new words may be: the input method user computing device sends the user's personalized words to the word collecting computing device in real time or at a time.

Preferably, the method for acquiring a new word further includes: generating a new thesaurus according to the outputted new words or adding the obtained new words to the original thesaurus, and obtaining a new thesaurus or a new version of the whole thesaurus.

The invention also discloses a method for acquiring a new word, comprising: acquiring a word selected by a user in a user input process; collecting selected words of each user; comparing the selected word of the user with the existing word, according to The result of the comparison obtains the user's personality word; the new word is obtained according to the personality word.

The invention also discloses a new word acquisition system based on an input method, comprising: a word extraction unit, which is connected with an input method system, and is used for acquiring a word selected by a user in a user input process; a word comparison unit, Connected to the word extraction unit, used to compare the selected word with the existing word, and obtain the user's individual word according to the comparison result; the collecting unit is used to collect the individual words of each user; the new word acquiring unit is used Obtain new words based on the personality words.

The invention also discloses another new word acquisition system based on the input method, comprising: a word extraction unit, which is connected with the input method system, and is used for acquiring the words selected by the user during the user input process; the collecting unit, a selected word for collecting each user; a word matching unit, connected to the collecting unit, for comparing the selected word with the existing word, and obtaining the user's individual word according to the comparison result; , for obtaining a new word according to the personality word.

The invention also discloses an input method system, comprising an input interface unit, a display unit and a system vocabulary, further comprising: a word extraction unit, connected to the input method system, for acquiring a word selected by the user during the user input process The word matching unit is connected to the word extracting unit for comparing the selected word with the existing word, and obtaining the user's individual word according to the comparison result.

The input interface unit, the display unit, and the system vocabulary of the input method system may be located in the same computing device; or the input interface unit and the display unit of the input method system are located in the first computing device, and the system vocabulary is located at the first In the second computing device, the input method system acquires corresponding information from the second computing device according to the information input by the user, and displays the corresponding character in the first computing device.

The input method system may further include: a communication unit, configured to send the personalized word. The input method system may further include: a user vocabulary for storing words selected by the user. The input method system may further include: a word frequency recording unit, connected to the input method system, configured to record a user word frequency during a user input process, wherein the user word frequency is a frequency information input by the user for the word.

The word comparison unit may include: a first comparison subunit, configured to determine whether a word selected by the user exists in an existing word; if yes, output the word to a third comparison a unit, if not present, outputting the word to the second comparison subunit; and a second comparison unit, configured to further determine the corresponding word when the selected word does not exist in the existing word User word frequency; if the corresponding user word frequency of the word is greater than or equal to the predetermined threshold, then the word is determined to be a personalized word; the third comparison sub-unit is used when the user selected word exists in the existing word Further comparing the user word frequency and the system word frequency of the word, the system word frequency is the word frequency information corresponding to the existing word preset in the input system system vocabulary; if the ratio of the user word frequency to the system word frequency is greater than or equal to the predetermined For a wide value, the word is determined to be a personal word.

The invention also discloses a new word obtaining device, comprising: a personalized word collecting unit, configured to collect individual words of each user; a statistical unit, configured to count the personalized words appearing in a preset internet page database The number of times; the new word determining unit is connected to the statistical unit for determining whether the number of occurrences of the personalized word is greater than or equal to a preset threshold, and if so, outputting the word as a new word. The collecting is that the user computing device sends the user's personalized words to the personalized word collecting unit in real time or at a time.

The new word obtaining device further includes: a thesaurus generating unit, configured to generate a new thesaurus according to the outputted new words or add the obtained new words to the original thesaurus, and obtain a new thesaurus or a new version of the whole thesaurus .

The new word obtaining device further includes: an internet page database generating unit, configured to perform weighting assignment on the internet page; and store an internet page whose weight value is greater than or equal to a preset threshold to the internet page database.

The invention also discloses a new word obtaining device, comprising: a word collecting unit for collecting selected words of each user; a word matching unit, connected with the word collecting unit, for comparing the selected words of the user a word and an existing word, obtaining a user personality word according to the comparison result; a new word obtaining unit, configured to acquire a new word according to the personality word.

Preferably, the new word obtaining unit includes: a statistical subunit, configured to count the number of times the personalized word appears in the preset internet page database; the new word determining subunit is connected to the statistical subunit for determining Whether the number of occurrences of the personalized word is greater than or equal to a preset threshold, and if so, the word is output as a new word.

The word collecting unit is further configured to collect a user word frequency corresponding to the word selected by the user; the new word acquiring device further includes: a statistical subunit, configured to collect the personalized word in the preset internet page database The number of occurrences in the Internet, the Internet word frequency is obtained; the weight word frequency determining sub-unit is configured to perform weight correction on the user word frequency and the Internet word frequency of the new word, and obtain the weight word frequency of the new word; the new word determining sub-unit, And determining whether the weight word frequency of the personalized word is greater than or equal to a preset threshold, and if so, outputting the word as a new word.

The invention also discloses a vocabulary generating method, comprising: collecting input behavior information of each user, the input behavior information including a selected word in a user input process and a corresponding user word frequency of the word; Each user's word frequency is weighted, and the user's cumulative word frequency of each word is calculated; a vocabulary is generated, and the vocabulary includes the words and their corresponding user cumulative word frequencies.

The vocabulary generating method further includes: removing a word whose user cumulative word frequency is less than or equal to a certain threshold.

The method for generating a thesaurus further includes: comparing the generated thesaurus with the existing thesaurus, and removing the words that do not conform to the preset rules according to the comparison result, and outputting the user's personalized words; according to the user's personalized words Words generate a personal dictionary of words.

Or the method for generating the thesaurus, further comprising: comparing the generated thesaurus with the existing thesaurus, and removing the words that do not conform to the preset rules according to the comparison result, and outputting the user's personalized words; The number of times the word appears in the preset Internet page database, the Internet word frequency is obtained; the user cumulative word frequency of the personalized word and the Internet word frequency are weighted and summed to obtain the weight word frequency of the new word; If the weight of the word is greater than or equal to the preset threshold, the word is output as a new word; a new vocabulary is generated according to the outputted new word, and the new vocabulary includes the new word and its corresponding weight word frequency.

The invention also discloses a vocabulary generating device, comprising: a collecting unit, configured to collect input behavior information of each user, wherein the input behavior information includes a selected word in a user input process and a corresponding word frequency of the word a word frequency calculation unit, configured to perform weight correction on each user word frequency corresponding to the word, and calculate a cumulative word frequency of each word; a thesaurus generating unit, configured to generate a thesaurus, the word library including the words and their corresponding accumulations Word frequency.

The thesaurus generating device further includes: a personalized word determining unit, configured to compare the generated thesaurus with the existing thesaurus, and remove the words that do not conform to the preset rules according to the comparison result, and output the user personalized words. The thesaurus generating device further includes: a personalized word determining unit, configured to compare the generated thesaurus with the existing thesaurus, and remove the words that do not conform to the preset rules according to the comparison result, and output the user personalized words. a statistical unit, configured to count the number of occurrences of the personalized word in the preset Internet page database, to obtain an Internet word frequency; a weight word frequency determining unit, configured to perform a cumulative word frequency and an Internet word frequency for the user of the personalized word The weight is corrected and summed to obtain the weight of the word; the new word determining unit outputs the word as a new word if the weight of the personalized word is greater than or equal to the preset threshold; The generating unit generates a new vocabulary according to the outputted new word, and the new vocabulary includes the new word and its corresponding weight word frequency.

Compared with the prior art, the present invention has the following advantages:

First, the present invention proposes a distributed architecture, including multiple users and a collection end, and collects new words with universal meanings from individual user words by collecting user input behavior information of multiple users; The new words in the Internet information or corpus are also generated by the usage behavior of each user, so the present invention provides a solution from the perspective of user input, thereby being simple and convenient. Get more accurate, universal words.

Secondly, the present invention further collects the user word frequency information in the user input behavior, thereby removing some interference vocabulary, such as user input errors, etc.; and also finding some new words with sociological significance, for example, obtaining some words through the user word frequency. Some words that were not commonly used, but are now commonly used, that is, new words whose application scope or application environment has changed. Through the above analysis, new words that are more accurate can be obtained.

The invention can further input the collected user input behavior information into a selected internet page database, perform statistics on the number of occurrences thereof, and remove the vocabulary with lower frequency, thereby obtaining more accurate new words, that is, finding true It is a new word in the linguistic sense, and removes vocabulary or wrong vocabulary that does not have universal meaning.

The invention can also arrange the obtained new words into a new vocabulary or a new version of the whole vocabulary, thereby providing the input method, which can improve the hit rate and input speed of the preferred words when the user inputs, and can improve the reasonable sorting of the candidate words. Sex, convenient for users to input new words faster and more accurately, without the cumbersome candidate selection process, you can get the words you want to input in the first or first page candidate. The new thesaurus or the new version of the full thesaurus can also be provided to the search engine. When the user's query keyword string includes new words, the accuracy and coverage of the search results can be improved.

DRAWINGS

1 is a flow chart showing the steps of Embodiment 1 of the present invention;

Figure 2 is a flow chart showing the steps of Embodiment 2 of the present invention;

Figure 3 is a flow chart showing the steps of Embodiment 3 of the present invention;

Figure 4 is a flow chart showing the steps of obtaining a new word from the collected user personality words;

Figure 5 is a block diagram showing the structure of an embodiment of an input method system of the present invention;

6 is a structural block diagram of a new word acquisition apparatus of the present invention;

7 is a structural block diagram of another new word acquisition apparatus of the present invention;

FIG. 8 is a flow chart showing the steps of a method for generating a thesaurus according to the present invention.

detailed description

The present invention will be further described in detail with reference to the drawings and specific embodiments. For example, Chinese, Japanese, Korean, etc., because when inputting the code, the input method system provides the candidate words for the user in the information input process, and the user selects the words he needs, thereby collecting the selected words of the user as acquiring new words. Source of information. Since the application flow of the present invention in the above several languages is similar, for convenience of explanation, only the case where the present invention is applied in Chinese will be described below.

1 is a flow chart of the steps of Embodiment 1 of the present invention, including the following steps:

Step 101: Obtain a word selected by the user during the user input process.

For a language that needs to input text by encoding, the user needs to input the encoded string and select the desired word among the candidate words to complete the input. Step 101 is a word selected by the user who records the user's input behavior information. The encoded character string may be a pinyin code or a font code, that is, the present invention can be applied to various input methods.

Some words of the user's personality will be included in the words selected by the user. For example, the user needs to input words such as "broad value", "nine ministries" or a certain name, but the original vocabulary of the input method does not Such words cannot be directly displayed to the user in the candidate words, and the user needs to select each word to obtain the desired personalized vocabulary. For another example, the user can also create new words and new words in the original thesaurus that are not needed by the user through the artificial word-making function provided by the input method, so that the user can select the desired personality word during the input process. word. The present invention is capable of selecting the personal words of the user from the words selected by the user.

Step 102: Compare the selected word with the existing word, and obtain the user's personalized word according to the comparison result.

The comparison may be performed once each time the user determines the selected word, and compares the selected word with the existing word. If it is within the preset judgment rule, it is determined to be the user's individual word and recorded, Recording the user's personality words into the system vocabulary or recording to the user's personality vocabulary;

The words selected by the user in 101 can be recorded only in the form of a cache.

If the step 101 records the user-selected words to the user lexicon first, and the input method system vocabulary is used to store the existing words, the comparison in step 102 can also compare the user lexicon with the input method system words at regular intervals. The library records the determined user personality words into the user's personality dictionary or marks them in the user's vocabulary. This method can reduce the amount of data calculation during the user input process, thereby avoiding the extraction of the user input behavior and affecting the user's input behavior itself.

The preset rule for determining the user's personalized words can be set by a person skilled in the art as needed. Yes. For example, in the simplest way, the user's personalized word is obtained by the following steps: determining whether the word selected by the user exists in the existing word; if not, determining that the word is the user's individual word.

Step 103: Collect individual words of each user.

The collecting may be: the input method user computing device sends the user's personalized words to the word collection computing device in real time or periodically, that is, the input method computing device has an automatically transmitted module. Preferably, the collection computing device exists in the form of a server.

The collecting may also send the personalized words to the collecting end periodically or irregularly for the input method user, that is, the sending is manually initiated by the user, for example, each user sends his own personalized words to a unified email address. Or implement collection in a unified server.

Of course, if the user stores the personal words in the user lexicon or the system lexicon, the vocabulary storing the user's personalized words may be sent to the collecting computing device in real time or periodically, for example, each user passes the timing or Unscheduled collection of the thesaurus on the server can be achieved.

Furthermore, for the network input method (provided only to the user input interface and display interface, through the connection server to complete the entire input process), the collection of user personality words is simpler, because the input method system used by the user at this time It is a server itself, which can be used by multiple users. It can collect the input behavior information of each user during use.

In fact, the present invention is feasible in any way that enables information collection, and is no longer - an illustration.

Step 104: Obtain a new word according to the personality word.

This step gets new words by removing duplicate words from all collected user personal words. This step can also use new filtering, simplified ways to get new words.

Preferably, the present invention can obtain new words from the collected user personal words by: counting the number of occurrences of the personalized words in the preset Internet page database; if the number of occurrences of the personalized words is greater than or equal to If the preset threshold is used, the word is output as a new word.

Referring to FIG. 2, it is a flow chart of the steps of Embodiment 2 of the present invention, which includes the following steps:

Step 201: Obtain, in a user input process, a word selected by a user;

Step 202: Collect selected words of each user; (Non-read only), step 202 collects the user vocabulary of each user or the word selected by the user in the system vocabulary. The collection manners may be in various manners as described above, and are not described herein again.

Step 203: Compare the selected word and the existing word by the user, and obtain the user's personalized word according to the comparison result;

Step 204: Obtain a new word according to the personality word.

The second embodiment is basically similar to the concept of the first embodiment. The main difference is that the selected words of a plurality of users are collected first, and then the comparison is performed uniformly, and the user's individual words are obtained according to the comparison result; the method can reduce the comparison calculation. The number of times, and can reduce the burden of the local input method system, but because a large number of user-selected words are compared, the comparison will increase the system load of the server. For the embodiment 2 and the embodiment 1, the person skilled in the art can select and use according to the needs.

Referring to FIG. 3, it is a flowchart of the steps of Embodiment 3 of the present invention. Further optimization of Embodiment 3 based on Embodiment 1 includes the following steps:

Step 301: During the user input process, record the words selected by the user and the frequency of the user words to the user vocabulary;

A user vocabulary is created on the user side for recording the words selected by the user and the frequency of the user words, and the frequency of the user words is frequency information of the user inputting the words. This step can completely record the user's input behavior, regardless of whether the word is a new word.

Of course, instead of setting the user vocabulary, the input system vocabulary can be set to the modifiable mode, and the user-selected words and their user words can be directly recorded to the system vocabulary.

Step 302: Compare the user vocabulary and the system vocabulary, and obtain the user's personalized words according to the comparison result; the following methods.

The first type: determines whether the word selected by the user exists in the existing word; if not, determines that the word is a user's individual word.

The second type: determining whether the word selected by the user exists in the existing word; if not, further determining the corresponding word frequency of the word; if the corresponding word frequency of the word is greater than or equal to the predetermined threshold, then determining This word is a personal word. If it exists, it can be determined as a non-personal word.

The third type: determining whether the word selected by the user exists in the existing word; if not, determining that the word is a user's individual word; if present, further comparing the user's word frequency and system word of the word Frequency, the word frequency of the system is word frequency information corresponding to an existing word preset in the input method system vocabulary; if the ratio of the user word frequency to the system word frequency is greater than or equal to a predetermined threshold, determining the word as a personalized word . The user word frequency is used to further judge the individual words, and some words that are not commonly used, but are very commonly used nowadays, that is, new words whose application scope or application environment has changed, can be obtained. The ratio parameter used in the above method is a preferred example, and of course, other feasible parameters can also be used for evaluation.

The fourth type determines whether the word selected by the user exists in the existing word; if not, further determines the corresponding word frequency of the word; if the corresponding word frequency of the word is greater than or equal to the predetermined threshold, then determining The word is a personalized word; if present, the user's word frequency and the system word frequency of the word are further compared, and the system word frequency is the word frequency information corresponding to the existing word preset in the input system system vocabulary; If the ratio of the word frequency to the system word frequency is greater than or equal to the predetermined threshold, then the word is determined to be a personalized word. This mode is a preferred example of the present invention, and a more accurate user personality word can be obtained.

Step 303: Collect individual words of each user.

Step 304: Obtain a new word according to the personality word.

This step gets new words by removing duplicate words from all collected user personal words. This step can also use new filtering, simplified ways to get new words. This will be detailed later in Figure 4.

Step 305: Generate a new thesaurus according to the outputted new words or add the obtained new words to the original thesaurus to obtain a new thesaurus or a new version of the full thesaurus.

This step is used to organize the new words obtained in step 304 into a vocabulary, which can be used in the input method system or the search field.

For example, for updating the normal input method: setting an input method system including a system vocabulary in the first computing device, and obtaining a new vocabulary or a new version of the full vocabulary in the second computing device; The system connects the second computing device to the second computing device to complete the update of the system vocabulary.

The stored new vocabulary or the new version of the second vocabulary second computing device may exist in the network in the form of a server, and provide a vocabulary update service to any other client program that needs to input the new vocabulary information. Of course, it does not need to be in the form of a fixed server, or it can exist in a local computing device, and any required input method to other terminals through P2P (peer-to-peer) technology. The client program of the new word information provides a thesaurus update service.

In the above updated embodiment, the updating may be performed by: updating the system vocabulary at the same time when the input method system is updated; or performing online update of the system vocabulary by means of the server actively pushing; or, by the user The request is initiated, and the server returns data according to the request to update the system vocabulary. Of course, you can also use the way of mobile memory update or version update. In short, various data update methods may be used, and the present invention is not limited thereto, and those skilled in the art may select them according to needs.

For another example, for updating the network input method: setting a unit for receiving user input information and displaying corresponding characters in the input method system is located in the first computing device; the obtained new thesaurus or the new version of the full thesaurus is the input method system a system vocabulary, the system vocabulary is located in a second computing device; the input method system obtains corresponding information from a system vocabulary located in the second computing device according to information input by the user, and displays corresponding characters in the first computing device , complete the text input.

In the above example, the new thesaurus or the new version of the whole thesaurus obtained according to the new word extraction method of the present invention can be directly used as the system vocabulary of the input method system, and the online thesaurus can be used without updating operations. The input method system is divided into two parts, the receiving and displaying unit is located in the first computing device, and the thesaurus information is located in the second computing device, which can perfectly implement the online application of the input method; of course, the encoding required for the input method system The matching process can be arbitrarily set in a computing device as needed.

Preferably, the present invention is also applicable to the field of search. When a new word is included in a query keyword string of a user, the user can accurately segment the query keyword string according to the thesaurus obtained by the method for extracting new words by the present invention. Then, based on the result of the word segmentation, the accuracy and coverage of the search results can be improved.

Preferably, referring to FIG. 4, the present invention can obtain new words from collected user personal words by the following steps:

Step 401: Remove duplicate user personality words;

Step 402: Perform weight assignment on the Internet page; store the Internet page whose weight value is greater than or equal to the preset threshold to the Internet page database, thereby obtaining a preset Internet page database; Step 403: Statistics the personalized word in the preset The number of occurrences in the internet page database; if the number of occurrences of the personalized word is greater than or equal to the preset threshold, the word is lost as a new word Out.

Step 402 is an optional step, and the purpose is to obtain a selected internet page database, so as to ensure the accuracy of the new word screening. Of course, other methods can be used to form a pre-built Internet page database.

In the step 402 of weight assignment, it is a relatively important situation to assign a corresponding weight value according to the time formed by the web page and the type of the web page. Because for word frequency statistics, the impact of web page time is very important, so the impact of web page time on the weight value is greater. The farther the time point from the word frequency statistics is, the lower the weight value is. If the time difference is greater than certain. The value can give the page a lower weight value, even excluded from the word frequency statistics. Secondly, the type of webpage has a great influence on the word frequency statistics. The webpage type generally refers to a portal website, a forum or some other determined webpages. The weight value of these webpages is higher because there are more participants and information in these webpages. Update the latest trends that are faster and better able to respond to word frequency. For the determination of the webpage type, a rule base can be set, and the URL addresses of some webpages are stored in the library, so that the webpages of these URLs are more important for word frequency statistics, and the words appearing on these webpages are preferred. For statistical purposes, the web page is given a greater weight value.

Secondly, the present invention can further remove some duplicate web pages, yellow web pages and spam web pages by giving lower weight values, thereby further ensuring the accuracy of new word verification.

Furthermore, since the result to be obtained is more accurate, the vocabulary that needs to be counted is as much as possible of the user's "redundant information of the input page, etc., and the page redundancy information is generally invalid information; if not removed, new information will be added. The amount of calculation of word extraction, and the frequency of words resulting in statistics are not objective, and the results are not accurate.

Correspondingly, the present invention also proposes two new word acquisition systems based on the input method. Since the system is used to complete the foregoing method, only a brief introduction will be made below. For details, refer to the related parts.

A new word acquisition system based on input method, including:

a word extraction unit, connected to the input method system, for acquiring a word selected by the user in the user input process; a word comparison unit, connected to the word extraction unit, for comparing the selected word with the existing a word, obtaining a user's personality word according to the comparison result; a collecting unit, configured to collect individual words of each user; and a new word obtaining unit, configured to acquire a new word according to the personality word. A new word acquisition system based on input method, including:

a word extraction unit, connected to the input method system, for acquiring a word selected by the user during the user input process; a collecting unit for collecting the selected words of each user; a word matching unit, connected to the collecting unit And a method for comparing a user-selected word with an existing word, and acquiring a user's personalized word according to the comparison result; and a new word obtaining unit, configured to acquire a new word according to the personalized word.

Referring to FIG. 5, the present invention also claims an input method system, including an input interface unit 501, a display unit 502, and a system vocabulary 503, and further includes:

a word extraction unit 504, connected to the input method system, for acquiring a word selected by the user during the user input process;

The word matching unit 505 is connected to the word extracting unit 504 for comparing the selected word with the existing word and obtaining the user's individual word according to the comparison result. The user personality words may be stored in the user vocabulary 506 or may be stored in the system vocabulary 503 for marking; or may be stored in a special vocabulary.

That is to say, the above input method system can be used to extract the user's personality words in addition to the ordinary word input. The input method system may be a common input method system. For example, the input interface unit, the display unit, and the system vocabulary of the input method system are located in the same computing device, and the input method system matches the local query according to the coding information input by the user. The corresponding characters are displayed locally. The input method system may also be a network input method system. For example, the input interface unit and the display unit of the input method system are located in the first computing device, and the system vocabulary is located in the second computing device, and the input method system is based on the user. The input information is obtained from the second computing device to obtain corresponding information, and the corresponding character is displayed on the first computing device.

The input method system may further include: a user vocabulary 506 for storing a word selected by the user; and a communication unit 507, configured to send the personalized word. Each user's input method system can send the user's personality words to a unified collection computing device, so as to collect a large amount of user input behavior information, and then analyze new words that meet the needs of the public and conform to the linguistic meaning.

In order to further improve the accuracy of the acquisition of the user's personal words, the input method system may further include:

The word frequency recording unit 508 is connected to the input method system for recording a user word frequency during the user input process, and the user word frequency is frequency information of the user inputting the word. At this time, the communication unit 507, can also be used to send user word frequency information related to personal words.

Preferably, the word comparison unit 505 may further include:

a first comparison subunit 5051, configured to determine whether a word selected by the user exists in an existing word; if yes, output the word to a third comparison subunit, if not, output the word To the second comparison subunit;

The second comparison sub-unit 5052 is configured to further determine a user word frequency corresponding to the word when the selected word does not exist in the existing word; if the corresponding word frequency of the word is greater than or equal to a predetermined threshold , then determine that the word is a personal word.

The third comparison sub-unit 5053 is configured to further compare the user word frequency and the system word frequency of the word when the word selected by the user exists in the existing word, and the system word frequency is pre-prescribed in the input method system vocabulary The word frequency information corresponding to the existing word is set; if the ratio of the user word frequency to the system word frequency is greater than or equal to the predetermined threshold, the word is determined to be a personalized word.

The above-mentioned word matching unit 505 is a preferred embodiment of the present invention. Of course, other matching rules may also be used, and the word matching unit 505 may include other sub-units, and the present invention No - an example.

The input interface unit 501 in the above input method system is most important for providing the user with information input and word selection; and can also be used for switching various modes, for example: input language switching ( Such as: Simplified and Traditional Chinese, Chinese and English switching), input mode switching (such as: single-word input, word input, sentence input switching), input state switching (such as: text, punctuation, special symbol switching) and so on. Display unit 502 and system vocabulary 503 are well known to those skilled in the art and will not be described in detail herein.

Referring to FIG. 6, the present invention also provides a new word acquiring apparatus, including:

The personalized word collecting unit 601 is configured to collect the personalized words of each user; the personalized words of the user may be obtained by the input method, and automatically sent to the personalized word collecting unit; or may be set or organized by the user, and sent To the individual word collection unit; or each user sets their personality word vocabulary to a fixed network space, and the personalized word collection unit obtains the individual words of each user from the network space. That is, the user's personal words in this embodiment are not necessarily obtained through user input behavior, but may also be set or organized by the user.

a statistical unit 602, configured to calculate that the personalized word appears in a preset Internet page database Number of times;

The new word determining unit 603 is connected to the statistical unit 602, and is configured to determine whether the number of occurrences of the personalized word is greater than or equal to a preset threshold, and if so, output the word as a new word.

The new word acquisition device can obtain a relatively accurate new word output according to the collected personal words of each user by using the verification in the Internet information. The individual words of each user may be automatically obtained by the user's input behavior, or may be set or organized by the user.

The new word obtaining means may further include: a thesaurus generating unit 604, configured to generate a new thesaurus according to the outputted new words or add the obtained new words to the original thesaurus to obtain a new thesaurus or a new version of the whole thesaurus. The new thesaurus or the new version of the full thesaurus can be used to update the input system system vocabulary or search for the word segmentation, thereby providing the user's input accuracy and the accuracy of the search results.

Preferably, the new word obtaining apparatus may further include: an internet page database generating unit 605, configured to perform weighting on the internet page; and store an internet page whose weight value is greater than or equal to a preset threshold to the internet page database. .

Referring to FIG. 7, the present invention also discloses another new word acquiring apparatus, including:

a word collecting unit 701, configured to collect selected words of each user;

The word collecting unit 701 can be directly connected to an existing input method system to collect selected words of each user in real time, for example, a network input method. The word collecting unit 701 can also extract the user-selected words transmitted in real time or periodically by each user's input method system, and the user-selected words are extracted by the user's input method system. The word collecting unit 701 can also achieve the purpose of collecting a user selected word by receiving a user vocabulary or a system vocabulary sent by each user's input method system, wherein the user selected word is input by the user. The method is extracted and stored in the user's thesaurus or system lexicon.

The word matching unit 702 is connected to the word collecting unit, and is configured to compare the selected word with the existing word, and obtain the user's personalized word according to the comparison result;

The new word obtaining unit 703 is configured to obtain a new word according to the personalized word.

Preferably, the word comparison unit 702 can further include:

a first comparison sub-unit 7021, configured to determine whether a word selected by the user exists in an existing word; if yes, output the word to a third comparison sub-unit, if not, output the word To the second comparison subunit; The second comparison unit 7022 is configured to further determine a user word frequency corresponding to the word when the selected word does not exist in the existing word; if the corresponding word frequency of the word is greater than or equal to a predetermined threshold, Then determine that the word is a personal word.

The third comparison sub-unit 7023 is configured to further compare the user word frequency and the system word frequency of the word when the word selected by the user exists in the existing word, and the system word frequency is pre-prescribed in the input method system vocabulary The word frequency information corresponding to the existing word is set; if the ratio of the user word frequency to the system word frequency is greater than or equal to the predetermined threshold, the word is determined to be a personalized word.

Preferably, the new word obtaining unit 703 may further include:

a statistical subunit 7031, configured to count the number of occurrences of the personalized word in a preset Internet page database, thereby obtaining an Internet word frequency of the word;

The new word determining subunit 7032 is connected to the statistical subunit for determining whether the internet word frequency is greater than or equal to a preset threshold, and if so, outputting the word as a new word.

Preferably, the new word acquiring device may further include:

The thesaurus generating unit 704 is configured to generate a new thesaurus according to the outputted new words or add the obtained new words to the original thesaurus to obtain a new thesaurus or a new version of the full thesaurus. The Internet page database generating unit 705 is configured to perform weighting on the Internet page; and store the Internet page whose weight value is greater than or equal to the preset threshold to the Internet page database.

Since the word collecting unit can collect the user's word frequency of the word while collecting the word selected by the user, the vocabulary generated by the vocabulary generating unit 704 can further include the user word frequency corresponding to the word. In order to ensure that a word in the lexicon corresponds to a word frequency, the user word frequency and the internet word frequency may be weighted and superimposed and summed, and the user's personality word is given a weight word frequency. Then, filtering and removing according to the weight word frequency, for example, determining whether the weight word frequency of the personality word is greater than or equal to a preset threshold, and if so, outputting the word as a new word.

Since the increase of the word frequency of a certain word reflects the increase of the word frequency statistics of the Internet, it takes some time, even a long time, and the weight of the word frequency can take both into consideration, and get more accurate new words and their word frequency. Conducive to increasing the user's input experience.

The invention also discloses a vocabulary generating method. Two embodiments of the vocabulary generating method are respectively described with reference to FIG. 8 , FIG. 8 a and FIG. 8 b , and the details are as follows: The thesaurus generation method shown in Figure 8a includes the following steps:

Step 801a: Collect input behavior information of each user, where the input behavior information includes a selected word in the user input process and a corresponding user word frequency of the word; the collection may be various manners mentioned in the foregoing.

Step 802a: performing weight correction on the word frequency of each user corresponding to the word, and calculating a cumulative word frequency of the user of each word; the weight correction may be performed by analyzing the word frequency of each user corresponding to a certain word, for example, first The word frequency of each user corresponding to the word is analyzed to find the distribution trend, and the probability of occurrence of a word frequency value or the frequency value of the word frequency is corrected by the average range of the word range. The user accumulated word frequency calculated after the above correction can remove some users' accidental behavior or malicious behavior, and obtain a more objective and accurate user cumulative word frequency, thereby ensuring the accuracy of the thesaurus.

Step 803a, removing words whose user cumulative word frequency is less than or equal to a certain threshold. This step is a preferred step for further improving the ubiquity of words in the revenue lexicon.

Step 804a, generating a thesaurus, the words database including words and their corresponding user cumulative word frequencies. Due to the large number of users of the input method, a universal vocabulary can be obtained by collecting the input behavior information of a large number of input method users. The thesaurus can be directly provided to the input method system as a system vocabulary; it can also be imported as a user vocabulary by the user and used in conjunction with the system vocabulary.

Preferably, the vocabulary generating method shown in FIG. 8a may further include the following steps: Step 805a: Comparing the generated lexicon with an existing vocabulary, and removing words that do not conform to the preset rule according to the comparison result, and outputting User-specific words; wherein the preset rules can be set by a person skilled in the art as needed, for example, in the foregoing step 302 of the present invention, four ways of obtaining user personality words according to the comparison result are obtained.

Step 806a: Generate a personalized word dictionary according to the user personality word.

The thesaurus generation method shown in Figure 8b includes the following steps:

Step 801b: Collect input behavior information of each user, where the input behavior information includes a selected word in the user input process and a corresponding word frequency of the word.

Step 802b, performing weight correction on the word frequency of each user corresponding to the word, and calculating the cumulative word frequency of the user of each word.

Step 803b, removing words whose user cumulative word frequency is less than or equal to a certain threshold.

Step 804b, generating a vocabulary, the vocabulary including words and their corresponding user cumulative word frequency. Step 805b: Compare the generated thesaurus with the existing thesaurus, and remove the words that do not conform to the preset rules according to the comparison result, and output the user personalized words;

Step 806b, counting the number of occurrences of the personalized words in the preset Internet page database, and obtaining an Internet word frequency;

Step 807b, performing weight correction on the cumulative word frequency of the user word and the Internet word frequency, and obtaining a weighted word frequency of the personalized word; if the weight word frequency of the personalized word is greater than or equal to a preset threshold, Output the word as a new word;

Step 808b: Generate a new vocabulary according to the outputted new word, the new vocabulary including the new word and its corresponding weight word frequency.

The invention also discloses a thesaurus generating device, comprising the following components:

a collecting unit, configured to collect input behavior information of each user, where the input behavior information includes a selected word in a user input process and a corresponding word frequency of the word;

a word frequency calculation unit, configured to perform weight correction on each word frequency of each word corresponding to the word, and calculate a cumulative word frequency of each word;

The thesaurus generating unit is configured to generate a thesaurus, the thesaurus including the words and their corresponding cumulative word frequencies. The vocabulary generating device may further include: a personalized word determining unit, configured to compare the generated vocabulary with an existing vocabulary, and remove a word that does not conform to the preset rule according to the comparison result, and output the user personality or The the thesaurus generating device may further include:

a personalized word determining unit, configured to compare the generated thesaurus with the existing thesaurus, and remove the words that do not conform to the preset rules according to the comparison result, and output the user personalized words;

a statistical unit, configured to count the number of occurrences of the personalized words in a preset Internet page database, and obtain an Internet word frequency;

a weight word frequency determining unit, configured to perform weighting on the cumulative word frequency of the user of the personalized word and the Internet word frequency, and obtain a weighted word frequency of the word;

a new word determining unit, if the weight word frequency of the personality word is greater than or equal to a preset threshold, the word is output as a new word;

The thesaurus generating unit generates a new thesaurus according to the outputted new words, the new thesaurus including new words and their corresponding weight words. Since the present invention uses the word frequency statistics technology based on Internet information, and the user inputs the behavior information as the source of the new word, a large number of new words frequently used by each user can be conveniently and quickly obtained, and these new words are collectively filtered and continuously Provided to input method users, so that these users can track changes in Internet information at all times during use, and constantly input new words without having to go through a tedious process of selecting words each time a new word is entered, so that new Words can also become the user's preferred words, improve the preferred word hit rate when users input new words, and improve the rationality of candidate word sorting.

Since the present invention is limited in length, the description of the method is more detailed, and the description of the system part is not detailed, please refer to the related parts mentioned above.

The method for acquiring a new word, the new word acquisition system, the new word acquisition device, and an input method system provided by the present invention are described in detail above. In this paper, a specific example is applied to implement the principle and implementation manner of the present invention. It is to be noted that the description of the above embodiments is only for helping to understand the method of the present invention and its core ideas; at the same time, for those skilled in the art, according to the idea of the present invention, there will be changes in specific embodiments and applications. In the above, the contents of the specification are not to be construed as limiting the invention.

Claims

Rights request

A method for acquiring a new word, comprising:

In the user input process, the word selected by the user is obtained;

Comparing the words selected by the user with the existing words, obtaining the user's individual words according to the comparison result; collecting the individual words of each user;

Obtain new words based on the personality words.

2. The method of claim 1, further comprising:

During the user input process, the user word frequency is recorded, and the user word frequency is the frequency information of the user inputting the word.

3. The method of claim 1 wherein: the comparing is:

Record the words selected by the user to the user vocabulary, store the existing words in the input system lexicon, and compare the user lexicon with the input method system vocabulary;

Or directly compare the user’s selected words to existing words.

4. The method according to claim 1, wherein the obtaining of the user's personal words is achieved by the following steps:

Determine if the word selected by the user exists in an existing word;

If it does not exist, it is determined that the word is a user's personality word.

5. The method according to claim 2, wherein the obtaining of the user's personal words is achieved by the following steps:

Determine if the word selected by the user exists in an existing word;

If not, further determine the corresponding word frequency of the word;

If the word frequency of the word corresponding to the word is greater than or equal to the predetermined threshold, then the word is determined to be a personality word.

6. The method of claim 2, wherein the obtaining of the user's personality word is achieved by the following steps:

Determine if the word selected by the user exists in an existing word;

If not, determine that the word is a user's personality word;

If yes, further comparing the user word frequency and the system word frequency of the word, the system word frequency is the word frequency information corresponding to the existing word preset in the input method system vocabulary; If the ratio of the user's word frequency to the system word frequency is greater than or equal to the predetermined threshold, then the word is determined to be a personal word.

7. The method according to claim 2, wherein the obtaining of the user's personal words is achieved by the following steps:

Determine if the word selected by the user exists in an existing word;

If not, further determining a corresponding word frequency of the word; if the corresponding word frequency of the word is greater than or equal to a predetermined threshold, determining that the word is a personalized word;

If yes, further comparing the user word frequency and the system word frequency of the word, the system word frequency is the word frequency information corresponding to the existing word preset in the input method system vocabulary; if the ratio of the user word frequency to the system word frequency is greater than or Equal to the predetermined threshold, then the word is determined to be a personal word.

8. The method of claim 1, further comprising:

Counting the number of times the personalized word appears in the preset Internet page database;

If the number of occurrences of the personality word is greater than or equal to the preset threshold, the word is output as a new word.

9. The method of extracting new words according to claim 8, wherein the preset internet page database is obtained by the following steps:

Weighting the Internet page;

The Internet page whose weight value is greater than or equal to the preset threshold is stored in the Internet page database.

10. The method of claim 1, wherein the collecting is: an input method user meter

The method according to claim 1, further comprising: generating a new thesaurus according to the outputted new words or adding the obtained new words to the original thesaurus, obtaining a new thesaurus or a new version of the thesaurus .

12. A method of acquiring a new word, comprising:

In the user input process, the word selected by the user is obtained;

Collect selected words from individual users;

Comparing the words selected by the user with the existing words, obtaining the user's personalized words according to the comparison result; obtaining new words according to the personalized words.

13. A new word acquisition system based on an input method, characterized in that it comprises:

a word extraction unit, connected to the input method system, for obtaining user selection during user input Selected words;

a word matching unit, connected to the word extracting unit, for comparing the selected word with the existing word, and obtaining the user's individual word according to the comparison result;

a collection unit for collecting individual words of each user;

a new word acquisition unit, configured to acquire a new word according to the personality word.

14. A new word acquisition system based on an input method, characterized in that:

a word extraction unit, connected to the input method system, for acquiring a word selected by the user during the user input process;

a collection unit for collecting selected words of each user;

a word matching unit, connected to the collecting unit, for comparing the selected word with the existing word, and obtaining the user's individual word according to the comparison result;

15. An input method system comprising an input interface unit, a display unit, and a system vocabulary, wherein the method further comprises:

The word comparison unit is connected to the word extraction unit for comparing the selected word with the existing word, and obtaining the user's individual word according to the comparison result.

16. The input method system of claim 15 wherein:

The input interface unit, the display unit, and the system vocabulary of the input method system are located in the same computing device;

Or the input interface unit and the display unit of the input method system are located in the first computing device, and the system vocabulary is located in the second computing device, and the input method system obtains corresponding information from the second computing device according to the information input by the user. Information, the corresponding character is displayed on the first computing device.

The input method system of claim 15, further comprising:

a communication unit, configured to send the personalized word.

The input method system of claim 15, further comprising:

User vocabulary for storing user-selected words.

The input method system of claim 15, further comprising: The word frequency recording unit is connected to the input method system for recording a user word frequency during the user input process, and the user word frequency is frequency information of the user inputting the word.

The input method system according to claim 19, wherein the word comparison unit comprises:

a first comparison subunit, configured to determine whether a word selected by the user exists in an existing word; if yes, output the word to a third comparison subunit, if not, output the word to Second alignment subunit;

a second comparison unit, configured to further determine a user word frequency of the word when the word selected by the user does not exist in the existing word; if the corresponding word frequency of the word is greater than or equal to a predetermined threshold, Make sure the word is a personal word;

a third comparison subunit, configured to further compare a user word frequency and a system word frequency of the word when the word selected by the user exists in the existing word, wherein the system word frequency is preset in the input method system vocabulary The word frequency information corresponding to the existing word; if the ratio of the user word frequency to the system word frequency is greater than or equal to the predetermined threshold, the word is determined to be a personality word.

21. A new word acquisition device, comprising:

a personalized word collection unit for collecting individual words of each user;

a statistical unit, configured to count the number of occurrences of the personalized words in a preset Internet page database;

The new word determining unit is connected to the statistical unit, and is configured to determine whether the number of occurrences of the personalized word is greater than or equal to a preset threshold, and if so, output the word as a new word.

22. The new word acquisition apparatus according to claim 21, wherein the collecting is that the user computing device sends the user personality word to the personality word collecting unit in real time or at a time.

The new word obtaining apparatus according to claim 21, further comprising: a thesaurus generating unit, configured to generate a new thesaurus according to the outputted new words or add the obtained new words to the original thesaurus, Get a new thesaurus or a new version of the thesaurus.

The new word obtaining apparatus according to claim 21, further comprising: an internet page database generating unit, configured to perform weighting on the internet page; and use an internet page whose weight value is greater than or equal to a preset threshold Store to the internet page database.

25. A new word acquisition device, comprising: a word collecting unit for collecting selected words of each user;

a word matching unit, connected to the word collecting unit, for comparing the selected word with the existing word, and obtaining the user's individual word according to the comparison result;

The new word acquisition device according to claim 25, wherein the new word acquisition unit comprises:

a statistical subunit for counting the number of occurrences of the personalized words in a preset Internet page database;

The new word determining subunit is connected to the statistical subunit for determining whether the number of occurrences of the personalized word is greater than or equal to a preset threshold, and if so, outputting the word as a new word.

The new word acquiring apparatus according to claim 25, further comprising: the word collecting unit is further configured to collect a user word frequency corresponding to the word selected by the user;

a statistical sub-unit for counting the number of occurrences of the personalized words in a preset Internet page database, and obtaining an Internet word frequency;

a weight word frequency determining subunit, configured to weight the user word frequency and the internet word frequency of the new word, and obtain a weighting word frequency of the new word;

The new word determining subunit is configured to determine whether the weight word frequency of the personalized word is greater than or equal to a preset threshold, and if so, output the word as a new word.

28. A method of generating a thesaurus, characterized by comprising:

Collecting input behavior information of each user, the input behavior information including the selected word in the user input process and the corresponding word frequency of the word;

Weight correction is performed on the word frequency of each user corresponding to the word, and the cumulative word frequency of the user of each word is calculated; a vocabulary is generated, the vocabulary including the word and its corresponding user cumulative word frequency.

29. The method of claim 28, further comprising:

Remove words whose user cumulative word frequency is less than or equal to a certain threshold.

30. The method of claim 28, further comprising:

Comparing the generated thesaurus with the existing thesaurus, and removing the words that do not conform to the preset rules according to the comparison result, and outputting the user's personalized words;

The personality word library is generated according to the user's personality words.

31. The method of claim 28, further comprising:

Counting the number of occurrences of the personalized words in the preset Internet page database, and obtaining the Internet word frequency;

The user cumulative word frequency and the internet word frequency of the personalized words are weighted and summed to obtain a weighted word frequency of the new word;

If the weight of the personalized word is greater than or equal to the preset threshold, the word is output as a new word;

A new vocabulary is generated based on the outputted new words, the new vocabulary including new words and their corresponding weighted words.

32. A vocabulary generating device, comprising:

The thesaurus generating unit is configured to generate a thesaurus, the thesaurus including the words and their corresponding cumulative word frequencies.

33. The device of claim 32, further comprising:

34. The device of claim 32, further comprising:

a new word determining unit, if the weight word frequency of the personality word is greater than or equal to a preset threshold, then Output the word as a new word;

The thesaurus generating unit generates a new thesaurus according to the outputted new words, the new thesaurus including new words and their corresponding weight words.