WO2017215244A1

WO2017215244A1 - Method and device for providing relevant words

Info

Publication number: WO2017215244A1
Application number: PCT/CN2016/113175
Authority: WO
Inventors: 李贤�
Original assignee: 广州视源电子科技股份有限公司
Priority date: 2016-06-17
Filing date: 2016-12-29
Publication date: 2017-12-21
Also published as: CN106126588B; CN106126588A

Abstract

A method and a device for providing relevant words, the method comprising: using user-inputted keywords as input words, obtaining from an entry database a word set subordinate to the keywords, and determining the degree of relevance to the keywords of each subordinate word in said subordinate word set (S1); on the basis of the word set subordinate to the keywords, obtaining from the entry database a set of words superordinate to the keywords, and determining the relevance to the keywords of each superordinate word in said superordinate word set (S2); using the combined set of the subordinate word set and the superordinate word set as the relevant word set output with respect to the keywords, then, according to the degree of relevance of each relevant word in the output word set, selecting relevant words from said output word set to provide to the user (S3). Use of the present method makes possible provision of a greater number of, and more precise, relevant words.

Description

Method and apparatus for providing related words

Technical field

The present invention relates to the field of computer technologies, and in particular, to a method and apparatus for providing related words.

Background technique

At present, the shopping website and the search engine service website provide the keyword search function, that is, the user inputs the keyword of the product or technology that is to be searched, and the server searches for the corresponding result according to the keyword and returns it to the user. In order to provide accurate search results, the server generally expands the keyword, that is, according to the keyword input by the user, finds the relevant word corresponding to the keyword, and provides the related word found to the user, and searches for the keyword through the keyword. When the satisfactory search results are not obtained, the search is based on the related words. However, the existing related word expansion is extended by existing dictionaries, such as WordNet, "Synonym Lin", and the related words obtained in this way are quite limited in number, and the related words obtained may not keep up with the language. The developmental changes cannot meet the requirements of timeliness of related words.

Summary of the invention

Embodiments of the present invention provide a method and apparatus for providing related words, which can provide a more and more accurate related words.

A method for providing related words according to an embodiment of the present invention includes:

Taking a keyword input by the user as an input word, acquiring a lower related word set of the keyword from the vocabulary database, and determining a relevance of each lower related word in the lower related word set to the keyword;

Obtaining, according to the lower-level related word set of the keyword, the episode related words of the keyword from the vocabulary database, and determining the relevance of each of the superordinate related words in the superordinate related word set to the keyword;

Taking the union of the lower related word set and the superordinate related word set of the keyword as the output related word set of the keyword, and outputting the relevance degree of the related word according to each of the output related word sets, The relevant related words are selected to select related words provided to the user.

According to a further improvement of the embodiment of the present invention, the episode related word set of the keyword is obtained from the vocabulary database according to the lower related word set of the keyword, and each of the upper related word sets is determined. The relevance of the related words to the keywords is specifically:

And for each lower-level related word in the lower-level related word set, the input word is updated by the lower-level related word, and the lower-level related word set of the updated input word is obtained from the entry database;

Determining whether the total number of the lower related words is greater than a preset threshold;

If yes, the lower related word set including the keyword is selected from the lower related word set, and the input word corresponding to the lower related word set including the keyword is used as the upper related word to obtain the keyword. a correlation word set; wherein, the degree of relevance of the keyword corresponding to the lower-level related word set in the lower-level related word set including the keyword, as the input word is used as a superordinate related word The relevance of the keyword;

If not, proceeding to: for each subordinate related word in the lower related word set of the updated input word, updating the input word again with the lower related word, and obtaining the updated input word from the entry database The lower related word set until the total number of lower related words is greater than a preset threshold.

Further, the manner of obtaining the lower related word set from the entry database includes:

Obtaining an entry containing the input word from the entry database according to the input word, and performing word segmentation and screening on the entry to obtain a related word set to be tested;

For each of the to-be-recognized related words in the to-be-tested related word set, according to the to-be-recognized related words, an entry containing the to-be-recognized related words is obtained from the entry database, and the related to-be-tested correlation is The entry of the word is subjected to word segmentation and screening, and the control word set of the related word to be tested is obtained;

When it is determined that the absolute value of the intersection of the comparison word set of the to-be-tested related word and the to-be-tested related word set is greater than a screening threshold, the to-be-relevant related word is a lower related word of the input word, and obtains a lower related word a set; wherein the absolute value is used as a correlation between the lower related word and the keyword.

As a further improvement of the present invention, according to the input word, the entry containing the input word is obtained from the vocabulary database, and the word is segmented and filtered, and the related word set is obtained, specifically including :

Obtaining, according to the input word, an entry that includes the input word and is sorted before the Mth position;

Formatting the acquired terms according to the standard entry format;

Call the word segmentation tool;

Using the word segmentation tool to perform segmentation on the format-adjusted entry to obtain a first term set;

Extracting, from the first word set, a word belonging to a core word in the user dictionary as a related word to be tested, and obtaining a related word set; wherein the user dictionary is provided by the word segmentation tool;

And obtaining, according to the to-be-recognized related words, an entry including the to-be-recognized related word from the entry database, and performing word segmentation and screening on the inquiring related term to obtain the The control word set of the relevant words to be tested includes:

Obtaining, according to the inquiring related words, an entry that includes the to-be-tested related words and is sorted before the Mth position;

Formatting the entry containing the to-be-tested related words and sorting before the Mth position according to the standard entry format;

Calling the word segmentation tool;

Using the word segmentation tool to perform segmentation on the format-adjusted term containing the to-be-tested related words and sorted before the Mth position, to obtain a second set of words;

A word belonging to the core word in the user dictionary is extracted from the second word set as a control word, and a control word set is obtained.

Specifically, the intersection of the lower related word set of the keyword and the superordinate related word set is included in the output related word set of the keyword, and the correlation degree of each output related word included in the intersection is T, T = (T1 + T2) / 2; wherein T1 is the degree of relevance to the keyword when the output related word is a lower related word, and T2 is used when the output related word is a higher related word The relevance of the keyword.

As a further modification of the present invention, the obtaining method further includes:

And subtracting the screening threshold from each of the lower related words in the lower related word set of the keyword and the relevance of the keyword;

The correlation threshold of each of the superordinate related words in the superordinate related word set of the keyword and the keyword is subtracted from the screening threshold, and the normalization of the correlation degree is completed.

Correspondingly, the implementation of the present invention further provides an apparatus for providing related words, including:

a lower-level related word set module, configured to use a keyword input by a user as an input word, obtain a lower-level related word set of the keyword from a vocabulary database, and determine each lower-level related word and place in the lower-level related word set The relevance of the keywords;

a superordinate related word set module, configured to acquire a superordinate related word set of the keyword from a vocabulary database according to a lower related word set of the keyword, and determine each superordinate related word in the episode related word set The relevance of the keyword;

And outputting a related word set module, configured to use a union of a lower related word set and a superordinate related word set of the keyword as an output related word set of the keyword, and output related according to each of the output related word sets The relevance of the word, the related words provided to the user are selected in the output related word set.

As a further improvement of the embodiment of the present invention, the upper related word set module specifically includes: a lower word set obtaining unit, a threshold value determining unit, and a higher word set obtaining unit, wherein

The lower word set obtaining unit is configured to update each input word with the lower related word for each lower related word in the lower related word set, and obtain the lower related word set of the updated input word from the entry database ;

The threshold determining unit is configured to determine whether the total number of the lower related word sets is greater than a preset threshold;

The upper word set obtaining unit is configured to: when determining that the total number of the lower related word sets is greater than a preset threshold, select a lower related word set including the keyword from the lower related word set, and include the The lower related words of the keyword Corresponding input words are used as superordinate related words to obtain a set of superordinate related words of the keyword; wherein, the input words corresponding to the keywords in the lower related word set including the keyword and the lower related related words set Correlation degree as the relevance of the input word to the keyword when it is a superordinate related word;

The lower word acquiring unit is further configured to: when determining that the total number of the lower related word sets is less than a preset threshold, continue to perform the following operations: for each lower related word in the lower related word set of the updated input words, The lower related words update the input words again, and obtain the lower related words of the newly updated input words from the entry database until the total number of the lower related words is greater than a preset threshold.

Further, the lower related word set module and the lower word set obtaining unit further comprise a unit for acquiring a lower related word set from the entry database, specifically:

The related word set unit is configured to obtain an entry including the input word from the vocabulary database according to the input word, and perform word segmentation and screening on the term, and obtain a related word set to be tested;

a comparison word set unit, configured to acquire, for each of the to-be-recognized related words in the to-be-tested related word set, an entry including the to-be-tested related word from the entry database according to the inquiring related word, And performing word segmentation and screening on the words of the related words to be inspected, and obtaining a comparison word set of the related words to be tested; and

a judgment obtaining unit, configured to determine, when the absolute value of the intersection of the control word set of the to-be-tested related word and the to-be-tested related word set is greater than a screening threshold, the in-relevant related word is a lower correlation of the input word a word, obtaining a lower related word set; wherein the absolute value is used as a relevance of the lower related word to the keyword.

Further, the unit of the related words to be tested specifically includes:

a first lexical sub-unit, configured to obtain, from the vocabulary database, an entry that includes the input word and is sorted before the Mth position according to the input word;

a first adjustment subunit, configured to perform format adjustment on the obtained entry according to a standard entry format;

The first call subunit is used to call the word segmentation tool;

a first word segment sub-unit, configured to perform word segmentation on the format-adjusted term by using the word segmentation tool to obtain a first word set; and,

a first extracting subunit, configured to extract a word belonging to a core word in a user word from the first word set as a related word to be tested, to obtain a related word set to be tested; wherein the user dictionary is a word segmentation tool which provided;

And the control word set unit specifically includes:

a second term sub-unit, configured to obtain, according to the to-be-tested related words, an entry that includes the to-be-tested related words and is sorted before the Mth position;

a second adjustment subunit, configured to perform format adjustment on the term that includes the to-be-recognized related word and is sorted before the Mth position according to the standard entry format;

a second calling subunit, configured to invoke the word segmentation tool;

a second word segment sub-unit, configured to perform word segmentation on the format-adjusted term containing the to-be-tested related words and sorted before the Mth position by using the word segmentation tool to obtain a second word set;

a second extraction subunit, configured to obtain a comparison word set according to a word extracted from the second word set and belonging to a core word in the user dictionary as a control word.

Further, the apparatus for providing related words further includes a normalization module:

The normalization module is configured to subtract the relevance of each of the lower related words in the lower related word set of the keyword from the keyword by the screening threshold; and to use the keyword The correlation between each of the superordinate related words in the epistem-related word set and the keyword is subtracted from the screening threshold, and the normalization of the correlation is completed.

Embodiments of the present invention have the following beneficial effects:

The method and device for providing a related word provided by an embodiment of the present invention obtains a lower related word set of the keyword from a vocabulary database by using a keyword provided by a user, and then, according to the lower related word set, the keyword is extracted. The episode of related words, and finally the union of the lower related words and the episodes as the output related words of the keyword, can expand a large number of related words to provide for user selection, and further, by determining related words Relevance can be accurately described as the degree of correlation between related words and keywords, and subsequent related words can be selected according to the relevance of related words, and can be accurately described by the relevance of related words. Provide related words.

DRAWINGS

1 is a schematic flow chart of an embodiment of a method for providing related words provided by the present invention;

2 is a schematic flow chart of an embodiment of step S2 of the method for providing related words provided in FIG. 1;

3 is a schematic flow chart of an implementation of step S3 of the method for providing related words provided by FIG. 1;

4 is a schematic flow chart of another embodiment of a method for providing related words provided by the present invention;

FIG. 5 is a schematic structural diagram of an embodiment of an apparatus for providing related words according to the present invention; FIG.

6 is a schematic structural diagram of an embodiment of a superordinate related word set module of a device for providing related words according to the present invention;

7 is a schematic structural diagram of an embodiment of a unit for acquiring a lower related word set of the apparatus for providing related words provided by the present invention;

FIG. 8 is a schematic structural diagram of an embodiment of a to-be-relevant related word set unit of a device for providing related words according to the present invention; FIG.

FIG. 9 is a schematic structural diagram of an embodiment of a control word set unit of the apparatus for providing related words provided by the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

Referring to FIG. 1 , FIG. 2 and FIG. 3 , FIG. 1 is a schematic flowchart of an embodiment of a method for providing related words provided by the present invention, and FIG. 2 is an embodiment of step S2 of the method for providing related words provided by FIG. 1 . FIG. 3 is a schematic flow chart of an implementation of step S3 of the method for providing related words provided in FIG. 1 . In the following, in combination with the three flowcharts, the paper database (for example, China Knowledge Network) is used as the entry database, and the related words of the keyword Java are obtained as an example, and the method for providing related words in the embodiment is described in detail, and the method includes the following step:

S1, using the keyword Java input by the user as an input word, obtaining a lower-level related word set of the keyword Java from the entry database, and determining the relevance of each lower-level related word in the lower-level related word set to the keyword . Step S1 includes steps S11 to S13, as follows:

S11. Acquire an entry containing the input word Java from the paper database according to the input word Java, and perform word segmentation and screening on the entry, and obtain a related word set A={a ₁ ,..., a _n }; The specific implementation process of this step is as follows:

Using the search engine to obtain, according to the input word Java, the entry containing the input word Java and sorted before the Mth position, for example, the first 50 pages of the abstract as a term, or searching for keywords in the wiki The first 500 abstracts of Java;

Formatting the terms according to the standard entry format; for example, unifying lowercase in the entry into uppercase, deleting extra spaces in the entry, punctuation in the unified entry, or formatting the entry in full-width or The half-width format is unified into one type.

The word segmentation tool is called; preferably, the word segmentation tool is a jieba word segmentation tool, but is not limited to this word segmentation tool.

Extracting, according to the keyword extraction algorithm, words related to the input words from the first word set as related words {a ₁ , . . . , a _n } to obtain a related word set A={a ₁ ,... , a _n }. It should be noted that the core word can be extracted from the first word set as a related word to be tested by using a word segmentation tool or by adding a dictionary through the device providing the related word.

S12. For each of the to-be-recognized related words in the set of related words A={a ₁ , . . . , a _n }, obtaining the to-be-tested from the entry database according to the to-be-recognized related words. The terms of the related words are segmented and screened for the words of the related words to be inspected, and the control words of the related words to be tested are obtained. It should be noted that this step S22 is the same as the specific implementation process of the previous step S21, except that the input word in step S21 becomes the related word {a ₁ , . . . , a _n }, and then the obtained test is obtained. a _i related words of the set of words associated quarantine _{_{B ai = {b i1, ...}} , b in} as a control experiment to be the set of words associated word a _i, and therefore will not describe them here.

S13, when it is determined the control word associated set of word a _i B _ai = the quarantine _{_{{b i1, ..., b in}} } be associated with the word test set _{A = {a 1, ...,} a n} of intersection when r is greater than the absolute value of the threshold value filter p, i.e., the number of set a and set B _ai same filter element is greater than the threshold value p, the quarantine related words input a _i is the lower bit word Java-related words, the key is obtained The lower related word set A'={a _j }, and j∈{1,...,n}, |A'|≤n, |A⌒B _aj |>p; where the absolute value of the intersection r The degree of relevance of the lower related words in the lower related word set. It should be noted that the correlation degree is expressed as the degree of correlation between the related words in the related word set and the input words of the related word set.

By obtaining the lower related words of the input words through the above steps S11, S12 and S13, the noise words can be filtered out, and the efficiency of acquiring the lower related words is improved.

Obtaining a set of superordinate related words of the keyword from the vocabulary database according to the lower related word set of the keyword, and determining a correlation between each of the superordinate related words in the epistem related word set and the keyword

S2. Obtain a set of a superordinate related word of the keyword from the vocabulary database according to the lower related word set A′={a _j } of the keyword, and determine each superordinate related word in the episode related word set. The degree of relevance to the keyword. The specific steps of this step include the following steps S21 to S24:

S21, for each of the lower related words in the lower related word set A'={a _j }, update the input word with the lower related word a _j , that is, as an input word, obtain the updated input from the paper database. lower-related words words a _j set a "; Incidentally, in the present embodiment, preferably, step S31 obtain a consistent manner the bit associated word set acquires the next bit associated word set with the step S2 above embodiment, this No longer.

S22, determining whether the total number N of the current lower related word set is greater than a preset threshold S;

S23, if yes, selecting all the lower related words containing the keyword from the lower related word set, and using the input word corresponding to the lower related word set including the keyword as the upper related word, obtaining the a superordinate related word set C of the keyword; wherein, the degree of relevance of the keyword corresponding to the lower related word set in the lower related word set including the keyword is used as the upper word as the input word Relevance of relevant words with the keywords

S24, if no, proceeding to: for each subordinate related word in the lower related word set of the updated input word, updating the input word again with the lower related word, and obtaining the updated input from the entry database The subordinate related word set of the word until the total number N of the lower related word set is greater than the preset threshold S; it should be noted that the manner of acquiring the lower related word set in steps S21 and S23 and obtaining the lower related word in the above step S1 The way of collection is also the same, and will not be repeated here.

That is to say, for example, for the keyword Java, the upper-level related word set of Java is a set of input words in a set, that is, the lower-level related word set of each element in the set has the same element as Java. . By retrieving the set of superordinate related words of the keyword in the same way as acquiring the lower related word set, the user can be provided with relevant information from multiple dimensions. word.

S3, using a union of a lower-level related word set and a superordinate related word set of the keyword as an output related word set of the keyword, and outputting a correlation degree of the related word according to each of the output related word sets, The output related word set selects related words provided to the user.

Specifically, the intersection of the lower related word set of the keyword and the episode related word set is included in the output related word set of the keyword, and the correlation degree of each output related word included in the intersection is T , T = (T1 + T2) / 2; wherein T1 is the degree of relevance to the keyword when the output related word is a lower related word, and T2 is used as the key when the output related word is a higher related word The relevance of the word. That is to say, after the union, the correlation degree of the related words of the same in the upper related word set and the lower related word set is the mean value of the correlation degree of the related words in the two sets.

As a further improvement of the present invention, the obtaining method further comprises normalizing the correlation:

It should be noted that the purpose of normalization is to make the value of the correlation between the related words of the keyword-related output words and the degree of relevance of the keyword can be based on 0, the higher the value, the related words and keywords. The higher the degree of correlation, the more convenient to select the relevant words provided to the user in the output related word set in step S4.

The method for providing a related word according to an embodiment of the present invention can filter out the influence of a noise word and improve the quality of the obtained related word by using the related word after the obtained lower-order related words to be verified as the lower related words. In other words, the accuracy of the relevant words provided to the user can be ensured. On the other hand, after obtaining the lower-level related words of the keyword, the upper-level related words of the keyword are reversely obtained when the lower-level related word set is continued, and the number of related words provided by the user can be expanded to a large extent, and the upper-level related words can be confirmed. The quality of related words.

Referring to FIG. 4, it is a schematic flowchart of another embodiment of a method for providing related words according to the present invention. The method for providing related words in this embodiment is as follows: using a thesis database and a Wikipedia database as the entry database respectively, and obtaining corresponding data therefrom. a first output related word set and a second output related word set, and then the union of the first output related word set and the second output related word set as a final output related word set of the keyword; wherein, in the Wikipedia database The manner in which the second output related word set is obtained is the same as the manner in which the output related word set is obtained in the paper database in the previous embodiment. In this embodiment, two different vocabulary databases are used, and the vocabulary database is a essay database and a Wikipedia database for mining related words. On the one hand, the extension of related words is highly targeted, and the corpus can be avoided. The related words provided to the user are too one-sided.

Correspondingly, referring to FIG. 5, which is a schematic structural diagram of an embodiment of an apparatus for providing related words provided by the present invention, which can implement the entire process of the foregoing two embodiments, and the apparatus for providing related words includes:

The lower related word set module 10 is configured to use a keyword input by the user as an input word, obtain a lower related word set of the keyword from the entry database, and determine each lower related word in the lower related word set. The relevance of the keyword;

The superordinate related word set module 20 is configured to obtain a superordinate related word set of the keyword from the vocabulary database according to the lower related word set of the keyword, and determine each superordinate related word in the superordinate related word set Relevance to the keyword;

And outputting a related word set module 30, configured to use a union of a lower related word set and a superordinate related word set of the keyword as an output related word set of the keyword, and output each of the output related word sets according to the output The relevance of the related words, the related words provided to the user are selected in the output related word set.

As a further improvement of the embodiment of the present invention, as shown in FIG. 6, FIG. 6 is a schematic structural diagram of an embodiment of a superordinate related word set module of the apparatus for providing related words provided by the present invention; the upper related word set module 30 specifically includes a lower word set obtaining unit 31, a threshold value determining unit 32, and a higher word set obtaining unit 33, wherein

The lower word set obtaining unit 31 is configured to update each input word with the lower related word for each lower related word in the lower related word set, and obtain the lower related word of the updated input word from the entry database set;

The threshold determining unit 32 is configured to determine whether the total number of the lower related word sets is greater than a preset threshold;

The upper word set obtaining unit 33 is configured to: when determining that the total number of the lower related word sets is greater than a preset threshold, select a lower related word set including the keyword from the lower related word set, and use the upper related word set The input word corresponding to the lower related word set of the keyword is used as a superordinate related word to obtain a superordinate related word set of the keyword; wherein the keyword in the lower related word set including the keyword and the keyword Correlation degree of the input word corresponding to the lower related word set, as the relevance of the input word to the keyword when it is a superordinate related word;

The lower word set obtaining unit 31 is further configured to: when determining that the total number of the lower related word sets is less than a preset threshold, continue to perform the following operations: for each lower related word in the lower related word set of the updated input word, The input word is updated again by the lower related word, and the lower related word set of the newly updated input word is obtained from the entry database until the total number of the lower related word set is greater than a preset threshold.

Further, the lower related word set module 20 and the lower word set obtaining unit 31 further comprise means for acquiring a lower related word set from the entry database, as shown in FIG. 7, FIG. 7 is provided by the present invention. A schematic structural diagram of an embodiment of a unit for obtaining a lower-level related word set of a device for providing related words, specifically comprising:

The related word set unit 1 is configured to obtain, from the entry database, a word including the input word according to the input word And classifying and screening the terms to obtain a set of related words to be tested;

a comparison word set unit 2, configured to acquire, for each of the to-be-recognized related words in the to-be-tested related word set, an entry including the to-be-recognized related word from the entry database according to the inquiring related word And classifying and screening the terms of the related words to be inspected, and obtaining a comparison word set of the related words to be tested; and

a determining obtaining unit 3, configured to: when determining that an absolute value of an intersection of the comparison word set of the to-be-tested related word and the to-be-tested related word set is greater than a screening threshold, the inquiring related word is a lower position of the input word a related word, obtaining a lower related word set; wherein the absolute value is used as a relevance of the lower related word to the keyword.

Further, as shown in FIG. 8, FIG. 8 is a schematic structural diagram of an embodiment of a to-be-recognized related word set unit of the apparatus for providing related words according to the present invention;

a first lexical sub-unit 11 configured to obtain, from the vocabulary database, an entry that includes the input word and is sorted before the Mth position according to the input word;

The first adjusting sub-unit 12 is configured to perform format adjustment on the obtained entry according to the standard entry format;

a first calling subunit 13 for calling a word segmentation tool;

a first word segment sub-unit 14 configured to perform word segmentation on the format-adjusted term by using the word segmentation tool to obtain a first word set; and,

a first extracting sub-unit 15, configured to extract a word belonging to a core word in the user word from the first word set as a related word to be tested, and obtain a related word set to be tested; wherein the user dictionary is Provided by the word segmentation tool;

And, as shown in FIG. 9, FIG. 9 is a schematic structural diagram of an embodiment of a control word set unit of the apparatus for providing related words according to the present invention; and the control word set unit 2 specifically includes:

a second lexical sub-unit 21, configured to obtain, according to the to-be-tested related words, an entry that includes the to-be-tested related words and is sorted before the Mth position;

a second adjustment sub-unit 22, configured to perform format adjustment on the term that includes the to-be-recognized related word and is sorted before the Mth position according to the standard entry format;

a second calling subunit 23, configured to invoke the word segmentation tool;

a second word segment sub-unit 24, configured to use the word segmentation tool to perform segmentation on the format-adjusted term containing the to-be-tested related words and sorted before the Mth position, to obtain a second word set;

The second extracting sub-unit 25 is configured to obtain, from the second word set, a word belonging to the core word in the user dictionary as a control word, and obtain a control word set.

Specifically, the intersection of the lower related word set of the keyword and the superordinate related word set is included in the output related word set of the keyword, and the correlation degree of each output related word included in the intersection is T, T = (T1 + T2) / 2; wherein T1 is the degree of correlation with the keyword when the output related word is a lower related word, and T2 is used as the relevant word in the output The degree of relevance to the keyword when it is a superordinate related word.

Further, as shown in FIG. 5, the apparatus for providing related words further includes a normalization module 40:

The device for providing related words provided by the embodiment of the present invention can filter out the influence of the noise word and improve the quality of the obtained related word by using the related words after the obtained lower-order related words to be verified as the lower related words. In other words, the accuracy of the relevant words provided to the user can be ensured. On the other hand, after obtaining the lower-level related words of the keyword, the upper-level related words of the keyword are reversely obtained when the lower-level related word set is continued, and the number of related words provided by the user can be expanded to a large extent, and the upper-level related words can be confirmed. The quality of related words.

One of ordinary skill in the art can understand that all or part of the process of implementing the foregoing embodiments can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

The above is a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It is the scope of protection of the present invention.

Claims

A method for providing related words, comprising:

Taking a keyword input by the user as an input word, acquiring a lower related word set of the keyword from the vocabulary database, and determining a relevance of each lower related word in the lower related word set to the keyword;

Obtaining, according to the lower-level related word set of the keyword, the episode related words of the keyword from the vocabulary database, and determining the relevance of each of the superordinate related words in the superordinate related word set to the keyword;

Taking the union of the lower related word set and the superordinate related word set of the keyword as the output related word set of the keyword, and outputting the relevance degree of the related word according to each of the output related word sets, The relevant related words are selected to select related words provided to the user.
The method for providing a related word according to claim 1, wherein said obtaining a set of a superordinate related word of said keyword from said entry database according to said lower related word set of said keyword, and determining said The correlation between each of the superordinate related words in the epistem related words and the keywords is specifically:

And for each lower-level related word in the lower-level related word set, the input word is updated by the lower-level related word, and the lower-level related word set of the updated input word is obtained from the entry database;

Determining whether the total number of the lower related words is greater than a preset threshold;

If yes, the lower related word set including the keyword is selected from the lower related word set, and the input word corresponding to the lower related word set including the keyword is used as the upper related word to obtain the keyword. a correlation word set; wherein, the degree of relevance of the keyword corresponding to the lower-level related word set in the lower-level related word set including the keyword, as the input word is used as a superordinate related word The relevance of the keyword;

If not, proceeding to: for each subordinate related word in the lower related word set of the updated input word, updating the input word again with the lower related word, and obtaining the updated input word from the entry database The lower related word set until the total number of lower related words is greater than a preset threshold.
The method for providing a related word according to claim 2, wherein the manner of obtaining the lower related word set from the entry database specifically includes:

Obtaining an entry containing the input word from the entry database according to the input word, and performing word segmentation and screening on the entry to obtain a related word set to be tested;

For each of the to-be-recognized related words in the to-be-tested related word set, according to the to-be-recognized related words, an entry containing the to-be-recognized related words is obtained from the entry database, and the related to-be-tested correlation is Word entry for word segmentation and screening a set of comparison words for the relevant words to be examined;

When it is determined that the absolute value of the intersection of the comparison word set of the to-be-tested related word and the to-be-tested related word set is greater than a screening threshold, the to-be-relevant related word is a lower related word of the input word, and obtains a lower related word a set; wherein the absolute value is used as a correlation between the lower related word and the keyword.
The method for providing related words according to claim 3, wherein said obtaining an entry containing said input word from said entry database according to said input word, and classifying and screening said entry , obtaining the relevant words to be tested, including:

Obtaining, according to the input word, an entry that includes the input word and is sorted before the Mth position;

Formatting the acquired terms according to the standard entry format;

Call the word segmentation tool;

Using the word segmentation tool to perform segmentation on the format-adjusted entry to obtain a first term set;

Extracting, from the first word set, a word belonging to a core word in the user dictionary as a related word to be tested, and obtaining a related word set; wherein the user dictionary is provided by the word segmentation tool;

And obtaining, according to the to-be-recognized related words, an entry including the to-be-recognized related word from the entry database, and performing word segmentation and screening on the inquiring related term to obtain the The control word set of the relevant words to be tested includes:

Obtaining, according to the inquiring related words, an entry that includes the to-be-tested related words and is sorted before the Mth position;

Formatting the entry containing the to-be-tested related words and sorting before the Mth position according to the standard entry format;

Calling the word segmentation tool;

Using the word segmentation tool to perform segmentation on the format-adjusted term containing the to-be-tested related words and sorted before the Mth position, to obtain a second set of words;

A word belonging to the core word in the user dictionary is extracted from the second word set as a control word, and a control word set is obtained.
The method for providing a related word according to claim 1, wherein an intersection of the lower related word set of the keyword and the upper related word set is included in an output related word set of the keyword, and is included in The correlation degree of each output related word in the intersection is T, T=(T1+T2)/2; wherein T1 is the correlation with the keyword when the output related word is a lower related word, T2 The degree of correlation with the keyword when the related word is output as a superordinate related word.
The method for providing a related word according to claim 3, wherein the obtaining method further comprises:

And subtracting the screening threshold from each of the lower related words in the lower related word set of the keyword and the relevance of the keyword;

The correlation threshold of each of the superordinate related words in the superordinate related word set of the keyword and the keyword is subtracted from the screening threshold, and the normalization of the correlation degree is completed.
A device for providing related words, comprising:

a lower-level related word set module, configured to use a keyword input by a user as an input word, obtain a lower-level related word set of the keyword from a vocabulary database, and determine each lower-level related word and place in the lower-level related word set The relevance of the keywords;

a superordinate related word set module, configured to acquire a superordinate related word set of the keyword from a vocabulary database according to a lower related word set of the keyword, and determine each superordinate related word in the episode related word set The relevance of the keyword;

And outputting a related word set module, configured to use a union of a lower related word set and a superordinate related word set of the keyword as an output related word set of the keyword, and output related according to each of the output related word sets The relevance of the word, the related words provided to the user are selected in the output related word set.
The device for providing a related word according to claim 7, wherein the upper related word set module comprises: a lower word set obtaining unit, a threshold value determining unit, and a higher word set obtaining unit, wherein

The lower word set obtaining unit is configured to update each input word with the lower related word for each lower related word in the lower related word set, and obtain the lower related word set of the updated input word from the entry database ;

The threshold determining unit is configured to determine whether the total number of the lower related word sets is greater than a preset threshold;

The upper word set obtaining unit is configured to: when determining that the total number of the lower related word sets is greater than a preset threshold, select a lower related word set including the keyword from the lower related word set, and include the The input word corresponding to the lower-level related word set of the keyword is used as a superordinate related word to obtain a superordinate related word set of the keyword; wherein the keyword and the lower position in the lower-level related word set including the keyword Correlation degree of the input word corresponding to the related word set, as the relevance of the input word to the keyword when it is a superordinate related word;

The lower word set obtaining unit is further configured to: when determining that the total number of the lower related word sets is less than a preset threshold, continue to perform the following operations: for each of the lower related words in the lower related word set of the updated input words, The lower related word updates the input word again, and obtains the lower related word set of the newly updated input word from the entry database until the total number of the lower related word set is greater than a preset threshold.
The apparatus for providing related words according to claim 8, wherein the lower related word set module and the lower word set obtaining unit further comprise means for acquiring a lower related word set from the entry database, for:

The related word set unit is configured to obtain an entry including the input word from the vocabulary database according to the input word, and perform word segmentation and screening on the term, and obtain a related word set to be tested;

a comparison word set unit, configured to acquire, for each of the to-be-recognized related words in the to-be-tested related word set, an entry including the to-be-tested related word from the entry database according to the inquiring related word, And performing word segmentation and screening on the words of the related words to be inspected, and obtaining a comparison word set of the related words to be tested; and

a judgment obtaining unit, configured to determine, when the absolute value of the intersection of the control word set of the to-be-tested related word and the to-be-tested related word set is greater than a screening threshold, the in-relevant related word is a lower correlation of the input word a word, obtaining a lower related word set; wherein the absolute value is used as a relevance of the lower related word to the keyword.
The apparatus for providing a related word according to claim 9, wherein the unit of the related words to be examined specifically includes:

a first lexical sub-unit, configured to obtain, from the vocabulary database, an entry that includes the input word and is sorted before the Mth position according to the input word;

a first adjustment subunit, configured to perform format adjustment on the obtained entry according to a standard entry format;

The first call subunit is used to call the word segmentation tool;

a first word segment sub-unit, configured to perform word segmentation on the format-adjusted term by using the word segmentation tool to obtain a first word set; and,

a first extracting subunit, configured to extract a word belonging to a core word in a user word from the first word set as a related word to be tested, to obtain a related word set to be tested; wherein the user dictionary is a word segmentation tool which provided;

And the control word set unit specifically includes:

a second term sub-unit, configured to obtain, according to the to-be-tested related words, an entry that includes the to-be-tested related words and is sorted before the Mth position;

a second adjustment subunit, configured to perform format adjustment on the term that includes the to-be-recognized related word and is sorted before the Mth position according to the standard entry format;

a second calling subunit, configured to invoke the word segmentation tool;

a second word segment sub-unit, configured to perform word segmentation on the format-adjusted term containing the to-be-tested related words and sorted before the Mth position by using the word segmentation tool to obtain a second word set;

a second extraction subunit, configured to obtain a comparison word set according to a word extracted from the second word set and belonging to a core word in the user dictionary as a control word.
The apparatus for providing related words according to claim 10, wherein the means for providing related words further comprises a normalization module:

The normalization module is configured to subtract the relevance of each of the lower related words in the lower related word set of the keyword from the keyword by the screening threshold; and to use the keyword The correlation between each of the superordinate related words in the epistem-related word set and the keyword is subtracted from the screening threshold, and the normalization of the correlation is completed.