JPH06251072A - Device and method for processing document - Google Patents

Abstract

PURPOSE:To calculate the significance of a key word extracted from inputted document information at every field to which the document information be longs. CONSTITUTION:The document information and field information are inputted by a document input device 11. A key word candidate is sampled from the document information inputted by a key word statistical information sampling device 12, and key word statistical information is sampled. The significance classified by every field is found at every key word candidate corresponding to the field information inputted by a significance arithmetic unit 13 classified by every field. Key word significance is calculated by a key word significance evaluation device 14 based on the key word statistical information and the significance classified by every field. The key word candidate is stored in a memory device 15 as the key word with the key word significance.

Description

Detailed Description of the Invention

[0001]

TECHNICAL FIELD The present invention relates to a document processing apparatus and method.

[0002]

2. Description of the Related Art A technique for extracting a keyword from a document and evaluating the importance of the extracted keyword is described in Japanese Patent Laid-Open No. 3-135669. In this technique, regardless of the form (or type) of the document from which the keyword is extracted (scientific paper, patent document, newspaper article, etc.) and the length of the document, the importance evaluation of the extracted keyword is fixed and is general-purpose.

However, this technique has a problem in that it is not possible to perform importance evaluation suitable for the form of a document, because a fixed general-purpose importance evaluation is performed for extracted keywords.

Further, since statistical information such as the number of appearances and appearance positions of keywords used for evaluating the importance of keywords extracted from a document is not normalized regardless of the length of the document, the importance of the keyword depends on the length of the document. There was a problem that there was an error in.

On the other hand, for a keyword extracted from a document, one of the methods for adding the degree of association between two different keywords is described in Japanese Patent Laid-Open No. 4-96177. In this method, multiple documents are used to calculate the degree of association between two keywords.

However, such a method requires a predetermined amount of documents to calculate the degree of association between keywords. Further, since the distance information between the keywords in one document is not used for the calculation of the degree of association, there is a problem that an accurate degree of association cannot be obtained for each document.

[0007]

DISCLOSURE OF THE INVENTION An object of the present invention is to enable the importance of a keyword extracted from a document to be evaluated in the field to which the document belongs.

According to the present invention, the importance of keywords extracted from a document can be evaluated accurately regardless of the length of the document and the field to which the document belongs, and the degree of association between the extracted keywords can be obtained for each document. The purpose is to be able to.

An object of the present invention is to enable the importance of a keyword extracted from a document to be evaluated with respect to the type of the document and the field to which the document belongs.

An object of the present invention is to enable the importance of a keyword extracted from a document to be evaluated for each type of the document and each field to which the document belongs, and to be accurately evaluated regardless of the length of the document. I am trying.

The first aspect of the present invention makes it possible to evaluate the importance of a keyword extracted from a document in the field to which the document belongs.

The document processing apparatus according to the first invention is a document input means for inputting document information and field information representing a predetermined field to which the document information belongs, and a keyword candidate is extracted from the input document information and extracted. The keyword statistical information creating means for creating the keyword statistical information about the keyword candidates, the plurality of first headwords, and the field-specific importance for each field to which each of the first headwords belongs are registered in advance. Field-specific importance dictionary, field-specific importance generation means for reading the field-specific importance of the field indicated by the field information input for each of the extracted keyword candidates, field-specific importance generation means, and importance evaluation rules, Importance evaluation rule dictionary with membership functions registered in advance, importance evaluation registered in the above importance evaluation rule dictionary Extracted by the keyword statistical information creating means based on the keyword statistical information created by the keyword statistical information creating means and the field importance created by the field importance creating means according to the rule and the membership function. And a keyword importance evaluation means for calculating the keyword importance of the keyword candidate, and a storage for storing the keyword candidate and the keyword importance calculated for the keyword candidate in association with the data designating the input document information. Equipped with means.

In the document processing method according to the first aspect of the present invention, a plurality of first headwords and, for each of the first headwords, the field importance for each field is registered in advance in the field importance dictionary. The importance evaluation rule and the membership function are registered in advance in the importance evaluation rule dictionary, and the input document information and the document information representing the predetermined field to which the document information belongs are accepted, and the input document is input. Extract keyword candidates from the information, create keyword statistical information about the extracted keywords,
For each of the keyword candidates, the field-specific importance of the field represented by the input field information is read out from the field-specific importance dictionary, and is stored in the importance evaluation rule and the membership function registered in the importance evaluation rule dictionary. Therefore, the keyword importance of the extracted keyword candidate is calculated based on the created keyword statistical information and the generated field-specific importance, and the extracted keyword candidate and the calculated keyword importance of the keyword candidate are calculated. The degree is stored in association with the data specifying the input document information.

According to the first invention, the keyword statistical information is created for each keyword candidate extracted from the input document information. In addition, the degree of importance by field is obtained for each keyword candidate extracted based on the input field information. Since the keyword importance of the extracted keyword candidates is calculated based on the keyword statistical information for each keyword candidate and the importance by field, the keyword importance in the field to which the input document information belongs can be obtained. Further, by registering the degree of importance of various fields in the degree of importance of each field, it is possible to handle document information of various fields.

In a preferred embodiment of the first invention, a plurality of second headwords, related words related to each of the second headwords, and a degree of association between the second headword and the related words. Further comprising a related word dictionary in which the degree of relevance representing is registered in advance in the field-specific importance dictionary among the keyword candidates extracted by the keyword statistical information creating means. When there are registered keyword candidates, the degree of relevance of the unregistered keyword candidates and its degree of relevance are read from the related word dictionary, and the degree of importance of the related words of the unregistered keyword candidates by field is determined by the degree of importance by field. The degree of importance of each of the unregistered keyword candidates is read out from the dictionary, and the degree of importance of each of the unregistered keyword candidates is calculated based on the degree of relevance and the degree of importance of each field.

As a result, even if there is an unregistered keyword candidate in the field-specific importance dictionary among the extracted keyword candidates, the field-specific importance of all the extracted keyword candidates can be calculated.

Further, when the field information is not input from the document input means, the field importance generation means reads out the field importance of a predetermined field.

As a result, even if the field information is not input, the field-specific importance of the extracted keyword candidates can be obtained.

Further, the storage means stores a keyword candidate having a keyword importance of a predetermined threshold value or more as a keyword of the input document information.

As a result, only the keywords that well represent the contents of the document information are stored.

The second aspect of the present invention can accurately evaluate the importance of the keyword extracted from the document regardless of the length of the document and the field to which the document belongs, and the degree of association between the extracted keywords for each document. Be able to ask.

The document processing apparatus according to the second invention is a document input means for inputting document information and field information representing a predetermined field to which the document information belongs, and a keyword candidate is extracted from the input document information and extracted. A keyword statistical information creating means for creating keyword statistical information about the keyword candidates, a plurality of first headwords, and a synonym dictionary in which synonyms for each of the first headwords are registered in advance, extracted. Regarding keyword candidates, referring to the synonym dictionary, a synonym group is configured by keyword candidates registered as synonyms, and at least a part of the keyword statistical information of the keyword candidates belonging to the same synonym group Entered the keyword statistical information that was totaled for each synonym group Keyword information normalization means for normalizing with the entire information about the book information, the plurality of second
Of the first headword and the first headword in the synonym dictionary of the synonym group in which the field importance of each of the first headwords is registered in advance for each field to which it belongs. Is searched for in the field importance dictionary, the field importance of the field represented by the input field information is read, and the field importance is set as the field importance of the keyword candidate belonging to the synonym group. According to the importance level evaluation rule dictionary and the membership function registered in the importance level evaluation rule dictionary in which the importance level generating means for each field, the importance level evaluation rule and the membership function are registered in advance,
The keyword importance of the keyword candidate is calculated based on the keyword statistical information including the information normalized by the keyword statistical information normalizing means and the field-specific importance of the keyword candidate generated by the field-specific importance calculating means. A keyword importance evaluation means, and a storage means for storing the extracted keyword candidates and the keyword importance calculated for them in association with the data designating the input document information.

In the document processing method according to the second invention, a plurality of first headwords and synonyms for each of the first headwords are registered in advance in a synonym dictionary, and a plurality of second headwords are registered. For each word and each of the above-mentioned second headwords, the degree of importance for each field is registered in the field importance dictionary in advance, and the importance evaluation rule and the membership function are registered in the importance evaluation rule dictionary in advance. Register and accept the input document information and field information indicating the predetermined field to which the document information belongs,
Extract keyword candidates from the input document information,
The keyword statistical information about the extracted keyword candidates is created, and with respect to the extracted keyword candidates, the synonym group is constructed by the keyword candidates registered as synonyms by referring to the synonym dictionary, and the same synonyms are formed. At least a part of the keyword statistical information of the keyword candidates belonging to the word group is aggregated for each synonym group, and the aggregated keyword candidate information is normalized by using the overall information about the input document information, The field-specific importance dictionary is searched for the first headword in the synonym dictionary of the word group, and the field-specific importance of the field represented by the input field information is read.
A keyword including information normalized according to the importance evaluation rule and membership function registered in the above-mentioned importance evaluation rule dictionary is defined as the field importance of the keyword candidates belonging to the synonym group. The keyword importance of the keyword candidate is calculated based on the statistical information and the field-specific importance of the generated keyword candidate. The extracted keyword candidate and the keyword importance calculated for the keyword candidate are input as described above. The document information is stored in association with the data specifying the document information.

According to the second aspect of the present invention, the keyword statistical information is created for each keyword candidate extracted from the input document information, and the input document information is normalized using the whole information. Further, based on the inputted field information, the field-specific importance is obtained for each keyword candidate. Since the keyword importance of the extracted keyword candidates is calculated based on the keyword statistical information for each keyword candidate and the importance by field, the keyword importance in the field to which the input document information belongs can be obtained. Further, since the extracted keyword statistical information is normalized by the normalization information, the accurate keyword importance can be calculated regardless of the length of the input document information. Further, by registering the degree of importance of each field in the various fields in the dictionary of importance of each field, the document information of various fields can be handled.

When no field information is input from the document input means, the field importance generation means reads out the field importance of a predetermined field.

As a result, even if the field information is not input, the field-specific importance of the extracted keyword candidates can be obtained.

In a preferred embodiment of the second invention, a plurality of third headwords, related words related to each of the third headwords, and degree of association between the third headword and the related words. Further comprising a related word dictionary in which the degree of relevance representing is registered in advance in the field-specific importance dictionary among the keyword candidates extracted by the keyword statistical information creating means. When there are registered keyword candidates, the related words of the unregistered keyword candidates and their degrees of relevance are read from the related word dictionary, and the field-specific importance of the related words of the unregistered keyword candidates is classified by the field importance. The degree of importance of each unregistered keyword candidate by category is calculated based on the degree of association of the related words and the degree of importance of each category read out from the dictionary.

As a result, even when there is an unregistered keyword candidate in the field-specific importance dictionary among the extracted keyword candidates, the field-specific importance of all the extracted keyword candidates can be calculated.

In a preferred embodiment of the second invention, distance information between any two keyword candidates in the keyword candidates is created based on the input document information, and between the created two keyword candidates. When the degree of relevance of the two keyword candidates is calculated according to a relevance degree evaluation rule and a membership function which are set in advance based on the distance information of, and the two keyword candidates are registered in the related word dictionary, Further includes an inter-keyword relevance degree setting means for updating the registered relevance degree with the calculated relevance degree, and writing the calculated relevance degree in the above-mentioned related word dictionary when not registered in the above-mentioned related word dictionary. There is.

Thus, the degree of association between the two keyword candidates can be calculated based on the distance information between the two keywords created for each input document information.

Further, the storage means stores a keyword candidate having a keyword importance of a predetermined threshold value or more as a keyword of the input document information.

As a result, only the keywords that well represent the contents of the document information are stored.

The third invention makes it possible to evaluate the importance of the keyword extracted from the document with respect to the type of the document and the field to which the document belongs.

A document processing apparatus according to a third aspect of the present invention includes document information, field information indicating a predetermined field to which the document information belongs and a document input means for inputting a document type of the document information, and a keyword from the input document information. Keyword statistical information creation means for extracting candidates and creating keyword statistical information about the extracted keywords, importance evaluation rule and membership function dictionary in which membership functions are registered in advance for each field and document type, input Selection means for selecting the importance evaluation rule and membership function registered in the importance evaluation rule dictionary, selected from the importance evaluation rule dictionary by the selection means, according to the field information and the document type. According to the importance evaluation rule and membership function, the above keyword statistical information is created. Keyword importance evaluation means for calculating the keyword importance of the keyword candidates extracted by the keyword statistical information creating means based on the keyword statistical information created by the means, and the keyword candidates and the above calculated for the keyword candidates A storage unit is provided for storing the keyword importance in association with the data specifying the input document information.

In the document processing method according to the third invention, the importance evaluation rule and the membership function are registered in advance in the importance evaluation rule dictionary for each field and document type.
Accepting the input document information, the field information indicating a predetermined field to which the document information belongs and the document type of the document information, extracting the keyword candidate from the input document information, and the keyword statistical information regarding the extracted keyword Is created, the importance evaluation rules and membership functions registered in the importance evaluation rule dictionary are selected according to the entered field information and document type, and the selection is made from the importance evaluation rule dictionary. The keyword importance of the extracted keyword candidates is calculated based on the created keyword statistical information according to the importance evaluation rule and the membership function, and the keyword candidates and the calculated keyword importance of the keyword candidates are calculated. , Stored in association with the data that specifies the input document information above A.

According to the third invention, the keyword statistical information is created for each keyword candidate extracted from the input document information, and the keyword of the keyword candidate extracted based on the created keyword statistical information for each keyword candidate Since the importance is calculated according to the importance evaluation rule in the input document type and field, the keyword importance in the input document type and field can be obtained.

In a preferred embodiment of the third aspect of the invention, a plurality of headwords, a field-specific importance dictionary in which the field-specific importance is registered in advance for each field to which each of the above-mentioned headwords belongs, and extracted. The field-specific importance of the keyword candidate is read from the field-specific importance dictionary, and the input document information is obtained based on the field-specific importance of the keyword candidate and the information included in the keyword statistical information of the keyword candidate. Means for determining the field to which the document belongs and determining the document type of the input document information based on the keyword candidate and the overall information about the input document information according to a preset document type determination rule. There is.

Therefore, since the document type and field information of the input document information is determined, the keyword importance in the document type and field of the input document information can be calculated even when the document type and field information is not input.

Further, the storage means stores a keyword candidate having a keyword importance of a predetermined threshold value or more as a keyword of the input document information.

As a result, only the keywords that well represent the contents of the document information are stored.

The fourth aspect of the present invention makes it possible to evaluate the importance of a keyword extracted from a document for each type of the document and each field to which the document belongs, and to accurately evaluate the importance regardless of the length of the document.

A document processing apparatus according to a fourth aspect of the present invention includes document information, field information indicating a predetermined field to which the document information belongs and document input means for inputting a document type of the document information, and a keyword from the input document information Keyword statistical information extraction means for extracting a candidate and creating keyword statistical information about the extracted keyword candidate, a plurality of first headwords, and synonyms for each of the first headwords are registered in advance. With respect to the synonym dictionary and the extracted keyword candidates, the synonym dictionary is referred to, a synonym group is configured by the keyword candidates registered as synonyms, and the keyword statistics of the keyword candidates belonging to the same synonym group are formed. Aggregate at least some of the information by synonym group,
The keyword statistical information normalization means, the importance evaluation rule, and the membership function for normalizing the aggregated keyword statistical information using the entire information about the input document information are registered in advance for each field and document type. Importance evaluation rule dictionary, selection means for selecting the importance evaluation rule and membership function registered in the importance evaluation rule dictionary according to the input field information and document type, from the importance evaluation rule dictionary Extracted by the keyword statistical information creating means based on the keyword statistical information including the information normalized by the keyword statistical information normalizing means in accordance with the importance evaluation rule and the membership function selected by the selecting means. The keyword weight for calculating the keyword importance of the above keyword candidates Degree evaluation unit, and the keyword candidate and the keyword importance degree calculated for it, and a storage means for storing in conjunction with data designating the document information the input.

In the document processing method according to the fourth aspect of the present invention, a plurality of first headwords and synonyms for each of the first headwords are registered in advance in the synonym dictionary, and the importance evaluation rule and members are registered. The ship function is registered in advance in the importance evaluation rule dictionary for each field and document type, and the input document information, the field information indicating the predetermined field to which the document information belongs and the document type of the document information are received and input. A keyword candidate is extracted from the extracted document information, keyword statistical information regarding the extracted keyword candidate is created, and a keyword registered as a synonym for the extracted keyword candidate by referring to the synonym dictionary. A synonym group is composed of candidates, and the above keyword series of keyword candidates belonging to the same synonym group are combined. At least a part of the information is aggregated for each synonym group, and the aggregated keyword statistical information is normalized using the overall information about the input document information, and according to the input field information and document type, The importance evaluation rules and membership functions registered in the above importance evaluation rule dictionary are selected, and normalized information is obtained according to the importance evaluation rules and membership functions selected from the above importance evaluation rule dictionary. The keyword importance of the extracted keyword candidates is calculated based on the included keyword statistical information, and the keyword candidates and the keyword importance calculated for them are related to the data specifying the input document information. It is something that is memorized.

According to the fourth invention, the keyword statistical information is created for each keyword candidate extracted from the input document information, and based on the keyword statistical information normalized using the whole information about the input document information. Then, the keyword importance is calculated according to the importance evaluation rule in the document type and field of the input document information. Therefore, it is possible to obtain the optimum keyword importance in the input document type and field.

In a preferred embodiment of the fourth aspect of the present invention, a plurality of second headwords and, for each of the second headwords, a field-specific importance is registered in advance for each field to which the field-specific importance is registered. Degree dictionary, and the degree of importance of the extracted keyword candidates by field is read from the degree of importance of each field, and based on the degree of importance of the above keyword candidates by area and the information included in the above keyword statistical information of the above keyword candidates. , The field to which the input document information belongs is determined, and the document type of the input document information is determined based on the keyword candidate and the overall information about the input document information according to a preset document type determination rule. It further comprises a means for doing.

Therefore, since the document type and field of the input document information are determined, the keyword importance in the document type and field of the input document information can be calculated.

The storage means stores a keyword candidate having a keyword importance of a predetermined threshold value or more as a keyword of the input document information.

As a result, only the keywords that well represent the contents of the document information are stored.

[0049]

[Explanation of Examples]

First Embodiment FIG. 1 is a block diagram showing the overall configuration of a document processing apparatus according to the first embodiment.

This document processing apparatus can be realized by a hardware architecture, or
It can also be realized by a programmed computer system. Further, a part of the document processing device can be realized by hardware and the other part can be realized by software.

The document input device 11 uses document information (document data)
And field information, which comprises a keyboard, an image reader, and a character recognition device for converting the image information read by the keyboard into a character code,
It is realized by a reading device or the like for inputting an electronic file.

FIG. 2 shows an example of document information and field information input from the document input device 11.

A scientific paper is shown as an example of document information. Document information includes "title", "abstract",
Items such as "text" are added.

The field information represents a group to which the document information belongs when the document information is classified according to a certain idea. Standard classifications include international patent classification and international book decimal classification.

Field information is entered only if known.
It is not necessary to enter it when the field is unknown. The field information relating to the document information shown in FIG. 2 is “industry in general”.

The document information input from the document input device 11 is given to the keyword statistical information extraction device 12, and the field information is given to the field-specific important calculation device 13.

The keyword statistical information extraction device 12 extracts keyword candidates which are candidate keywords from the document information given from the document input device 11 and creates keyword statistical information for each of the extracted keyword candidates. .

The longest match method, syntax analysis, etc. are used to extract the keyword candidates. For example, the keyword candidate extraction process is performed as follows.

First, the document represented by the input document information is searched for a phrase (“word + particle”) having a particle such as “ga, ha, ni, o, na, na, etc.”. Will be issued. Also". 、、、
., {}, “”, [], (), [] ”And other clauses (“ words + symbols ”) are searched for. The found clause is taken out from the sentence. Particles or symbols are deleted from the extracted clauses, and words, that is, keyword candidates are extracted.

FIG. 3 shows keyword candidates extracted from the document information shown in FIG. 2 as described above.

Creation of the keyword statistical information for each of the extracted keyword candidates is performed as follows.

The types of keyword statistical information include the number of characters, the type of characters, the type of words, the number of appearances, the position of appearance, the number of emphasized expressions, grammatical information and the like.

The number of characters represents the number of characters included in the character string which constitutes the keyword candidate. For example, the number of characters of the keyword candidate “fuzzy control system” is “7”.

The character type represents the type of character included in the character string forming the keyword candidate. The types of characters include kanji, hiragana, katakana, alphabets and numbers. For example, the character type of the keyword candidate “fuzzy control system” is “mixed katakana and kanji”.

The word type indicates the type of word that is a keyword candidate (grammatical part of speech or something similar thereto).
The types of words include general nouns, company names, and personal names. For example, the word type of the keyword candidate “fuzzy control system” is “general noun”.

The number of appearances represents the number of times the same keyword candidate appears in one input document information. For example, the number of appearances of the keyword candidate “fuzzy control system” is “5”.

The appearance position represents in what position the keyword candidate appears in the input character information. The appearance position is expressed by the items such as the title, subtitle, abstract, and text described above. For example, the keyword candidate "fuzzy control system" appears in the title, abstract, and body.

The number of emphasized expressions represents the number of times the emphasized expressions (eg, "", [], """, etc.) are added to the keyword candidates. For example, since the keyword candidate “fuzzy control system” has no emphasized expression, the number of emphasized expressions is “0”.

The grammatical information is "ga
Represents the number of times a particle such as ”is attached. For example,
Immediately after the keyword candidate "fuzzy control system", the particle "o" is attached once and "no" is attached four times.

Examples of keyword statistical information about some of the keyword candidates shown in FIG. 3 are shown in FIGS.

The keyword candidates extracted by the keyword statistical information extracting device 12 are given to the field importance calculating device 13, and the keyword statistical information is given to the keyword importance evaluating device 14.

The field-specific importance calculation device 13 obtains the field-specific importance of the keyword candidate given from the keyword statistical information extraction device 12 by referring to the field-specific importance dictionary 17. When the field information is given from the document input device 11, this field information is also used.

An example of the field-specific importance dictionary 17 is shown in FIG. Area-specific importance dictionary 17 is a hard disk, RO
It is realized by a memory such as M. In the field-specific importance dictionary 17, the field-specific importance in each field is registered in advance for each headword.

The degree of importance for each field is basically obtained as follows.

The field importance dictionary 17 is searched for the given keyword candidates, and the field importance of the field specified by the field information input from the document input device 11 is selected from the field importances of the keyword candidates. Degree is selected and read. For example, since the field information of the document shown in FIG. 2 is “industry in general”, the keyword candidate “fuzzy control system” has a field importance of “0.88”.

When the field information is not input, the field-specific importance of the field "general" is selected.

For keyword candidates not registered in the field-specific importance dictionary 17, the related word dictionary is obtained as follows.
16 is used to calculate the importance of each keyword candidate in each field.

An example of the related word dictionary 16 is shown in FIG. The related word dictionary 16 is realized by a memory such as a hard disk or a ROM. In the related word dictionary 16, for each headword,
The related word related to the headword and the degree of association indicating the degree of association between the headword and the related word are registered in advance.

First, the related word dictionary 16 is searched, and the related words and the related degrees of the keyword candidates that are not registered in the field-specific importance dictionary 17 are read from the related word dictionary 16.

Of the read related words, the field importance of the related words registered in the field importance dictionary 17 is obtained. At this time, as described above, when the field is specified by the field information, the field importance of the field is selected, and when not specified, the field "general" field importance is selected. . In addition, when a plurality of related words of keyword candidates are registered in the category importance dictionary 17,
The maximum value (or other calculation result) of the field-specific importance of these related words is obtained.

For example, regarding the keyword candidate “membership function” that is not registered in the field-specific importance dictionary 17, the related word “fuzzy” and its degree of relevance “0.74” are obtained from the related word dictionary 16, and From the importance degree dictionary 17, the importance degree “0.99” for each field of the field “general industry” of the related word “fuzzy” is obtained.

From the degree of association of the related word obtained from the related word dictionary 16 and the degree of importance of the related term by field (when there are a plurality of related words, the maximum value of the degree of importance by field as described above) , The importance of each keyword candidate in each field is calculated by the following formula.

Field-Specific Importance = (Related Word Relevance) × (Related Word Field Importance) (1)

From the expression (1), the degree of importance of the keyword candidate “membership function” by field is 0.74 × 0.99 = 0.73.

MIN calculation may be performed instead of multiplication in the equation (1).

In this way, the field-specific importance of the keyword candidate is calculated by the field-specific importance calculator 13. FIG. 8 shows the calculated degree of importance of each keyword candidate in the field “general industry”.

The calculated field-specific importance is given to the keyword importance evaluation device 14.

The keyword importance level evaluation device 14 uses the keyword evaluation information registered in the importance level evaluation rule dictionary 18 in accordance with the importance level evaluation rules to acquire the keyword statistical information for each keyword candidate given by the keyword statistical information extraction device 12 and the important information for each field. The degree of importance of the keyword candidates is calculated (or evaluated) based on the degree of importance of each field given by the degree calculation device 13 for each field.

In the importance degree evaluation rule dictionary 18, membership functions relating to importance degree evaluation rules, keyword statistical information types, related items, and field-specific importance degrees are registered in advance. The importance evaluation rule dictionary 18 is realized by a memory such as a hard disk or a ROM.

An example of a set of importance evaluation rules is shown below.

Importance evaluation rule 1 IF number of characters = small character type = * word type = general noun appearance count = small appearance position = * emphasized expression count = small grammatical information (number of "ga" + number of "ha") / (Number of appearances) = Small (number of “ni” + number of “wa”) / (number of occurrences) = Small field importance = Low THEN importance = 0.2 Importance evaluation rule 2 IF character count = Small character type = Kanji , Hiragana mixed word type = general noun number of occurrences = few occurrence positions = * number of emphasized expressions = few Grammar information (number of "ga" + number of "ha") / (number of occurrences) = few (number of "ni" + "Number of times" / (Number of occurrences) = Normal Importance by field = Low THEN Importance = 0.4 Importance rating rule 3 IF character count = Normal character type = * Word type = * Occurrence count = Normal Occurrence position = * Strong Number of key expressions = normal Grammar information (number of "ga" + number of "ha") / (number of appearances) = ordinary (number of "ni" + number of "wa") / (number of appearances) = ordinary Important by field Degree = Normal THEN Importance = 0.6 Importance rating rule 4 Number of IF characters = Large character type = * Word type = Company name, personal name Occurrence frequency = High Occurrence position = Title, Abstract emphasized expression frequency = High Grammar information (“ga” Number of times + Number of "ha") / (Number of occurrences) = Large (Number of "ni" + Number of "wa") / (Number of occurrences) = Normal Category-specific importance = High THEN importance = 0.8 Importance rating Rule 5 Number of IF characters = large number of characters = katakana, mixed kanji, alphabet, mixed kanji word type = company name, personal name occurrence count = large occurrence position = title, abstract emphasized expression count = large grammar information (number of "ga" + Number of "ha") / The number of occurrences) = large (number of times "to" number of times + "wo" of) / (number of occurrences) = average sectoral Severity = high THEN Severity = 1.0

The * in the antecedent part (IF) of the importance evaluation rules 1 to 5 indicates that the keyword statistical information is not used.

Regarding the grammar information, the number of times a particle "ga" or "ha" is used as a subject and the number of times a particle "ni" or "wa" is used as an object are separately considered. . Moreover, by dividing these numbers by the number of appearances, the ratio of the number of times used as the subject and the ratio of the number of times used as the object are variables of the antecedent part in the importance evaluation rule.

As can be seen from these importance evaluation rules,
Variables in the antecedent part "Number of characters", "Number of appearances", "Number of emphasized expressions", "(Number of" ga "+ number of" ha ") / (Number of appearances)" (ratio of the number of times used as the subject),
"(Number of" ni "+ number of" wa ") / (number of appearances)"
(Ratio of the number of times of use as an object) and importance by field are expressed by fuzzy set representation. On the other hand, the variables “character type”, “word type”, “appearance position” in the antecedent part and “importance” in the consequent part are represented by a crisp set expression.

Membership functions are prepared in advance for the variables represented by the fuzzy set expression, and are registered in the importance evaluation rule dictionary 18 as described above. Figure 9
(A) to (F) show examples of these membership functions. (A), (B), (C), (D), (E) and (F) are the number of characters, the number of occurrences, the number of emphasized expressions, and
Number of times + number of "ha") / (number of occurrences), (number of "ni" + number of "wa") / (number of occurrences) and field importance, language information "small", "normal" and It represents three membership functions of "many".

Although the importance evaluation rules and membership functions shown above are common to all fields, they may be created and registered separately for each field.

FIG. 10 is a flow chart showing the calculation processing procedure of keyword importance.

The keyword statistical information provided from the keyword statistical information extracting device 12 is fetched by the keyword importance evaluation device 14 for each keyword candidate (step 101).

According to the importance evaluation rule registered in the importance evaluation rule dictionary 18, the fuzzy variables represented by the membership function are processed by keyword statistical information for the membership function (or obtained by processing these). Information) is calculated. For variables of the crisp set expression (that is, character type, word type, and appearance position), if the given keyword statistical information matches the condition of the antecedent part of the evaluation rule, the goodness of fit is “1.0”.
, And if they do not match, it is set to “0.0” (step 102).
).

The sum of the antecedent part conformances obtained by matching is calculated for each importance evaluation rule (step 103).
).

FIG. 11 shows the matching result and the sum of the matching degrees for the keyword candidate “fuzzy control system” thus obtained. In FIG. 11, * indicates that it is not used in the antecedent part of the importance evaluation rule.

The maximum value and the second largest value are searched for in the total sum of the calculated goodness of fit, and the importance described in the consequent part of the importance evaluation rule that causes them is extracted. (Step 104).

On the basis of the maximum value and the second largest value of the obtained sums of the goodness-of-fit and their corresponding degrees of importance,
The keyword importance of the keyword candidates is calculated by the weighted average represented by the following equation (step 105).

Keyword importance = [(maximum value of goodness of fit)
× (importance corresponding to maximum value) + (second largest value of fitness) × (importance corresponding to second largest value)] /
[(Maximum value of goodness of fit) + (Second largest value of goodness of fit)] (2)

The maximum value of the goodness of fit of the keyword candidate "fuzzy control system" shown in FIG. 11 is "5.4", the second largest value is "4.4", and the corresponding degrees of importance are "1.0". And "0.8". Therefore, equation (2)
Therefore, the keyword importance of the keyword candidate “fuzzy control system” is [(5.4 × 1.0) + (4.4 × 0.8)] / [5.4
+4.4] = 0.91.

In this way, the keyword importance of all the extracted keyword candidates is calculated.

The keyword candidates are given to the storage device 15 and stored together with the keyword importance calculated as the keyword of the input document information. All the extracted keyword candidates may be registered in the storage device 15 as keywords, or only a suitable number or keywords having a keyword importance of a predetermined value or higher are registered in the storage device 15 as keywords in descending order of keyword importance. You may.

An example of information stored in the storage device 15 is shown in FIG.
Is shown in. The stored information is the title of the input document, the keywords extracted from the document, and their keyword importance.

FIG. 13 is a flow chart showing the overall processing procedure of the document processing apparatus in the first embodiment.

Document information is input by the document input device 11. At this time, if the field to which the input document information belongs is known in advance, the field is input as field information (step 111).

A keyword candidate is extracted from the document information input by the keyword statistical information extraction device 12, and keyword statistical information is created for this keyword candidate (step 112).

The field-specific importance calculating device 13 obtains the extracted keyword candidates, and the keyword importance evaluating device 14 obtains the created keyword statistical information (step 113).

The field-specific importance calculation device 13 searches the field-specific importance dictionary 17 for the given keyword candidates, and when the keyword candidates are registered in the field-specific importance dictionary 17, the keyword candidates are searched for each keyword candidate. Get importance by field. At this time, when the field is specified by the field information, the field importance of the field is selected, and when the field is not specified, the field "general" field importance is selected ( Steps 114 and 115).

On the other hand, the keyword candidates are field-specific importance dictionaries.
If not registered in 17, the related words and the degrees of association of the unregistered keyword candidates are obtained from the related word dictionary 16 (step 11
6). The obtained field-specific importance of the related word is obtained from the field-specific importance dictionary 17, and the field-specific importance of the unregistered keyword candidate is calculated based on the field-related importance and the field-related importance of the related word ( Step 117).

The keyword importance evaluation device 14 reads the importance evaluation rule and the membership function from the importance evaluation rule dictionary 18 (step 118). According to the importance evaluation rule, the keyword importance of the keyword candidate is evaluated based on the keyword statistical information and the importance of each field (step 119).

The keyword candidates are output to the storage device 15 from the keyword importance evaluation device 14 together with the keyword importance as keywords of the input document information.
It is stored in 15 (step 120).

When the keyword importance is evaluated for all the extracted keyword candidates, the process is terminated (step 121).

Second Embodiment FIG. 14 is a block diagram showing the overall arrangement of a document processing apparatus according to the second embodiment.

Like the document processing apparatus in the first embodiment, the document processing apparatus in the second embodiment can be realized entirely by a hardware architecture or can be realized by a programmed computer system. . Further, a part of the document processing device can be realized by hardware and the other part can be realized by software.

In FIG. 14, the same parts as those shown in FIG. 1 are designated by the same reference numerals, and detailed description thereof will be omitted.

In many documents, a term (synonym) having the same meaning as that term is used in order to avoid repeated appearance of the same term (keyword candidate) or to express different nuances. May be Therefore, when evaluating the importance of keyword candidates, it is necessary to treat synonyms as one group and consider the number of appearances and the number of emphasized expressions of synonyms belonging to one group. Moreover, since the number of appearances and the number of emphasized expressions vary greatly depending on the length (size) of the document, rather than the absolute number of these times,
It is appropriate to consider it as a ratio (to obtain the ratio is called normalization) to the total number of appearances of keyword candidates in one document information.

The second embodiment considers the existence of synonyms, and normalizes the number of appearances and the number of emphasized expressions to obtain the importance of keyword candidates.

The keyword statistical information normalization device 20 is provided with the keyword statistical information from the keyword statistical information extraction device 12, and the synonym dictionary 21 is referred to, and the number of appearances and the number of emphasized expressions included in the keyword statistical information of the keyword candidates are included. Is normalized, the normalized keyword statistical information is output, and the normalized information used in the normalization process is output.

FIG. 16 shows an example of the synonym dictionary 21. The synonym dictionary 21 is realized by a memory such as a hard disk or a ROM. Synonyms are grouped and registered in the synonym dictionary 21 in advance. That is, the synonyms belonging to the synonym group name are stored in correspondence with the synonym group name.

FIG. 15 shows a keyword statistical information normalization device 20.
3 is a block diagram showing the internal configuration of FIG. The keyword statistical information normalization device 20 includes a keyword statistical information sharing unit 22 and a normalization unit 23.

The keyword statistical information sharing unit 22 uses the provided keyword statistical information to refer to the synonym dictionary 21 to create normalization information, and also refers to the synonym dictionary 21 based on the provided keyword statistical information. Then, the keyword statistical information shared by the keyword candidates included in one synonym group is created. The normalization unit 23 normalizes the shared keyword statistical information using the normalization information.

FIG. 17 shows an example of the normalization information created by the keyword statistical information sharing unit 22. The normalization information includes general information about keyword candidates and synonym group information.

The total information includes the number of types of keyword candidates appearing in one document and the total number of appearances of keyword candidates.

The synonym group information includes the number of synonym groups appearing in one document and information about each synonym group (each synonym group information). Each synonym group information includes, for each synonym group, the number of types of keyword candidates belonging to the synonym group and the total number of appearances of keyword candidates belonging to the synonym group.

FIG. 18 is a flow chart showing the procedure of sharing and normalizing the keyword statistical information.

The keyword statistical information sharing unit 22 counts the keyword candidates provided from the keyword statistical information extraction device 12 to determine the number of types of keyword candidates contained in one document information and the total number of appearances of the keyword candidates. Is obtained (step 122). As a result, the whole information is created.

The keyword statistical information sharing unit 22 searches the synonym dictionary 21 and judges, for each given keyword candidate, whether the same term as the keyword candidate exists in any synonym group. , Synonyms are grouped (step 123).

For example, referring to the synonym dictionary 21 shown in FIG. 16, since the keyword candidates “fuzzy control system” and “fuzzy control” in the keyword statistical information belong to the group name “fuzzy”, these two keyword candidates Form a group. Similarly, the keyword candidate “parameter adjustment procedure”, “parameter”, and “parameter adjustment” in the keyword statistical information are found to be included in the group with the group name “parameter” when referring to the synonym dictionary 21, so that one group Is determined to constitute.

When the grouping of all the keyword candidates included in the given keyword statistical information is completed in this way, the number of types of keyword candidates belonging to each synonym group is counted and each synonym group is classified. The total number of appearances (total number of appearances) of all the keyword candidates that belong to it is calculated. In this way, the synonym group information of the normalized information shown in FIG. 17 is created (step 124).

The number of appearances of each keyword candidate in the given keyword statistical information is replaced with the total number of appearances. Further, the number of emphasized expressions of each keyword candidate is replaced by the sum of the number of emphasized expressions of keyword candidates belonging to the same synonym group, and the grammatical information is replaced by a set of grammatical information belonging to the same synonym group.

For example, since the keyword candidates “fuzzy control system” and “fuzzy control” form one synonym group, the number of appearances of them is 5 + 1 = 6, the number of emphasized expressions is 0 + 0 = 0, and the grammar information is "Is":
1, “no”: 4 + 1 = 5 ”.

The above is the process of sharing the keyword statistical information.

This sharing process is not necessary when there are no more than two keyword candidates belonging to the same synonym group.

The shared keyword statistical information (including information not shared) is given to the normalization section 23 together with the created normalization information.

The normalization processing by the normalization unit 23 is performed for the number of appearances and the number of emphasized expressions. That is, for each shared keyword candidate, the number of appearances and the number of emphasized expressions are divided by the total number of appearances of the keyword candidate. For example, the number of appearances and the number of emphasized expressions of the keyword candidate “fuzzy control system” are “6” and “0”, respectively, and the total number of appearances of the keyword candidate in the overall information is “52”. These data are "6/52" and "0/52", respectively.
Becomes

The keyword candidates that are not shared are also normalized in the same manner. For example, the number of appearances and the number of emphasized expressions of the keyword candidate "membership function" are normalized to "1/52" and "0/52", respectively (step 125).

19 and 20 show the keyword statistical information of the keyword candidates which are shared and normalized by the keyword normalization device 20 in this way.

The normalized keyword statistical information is given to the keyword importance evaluation device 14. Further, the normalized information is given to the field importance calculator 24.

In the first embodiment, the related word dictionary 16 is set to be common to the processing of many pieces of document information.
Strictly speaking, the degree of association between keyword candidates is generally different for each document information. Therefore, in the second embodiment, the degree of association of keyword candidates is set or corrected for each document information based on the document information.

To the inter-keyword relevance degree setting device 30, the document information is supplied from the document input device 11 and the keyword candidates are supplied from the keyword statistical information extraction device 12. This device 30 obtains distance information between keyword candidates, calculates the degree of association between keyword candidates based on this distance information between keyword candidates, and sets it in the related word dictionary 16A.

FIG. 21 is a block diagram showing the internal structure of the inter-keyword relevance setting device 30. The inter-keyword degree-of-association setting device 30 includes an inter-keyword distance information extraction unit 31 and an association degree calculation unit 32.

The inter-keyword distance information extraction unit 31 selects an arbitrary 2
Distance information between keyword candidates between two different keyword candidates is extracted.

FIG. 23 shows an example of the distance information between keyword candidates between the keyword candidates “fuzzy control” and “parameter”.

The distance information between keyword candidates includes semantic distance information and physical distance information. The semantic distance information is information on how to use the keywords in the document, and indirectly represents the semantic connection between two different keywords. Further, the physical distance information is a notational distance in a document between two different keywords, and the more other keywords (words) exist between these keywords, the thinner the relationship between the physical keywords becomes.

In the semantic distance information, the number of sentences in which two different sets of keyword candidates both appear (a sentence is a reading point “.”).
End) and the number of paragraphs in which the above keyword set appears (the number of co-occurring paragraphs).

The physical distance information has a minimum value of the number of keyword candidates existing between the co-occurring keyword candidates and a minimum value of the number of characters existing between the co-occurring keyword candidates.

FIG. 22 shows a processing procedure for setting the degree of association between keyword candidates.

The inter-keyword distance information extraction unit 31 refers to the document information given from the document input device 11, counts the number of sentences in which any two different keyword candidates appear together, and further detects the number of sentences that appear together. The number is counted (steps 132 and 133). For example, two keyword candidates "fuzzy control system" and "parameter" appear in the abstract sentence, the second sentence of the first paragraph of the text, and the sentence of the third paragraph of the text. Therefore, the co-occurrence sentence is "3" and the number of co-occurrence paragraphs is also "3". In this way, semantic distance information is obtained.

The inter-keyword distance information extraction unit 31 also counts the number of keyword candidates and the number of characters existing between two arbitrary keyword candidates in a sentence in which any two different keyword candidates appear together, and determines their minimum value. Respectively (step 133).

For example, for an abstract sentence in which two keyword candidates "fuzzy control system" and "parameter" appear together, there is a keyword candidate "at the time of construction" between the two keyword candidates and a character string " When building, there is. Therefore, in this case, the number of keyword candidates between keyword candidates is "1", and the number of characters between keyword candidates is "5".

Similarly, the number of keyword candidates between the keyword candidates in the second sentence of the first paragraph of the text and the sentence of the third paragraph of the text are "5" and "0", respectively, and the number of characters between the keyword candidates is "40", respectively. And "1". The minimum values of the number of keyword candidates between these keyword candidates and the number of characters between the keyword candidates are "0" and "1", respectively.

In this way, the inter-keyword distance information extraction unit 31 obtains the number of words and the number of characters for all the sentences in which two keyword candidates appear together, and the minimum value of these is the physical distance information. FIG. 23 shows distance information between keyword candidates for “fuzzy control system” and “parameter”. The semantic distance information and the physical distance information are all calculated for all two arbitrary keyword candidate sets selected from the keyword candidates.

The obtained distance information is related to the degree-of-association calculation unit.
Given to 32.

The degree-of-association calculation unit 32 determines two different keywords based on the distance information between keyword candidates given from the distance-between-keywords information extraction unit 31 in accordance with preset degree-of-association evaluation rules and membership functions. The degree of association between candidates is calculated.

For example, the following set of relevance evaluation rules is preset in the relevance calculator 32.

Relevance evaluation rule 1 IF [(A: number of co-occurring sentences) = more OR (B: number of co-occurring paragraphs) = more] AND [(C: number of keyword candidates between keyword candidates) = less OR (D : Number of characters between keyword candidates) = small] THEN function degree = 0.0 relevance evaluation rule 2 IF [(A: number of co-occurring sentences) = small OR (B: number of co-occurring paragraphs) = large] AND [(C: keyword OR (D: number of characters between keyword candidates) = large] THEN degree of function = 0.5 Relevance evaluation rule 3 IF [(A: number of co-occurring sentences) = small OR (B: co-occurring) Number of paragraphs) = small] AND [(C: number of keyword candidates between keyword candidates = large)
OR (D: number of characters between keyword candidates) = many] THEN degree of function = 1.0

As can be seen from these relevance evaluation rules, the variables "A: number of co-occurring sentences", "B: number of co-occurring paragraphs", "C: number of keyword candidates between keyword candidates" and "D" in the antecedent part can be seen. ": Number of characters between keyword candidates" is represented by a fuzzy set expression. On the other hand, the degree of relevance of the consequent part is represented by the crisp set representation.

Membership functions are prepared in advance for variables represented by fuzzy set expressions.
24 (A) to (D) show examples of these membership functions. (A), (B), (C) and (D) are "A: number of co-occurring sentences", "B: number of co-occurring paragraphs", respectively.
Regarding "C: number of keyword candidates between keyword candidates" and "D: number of characters between keyword candidates", two membership functions of language information "small" and "large" are shown.

In the relevance calculating unit 32, the inter-keyword distance information extracting device 31 is operated according to the relevance evaluation rules 1 to
Distance information A, B, C between keyword candidates given from
The goodness-of-fit of D to their corresponding membership functions is calculated. An example of the calculation result is shown in FIG. The suitability of the antecedent part is calculated by the following formula for each rule.

Antecedent part goodness of fit = MIN (MAX (goodness of A, goodness of B), MAX (goodness of C, goodness of fit of D)) (3)

For example, if the antecedent part conformance for each relevance evaluation rule of two different keyword candidates “fuzzy control system” and “parameter” is calculated using equation (3),
It becomes "1.0, 0.66, 0.0".

When the conformance of the antecedent part is calculated for each relevance evaluation rule, the inter-keyword relevance is calculated by the following equation.

Relevance between keywords = [Σ {(relevance of consequent part) × (conformance of antecedent part)}] / [Σ (conformance of antecedent part)] (4)

For example, regarding the degree of keyword relevance between the “fuzzy control system” and the “parameter”, using the equation (4),
(0.0 x 0.0 +0.5 x0.66 +1.0 x1.0) / (0.0 +0.
66 + 1.0) = 0.80.

In this way, the inter-keyword relevance is calculated (step 134).

When the inter-keyword relevance is calculated, the relevance calculating unit 32 determines whether the keyword candidates calculated by referring to the related word dictionary 16A are registered in the related word dictionary 16A (step 135). ). If it is already registered, the registered degree of association is changed to the calculated degree of association (step 136).

If not registered, these keyword candidates and the calculated degree of association are registered in the related word dictionary 16A (step 137).

The field-specific importance calculating device 24 refers to the field-specific importance dictionary 27 to determine the field-specific importance of the keyword candidate given from the keyword statistical information extracting device 12,
It is calculated based on the field information provided from the document input device 11 and the normalized information provided from the keyword statistical information normalization device 20.

FIG. 26 shows an example of the field-specific importance dictionary 27. Area-specific importance dictionary 27 is a hard disk, RO
It is realized by a memory such as M. In the field-specific importance dictionary, the field-specific importance of each field is registered in advance for entry words (group names).

The degree of importance by field is basically obtained as follows.

With respect to the group name of each synonym group of the synonym group information included in the given normalization information,
The field-specific importance dictionary 27 is searched, and the field-specific importance regarding the field information input from the document input device 11 is read from the field-specific importance of the synonym group. At this time, the degree of importance by field is shared by keyword candidates between synonym groups. For example, the keyword candidate “fuzzy control system” belongs to the synonym group “fuzzy” and the field information is “industry in general”, so that the keyword candidate “fuzzy control” has a field importance of “0.99”.

When the field information is not input, the field-specific importance of the field "general" is selected.

As for the keyword candidates that do not belong to the synonym group, the degree of importance by field is required for the keyword candidates, as in the synonym group.

For keyword candidates not registered in the field-specific importance dictionary 17, the related word dictionary is obtained as follows.
16A is used to calculate the importance of each keyword candidate by field.

First, the related word dictionary 16A is searched, and the related words and the related degrees of the keyword candidates that are not registered in the category importance dictionary 27 are read from the related word dictionary 16A.

Of the read related words, the field importance of the related words registered in the field importance dictionary 27 is obtained. At this time, as described above, when the field is specified by the field information, the field importance of the field is selected, and when not specified, the field "general" field importance is selected. . If a plurality of related words of keyword candidates are registered in the field-specific importance dictionary 27,
The maximum value (or other calculation result) of the field-specific importance of these related words is obtained.

For example, regarding the keyword candidate “membership function” that is not registered in the field-specific importance dictionary 27, the related word “fuzzy” and its degree of relevance “0.74” are obtained from the related word dictionary 16A, and From the importance degree dictionary 27, the importance degree "0.99" by field for the field "general industry" of the related word "fuzzy" is obtained.

From the degree of relevance of the related word obtained from the related word dictionary 16A and the degree of importance of the related term by field (when there are a plurality of related words, the maximum value of the degree of importance by field as described above) , The importance of each keyword candidate in each field is calculated by the following formula.

Field-Specific Importance = (Related Word Relevance) × (Related Word Field Importance) (1)

From the expression (1), the importance of each keyword candidate “membership function” by field is 0.74 × 0.99 = 0.73.

In the equation (1), MIN calculation may be performed instead of multiplication.

In the importance evaluation rule dictionary 28, membership functions relating to the importance evaluation rule, keyword statistical information types, related items, field-specific importance, etc. are registered in advance. The importance evaluation rule dictionary 28 is realized by a memory such as a hard disk or a ROM.

An example of a set of importance evaluation rules is shown below.

Importance evaluation rule 1 IF number of characters = small character type = * word type = general noun appearance count = small appearance position = * emphasized expression count = small grammatical information (number of "ga" + number of "ha") / (Number of appearances) = Small (number of “ni” + number of “wa”) / (number of occurrences) = Small field importance = Low THEN importance = 0.2 Importance evaluation rule 2 IF character count = Small character type = Kanji , Hiragana mixed word type = general noun number of occurrences = few occurrence position = * number of emphasized expressions = few Grammar information (number of "ga" + number of "ha") / (number of occurrences) = few (number of "ni" + "Number of times" / (Number of occurrences) = Normal Importance by field = Low THEN Importance = 0.4 Importance rating rule 3 IF character count = Normal character type = * Word type = * Occurrence count = Normal Occurrence position = * Strong Number of key expressions = normal Grammar information (number of "ga" + number of "ha") / (number of appearances) = ordinary (number of "ni" + number of "wa") / (number of appearances) = ordinary Important by field Degree = Normal THEN Importance = 0.6 Importance rating rule 4 Number of IF characters = Large character type = * Word type = Company name, personal name Occurrence frequency = High Occurrence position = Title, Abstract emphasized expression frequency = High Grammar information (“ga” Number of times + Number of "ha") / (Number of occurrences) = Large (Number of "ni" + Number of "wa") / (Number of occurrences) = Normal Category-specific importance = High THEN importance = 0.8 Importance rating Rule 5 Number of IF characters = large number of characters = katakana, mixed kanji, alphabet, mixed kanji word type = company name, personal name occurrence count = large occurrence position = title, abstract emphasized expression count = large grammar information (number of "ga" + Number of "ha") / The number of occurrences) = large (number of times "to" number of times + "wo" of) / (number of occurrences) = average sectoral Severity = high THEN Severity = 1.0

The * in the antecedent part (IF) of the importance evaluation rules 1 to 5 indicates that the keyword statistical information is not used.

Regarding the grammar information, the number of times a particle "ga" or "ha" is used as a subject and the number of times a particle "ni" or "is" is used as an object are separately considered. . Moreover, by dividing these numbers by the number of appearances, the ratio of the number of times used as the subject and the ratio of the number of times used as the object are variables of the antecedent part in the importance evaluation rule.

As can be seen from these importance evaluation rules,
Variables in the antecedent part "Number of characters", "Number of appearances", "Number of emphasized expressions", "(Number of" ga "+ number of" ha ") / (Number of appearances)" (ratio of the number of times used as the subject),
"(Number of" ni "+ number of" wa ") / (number of appearances)"
(Ratio of the number of times of use as an object) and importance by field are expressed by fuzzy set representation. On the other hand, the variables “character type”, “word type”, “appearance position” in the antecedent part and “importance” in the consequent part are represented by a crisp set expression.

Membership functions are prepared in advance for the variables represented by the fuzzy set expression, and are registered in the importance evaluation rule dictionary 28 as described above. Figure 28
(A) to (F) show examples of these membership functions. (A), (B), (C), (D), (E) and (F) are the number of characters, the number of normalized occurrences, the number of normalized emphasis expressions, (the number of "ga" + Number of "ha") /
With respect to (number of occurrences), (number of "ni" + number of "wa") / (number of occurrences) and degree of importance by field, three membership functions of language information "low", "normal" and "high" It represents.

Although the importance evaluation rules and membership functions shown above are common to all fields, they may be created and registered separately for each field.

The keyword importance evaluation device 14 follows the importance evaluation rules registered in the importance evaluation rule dictionary 28 to provide the normalized keyword statistical information and field-specific importance given by the keyword statistical information normalization device 20. The keyword importance of the keyword candidate is calculated based on the field-specific importance given by the arithmetic unit 24. The calculated keyword importance is stored in the storage device 15 together with the keyword.

The processing in the keyword importance evaluation device 14 is the same as the processing in the first embodiment. The keyword statistical information given from the keyword statistical information extraction device 12 in the first embodiment, the field importance given from the field importance calculating device 13, and the importance evaluation rules and members registered in the importance evaluation rule dictionary 18 The ship functions are normalized in the keyword statistical information normalizing device 20 and the keyword importance information registered in the category evaluation index dictionary 28 It should be read as a degree evaluation rule and a membership function.

30 and 31 are flow charts showing the overall processing procedure of the document processing apparatus according to the second embodiment.

30 and 31, the same processes as those in FIG. 13 are designated by the same reference numerals, and the detailed description thereof will be omitted.

Document information and field information are input by the document input device 11, keyword candidates are extracted from this document information by the keyword statistical information extraction device 12, and the keyword statistical information is created (steps 111 and 112).
).

The keyword statistical information normalization device 20, the relevance setting device 30, and the field-specific importance calculation device 24 obtain the extracted keyword statistical information (step 140).

Whether the keyword statistical information extracted in step 141 is to be normalized or not is judged. When the keyword statistical information is to be normalized, the keyword statistical information normalizing device 20 executes the keyword statistical information normalizing process. As a result, the normalization information is extracted, the keyword statistical information is shared, and the normalization is performed (step 142).

In step 143, it is determined whether the degree of association between the extracted keyword candidates is to be set. If the degree of association is to be set, the degree-of-association setting device 30 performs the degree-of-association setting process. By these, distance information between keyword candidates is extracted for any two different keyword candidates, the degree of association between these keyword candidates is calculated, and the calculated degree of association is set in the related word dictionary 16A (step 144).

The field-specific importance arithmetic unit 24 searches the field-specific importance dictionary 28, and the synonym group included in the normalization information given from the keyword statistical information extraction unit 20 is extracted from the field-specific importance dictionary 28 and its keywords are searched. Get the categorical importance of candidates and synonym groups. At this time, when the field information is input and the field is designated, the field-specific importance of the field is obtained. When no field is specified, the field importance of the field "general" is obtained.
The field-wise importance of the synonym group is shared by the keyword candidates belonging to the synonym group (steps 145 and 146).

On the other hand, the keyword candidates are field-specific importance dictionaries.
If not registered in 27, the related word and the degree of association are obtained from the related word dictionary 16A (step 116). The field-specific importance of the related word is obtained from the field-specific importance dictionary, and the field-specific importance of the keyword candidate is calculated based on the field-related importance of the related word and the field-related importance of the related word (step 117).

The keyword importance evaluation rule device 14 reads the importance evaluation rules from the importance evaluation rule dictionary 28 (step
118).

The keyword importance evaluation device 14 normalizes the keyword statistical information according to the importance evaluation rule.
The keyword importance of the keyword candidate is calculated based on the normalized statistical information given by 20 and the area importance given by the area importance calculator 24 (step 119).

The calculated keyword importance is output to the storage device 15 together with the keyword (step 120). When the keyword importance is evaluated for all the keyword candidates, the process ends (step 121).

Third Embodiment FIG. 31 is a block diagram showing the overall arrangement of a document processing apparatus according to the third embodiment.

The document processing apparatus in the third embodiment is the first
All of them can be realized by the hardware architecture as well as the document processing apparatus in the second embodiment, or can be realized by the programmed computer system. Further, a part of the document processing device can be realized by hardware and the other part can be realized by software.

In FIG. 31, the same parts as those shown in FIG. 1 or FIG. 14 are designated by the same reference numerals, and detailed description thereof will be omitted.

In the first embodiment, when the field is not given to the input document information, the field "general" is uniformly given, but in the third embodiment, the field to which the document belongs based on the document information. Is determined. Also, a new concept of document type has been introduced. If this document type is not input, it will be determined based on the document information. These field information and document type are used when calculating the keyword importance.

The document input device 43 is for inputting the document type in addition to the document information (document data) and field information, and is a keyboard, an image reader, and character recognition for converting the image information read by the keyboard into a character code. It is realized by a device and a reading device for inputting an electronic file.

FIG. 32 shows an example of the document information and field information input from the document input device 43.

An example of the document information is shown. Items such as “title”, “abstract”, and “text” are added to the document information.

The document type represents the form or format of the input document information. Document types include patent documents, scientific papers, general documents, newspaper articles, magazine articles, and the like.

The document type is input only when it is known. Figure
The document type related to the document information shown in 32 is “science and technology paper”.

The field information represents a group to which the document information when the document information is classified according to a certain idea. Standard classifications include international patent classification and international book decimal classification.

Field information is entered only if known.
It is not necessary to enter it when the field is unknown. The field information relating to the document information shown in FIG. 32 is “industry in general”.

The document information input from the document input device 43 is provided to the keyword statistical information extraction device 12, and the document type and field information is provided to the registration data creation device 40.

The registration data creation device 40 is the document input device 43.
When the document type and the field information of the document information given from are unknown, the keyword statistical information given from the keyword statistical information extracting device 12 and the normalized information given from the keyword statistical information normalizing device 20 are used to determine the degree of importance for each field. The document type and field information are determined by referring to the dictionary 17. Also, when the document type and field information are known, the information is requested. In this case, it is used to confirm the document type and field information input from the document input device 43.

FIG. 33 is a block diagram showing the internal structure of the registration data creation device 40.

The registration data creating device 40 comprises a field determining section 41 and a document type determining section 42. The field determining section 41 determines the field (field information) to which the document information belongs, and the document type determining section 42.
Is for determining the document type of the document information.

The field determining unit 41 obtains, from the field-specific importance dictionary 17, the field-specific importance in each field for each keyword candidate given from the keyword statistical information extraction device 12. Also, the number of appearances included in the keyword statistical information of each keyword candidate is obtained. Using the obtained degree of importance and appearance frequency of each keyword candidate, the sum of the degree of importance of each category is calculated by the following formula (general, general industry, politics,
Calculate for each field such as physics.

[0224] Sum of field-specific importance = Σ (keyword candidate field-specific importance) x (number of keyword candidate appearances) ...
(Four)

Therefore, the degree of importance for each field of the document information shown in FIG. 32 in each field is as follows using the equation (4).

Sum of importance by field (field "general") = (0.80 / fuzzy control system) x 5 + (0.66 / parameter adjustment procedure) x 1 + (0.55 / parameter) x 5 + (0.81 /
Fuzzy control) x 1 + (0.70 / parameter adjustment) x 2 +
… ＝ 4.00 ＋ 0.66 ＋ 3.96 ＋ 0.81 ＋ 1.40 ＋… Sum of importance by field (field “general general”) = (0.88 / fuzzy control system) × 5 + (0.80 / parameter adjustment procedure) × 1 + (0.85 / parameter) ) X 6 + (0.99 /
Fuzzy control) x 1 + (0.70 / parameter adjustment) x 2 +
... = 4.40 + 0.80 + 5.10 + 0.99 + 1.40 + ... Sum of importance by field (field "politics") = (0.55 / fuzzy control system) x 5 + (0.25 / parameter adjustment procedure) x 1+ (0.30 / parameter) × 6 + (0.50 /
Fuzzy control) x 1 + (0.35 / parameter adjustment) x 2 +
... = 2.75 + 0.25 + 1.80 + 0.50 + 0.70 + ... Sum of importance by field (field "physics") = (0.70 / parameter adjustment procedure) x 1 + (0.76 / parameter) x 6+ (0.60 / parameter adjustment) × 2 ＋ ・ ・ ・ ＝ 0.70 ＋ 4.56 ＋ 1.20 ＋…

A histogram is created based on the obtained sum of the degree of importance for each field. An example of the created histogram is shown in FIG.

The maximum of this histogram, ie,
The field “general industry” is selected, and the field to which the input document information belongs is determined to be “general industry”.

The determined field “general industry” is given to the keyword importance evaluation device 44 as field information. When the field information is input from the document input device 43, the field information thus input is given to the keyword importance evaluation device 44 as it is or after the registration data creation device 40 confirms this.

The document type determining unit 42 determines the document type based on the keyword candidates given from the keyword statistical information extracting device 12 and the whole information contained in the normalized information given from the keyword statistical information normalizing device 20.

In the document type determining unit 42, for example, a set of document type determining rules as described below is preset.

Document Type Determination Rule 1 At least five of the following words are included in all keyword candidates extracted from IF document information [patent application, Commissioner of the Patent Office, International Patent Classification, Claims, Inventor] , Agent, patent attorney, description, claims, action,
Example] AND (number of types of keyword candidates) / (total number of appearances of keyword candidates) = small THEN document type = patent document document type determination rule 2 Among all the keyword candidates extracted from IF document information, the following words "Introduction, Abstract, Introduction, Conclusion, Discussion, Acknowledgment, Title, Abstract" AND (Number of Keyword Candidates) / (Total Number of Keyword Candidates) = Small THEN Document Type = Science and Technology Thesis document type determination rule 3 At least five of the following words are included in all keyword candidates extracted from IF document information [patent application, Commissioner of the Patent Office, International Patent Classification, Claims, Inventor, Proxy] Person, patent attorney, description, claims, action,
Example ”“ Introduction, summary, introduction, conclusion, consideration, acknowledgement, title, abstract ”AND (number of types of keyword candidates) / (total number of appearances of keyword candidates) = large THEN document type = general document, newspaper article, magazine article

As can be seen from these document type determination rules, the variable "(number of types of keyword candidates) / (total number of appearances of keyword candidates)" in the antecedent part is represented by a fuzzy set expression. On the other hand, the variable “predetermined number of predetermined words in keyword candidates” in the antecedent part and the variable “document type” in the consequent part are represented by a crisp set expression.

Membership functions are prepared in advance for variables represented by fuzzy set expressions.
FIG. 35 shows an example of these membership functions. Figure 35 shows "(the number of types of keyword candidates) /
"(Total number of appearances of keyword candidates)" indicates two membership functions of language information "small" and "large".

The document type determination unit 42 uses the document type determination rule 1
According to ~ 3, for a fuzzy variable represented by a membership function, the goodness of fit of the general information (or information obtained by processing these) contained in the normalized information for that membership function is It is calculated. Regarding the variables of the crisp set representation, if the given keyword candidate matches the condition of the antecedent part of the document type determination rule, the goodness of fit is set to 1.0, and if they do not match, it is set to 0.0.

The MIN calculation of the matching degree of the antecedent part calculated for each document type determination rule is performed.

FIG. 36 shows the calculated goodness of fit and the MIN calculation result.

The maximum document type of the MIN calculation result is determined as the document type of the input document information. Therefore,
As can be seen from FIG. 36, the document type of the document information shown in FIG. 32 is the “science and technology paper” with the maximum MIN operation result.

The determined document type “scientific paper” is given to the keyword importance evaluation device 44. Document input device
When the field information is input from 43, the input field information is given to the keyword importance evaluation device 44 as it is or after the registration data creation device 40 confirms this.

The keyword importance evaluation device 44 selects the importance evaluation rule registered in the importance evaluation rule dictionary 48 for each document type and each field based on the field information and the document type, and selects the selected importance evaluation rule. Accordingly, the importance of the keyword candidate is calculated (or evaluated) based on the keyword statistical information for each keyword candidate given from the keyword statistical information extraction device 12.

In the importance level evaluation rule dictionary 48, the importance level evaluation rules for each document type and field include membership function related to the type of keyword statistical information, related items, field-specific importance level, etc. (if necessary. It is registered in advance (by document type and field).

An example of a set of importance evaluation rules for the document type “Science and technology paper” and the field information “Industrial general” is shown below.

Importance Evaluation Rule 1 IF Number of Characters = Short Character Type = * Word Type = General Noun Number of Occurrences = Low Number of Occurrence Positions = * Number of Emphasized Expressions = Low Grammar Information (Number of “ga” + Number of “ha”) / (Number of occurrences) = Small (number of “ni” + number of “”) / (number of occurrences) = Some THEN importance = 0.2 Importance evaluation rule 2 IF number of characters = small character type = Kanji and Hiragana mixed word type = General nouns Number of occurrences = Low Number of occurrences = * Number of emphasized expressions = Little Grammar information (number of "ga" + number of "ha") / (number of occurrences) = Little (number of "ni" + number of "wa") / (Number of occurrences) = Normal THEN Importance = 0.4 Importance rating rule 3 Number of IF characters = Normal Character type = * Word type = * Number of occurrences = Normal Occurrence position = * Number of emphasized expressions = Normal Grammar information Number + number of "ha") / (number of appearances) = normal (number of "ni" + number of "wa") / (number of appearances) = normal THEN importance = 0.6 importance evaluation rule 4 IF characters = large characters Type = * Word type = Company name, personal name Number of occurrences = Many Occurrence position = Title, abstract Number of emphasized expressions = Many Grammar information (number of "ga" + number of "ha") / (Number of occurrences) = Many (" Number of “+” + Number of “)” / (Number of occurrences) = Normal THEN Importance = 0.8 Importance rating rule 5 IF number of characters = Large number of characters = Katakana, mixed Kanji, alphabet, mixed Kanji word type = company name, Personal name Number of occurrences = Large Number of occurrences = Title, abstract Number of emphasized expressions = Many Grammar information (number of "ga" + number of "ha") / (number of occurrences) = Many (number of "ni" + "of" Number of times) / (Number of appearances) = Normal THE N importance = 1.0

[0244] * in the antecedent part (IF) of the importance evaluation rules 1 to 5 indicates that the keyword statistical information is not used.

Regarding the grammatical information, the number of times a particle "ga" or "ha" is used as a subject and the number of times a particle "ni" or "is" is used as an object are separately considered. . Moreover, since these numbers are the number of appearances, the ratio of the number of times they are used as the subject and the ratio of the number of times they are used as the object are variables of the antecedent part in the importance evaluation rule.

As can be seen from these importance evaluation rules,
Variables in the antecedent part "Number of characters", "Number of appearances", "Number of emphasized expressions", "(Number of" ga "+ number of" ha ") / (Number of appearances)" (ratio of the number of times used as subject) and "(Number of" ni "+ number of" wa ") / (number of appearances)"
(Ratio of the number of times it is used as an object) is expressed by fuzzy set expression. On the other hand, the variables “character type”, “word type”, “appearance position” in the antecedent part and “importance” in the consequent part are represented by a crisp set expression.

Membership functions are prepared in advance for the variables represented by the fuzzy set expression and registered in the importance evaluation rule dictionary 48 as described above. Figure 37
(A) to (E) show examples of these membership functions. (A), (B), (C), (D) and (E) are the number of characters, the number of appearances, the number of emphasized expressions, (the number of "ga" +
Number of "ha" / number of appearances and (number of "ni" +
Regarding "number of times" / (number of times of occurrence), three membership functions of language information "small", "normal" and "large" are shown.

The keyword importance evaluation device 44 takes in the importance evaluation rule according to the field information and the document type given from the registration data creation device 40 from the importance evaluation rule dictionary 48. If this field information and document type are not given for some reason, the “general” importance rating rule is selected.

According to the selected importance evaluation rule, the same keyword calculation as that shown in FIG. 10 is performed by the keyword importance evaluation device 44 using the provided keyword statistical information, and the keyword importance is calculated. It

The calculated keyword importance is output to the storage device 45 together with the field information and the document type.

All of the extracted keyword candidates may be registered in the storage device 45 as keywords, or only a suitable number or keywords having a keyword importance of a predetermined value or more are stored in the storage device in descending order of keyword importance. You may register as.

FIG. 38 shows an example of information stored in the storage device 45.
Is shown in. The stored information is the title of the input document, the document type, the field information, the keyword extracted from the document, and the keyword importance thereof.

39 and 40 are flow charts showing the overall processing procedure of the document processing apparatus according to the third embodiment.

39 and 40, the same processes as those in FIGS. 30 and 31 are designated by the same reference numerals, and detailed description thereof will be omitted.

Document information is input by the document input device 43 (step 110). At this time, when the field and the document type to which the input document information belongs are known in advance, these field information and the document type are input.

Keyword candidates from the input document information,
The keyword statistical information is extracted and the keyword statistical information is normalized (steps 112, 113, 141, 142).
).

In step 151, it is determined whether the field is to be evaluated. If the document type and the field need to be evaluated,
The registration data creation device 40 determines the document type and field (steps 151 to 153). When the field and the document type are determined, the keyword importance evaluation device 44 fetches the importance evaluation rule of the specified field from the importance evaluation rule dictionary 48 based on this (step 154).

When the document type and the field information are not input and these determinations are not made, the keyword importance evaluation device 44 fetches the importance evaluation rule of the field "general" from the importance evaluation rule dictionary 48 (step 155).

The keyword importance evaluation device 44 evaluates (calculates) the keyword importance of the keyword candidates, and the calculated keyword importance is output to the storage device 45 together with the keywords and stored in the storage device 45 (step 119). , 120).

When the keyword importance is evaluated for all the keyword candidates, the process is terminated (step 121).

[Brief description of drawings]

FIG. 1 is a block diagram showing an overall configuration of a document processing apparatus according to a first embodiment.

FIG. 2 shows an example of document information and field information.

FIG. 3 shows an example of keyword candidates extracted from document information.

FIG. 4 shows an example of keyword statistical information.

FIG. 5 shows an example of keyword statistical information.

FIG. 6 shows an example of a field-specific importance dictionary.

FIG. 7 shows an example of a related word dictionary.

FIG. 8 shows an example of the degree of importance by field.

9 (A), (B), (C), (D), (E) and (F) are
Number of characters, number of appearances, number of emphasized expressions, (number of "ga" +
Number of "ha" / (number of appearances), (number of "ni" +
Regarding the "number of times" / (number of times of occurrence) and the degree of importance by field, the membership functions of the language information "low", "normal" and "high" are shown respectively.

FIG. 10 is a flow chart showing a keyword importance calculation processing procedure.

FIG. 11 shows an example of a matching result between keyword statistical information and a membership function.

FIG. 12 shows an example of a keyword and its keyword importance.

FIG. 13 is a flow chart showing an overall processing procedure of the document processing apparatus in the first embodiment.

FIG. 14 is a block diagram showing an overall configuration of a document processing apparatus according to a second embodiment.

FIG. 15 is a block diagram showing an internal configuration of a keyword statistical information normalization device.

FIG. 16 shows an example of a synonym dictionary.

FIG. 17 shows an example of normalization information.

FIG. 18 is a flow chart showing a processing procedure of keyword statistical information normalization processing.

FIG. 19 shows an example of normalized keyword statistical information.

FIG. 20 shows an example of normalized keyword statistical information.

FIG. 21 is a block diagram showing an internal configuration of a keyword association degree setting device.

FIG. 22 is a flow chart showing a processing procedure of association degree setting processing.

FIG. 23 shows an example of distance information between keyword candidates.

24 (A), (B), (C) and (D) are the number of co-occurring sentences, the number of co-occurring paragraphs, the minimum number of keyword candidates between keyword candidates, and the minimum number of characters between keyword candidates. Regarding, regarding language information, an example of membership functions of language information “low” and “high” is respectively shown.

FIG. 25 shows an example of a matching result between keyword candidate distance information and a membership function.

FIG. 26 shows an example of a field-specific importance dictionary.

FIG. 27 shows an example of the degree of importance for each field.

28 (A), (B), (C), (D), (E) and (F)
Is the number of characters, the number of appearances, the number of emphasized expressions, (the number of "ga" + the number of "ha") / (the number of appearances), (the number of "ni" +
Regarding the "number of times" / (number of times of occurrence) and the degree of importance by field, the membership functions of the language information "low", "normal" and "high" are shown respectively.

FIG. 29 is a flowchart showing the overall processing procedure of the document processing apparatus according to the second embodiment.

FIG. 30 is a flowchart showing the overall processing procedure of the document processing apparatus according to the second embodiment.

FIG. 31 is a block diagram showing the overall configuration of a document processing apparatus according to a third embodiment.

FIG. 32 shows an example of document information, field information, and document type.

FIG. 33 is a block diagram showing an internal configuration of a registration data creation device.

FIG. 34 is a histogram showing the sum of the degree of importance for each field.

FIG. 35 shows membership functions of language information “small” and “large” with respect to (number of types of keyword candidates) / (total number of appearances of keyword candidates).

FIG. 36 is a diagram showing a process of determining a document type.

37 (A), (B), (C), (D) and (E) are the number of characters, the number of appearances, the number of emphasized expressions, (the number of "ga" + "wa").
Number of times) / (number of appearances) and (number of "ni" + "wa"
With respect to (number of times) / (number of occurrences), the membership functions of the language information “small”, “normal” and “large” are shown respectively.

FIG. 38 shows an example of stored information.

FIG. 39 is a flow chart showing the overall processing procedure of the document processing apparatus according to the third embodiment.

FIG. 40 is a flow chart showing the overall processing procedure of the document processing apparatus according to the third embodiment.

[Explanation of symbols]

 11, 43 Document input device 12 Keyword statistical information extraction device 13, 24 Sectoral importance calculation device 14, 26, 44 Keyword evaluation device 15, 45 Storage device 16, 16A Related word dictionary 17, 27 Sectoral importance dictionary 18, 28, 48 Importance evaluation rule 20 Keyword statistical information normalization device 21 Synonym dictionary 22 Keyword statistical information sharing unit 23 Normalization unit 30 Keyword inter-related degree setting device 31 Inter-keyword distance information extraction unit 32 Relevance degree operation unit 40 Registration data creation device 41 Field determination unit 42 Document type determination unit

Claims (30)

[Claims] 1. Document input means for inputting document information and field information indicating a predetermined field to which the document information belongs, keyword candidates extracted from the input document information, and keyword statistical information relating to the extracted keyword candidates. Keyword statistical information creating means for creating a plurality of first
Of each of the first headwords, the field-specific importance dictionary in which the field-specific importance is registered in advance for each field to which the first headword belongs, and the field information input for each of the extracted keyword candidates. A field-specific importance generating means for reading the field-specific importance of the field to be expressed from the field-specific importance dictionary, a priority evaluation rule dictionary in which a priority evaluation rule and a membership function are registered in advance, and a priority evaluation rule dictionary Based on the keyword statistical information created by the keyword statistical information creating means and the field-specific importance created by the field-specific importance creating means according to the importance evaluation rule and the membership function registered in Keywords for calculating the keyword importance of the keyword candidates extracted by the keyword statistical information creating means Iodide evaluation unit, and a document processing apparatus provided with the keyword candidate and the keyword importance degree calculated for it, storage means for storing in conjunction with data designating the document information the input, the. 2. A plurality of second headwords, related words related to each of the second headwords, and a degree of relevance indicating a degree of relevance between the second headword and the related words are registered in advance. If there is an unregistered keyword candidate in the field importance dictionary among the keyword candidates extracted by the keyword statistical information creating means, the field importance degree generation means further includes a related word dictionary The degree of relevance of the unregistered keyword candidate and its degree of relevance are read from the related word dictionary, and the degree of importance of the related term of the unregistered keyword candidate by category is read from the degree of importance by area dictionary. The document processing apparatus according to claim 1, wherein the degree of importance of each of the unregistered keyword candidates by area is calculated based on the degree of association and the degree of importance by area. 3. The storage means stores a keyword candidate having a keyword importance of a predetermined threshold value or more as a keyword of the input document information.
The document processing device described in 1. 4. The field-specific importance generation means reads out the field-specific importance of a predetermined field when the field information is not input from the document input means. Document processing device. 5. A plurality of first headwords, and the first
For each headword of, the field-specific importance for each field to which it belongs is registered in advance in the field-specific importance dictionary, and the importance evaluation rules and membership functions are registered in advance in the importance evaluation rule dictionary and input. Received document information and document information representing a predetermined field to which the document information belongs, keyword candidates are extracted from the input document information, keyword statistical information regarding the extracted keywords is created, and each keyword candidate is extracted. The field-specific importance of the field indicated by the input field information is read from the field-specific importance dictionary, and created according to the importance-evaluation rule and the membership function registered in the importance-evaluation rule dictionary. The keyword candidates extracted based on the keyword statistical information and the generated degree of importance by field Keyword is calculated importance, the extracted the keyword candidate and the keyword importance degree calculated for it, and stores in connection with data specifying the document information the input, document processing method. 6. A related word dictionary includes a plurality of second headwords, a degree of relevance associated with each of the second headwords, and a degree of relevance indicating a degree of relevance between the second headword and the related term. If there is an unregistered keyword candidate in the category-specific importance dictionary that has been registered in advance and is extracted, the related word of the unregistered keyword candidate and its degree of relevance are searched for in the related word dictionary. Read from the field-specific importance of the related word of the unregistered keyword candidate from the field-specific importance dictionary, and based on the relevance and the field-specific importance of the read related word, the unregistered keyword candidate The document processing method according to claim 5, wherein the degree of importance for each field is calculated. 7. The document processing method according to claim 5, wherein a keyword candidate having a keyword importance of a predetermined threshold value or more is stored as a keyword of the input document information. 8. When the field information is not input, the field-specific importance of a predetermined field is read out,
The document processing method according to claim 5. 9. Document input means for inputting document information and field information representing a predetermined field to which the document information belongs, keyword candidates extracted from the input document information, and keyword statistical information relating to the extracted keyword candidates. Keyword statistical information creating means for creating a plurality of first
Of the keyword and the synonym dictionary in which synonyms relating to each of the first headwords are registered in advance, and extracted keyword candidates, the keywords registered as synonyms by referring to the synonym dictionary A synonym group is composed of candidates, and at least a part of the keyword statistical information of the keyword candidates belonging to the same synonym group is aggregated for each synonym group, and the aggregated keyword statistical information is input to the input document information. The keyword-based statistical information normalization means for normalizing using the whole information about the above, a plurality of second headwords, and the field-specific importance of each of the first headwords are registered in advance for each field to which it belongs. About the first headword in the synonym dictionary of the synonym group in the field-specific importance dictionary by the field The importance dictionary is searched by searching the importance dictionary, and the importance by area of the area indicated by the input area information is read, and the importance by area is defined as the importance by keyword of the keyword candidate belonging to the synonym group. The keyword statistical information normal according to the importance evaluation rule dictionary in which the generation means, the importance evaluation rule and the membership function are registered in advance, and the importance evaluation rule and the membership function registered in the importance evaluation rule dictionary. Keyword importance evaluation means for calculating the keyword importance of the keyword candidate based on the keyword statistical information including the information normalized by the conversion means and the field importance of the keyword candidate generated by the field importance calculation means , And the extracted keyword candidates and the keyword weights calculated for them Degrees and in connection with data specifying the document information the input, storage storing unit, the document processing apparatus having a. 10. A plurality of third headwords, related words related to each of the third headwords, and a degree of relevance indicating a degree of relevance between the third headword and the related words are registered in advance. If there is an unregistered keyword candidate in the field importance dictionary among the keyword candidates extracted by the keyword statistical information creating means, the field importance degree generation means further includes a related word dictionary The related word of the unregistered keyword candidate and its degree of relevance are read from the related word dictionary, and the field-specific importance of the related word of the unregistered keyword candidate is read from the field-specific importance dictionary and read out. 10. The document processing apparatus according to claim 9, wherein the field-specific importance of the unregistered keyword candidate is calculated based on the degree of association and field-specific importance. 11. Arbitrary 2 in the keyword candidates
Distance information between two keyword candidates is created based on the input document information, and according to a relevance evaluation rule and a membership function preset based on the created distance information between the two keyword candidates,
The degree of relevance of the two keyword candidates is calculated, and when the two keyword candidates are registered in the related word dictionary, the registered degree of relevance is updated with the calculated degree of relevance to the related word dictionary. 11. The document processing apparatus according to claim 10, further comprising inter-keyword relevance degree setting means for writing the calculated relevance degree in the related term dictionary when not registered. 12. The document processing apparatus according to claim 9, wherein the storage unit stores a keyword candidate having a keyword importance of a predetermined threshold value or more as a keyword of the input document information. 13. The field importance generator for reading out the field importance of a predetermined field when field information is not input from the document input unit. Document processing device. 14. A plurality of first headwords and synonyms relating to each of the first headwords are registered in advance in a synonym dictionary, and the plurality of second headwords and the second headwords are registered. Regarding the entry word, the field-specific importance for each field to which it belongs is registered in advance in the field-specific importance dictionary, and the importance evaluation rules and membership functions are registered in advance in the importance evaluation rule dictionary and are input. Document information and field information indicating a predetermined field to which the document information belongs are accepted, keyword candidates are extracted from the input document information, keyword statistical information regarding the extracted keyword candidates is created, and extracted keyword candidates , Refer to the above synonym dictionary, form a synonym group with keyword candidates registered as synonyms, and identify At least a part of the above keyword statistical information of the keyword candidates belonging to the synonym group is totaled for each synonym group, and the totalized keyword candidate information is normalized using the whole information about the input document information, The field-specific importance dictionary is searched for the first headword in the synonym dictionary of the synonym group, and the field-specific importance of the field represented by the input field information is read to determine the field-specific importance. The keyword statistical information including the information normalized by the importance evaluation rule and the membership function registered in the importance evaluation rule dictionary and the generated keyword statistical information as the importance of each keyword candidate belonging to the synonym group by field are generated. Extraction of the keyword importance of the above keyword candidates based on the importance of each keyword candidate in each field The said keyword candidate and the keyword importance degree calculated for it, and stores in connection with data specifying the document information the input, document processing method. 15. A plurality of third headwords, related words related to each of the third headwords, and a relevance degree indicating a degree of relevance between the third headword and the related words are stored in a relevance dictionary. If there is an unregistered keyword candidate in the category-specific importance dictionary that has been registered in advance and is extracted, the related word of the unregistered keyword candidate and its degree of relevance are searched for in the related word dictionary. Read from the field-specific importance of the related word of the unregistered keyword candidate from the field-specific importance dictionary, and based on the relevance and the field-specific importance of the read related word, the unregistered keyword candidate 15. The document processing method according to claim 14, wherein the degree of importance for each field is calculated. 16. Arbitrary 2 in the keyword candidates
Distance information between two keyword candidates is created based on the input document information, and according to a relevance evaluation rule and a membership function preset based on the created distance information between the two keyword candidates,
The relevance of the two keyword candidates is calculated, and when the two keyword candidates are registered in the related word dictionary, the registered relevance is updated with the calculated relevance, and the relevance dictionary is updated. 16. The document processing method according to claim 15, wherein the calculated degree of relevance is written in the related word dictionary when not registered. 17. The document processing method according to claim 14, wherein keyword candidates having a keyword importance of a predetermined threshold value or more are stored as keywords of the input document information. 18. The document processing method according to claim 14, wherein when the field information is not input, the field-specific importance of a predetermined field is read. 19. Document information, field information indicating a predetermined field to which the document information belongs and document input means for inputting a document type of the document information, keyword candidates are extracted from the input document information, and extracted. A keyword statistical information creating means for creating keyword statistical information about the above keywords, an importance evaluation rule dictionary in which importance evaluation rules and membership functions are registered in advance for each field and document type, input field information and document type Correspondingly, selection means for selecting the importance evaluation rule and membership function registered in the importance evaluation rule dictionary, importance evaluation rule and membership function selected by the selection means from the importance evaluation rule dictionary According to the above, the key created by the keyword statistical information creating means The keyword importance evaluation means for calculating the keyword importance of the keyword candidates extracted by the keyword statistical information creating means based on the word statistical information, and the keyword candidates and the keyword importance calculated for the keyword candidates are described above. A document processing apparatus comprising: a storage unit that stores the input document information in association with data that specifies the designated document information. 20. A plurality of headwords, a field-specific importance dictionary in which the field-specific importance is registered in advance for each field to which the respective headword belongs, and a field-specific importance of the extracted keyword candidates. The field to which the input document information belongs is determined and preset based on the field importance of the keyword candidate and the information included in the keyword statistical information of the keyword candidate, which is read from the field-specific importance dictionary. 20. The document processing according to claim 19, further comprising means for determining a document type of the input document information based on the keyword candidate and overall information about the input document information according to the input document type determination rule. apparatus. 21. The storage means stores a keyword candidate having a keyword importance of a predetermined threshold value or more as a keyword of the input document information.
The document processing device according to item 19. 22. Document information, document information indicating a predetermined field to which the document information belongs and document input means for inputting a document type of the document information, keyword candidates extracted from the input document information, and extracted. Keyword statistical information extraction means for creating keyword statistical information about the keyword candidates, a plurality of first headwords, and a synonym dictionary in which synonyms for each of the first headwords are registered in advance, extracted keywords For the candidates, the synonym dictionary is referred to, a synonym group is formed by keyword candidates registered as synonyms, and at least a part of the keyword statistical information of the keyword candidates belonging to the same synonym group is synonymous. Aggregated by word group, aggregated keyword statistical information is added to the input document information. Keyword statistical information normalization means for normalizing using the whole information about information, importance evaluation rules dictionary and importance evaluation rule dictionary in which membership functions are registered in advance for each field and document type, input field information and Selection means for selecting the importance evaluation rules and membership functions registered in the importance evaluation rule dictionary according to the document type; importance evaluation rules selected by the selection means from the importance evaluation rule dictionary; A keyword for calculating the keyword importance of the keyword candidate extracted by the keyword statistical information creating means based on the keyword statistical information including the information normalized by the keyword statistical information normalizing means according to the membership function The importance evaluation means, the above keyword candidates and their Storage means for the keyword importance calculated and stored in relation to data specifying the document information the input for,
A document processing device provided with. 23. A plurality of second headwords, a field-specific importance dictionary in which the field-specific importance is registered in advance for each field to which the second headword belongs, and the extracted keyword candidates. The field-specific importance of is read from the field-specific importance dictionary, and the field to which the input document information belongs based on the field-specific importance of the keyword candidate and the information included in the keyword statistical information of the keyword candidate. And a means for determining the document type of the input document information based on the keyword candidates and the overall information about the input document information according to a preset document type determination rule. The document processing device according to item 22. 24. The storage means stores a keyword candidate having a keyword importance of a predetermined threshold value or more as a keyword of the input document information.
The document processing device according to item 22. 25. An importance evaluation rule and a membership function are registered in advance in the importance evaluation rule dictionary for each field and document type, and input document information and field information representing a predetermined field to which the document information belongs. And the document type of the document information is accepted, keyword candidates are extracted from the input document information, keyword statistical information about the extracted keyword is created, and the important information is input according to the input field information and document type. The keyword statistical information created by selecting the importance evaluation rule and the membership function registered in the importance evaluation rule dictionary and created in accordance with the importance evaluation rule and the membership function selected from the importance evaluation rule dictionary. On the basis of,
A document processing method for calculating a keyword importance of the extracted keyword candidate, and storing the keyword candidate and the keyword importance calculated for the keyword candidate in association with data specifying the input document information. 26. A plurality of headwords and each headword for each field to which the headword belongs are registered in a field-specific importance dictionary in advance, and the field-specific importance of the extracted keyword candidates is set to the field-specific importance. A field to which the input document information belongs is determined based on the degree of importance of each of the keyword candidates by category and the information included in the keyword statistical information of the keyword candidates, and the preset document type is determined. 26. The document processing method according to claim 25, wherein the document type of the input document information is determined based on the keyword candidate and the entire information about the input document information according to a rule. 27. The document processing method according to claim 25, wherein keyword candidates having a keyword importance of a predetermined threshold value or more are stored as keywords of the input document information. 28. A plurality of first headwords and synonyms for each of the first headwords are registered in advance in a synonym dictionary, and the importance evaluation rules and membership functions are stored in the importance evaluation rule dictionary. Document information to be entered by registering in advance in each field and document type,
Accepting field information indicating a predetermined field to which the document information belongs and the document type of the document information, extracting keyword candidates from the input document information, creating keyword statistical information on the extracted keyword candidates, and extracting With respect to the obtained keyword candidates, the synonym dictionary is referred to, a synonym group is configured by the keyword candidates registered as synonyms, and at least one of the keyword statistical information of the keyword candidates belonging to the same synonym group is formed. Parts are summed up for each synonym group, the summed keyword statistical information is normalized using the whole information about the input document information, and the importance evaluation rule described above is input according to the input field information and document type. Select the importance evaluation rule and membership function registered in the dictionary and According to the importance evaluation rule and the membership function selected from the evaluation rule dictionary, the keyword importance of the extracted keyword candidate is calculated based on the keyword statistical information including the normalized information, and the keyword candidate is calculated. And a keyword processing method for storing the keyword importance calculated for the keyword in association with the data specifying the input document information. 29. A plurality of second headwords, and field-specific importances for respective fields to which each of the second headwords belongs are registered in a field-specific importance dictionary in advance, and extracted keyword candidates The field-specific importance of is read from the field-specific importance dictionary, and the field to which the input document information belongs based on the field-specific importance of the keyword candidate and the information included in the keyword statistical information of the keyword candidate. 29. The document according to claim 28, wherein the document type of the input document information is determined based on the keyword candidate and the overall information about the input document information according to a preset document type determination rule. Processing method. 30. The document processing method according to claim 28, wherein keyword candidates having a keyword importance of a predetermined threshold value or more are stored as keywords of the input document information.