JP2005135311A - Category-classified new feature word ranking method, apparatus and program, and computer readable storage medium recorded with category-classified new feature word ranking program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a category-classified new feature word ranking method, apparatus and program by which a newly arrived feature word for every category is easily extracted from many documents collected by a plurality of categories to support the present trend, and to provide a computer readable storage medium in which the category-classified new feature word ranking program is recorded. <P>SOLUTION: The category-classified new feature word ranking method includes the following steps: upon inputting the preparation time information-borne document classified by the plurality of categories from a database, analyzing the document; totalizing words and phrases allowed to emerge on the document and words and phrases-accompanied information on the words and phrases; using the words and phrases-accompanied information on the words and phrases; and calculating the relevancy to the category allowed to emerge the words and phrases for each of the words and phrases. The newly arrived feature words by categories are easily extracted from the many documents collected by the plurality of categories to support the present trend. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a category-specific new feature word ranking method and apparatus, a program, and a computer-readable storage medium in which a category-specific new feature word ranking program is recorded. The present invention also relates to a category-specific new feature word ranking method and apparatus and a program for ranking new feature words, and a computer-readable storage medium storing the category-specific new feature word ranking program.

  Documents created several hours to several days ago from now are likely to contain timely information such as current trends, interests, and new arrival information. Therefore, by collecting and analyzing many documents with new creation times, it is possible to grasp recent trends and timely events. This is especially true for documents on the Internet that are updated quickly because new information is added from time to time.

  In order to obtain new arrival information, there is a technology that supports continuous acquisition of timely information by selecting and presenting only updated portions from text information that is sent one after another (see, for example, Patent Document 1). However, it is a technology that targets information sources in which a previously received document and a part of a newly received document overlap, and targets documents created in the period of several hours to several days ago. It is impossible to extract trends and timely events.

  Further, there is a technique of counting up the appearance frequencies of words and listing up words having high appearance frequencies as words representing trends (for example, see Patent Document 2). If a document created several hours to several days ago is used as an input for this technology, it will be possible to list words that represent recent trends, but words that appear frequently in sentences are general. In many cases, it is a high word, and not only the word indicating the trend is necessarily listed.

On the other hand, in the field of natural language processing, there is a technique for analyzing the correlation between the occurrence frequencies of words and phrases and extracting characteristic words and phrases in each document. This is done by assigning a large weight to words that appear frequently in one document and less frequently in other documents, and reducing the weight of words that are common in many documents. Is to do. If this technique is applied to documents classified in advance into a plurality of categories according to the contents, it is possible to extract “characteristic words in each category”. Furthermore, if processing is performed on a recently created document, it is possible to extract a phrase representing a recent trend. However, it is very difficult to select and extract timely topics that appear in recently created documents, are characteristic of a certain category, and have recently appeared.
JP-A-8-161299 Japanese Patent Laid-Open No. 10-69496

  As described above, with the conventional technology, it has been difficult to extract new concepts, timely incidents, and phrases that represent events from recently created documents.

  The present invention has been made in view of the above points. A new category-by-category capable of easily extracting new feature words for each category from a large number of documents collected by a plurality of categories and supporting current trends. It is an object of the present invention to provide a computer-readable storage medium in which an outgoing feature word ranking method, apparatus, program, and category-specific new feature word ranking program are recorded.

  FIG. 1 is a diagram for explaining the principle of the present invention.

To achieve the above object, the present invention provides a category-specific new feature word ranking method for ranking new feature words by category.
When a document with creation time information classified into a plurality of categories is input from the database, the word totaling unit analyzes the document and totals the words that appear in the document and the word-related information related to the word Counting step (step 1);
The category relevance evaluation means comprises a category relevance evaluation step (step 2) for calculating the relevance to the category in which the phrase appears, using the phrase accompanying information of the word, and for each word.
The word counting step (Step 1)
The number of appearance categories of the phrase as the phrase accompanying information, and the time-gradual appearance by category obtained by adding all the documents in the category while adding a greater weight to the number of occurrences of the phrase in the document with a newer creation time Record the amount in the storage means,
The category relevance evaluation step (Step 2)
The category of the phrase is calculated by calculating a category relevance composed of an appearance category number element determined based on the number of appearance categories of the phrase and an appearance amount element determined based on the time-gradient appearance amount by category. Create another ranking.

Further, the present invention provides a phrase totaling step (step 1):
In addition to the number of appearance categories of the phrase and the time-gradient appearance amount by category as the phrase accompanying information, the phrase appearance period based on the creation time of the document in which the phrase appears is recorded in the storage means,
In the category relevance evaluation step (step 2),
By calculating the category relevance composed of the life element based on the word appearance period in addition to the appearance category number element and the appearance amount element, the ranking of the word by category is created.

Further, the present invention provides a phrase totaling step (step 1):
In addition to the number of appearance categories of words and the amount of time-gradient appearance of each category as word-accompanying information, the number of documents that appear in each category and the number of documents in which the words appear in each category are recorded in the storage means,
In the category relevance evaluation step (step 2),
The category ranking of words is performed by calculating the category relevance composed of the number of appearance document elements based on the number of appearance words of each category in addition to the appearance category number element and the appearance amount element.

Further, the present invention provides a phrase totaling step (step 1):
In addition to the number of appearance categories of words and the time-graded appearance amount by category as word-accompanying information, the word appearance period based on the creation time of the document in which the word appears and the number of documents in which the word appears in each category Record the number of words appearing in the storage means,
In the category relevance evaluation step (step 2),
In addition to the appearance category number element and the appearance amount element, the ranking of each word by category is calculated by calculating the category relevance that is composed of the lifetime element based on the word appearance period and the appearance document number element based on the word appearance document number by category. I do.

  FIG. 2 is a principle configuration diagram of the present invention.

The present invention is a category-specific new feature word ranking device for ranking new feature words by category,
When a document with creation time information classified into a plurality of categories is input from the database, the word totaling unit 13 analyzes the document and totals the words appearing in the document and the word accompanying information related to the word;
Category relevance evaluation means 14 for calculating the relevance to the category in which the word appears, using the word accompanying information of the word;
The phrase totalization means 13
The number of appearance categories of the phrase as the phrase accompanying information, and the time-gradual appearance by category obtained by adding all the documents in the category while adding a greater weight to the number of occurrences of the phrase in the document with a newer creation time Means for recording the quantity in a storage means,
The category relevance evaluation means 14
The category of the phrase is calculated by calculating a category relevance composed of an appearance category number element determined based on the number of appearance categories of the phrase and an appearance amount element determined based on the time-gradient appearance amount by category. A means for creating another ranking is included.

Moreover, the word totalizing means 13 of the present invention
Means for recording in the storage means the word appearance period based on the creation time of the document in which the word appears, in addition to the number of appearance categories of the word and the time gradient appearance amount by category as the word accompanying information,
The category relevance evaluation means 14
In addition to the appearance category number element and the appearance amount element, it includes means for creating a category ranking of words by calculating the category relevance composed of life elements based on the word appearance period.

Moreover, the word totalizing means 13 of the present invention
Means for recording in the storage means, in addition to the number of appearance categories of words and the amount of time-gradient appearance of each category as word-accompanying information, the number of documents that appear in each category and the number of documents in which the words appear in each category;
The category relevance evaluation means 14
Means for ranking the phrases by category by calculating the category relevance composed of the appearance document number elements based on the number of appearance word count documents by category in addition to the appearance category number element and the appearance amount element.

Moreover, the word totalizing means 13 of the present invention
In addition to the number of appearance categories of words and the time-graded appearance amount by category as word-accompanying information, the word appearance period based on the creation time of the document in which the word appears and the number of documents in which the word appears in each category Means for recording the number of word appearance documents in the storage means,
The category relevance evaluation means 14
In addition to the appearance category number element and the appearance amount element, the ranking of each word by category is calculated by calculating the category relevance that is composed of the lifetime element based on the word appearance period and the appearance document number element based on the word appearance document number by category. Means for performing.

The present invention is a category-specific new feature word ranking program for ranking new feature words by category,
Computer
When a document with creation time information classified into a plurality of categories is input from the database, the document is analyzed, and a phrase totaling unit that totals the phrases that appear in the document and the phrase-accompanying information related to the phrases;
The category relevance evaluation means is a program that uses the phrase accompanying information of a word and functions as a category relevance evaluation means for calculating the relevance to the category in which the word appears for each word,
The word aggregation means is
The number of appearance categories of the phrase as the phrase accompanying information, and the time-gradual appearance by category obtained by adding all the documents in the category while adding a greater weight to the number of occurrences of the phrase in the document with a newer creation time Record the amount in the storage means,
Category relevance evaluation means
The category of the phrase is calculated by calculating a category relevance composed of an appearance category number element determined based on the number of appearance categories of the phrase and an appearance amount element determined based on the time-gradient appearance amount by category. Create another ranking.

In addition, the category-specific new feature word ranking program of the present invention is a phrase totaling means,
In addition to the number of appearance categories of the phrase and the time-gradient appearance amount by category as the phrase accompanying information, the phrase appearance period based on the creation time of the document in which the phrase appears is recorded in the storage means,
In category relevance evaluation means,
By calculating the category relevance composed of the life element based on the word appearance period in addition to the appearance category number element and the appearance amount element, the ranking of the word by category is created.

In addition, the category-specific new feature word ranking program of the present invention is a phrase totaling means,
In addition to the number of appearance categories of words and the amount of time-gradient appearance of each category as word-accompanying information, the number of documents that appear in each category and the number of documents in which the words appear in each category are recorded in the storage means,
In category relevance evaluation means,
The category ranking of words is performed by calculating the category relevance composed of the number of appearance document elements based on the number of appearance words of each category in addition to the appearance category number element and the appearance amount element.

In addition, the category-specific new feature word ranking program of the present invention is a phrase totaling means,
In addition to the number of appearance categories of words and the time-graded appearance amount by category as word-accompanying information, the word appearance period based on the creation time of the document in which the word appears and the number of documents in which the word appears in each category Record the number of words appearing in the storage means,
In category relevance evaluation means,
In addition to the appearance category number element and the appearance amount element, the ranking of each word by category is calculated by calculating the category relevance that is composed of the lifetime element based on the word appearance period and the appearance document number element based on the word appearance document number by category. I do.

  The present invention is a computer-readable storage medium storing a category-specific new feature word ranking program for ranking new feature words by category, and records the category-specific new feature word ranking program. .

  According to the present invention, words that represent timely topics that have recently appeared from a large number of documents and that are characteristic for each category are automatically extracted, so that each sentence can be extracted. You can grasp the trend just by looking at the extracted words without looking through.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 3 shows a configuration of a category-specific new feature word ranking apparatus according to an embodiment of the present invention.

  A collected document database 12 and a relevance ranking database 15 are connected to the category-specific new feature word ranking device 11.

  The category-specific new feature word ranking device 11 includes a phrase totaling unit and a category relevance evaluation unit 14, and inputs a collection document group with creation time information classified into a plurality of categories from the collection document database 12, The phrase relevance ranking for each category is output to the relevance ranking database 15.

  The phrase totaling unit 13 includes a morphological analysis unit 131, an appearance category number totaling unit 132, a category-specific time gradient appearance amount totaling unit 133, an appearance period totaling unit 134, and a category-specific appearance document number totaling unit 135.

  The category association evaluation unit 14 includes an appearance category number element calculation unit 141, an appearance amount element calculation unit 142, a life element calculation unit 143, an appearance document number element calculation unit 144, and a category relevance calculation unit 145.

  The phrase totaling unit 13 decomposes the collected documents stored in the collected document database 12 into morphemes by the morpheme analyzing unit 131, and extracts only nouns.

  The appearance category number totaling unit 132, the category-specific time gradient appearance amount totaling unit 133, the appearance period totaling unit 134, and the category-specific appearance document number totaling unit 135 are related to each of the nouns extracted from each category-categorized document. Accompanying information used for evaluation is aggregated and temporarily recorded in a storage means such as a memory.

  The appearance category number element calculation unit 141, the appearance amount element calculation unit 142, the life element calculation unit 143, the appearance document number element calculation unit 144, and the category relevance calculation unit 145 of the category relevance evaluation unit 14 are stored in a storage unit such as a memory. The category relevance is calculated using each recorded phrase accompanying information, and is output as a phrase relevance ranking 15 for each category.

  Hereinafter, a specific example will be described.

  FIG. 4 shows an example of collected document data in the collected document database 12 that is input to the category-specific new feature word ranking device 11 of the present invention. In the collected document database 12, collected document data classified into any one of all N categories of category 1 to category N is stored with creation time information.

  FIG. 5 is a flowchart showing the overall flow of the category-specific new feature word ranking method according to the embodiment of the present invention.

  Step 301) The collected document is input from the collected document database 12 of FIG. 4 to the morphological analysis unit 131 of the phrase totaling unit 13. The morphological analysis unit 131 decomposes the input document data for each part of speech with part of speech information, and outputs only the part of speech for which ranking is to be created. In the present embodiment, description will be made on the assumption that ranking is created using only nouns as target parts of speech.

  Step 302) The above processing is repeated for all the collected documents.

  Step 303) Next, each of the appearance category totaling unit 132, the category-specific time gradient appearance amount totaling unit 133, the appearance period totaling unit 134, and the category-specific appearance document number totaling unit 135 totals the accompanying information of the phrase. The operation of each of the following totaling units 132 to 135 will be described.

  The appearance category totaling unit 132 considers that a certain phrase w appears once in the document in the category as an occurrence in the category, and totals the number of categories CF (w) in which the phrase w appears.

  The category-specific time-gradient appearance amount totaling unit 133 adds the weight associated with the document creation time to the number of occurrences of the word / phrase in each document for all the documents in the category.

  In the category-specific new feature word ranking device of the present invention for selecting new words, weights are given so that the newer the creation time of a document, the greater the influence of the number of occurrences of the phrase in the document, and the smaller the older the influence is. For example, as shown in FIG. 6, there is a method of linearly setting the weight so that the weight is 1 for the newest document and 0 for the oldest document. If the number of occurrences of the word w in the document d in the category C is TF (d, w) and the creation time of the document d is t (d), the number of appearances TF (d, w) is determined from FIG. A value multiplied by the weight W (t (d)) is added to all the documents in category C to obtain a category-specific time gradient appearance amount TA (C, w) of phrase w in category C (formula (1)). .

カテゴリ別時間傾斜出現量は、どの期間の新出特徴語ランキングを作成するか、即ち、最近２日間や、最近２時間といった注目時間帯に応じて重みの付け方を変えればよく、図６のように直線的に変換する重みに限定するものではない。

As for the time gradient appearance amount by category, it is only necessary to change the weighting method according to which period the new feature word ranking is created, that is, according to the attention time zone such as the last two days or the last two hours, as shown in FIG. It is not limited to the weight that is linearly converted to.

  The appearance period totaling unit 134 totals how long a word w appears in a document in one category, that is, a period that can be said to be the life of the word. Documents in a category are classified according to their creation time, for example, at 15-minute intervals as shown in FIG. 7, and if a word w is present even once in a document group created in each period, it is regarded as appearing in that period. . In the example of FIG. 7, words appear in four sections out of all seven sections at 15-minute intervals, so the appearance period L (C, w) of the word w in category C is 4.

  The category-specific appearance document totalization unit 135 totals the number of documents DF (C, w) in which the word w appears even once among all the documents in the category C.

  Step 304) Using the accompanying information of the words and phrases compiled above, the appearance category number element calculation unit 141, the appearance amount element calculation unit 142, the life element calculation unit 143, and the appearance document number element calculation unit 144 of the category relevance evaluation unit 14 Are calculated and sent to the category relevance calculation unit 145, and the category relevance calculation unit 145 calculates the category relevance level of the phrase based on these elements.

  The appearance category number element calculation unit 141 determines the appearance category number element necessary for the evaluation of the feature word, using the appearance category number CF (w) of the word / phrase totaled by the appearance category number totalization unit 132. Given that general words and phrases are likely to appear in many categories, and words that are characteristic of categories have a small number of appearing categories, the number of appearing categories is given so that the value increases as the number of appearing categories decreases. Is desirable.

  For example, when N is the total number of categories, and the logarithmic value (formula (2)) of N divided by the number of appearance categories CF (w) of the phrase w is an appearance category number element Category (w), all categories In terms of words that appear in (words whose number of appearance categories is N), the number-of-appearance category element has a minimum value of 0, and as shown in FIG. 8, an evaluation expression that takes a larger value as the number of appearance categories decreases can be realized.

出現量要素算出部１４２は、作成時刻が新しい文書での語句の出現回数ほどカテゴリ関連度への影響を大きく、古い文書での出現回数ほど影響を小さく抑えることで、よりタイムリーな性格を持つ語句を高く評価する。

The appearance amount element calculation unit 142 has a more timely personality by suppressing the influence on the category relevance as the number of occurrences of the phrase in the document with a new creation time and suppressing the influence as small as the number of appearances in the old document. I appreciate the phrase.

  In the present embodiment, it is assumed that the category-specific time gradient appearance amount TA (C, w) counted by the category-specific time gradient appearance amount totalization unit 133 is handled as it is as the appearance amount element Appearance (C, w) (formula ( 3)).

寿命要素算出部１４３は、語句が出現している期間に基づき、長期間に渡って出現し続ける語句は新出語ではない、すなわち、タイムリー性が低いとみなし、短期間に出現する語句の影響を重視するような要素を出力する。しかしながら、極端に短い期間にのみ出現する語句は、偶然に出現したあまり重要ではない（カテゴリへの関連が薄い）語句である可能性も高いため、例えば（式（４））のＬｉｆｅ（Ｃ，ｗ）のように、全期間ＰをカテゴリＣでの語句ｗの出現期間Ｌ（Ｃ，ｗ）で割った値の対数値に出現期間Ｌ（Ｃ，ｗ）の対数値を掛けた値を寿命要素として用いるとよい。

The lifetime element calculation unit 143 considers that a word that continues to appear for a long period of time is not a new word based on the period in which the word appears, that is, has low timeliness, Output elements that emphasize impact. However, since a phrase that appears only in an extremely short period of time is likely to be a less important phrase that appears by chance (less relevant to a category), for example, Life (C, The lifetime obtained by multiplying the logarithmic value of the value obtained by dividing the entire period P by the appearance period L (C, w) of the phrase w in the category C by the logarithmic value of the appearance period L (C, w) as in w) Use as an element.

式（４）は図９のような曲線を描くため、出現期間が１であれば寿命要素が０となり、出現期間が長い場合にも寿命要素が小さくなり、出現期間が短い語句の評価を高める目的を満たした要素となる。

Since Expression (4) draws a curve as shown in FIG. 9, if the appearance period is 1, the life element is 0, and even when the appearance period is long, the life element is small, and the evaluation of words with a short appearance period is improved. It becomes an element that meets the purpose.

  The appearance document number element calculation unit 144 uses the output of the category-specific appearance document number totalization unit 135 to output an element based on the number of appearance documents of words in the category. A phrase having a larger number of appearing documents is more characteristic of the category. For example, the number of appearing documents by category DF (C, w) is used as it is as the appearing document number element Documents (C, w) (formula (5)).

ところで、例えば「経済」というカテゴリに分類できる文書の多くに出現する語句として「終値」「株価」「前日比」などがあり、これらは「経済」カテゴリに特徴的な語である。しかし、これらの語句は本発明のランキング装置が対象とするタイムリーな語句（新出特徴語）ではなく、「経済」カテゴリ内では常に出現しやすい一般的な語である。そこで、出現文書数要素Documents（Ｃ，ｗ）として、出現文書数があまりにも多い語句の評価を下げるように要因を含めてよい。この１例としては、カテゴリ内の全収集文書数Ｄ（Ｃ）を語句ｗの出現文書数ＤＦ（Ｃ，ｗ）で割った値の対数値に出現文書数のＤＦ（Ｃ，ｗ）の対数値を掛けた値（式（６））があげられる。この場合、図１０のように出現文書数ＤＦ（Ｃ，ｗ）が１の場合に出現文書数要素が０になり、出現文書数が大きな値をとった場合に出現文書数要素が小さくなる。

By the way, for example, words that appear in many documents that can be classified into the category “Economy” include “closing price”, “stock price”, “comparison with the previous day”, and the like, which are characteristic of the “economy” category. However, these words are not timely words (new feature words) targeted by the ranking device of the present invention, but are general words that are always likely to appear in the “economic” category. Therefore, a factor may be included as the appearance document number element Documents (C, w) so as to lower the evaluation of the phrase having too many appearance documents. As an example of this, the logarithm of a value obtained by dividing the total number of collected documents D (C) in a category by the number of appearing documents DF (C, w) of the phrase w is a pair of the number of appearing documents DF (C, w). A value multiplied by a numerical value (formula (6)) is given. In this case, as shown in FIG. 10, when the number of appearing documents DF (C, w) is 1, the appearing document number element becomes 0, and when the appearing document number takes a large value, the appearing document number element becomes smaller.

ステップ３０５）これを、全カテゴリの全語句について終了するまで繰り返す。

Step 305) Repeat this until all words in all categories are finished.

  Step 306) The category relevance calculation unit 145 multiplies the output results of the output element calculation units of the appearance category number element calculation unit 141, the appearance amount element calculation unit 142, the life element calculation unit 143, and the appearance document number element calculation unit 144. Then, the category relevance is calculated (formula (7)), and a list in which words are sorted by category according to the category relevance is output as relevance ranking data as shown in FIG. “Category 1” is a ranking example of the category of “politics”, and the phrase “Government Koizumi” and the category relevance Relation (“politics”, “Governor Koizumi”) = 17.368 are output at the top of the rank. Has been.

なお、上記の出現カテゴリ数集計部１３２、カテゴリ別時間傾斜出現量集計部１３３、出現期間集計部１３４、カテゴリ別出現文書数集計部１３５、ならびに、出現カテゴリ数要素算出部１４１、出現量要素算出部１４２、寿命要素算出部１４３、出現文書数要素算出部１４４は、本実施の形態で説明した以外にも、対象とするカテゴリの特性や収集文書の量などに応じて集計方法、ならびに算出方法を変えるのがよい。

It should be noted that the above-described appearance category number totaling unit 132, category-specific time gradient appearance amount totaling unit 133, appearance period totaling unit 134, category-specific appearance document number totaling unit 135, appearance category number element calculating unit 141, appearance amount element calculating In addition to the description in the present embodiment, the unit 142, the lifetime element calculation unit 143, and the appearance document number element calculation unit 144 are not limited to those described in the present embodiment, but are calculated according to the characteristics of the target category, the amount of collected documents, and the like. It is good to change.

  Each component of the category-specific new feature word ranking device is constructed as a program and distributed via a network, or installed in a computer used as a category-specific new feature word ranking device, CPU, etc. It may be executed by the control means.

  The constructed program can also be stored in a computer-readable storage medium such as a hard disk, a flexible disk, or a CD-ROM connected to a computer used as a category-specific new feature word ranking device. .

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made within the scope of the claims.

  The present invention is applicable to a technique for extracting a word / phrase indicating an event from a document such as newly arrived information.

It is a figure for demonstrating the principle of this invention. It is a principle block diagram of this invention. It is a block diagram of the new feature word ranking apparatus classified by category in one embodiment of this invention. It is an example of data of the collection document database in one embodiment of this invention. It is a flowchart showing the flow of the new feature word ranking method according to category in one embodiment of the present invention. It is an example of the weight based on the document creation time in one embodiment of this invention. It is an example of the phrase appearance period in one embodiment of this invention. It is an example of the appearance category number element in one embodiment of this invention. It is a figure which shows the lifetime element in one embodiment of this invention. It is a figure which shows the appearance document number element in one embodiment of this invention. It is an example of the category relevance ranking database in one embodiment of the present invention.

Explanation of symbols

11 New feature word ranking device by category 12 Collected document database 13 Phrase totalization means, phrase totalization section 14 Category relevance evaluation means, category relevance evaluation section 15 Relevance ranking database 131 Morphological analysis section 132 Appearance category number totalization section 133 Category Separate time slope appearance amount totaling unit 134 Appearance period totaling unit 135 Category-specific appearance document number totaling unit 141 Appearance category number element calculation unit 142 Appearance amount element calculation unit 143 Lifetime element calculation unit 144 Appearance document number element calculation unit 145 Category relevance calculation Part

Claims (13)

In the category-specific new feature word ranking method for ranking new feature words by category,
When a document with creation time information classified into a plurality of categories is input from the database, the word totaling unit analyzes the document and totals the words that appear in the document and the word-related information related to the word An aggregation step;
The category relevance evaluation means comprises a category relevance evaluation step for calculating the relevance to the category in which the word appears using the word accompanying information of the word, and for each word.
The phrase aggregation step includes:
Category-specific time obtained by adding the number of occurrence categories of the word as the word-accompanying information and the number of appearances of the word in the document to all the documents in the category while applying a greater weight to a document with a newer creation time Record the amount of slant appearance in the storage means,
The category relevance evaluation step includes:
By calculating a category relevance composed of an appearance category number element determined based on the number of appearance categories of a word and an appearance amount element determined based on the time-gradient appearance amount by category, A category-specific new feature word ranking method characterized by creating a category-specific ranking. In the phrase aggregation step,
In addition to the number of appearance categories of the phrase and the time gradient appearance amount by category as the phrase accompanying information, the phrase appearance period based on the creation time of the document in which the phrase appears is recorded in the storage unit,
In the category relevance evaluation step,
2. The new category-specific ranking according to claim 1, wherein a category-related ranking is created by calculating a category relevance composed of a lifetime element based on the word appearance period in addition to the appearance category number element and the appearance amount element. Outgoing feature word ranking method. In the phrase aggregation step,
In addition to the number of appearance categories of the word and the time-gradient appearance amount of each category as the word-accompanying information, record the number of word-by-category appearance documents representing the number of documents in which the word appears in each category in the storage unit,
In the category relevance evaluation step,
2. The ranking of words by category is performed by calculating a category relevance composed of appearance document number elements based on the number of appearance words of each category in addition to the appearance category number element and the appearance amount element. Category feature word ranking method. In the phrase aggregation step,
In addition to the number of appearance categories and the time-gradient appearance amount of each word as the word-accompanying information, the word appearance period based on the creation time of the document in which the word appears, and the number of documents in which the word appears in each category The category-specific phrase occurrence document number to be recorded in the storage means,
In the category relevance evaluation step,
In addition to the appearance category number element and the appearance amount element, calculating a category relevance composed of a lifetime element based on the word appearance period and an appearance document number element based on the number of word appearance documents by category, The category-specific feature word ranking method according to claim 1, wherein ranking by category is performed. A category-specific new feature word ranking device for ranking new feature words by category,
When a document with creation time information classified into a plurality of categories is input from the database, the document is analyzed, and a phrase totaling unit that totals the phrases that appear in the document and the phrase-accompanying information related to the phrases;
Category relevance evaluation means for calculating the relevance to the category in which the word appears, using the word accompanying information of the word;
The word aggregation means is:
Category-specific time obtained by adding the number of occurrence categories of the word as the word-accompanying information and the number of appearances of the word in the document to all the documents in the category while applying a greater weight to a document with a newer creation time Means for recording the slope appearance amount in the storage means;
The category relevance evaluation means includes:
By calculating a category relevance composed of an appearance category number element determined based on the number of appearance categories of a word and an appearance amount element determined based on the time-gradient appearance amount by category, A category-specific new feature word ranking device, characterized by comprising means for creating a category-specific ranking. The word aggregation means is:
Means for recording, in the storage means, a word appearance period based on the creation time of a document in which the word appears, in addition to the number of appearance categories of the word and the time gradient appearance amount by category as the word accompanying information,
The category relevance evaluation means includes:
6. The means according to claim 5, further comprising means for creating a category ranking of words by calculating a category relevance composed of life elements based on the word appearance period in addition to the appearance category number element and the appearance amount element. New feature word ranking device by category. The word aggregation means is:
Means for recording, in the storage means, the number of appearance words of each phrase representing the number of documents in which the word appears in each category in addition to the number of appearance categories of the word and the time gradient appearance amount of each category as the word accompanying information Including
The category relevance evaluation means includes:
A means for ranking the phrases by category by calculating a category relevance composed of the appearance document number elements based on the number of appearance words of each category in addition to the appearance category number element and the appearance amount element; Item-specific feature word ranking device according to Item 5. The word aggregation means is:
In addition to the number of appearance categories and the time-gradient appearance amount of each word as the word-accompanying information, the word appearance period based on the creation time of the document in which the word appears, and the number of documents in which the word appears in each category Means for recording the category-specific phrase occurrence document number to be represented in the storage means,
The category relevance evaluation means includes:
In addition to the appearance category number element and the appearance amount element, calculating a category relevance composed of a lifetime element based on the word appearance period and an appearance document number element based on the number of word appearance documents by category, The category characteristic word ranking apparatus according to claim 5, further comprising means for performing category ranking. A category-specific new feature word ranking program for ranking new feature words by category,
Computer
When a document with creation time information classified into a plurality of categories is input from the database, the document is analyzed, and a phrase totaling unit that totals the phrases that appear in the document and the phrase-accompanying information related to the phrases;
A category relevance evaluation means is a program that uses the phrase accompanying information of a word and functions as a category relevance evaluation means for calculating the relevance to a category in which the word appears for each word,
The word aggregation means is:
Category-specific time obtained by adding the number of occurrence categories of the word as the word-accompanying information and the number of appearances of the word in the document to all the documents in the category while applying a greater weight to a document with a newer creation time Record the amount of slant appearance in the storage means,
The category relevance evaluation means includes:
By calculating a category relevance composed of an appearance category number element determined based on the number of appearance categories of a word and an appearance amount element determined based on the time-gradient appearance amount by category, A category-specific new feature word ranking program characterized by creating category rankings. In the word counting means,
In addition to the number of appearance categories of the phrase and the time gradient appearance amount by category as the phrase accompanying information, the phrase appearance period based on the creation time of the document in which the phrase appears is recorded in the storage unit,
In the category relevance evaluation means,
The category-specific ranking according to claim 9, wherein a category-related ranking is created by calculating a category relevance composed of a lifetime element based on the word appearance period in addition to the appearance category number element and the appearance amount element. Outgoing feature word ranking program. In the word counting means,
In addition to the number of appearance categories of the word and the time-gradient appearance amount of each category as the word-accompanying information, record the number of word-by-category appearance documents representing the number of documents in which the word appears in each category in the storage unit,
In the category relevance evaluation means,
10. The ranking of words according to category is performed by calculating a category relevance composed of appearance document number elements based on the number of appearance words of each category in addition to the appearance category number element and the appearance amount element. Category-specific feature word ranking program. In the word counting means,
In addition to the number of appearance categories and the time-gradient appearance amount of each word as the word-accompanying information, the word appearance period based on the creation time of the document in which the word appears, and the number of documents in which the word appears in each category A category-specific word appearance document number to be recorded in the storage means,
In the category relevance evaluation means,
In addition to the appearance category number element and the appearance amount element, calculating a category relevance composed of a lifetime element based on the word appearance period and an appearance document number element based on the number of word appearance documents by category, The category-specific feature word ranking program according to claim 9, wherein ranking by category is performed. A computer-readable storage medium storing a category-specific new feature word ranking program for ranking new feature words by category,
A computer-readable storage medium recording a category-specific new feature word ranking program, wherein the program according to at least one of claims 9 to 12 is recorded.

Images