JPH0765006A - Description system for natural language processing vocabulary dictionary - Google Patents

Abstract

PURPOSE:To compress the quantity of stored data compared with an ordinary vocabulary dictionary and also to facilitate the construction, the maintenance, the separating and shifting jobs, etc., by applying a description system for computer processing vocabulary dictionary which keeps the relationship between a basic vocabulary and its extension vocabulary. CONSTITUTION:A semantically basic vocabulary of a verb is equal to a sum word that shows a basic action. When the basic word is decided, other words are automatically defined as the extension vocabularies. The relationship is set up between the basic vocabulary and the extension vocabulary based on the semantic resemblance. The vocabulary items described in IPAL are used as the vocabulary items to be described. In the IPAL, a Japanese verb 'MANABU (to learn)', for example, has three types of meaning. In this connection, the meaning of words are set for each sentence pattern of vocabulary items. Then an index is given to each vocabulary. In regard of 'GAKUSHU SURU (to learn)', for example, the meaning of words '1' and '2' of 'MANABU' are succeeded. Therefore the index of each meaning of words is stored in a vocabulary pointer storing part 2 of an extension vocabulary storing part 4.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a description system of a vocabulary dictionary which is indispensable for a natural language processing system such as syntactic analysis and semantic analysis.

[0002]

2. Description of the Related Art A conventional vocabulary dictionary description method is a flat dictionary description method in which vocabulary information is described for each vocabulary. Moreover, even in a thesaurus dictionary having a hierarchical structure, only the upper and lower levels are defined in terms of semantic relationships, and not the grammatical and syntactic relationships of each vocabulary, but the thesaurus. Only the information is layered.

[0003]

In the flat dictionary description method in which vocabulary information is described, which is a conventional vocabulary dictionary description method, each word or vocabulary item must be described one by one. Therefore, the description work is very complicated,
Furthermore, the maintenance and correction work after the description of the vocabulary dictionary must be performed for each word, which is also troublesome. In addition, since each word is described one by one, the size of the dictionary also becomes large.

The present invention has been made in view of the problems of the above-described conventional techniques, and can reduce the amount of stored data as compared with a normal vocabulary dictionary, and can build, maintain, and maintain the dictionary.
It is an object of the present invention to realize a natural language processing vocabulary dictionary description method that can make field transition work very easy.

[0005]

The natural language processing vocabulary dictionary description method of the present invention is based on a basic vocabulary which is a set of basic words, and a meaning or a meaning for each of the basic words. , A syntactical, grammatical, or superficially similar set of words, and an extended vocabulary, which is a description method of a natural language processing vocabulary dictionary, in which basic vocabulary information for each word is provided. The basic vocabulary storage means for storing the vocabulary pointer storage means for describing the vocabulary pointer for the vocabulary information of each meaning of each word of the extended vocabulary among the vocabulary information stored in the basic vocabulary storage means, and the vocabulary pointer storage means Difference information storage means in which only the different vocabulary items of the expanded vocabulary information that are different from the extended vocabulary information are described as difference information.

[0006]

In the system according to the present invention, for each word or vocabulary item, the basic vocabulary and the basic vocabulary are semantically or
A two-level dictionary composed of syntactically, grammatically, or superficially similar extended vocabularies is described.

The description of the extended vocabulary is a description of a two-level natural language processing vocabulary dictionary consisting of a vocabulary pointer indicating vocabulary information similar to the extended vocabulary and difference information including vocabulary items different from the extended vocabulary of the vocabulary information. The format is used.

Therefore, when the vocabulary dictionary is constructed, maintained, and edited, only the above-mentioned difference information is edited for the expanded vocabulary, which occupies most of the vocabulary. The size can also be very small.

[0009]

Embodiments of the present invention will now be described with reference to the drawings.

FIG. 1 is a structural conceptual view of an embodiment of a natural language processing vocabulary dictionary editing apparatus according to the present invention.

1 is a basic vocabulary storage unit for storing vocabulary information of the basic vocabulary, 2 is a vocabulary pointer storage unit for storing a pointer to the basic vocabulary, 3 is the content of the vocabulary item of the basic vocabulary indicated by the vocabulary pointer, and the basic It is a difference information storage unit that describes the difference between the contents of the vocabulary items that the words of the extended vocabulary corresponding to the vocabulary should have, and the vocabulary pointer storage unit 2 and the difference information storage unit 3 are combined to form an extended vocabulary storage unit 4. It

In FIG. 1, solid arrows indicate the flow of input from the user through the input device (not shown), and dotted arrows indicate the output on the system side with respect to the user input through the output device (not shown).

Description will be made using a specific vocabulary dictionary description example.

Here, what relationship is used as the relationship between the basic vocabulary and the extended vocabulary must be set according to the purpose of the vocabulary dictionary. That is, if the vocabulary dictionary describes the semantic information handled by the thesaurus, it is optimal to describe the semantic relationship between the basic vocabulary and the extended vocabulary. Also, if the purpose is to describe syntactic case information (for example, the verb "gaku" takes items such as "who" and "what" in a sentence), then, of course, It is necessary to look at the relationship between the basic vocabulary and the extended vocabulary in the syntactic relationship.

By way of example, consider the example of describing a vocabulary dictionary of verbs in terms of semantic relationships. In a verb, what is a basic vocabulary semantically is a Japanese word that represents a basic action. As a vocabulary dictionary in which such words are collected, there is a Japanese basic verb dictionary for computer processing IPAL (Basic Verbs) of Information-technology Promotion Agency (IPA). This is a lexical dictionary that describes semantically important, basic, and frequently used Japanese verbs and describes each vocabulary item. About 8 can be used as a basic vocabulary for IPAL
There are 00 verbs and 1700 meanings. Think of this as a basic verb.

When the basic vocabulary is determined, the other words are automatically expanded vocabularies. The expanded vocabulary is about 20,000 words for all Japanese verbs. In other words, with respect to the meaning of 1700, the relationship is described for all the meanings of 20,000 verbs. Inagaki et al. (Inagaki., "Construction and problem of large-scale case dictionary using IPAL basic verb dictionary", IPAL symposium) and I
In PA (Nita et al., "Japanese Processing Research for Software Documents 9", Information Processing Promotion Agency), it is generally said that there are 1.7 meanings per word, so about 34,000 It is necessary to have a proper relationship with the meaning of the word.

Here, as the relation between the basic vocabulary and the extended vocabulary, "semantic similarity" is used for the relation. As for the vocabulary items to be described, the vocabulary items described in IPAL will be used. A typical vocabulary item used in IPAL is shown in FIG. 2, and its semantic features are shown in FIG. “Semantic similarity” is a set of words that are similar to “learn” as behaviors such as “learn” and “study”. Of course, in the case of "learning", there are many meanings, so you have to select the proper meaning for each.

In IPAL, "learn" has three meanings as shown in FIG. Here, the word sense is set for each sentence pattern of the vocabulary item. Then, an index is given to each vocabulary. For each word meaning of the basic vocabulary, an index having a similar meaning is described in the extended vocabulary. For example, in the case of “learn”, the meanings of 1 and 2 of “learn” are inherited, so that the index of each meaning is stored in the vocabulary pointer storage unit 2 of the expanded vocabulary storage unit 4. Similarly, if “study”, only the word sense 2 of “learn” is inherited, and the index of the word sense is stored in the vocabulary pointer storage unit 2. In the difference information storage unit 3, the difference in each vocabulary item is described with respect to the inherited basic vocabulary represented in the vocabulary pointer storage unit.

FIG. 5 is a diagram showing a storage example as described above. In FIG. 5, the difference information to be added to the basic vocabulary is represented by + (...) In the difference information, the basic vocabulary is added. The information to be deleted is indicated by-(...). For example, the difference information of "learning" that inherits the meaning 1 of "learning" must be two vocabulary items: temporal (leuform)-(future) + (present) temporal (other)-(techle) I understand. Here, the time phase (leu) indicates that the basic vocabulary is (future), while the extended vocabulary is (current). Similarly, in the temporal phase (others), in the basic vocabulary, (Tecule) could be used, but in this extended vocabulary,
Indicates that it cannot be used.

For other vocabulary items, it is sufficient to directly use the information of the meaning 1 of "learn" which is the basic vocabulary.

By using such a vocabulary description method, when constructing a similar vocabulary dictionary, the number of man-hours required for constructing the vocabulary dictionary can be reduced. In a normal vocabulary dictionary, you have to describe all meanings for all words,
When the vocabulary dictionary description method of the present invention is used, all vocabulary items are described for the basic vocabulary, but for the extended vocabulary occupying most of the vocabulary, the link of the relationship with the basic vocabulary and its inheritance are inherited. Only the difference from the vocabulary item of the basic vocabulary needs to be described, and the man-hour can be greatly reduced.

Further, in the maintenance of the vocabulary dictionary, it is possible to easily correct the basic vocabulary portion, even the inherited extended vocabulary, or independently. Also,
To change the vocabulary system when the field of the vocabulary dictionary is changed, which is a problem of the vocabulary dictionary in natural language processing, describe the change pattern of the vocabulary system for each vocabulary item and describe the pattern for the basic vocabulary. By applying, all the vocabulary items of the extended vocabulary can be transferred to the field at the same time.

As described above, by using the computer-processed vocabulary dictionary description method in which the information of the basic vocabulary is inherited to the extended vocabulary having a certain relationship with the basic vocabulary, a dictionary is constructed more than a normal vocabulary dictionary. It is possible to make maintenance, field transition work, etc. very easy.

[0024]

As described above, by using the computer-processed vocabulary dictionary description method in which an extended vocabulary having a relationship with the basic vocabulary is inherited, the amount of stored data can be reduced as compared with a normal vocabulary dictionary. It is possible to make the construction of dictionary, maintenance, and field transfer work very easy.

[Brief description of drawings]

FIG. 1 is a diagram showing an outline of a description method of a natural language processing vocabulary dictionary.

FIG. 2 is a vocabulary item example of a vocabulary dictionary used in natural language processing and the like.

FIG. 3 is a diagram showing an example of a thesaurus structure of semantic features used in natural language processing and the like.

FIG. 4 is a description example of a natural language processing vocabulary dictionary.

FIG. 5 is a diagram showing a storage example of a vocabulary pointer and difference information.

[Explanation of symbols]

 1 basic vocabulary storage unit 2 vocabulary pointer storage unit 3 difference information storage unit 4 extended vocabulary storage unit

Claims (1)

[Claims] 1. A basic vocabulary, which is a set of basic words, and, for each of the basic words, meaning or
A description method of a natural language processing vocabulary dictionary that is composed of an extended vocabulary that is a set of words that are syntactically, grammatically, or superficially similar, and stores vocabulary information for each meaning of basic words. A basic vocabulary storage unit, a vocabulary pointer storage unit in which a vocabulary pointer for the vocabulary information of each meaning of each word of the extended vocabulary among the vocabulary information stored in the basic vocabulary storage unit is described, and a vocabulary pointer A method for describing a vocabulary dictionary for natural language processing, comprising: a difference information storage unit in which vocabulary items of only different parts of vocabulary information with respect to an extended vocabulary are described as difference information.