KR100283023B1 - Standard dictionary editing and file processing method in text dictionary management system - Google Patents

Abstract

The present invention relates to a method of defining a dictionary and a text corpus structure in a text dictionary management system (TDMS), and more particularly, to a method of defining a dictionary structure and a text structure in order to describe various types of electronic dictionary logic structures as efficiently as possible using SDML (A certain format part) should be defined in the form of SGML DTD and must follow the format. The parts related to the remaining contents (the part where the format can be changed) are freely defined by the method defined in SGML, And the text corpus can be stored as simple text, so that the dictionary and the text corpus structure can be defined so that the text corpus can be managed. Thus, it can be used as the standard of the Korean language document as well as the foreign document. Manage, and transform it into new information. A method for defining a dictionary and a text corpus structure.

Description

How to define dictionary and text corpus structure in Text Dictionary Management System (TDMS)

The present invention relates to a method of defining a dictionary and a text corpus structure in a text dictionary management system (TDMS), and more particularly, a dictionary and a text corpus structure are defined using SDML (Standard Dictionary Markup Language) In order to be able to describe various types of electronic dictionary logic structures as effectively as possible, the regular regular structure of the dictionary can be defined in a fixed format and only the parts related to the remaining contents can be freely defined. The text corpus can be stored as simple text And a method of defining a dictionary and a text corpus structure in a text dictionary management system (TDMS) capable of managing text corpus.

In order to effectively manipulate a large amount of document information recorded by a computer, the format of the document must be unified. The unification of these document formats can be classified into the Standard Generalized Markup Language (SGML) It is a tendency to be unified.

<references>

1. Industry Promotion Agency (1993), "Document Description Language SGML," KSC 5913-1993, Korea Standards Association.

2. Bryan, M. (1988), SGML: An Author's Guide to the Standardized Generalized Markup Language, Addison-Wesley.

3. Goldfarb, Charles F. (1990), " The SGML Handbook, " Claredon Press, Oxford.

4. Travis, B. E. and Waldt, D. C. (1995), "The SGML Implementation Guide," Springer-Verlag Berlon Heidelberg, Germany, pp3-20.

SGML is a meta language that defines the syntax of a markup language and can be used to define various document structures. In other words, SGML defines a grammar structure that can define a syntax structure, and DTD (Document Type Definition) defines the syntax structure using it.

FIG. 1 shows a definition of an element declaration part in SGML.

Where mdo indicates the beginning of the markup definition and "<!" Is used. "Element" means to define element element of SGML as keyword. ps means blank, ps + means one or more spaces ps * means no spaces or one or more spaces.

The element type is the name of the element you want to define. The omitted tag minimization indicates whether the start tag and the end tag can be omitted from the currently defined element type. (declared content | content model) means either declared content used in SGML or one of the content models that defines the structure of the document. The "|" mark means to choose one of them. Finally, mdc tells the end of the markup definition that ">" is used.

According to these SGML technical rules, various document formats can be defined as DTDs. For example, the SGML DTD, such as Assay Method 2a, is for marking up example documents such as Assay Method 2b.

In other words, SGML refers to the syntax of a language (DTD) in which a document structure can be defined. A DTD defines the structure of a document according to SGML rules, and a general document is marked up One is a markup document. In general, documents marked up according to the SGML DTD are also referred to as SGML documents.

The text encoding initiative (TEI) proposes several standard forms, such as those in the following references, for documents in various fields that are recorded as text.

<references>

5. Ide, Nancy and Sperberg-McQueen, C. M. (1995), "The TEI: History, Goals, and Future," in Ide, Nancy and Veronis, Jean [20], pp 5-15.

6. Ide, Nancy and Veronis, Jean (1995), editors, "Text Encoding Initiative Background and Context," Kluwer Academic Publishers, Dordrect / Boston / London.

7. Sperberg-McQueen, C. M. and Burnard, Lou (1994), "Guidelines for Electronic Text Encoding and Interchange (TEI P3), Vol.

8. Sperberg-McQueen, C. M. and Burnard, Lou (1995), "The Design of the TEI Encoding Scheme," in Ide, Nancy and Veronis, Jean [20], pp 17-39.

For example, analysis method 3 shows some of the dictionary-related DTDs defined in TEI. This definition can be used for any of the home, sense, form, gramGrp, usg, def, etym, This is a structure that can be repeated over and over again.

However, the standards of the above-mentioned reference documents are in the form of documents, in particular, Western documents only, and the definition of the information necessary for managing this document is based on the method described in the following references

<references>

9. ISO / IEC (1994), "Information technology-Text and office system-Document Style Semantics and Specification Language (DSSSL) -Draft", ISO / IEC DIS 10179.2.

The use of such foreign document-based standards as a standard for Korean documents is problematic. In particular, there is a limit to the management and modification of documents in the form of dictionaries containing integrated information. In the case of TEI, home can be interpreted as a synonym, meaning sense, etc., and used as a tag, but it needs to be precisely defined according to our dictionary. Especially, there are no tags indicating "academic field" or "dialect" appearing in the Korean dictionary, and there is no segmentation of kanji, foreign language, and Korean language in "etymology".

In other words, the structure of the dictionary is defined by TEI, which is generally applicable, but there is no consideration for the Hangul dictionary as described above.

Therefore, it became clear that standardized notation formats are needed to newly build, manage, and modify dictionary-formatted documents into new information.

Kang, Beam-mo (1996), "Using the Structure of Korean Hangeul", Kang, Beam-mo (1996) TEI Scheme in compiling a Korean Dictionary ", ALLC-ACH '96, Bergen, Norway.)

However, since the method of the TEI or the analysis method 4 having the same structure takes too many cases into consideration, it is computationally too complicated to process in the actual text dictionary management system, and the module for parsing the structure and the parsed result There are many difficulties to use.

In more detail, Homing in the next step of the analysis method 4 is used recursively under hom, so that it is possible to repeat the step up to zero in theory. This can technically reduce the complexity of the computation by specifying the limits of the repetition - the processing overhead of the computer to parse and process the contents of each step - but still requires a large amount of computation do. Also, if the TEI document is defined to conform to the DTD defined in TEI, the storage format of the parsing module, which converts each content into a form that can be easily processed by the computer, As described above, when iterative definition is performed, it is necessary to consider the possibility of repeated use. Therefore, it causes a problem of generating an infinite number of tree structures. In order to avoid this, the lower node of the tree has to re-point to the upper node, so that a cycle is actually formed to be a tree other than a tree, and further complicated processing is required to handle this.

In addition, the Hangul dictionary can be analyzed in a structure that is different from the structure of TEI or Kangmo-moo formula as shown in the following reference document, that is, the structure shown in analysis method 5. This is because the dictionary is expressed by being too stereotyped It can not express a variety of forms (intermediate forms, not various forms, which can lead to complexity of implementation, such as iterative structures, as shown in TEI or KM). Therefore, there is a problem in accepting it as a general dictionary DTD.

<references>

10. Byeong-jin Choi, Jae-Sung Lee, Woon-Jae Lee, Ki-Sun Choi (1996), "Logical Structure of General Dictionary for Standardization," Proceedings of 8th Annual Conference on Korean and Korean Information Processing.

11. Byeongjin Choi, Jae-Sung Lee, Woon-Jae Lee, Ki-Sun Choi (1996), "Logical structure of dictionary entry for machine-readable dictionary construction," cognitive science 7-2.

In addition, the existing dictionary structure definition method has no definition as to how the management system displays the representation of each tag. Although it is possible to create a more diverse management system, there is a problem in using it as a standard management system.

In order to solve the above problems, the object of the present invention is to provide a text dictionary management system (TDMS) which can be used as a standard of a Korean language document as well as a foreign document and is adapted to newly construct, manage, ) And a method of defining a text corpus structure.

1 is a diagram showing a definition of an element declaration part in SGML

2A shows an example of an SGML DTD

2B is an exemplary diagram of a document marked up with the SGML DTD of FIG.

FIG. 3 shows some examples of dictionary-related DTDs defined in the TEI

FIG. 4 is a block diagram illustrating some examples of the Hangul dictionary structure proposed by Kang,

FIG. 5 is a block diagram illustrating some examples of the Korean-

Figure 6 is an exemplary diagram of a pre-structure represented in SDML according to the present invention;

FIG. 7 is an example showing the redefinition of the &lt; body &gt; partial structure of FIG. 3

Figure 8 is an exemplary diagram of a text corpus structure represented in SDML according to the present invention.

9 shows the SGML content model definition scheme

According to an aspect of the present invention, there is provided an electronic dictionary logic structure in which various types of electronic dictionary logic structures are defined in a regular, fixed, and fixed form so that they can be described as effectively as possible, And to define a dictionary and a text corpus structure by using SDML which can manage text corpus by allowing text corpus to be stored as simple text.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

First, the SDML used in the structure definition of the dictionary and the text corpus of the present invention defines a certain format part as an SGML DTD type and follows the format, and the part where the format can be changed is freely , But can be defined by the restriction rules of SDML.

The SDML includes a header area including contents such as dictionary name and version, a definition area defining a value that each attribute to be used in the dictionary defines, and contents of a real dictionary, and includes a headword A repeated entry group field of each entry or a text corpus file group field in which the contents of the text corpus file are repeated.

FIG. 6 and the analysis method 8 hierarchically show the dictionary and text corpus structure using the SDML as described above. The standard dictionary term is the highest hierarchical level, and the highest hierarchical level is the head of the standard dictionary. A clause defining a tag attribute that can be used in a custom tag of a standard dictionary and a set term of a dictionary entry or a text corpus file in its lower layer, In the lower hierarchy, a heading term and an explanation term corresponding to the heading term are included.

Hereinafter, terms and names appearing in Analysis Method 6 to Analysis Method 8 will be briefly described with reference to Table 1 below.

tag Features & Roles <Sd> Standard dictionary term <SdHeader> As the heading of the standard dictionary, terms that contain information such as dictionary name and version <SdFront> An element that defines tag attributes that can be used in custom tags in the standard dictionary <Group> A set of dictionary entries or files <Entry> Dictionary entry term <Wname> Heading term in dictionary entry <Body> An entry containing a description of the dictionary entry <Tdmsfile> An entry containing the contents of the file

Generally, in the definition of document structure, when a term or a name is used as a tag, it is distinguished from other data by being enclosed in <>, and the item enclosed by <> indicates the beginning of the item, and the item enclosed with </> .

At this time, the above-mentioned terms and names are actually defined in the DTD as shown in FIG. 7, and can be defined differently according to the intended purpose.

However, in the present invention, the following tags are defined as special tags, and they are used separately from general tags (user definable tags).

That is, <sd> represents the whole of the standard dictionary and indicates that there are <sdHeader>, <sdFront>, and <group> as its components. Also, <entry> indicates that the <wname> and <body> are included as the sub-terms of the <group> term (see FIG. 6).

Likewise, as in FIG. 8, the sub-clause of the <group> may include the term <tdmsfile> instead of the <entry> as a sub-term, meaning that the content of the text corpus file is included in the term .

Therefore, the structure of the dictionary and the text corpus according to the present invention will be described with reference to the items shown in Table 1 below.

The <sdHeader> that represents the header area contains the name and version of the dictionary. The <sdFront> representing the definition area defines a value that each attribute to be used in the dictionary can have, the <group> representing the collection area includes the contents of the actual dictionary, each <entry> Or a repetition of <tdmsfile> containing the contents of a text corpus file.

In the present invention, only the portion related to the content in the structure of the dictionary defined in FIG. 6 can be freely defined. The [standard dictionary element] portion that can be freely defined is an element included in the <body> Field, or may have a complicated tree structure.

For this purpose, the user can define the necessary dictionary structure and change the structure of <body>.

At this time, the <body> is initially defined as follows.

<! ELEMENT body ........ (# PCDATA) *>

Therefore, when changing to a new structure, it overwrites only the element.

For example, as shown in the attached FIG. 7, the <body> structure can be changed to a new structure including <part of speech> and <part of speech>. By redefining such a structure, Can be used by defining the structure and tag.

At this time, the definition of the new structure is generally defined in the same manner as the SGML format, but there are a few rules that should be used in a limited manner in SDML.

Condition 1: The SDML basically expresses the structure of the document in a tree form using the SGML content model definition method of FIG. At this time, the available basic elements are sequence (,), alternation (|), repetition (*), one or more repetition (+) and optional (?). At this time, the free sequence (&) is ignored for determining the dictionary format and is excluded.

Condition 2: It does not allow the recursive structure of tags that can appear in the representation of the document structure.

Condition 3: The name of the tag is used as a field name in the editor (SDE: Standard Dictionary Editor) which edits a document defined by SDML.

Condition 4: When the display information used in the editor is used, it is included in the tag and displayed by using the attribute name and attribute value set by the TDMS. If display information is not specially specified, it is displayed in the editor in a basic display manner.

Here, the display information is information used to display each field on the screen, and indicates the size of a letter, the shape of a letter, and the size or kind of an input window or a display window. The attribute is a property that can be used internally by a dictionary editor, It is used to define things that are a bit inadequate to express.

For example, if the <synonym> tag is displayed on the screen in the dictionary editor, the contents of the <synonym> tag can be underlined and the headword position of the synonym can be written as an attribute of the <synonym> tag.

In addition, the basic display method is to use a one-line unit input window as a default when inserting contents into an element type tag defined by #PCDATA or the like. It may also differ from implementation to implementation, but it defaults to the default value that is initially specified in the editor.

Condition 5: If there is an already defined tag, use that tag name as much as possible to make it compatible.

As a result, we have discussed some rules that should be used in a limited manner in SDML. The above condition 5 is for the standardization of tags in effect.

Hereinafter, the management of the text corpus will be described. In the present invention, <entry> is changed to <tdmsfile> among the definitions of the dictionary structure expressed by SDML so that the text corpus can be managed and the text corpus can be stored as simple text And records the related information in the header so as to distinguish the text corpus from the dictionary. The structure of the text corpus expressed in SDML is as shown in Fig.

In the SDML used in the dictionary and text corpus structure definition of the present invention as described above, most of the structural representation format of SGML is used as it is to describe various types of electronic dictionary logical structures as effectively as possible. That is, it uses the definition definition of SGML as it is, and restricts the use of unnecessary functions. Also, in order to maximize the management of the electronic dictionary while maximally reserving the definition of the standard tag which is still uncertain, the regular structure of the dictionary is fixed and it is possible to freely define only the parts related to the remaining contents. In accordance with this principle, management information can also be included in the current SGML tag format and processed. That is, the display information is included in the attribute so that the structure can be freely defined using the tag.

The dictionary and text corpus definition method of the present invention as described above is effective in constructing and managing a document in a dictionary format and transforming it into new information by considering some of the functions and considering the information used in the management system It can be used as a standard language for the standard dictionary.

Claims (4)

In defining the dictionary and text corpus structure in the text dictionary management system, the regular structure (predetermined format part) of the dictionary is defined in the form of SGML DTD, and is formed into a fixed format, and the part related to the remaining contents The present invention relates to a text dictionary management system and a text dictionary management system, and more particularly, to a text dictionary management system and a text dictionary management system, which are capable of freely defining a text dictionary by using a method defined by SGML and storing text corpus as simple text, Definition method. The method according to claim 1, The SDML includes a header area including contents such as a name and a version of a dictionary, a definition area defining a value that each attribute to be used in the dictionary defines, and contents of an actual dictionary, The contents of the repeated entry group region of the entries or the contents of the text corpus file are repeated, and the standard dictionary term is the highest hierarchical level, and the highest hierarchical level is the head of the standard dictionary. A clause defining a tag attribute that can be used in a custom tag of a standard dictionary and a set term of a dictionary entry or a text corpus file in its lower layer, Define the hierarchy to include terms that include entry headings and descriptions associated with dictionary headings How to pre-define and structure of the text in a text dictionary management system as claimed. 3. The method according to claim 2, wherein the user can redefine a protest structure including a description and the like associated with the dictionary entry. 4. The method of claim 3, wherein redefinition of the protest structure including description and the like of the dictionary entry is performed using an ELEMENT structure definition of SGML.

Images