JPH04191959A - Paragraph segmenting device - Google Patents

Abstract

PURPOSE:To simplify a device and to speed up a processing by successively storing character type decision result and storing a sentence while inserting the paragraph segmentation position information in a read sentence based on the changed point of stored character type and punctuations. CONSTITUTION:When a unit of segmentation processing, for example, a sentence is segmented from a sentence stored in a sentence storage means 1, the type of character for each character constituting the sentence is decided by a character type decision means 4, and the decision result is successively stored in a decision result storage means 5. Then a paragraph segmentation position insertion means 6 inserts information indicating the paragraph segmentation position at the changing point, for example, from KANA(Japanese syllabary) to KANJI (Chinese character) against the decided character type string, and the paragraph segmentation position information stores the inserted sentence in a storage means 7 to output the result to an output means 8. Thus, the constitution of the device is simplified since a dictionary is not used, and the paragraph segmentation processing and keyword retrieval processing are speeded up.

Description

DETAILED DESCRIPTION OF THE INVENTION (a) Industrial Application Field The present invention relates to a phrase segmentation device, and more specifically, it is suitable for language processing devices such as word processors, translation devices, proofreading devices, devices using databases, etc. This invention relates to a phrase extraction device.

(b) Conventional technology In order to extract phrases from a converted Japanese document in which phrase separation information has not been inserted, for example, for translation or proofreading, it is necessary to use independent word dictionaries, attached word dictionaries, affix dictionaries, etc. The phrases were extracted by referring to dictionaries, tables showing the connections between these elements, grammar tables, and other tables.

(c) Problems to be solved by the invention In the conventional phrase extraction device that uses dictionaries and tables, (1) a large amount of storage device is required to store the dictionaries and tables; Become. (2
) The phrase extraction process takes a long time to perform a dictionary search or table search.

(3) There were problems such as a complicated control program for segmentation.

The present invention has been made in consideration of the above-mentioned circumstances, and provides a phrase cutting device that can solve the above-mentioned problems.

(d) Means for Solving the Problems FIG. 1 is a block diagram showing the basic configuration of the present invention. In the figure, the present invention includes a sentence storage means 1 for storing sentences, an instruction means 2 for instructing to read a desired sentence from the sentence storage means 1, and a command means 2 for reading the instructed sentence from the sentence meaning storage means 1. A reading means 3, a character type discriminating means 4 that discriminates the character type of each read sentence, such as kanji, hiragana, katakana, etc., as well as a period, and a discrimination result that sequentially accumulates the discrimination results by the character type discriminating means 4. an accumulating means 5; a cutting-out position inserting means 6 for inserting segment cut-out position information into a sentence in reading based on the transition points and punctuation points of character types accumulated in the discrimination result accumulating means 5; This phrase extraction device is composed of a storage means 7 for storing the extracted sentence, and an output means 8 for outputting the ε sentence into which the extraction position information is inserted.

The phrase extraction device of the present invention can be applied to word processors, translation devices, proofreading devices, devices that use databases, etc. Furthermore, since phrase extraction processing is required in devices that output sentences as audio, the phrase extraction device of the present invention is applicable to word processors, translation devices, proofreading devices, devices that use databases, etc. Can be applied.

(e) Operation According to the present invention, when a unit of extraction processing, for example, one sentence, is extracted from the sentences stored in the sentence storage means l, the character type of each character constituting the sentence is determined by the character type determination means 4. The determination results are sequentially stored in the determination result storage means 5. Next, the cut-out position insertion means 6 inserts information representing the cut-out position of the phrase at the transition from kana to kanji, for example, to the determined character type string, and stores the sentence into which the cut-out position information has been inserted into the storage means 7. It acts to store the results and output them to the output means 8.

(F) EXAMPLES The present invention will be described in detail below based on examples shown in the figures. Note that this invention is not limited by this.

FIG. 2 is a block diagram showing a first embodiment in which the present invention is applied to a word processor. In the figure, 9 is the main body of the word processor. lO is a text storage device as a text storage means, and an external platform device such as flow t
It can be configured from a PC disk, a hard disk, an internal storage device such as a RAM, or another storage device such as a database, in which Japanese documents consisting of sentences mixed with kana and kanji are stored.

11 is a keyboard as an instruction means, text editing,
Character input key 1 for proofreading etc. It is equipped with various instruction keys, etc., and is used to input sentences and input instructions for reading a desired sentence from the sentence storage device 10.

Reference numeral 12 denotes a reading device which works together with the CPU 13, and reads out a sentence instructed by the keyboard 11 from the text storage device 10. 14 is a character type discrimination device that cooperates with CPU13,
Regarding the sentences read out from the sentence storage device 10, character types such as kanji, hiragana, katakana, etc. are determined for each character, and punctuation marks are determined. Reference numeral 15 denotes a result storage device as a discrimination result storage means and storage means, which is composed of a RAM, and sequentially stores the discrimination results by the character type discriminator I4, and inserts cutout position information by a cutout position insertion device to be described later. Memorize sentences. The cutout position insertion device 16 cooperates with the CPU 13, and the result storage device 15
Based on the transition points and punctuation points of the character types stored in , the segment cutout position information is inserted into the reading 73 sentence. Reference numeral 17 denotes a display device as an output means connected to the CPU 13 via the output control unit 18, and is composed of a dot matrix type display device such as a CRT or LCD, and displays sentences in which cutout position information has been inserted. .

In such a configuration, the clause extraction process according to the first embodiment will be explained using the example sentence "Create a patent to be submitted to the Japan Patent Office using a word processor and file it electronically" according to the flowchart shown in FIG.

FIG. 3 shows a state in which, for example, one sentence is cut out from the text storage device 10 in which text files, other databases, etc. are stored, in accordance with the unit of processing, and stored in the result storage device 15. In this way, when a desired sentence is read out from the sentence storage device 10 in accordance with the processing unit, such as one sentence, one paragraph, one chapter, etc. (step 30), the character types that make up the sentence are read out. The code is determined (step 3
1).

Specifically, each character in the read sentence is assigned a unique character code such as the JES code, so by comparing that character code with each condition in the code discrimination table shown in Figure 4, , determine the character type. In the conditions, CC is the character to be distinguished, &l and bl represent the beginning and end of the kanji code, a2 and b2 represent the beginning and end of the hiragana code, and a3 and b3 represent the beginning and end of the katakana code. A4 represents a period.

FIG. 5 shows the results of determining the character type of the example sentences. Here,"
``boku'', ``hi'', ``chiri'', and ``ku'' are respectively kanji codes,
This symbol indicates a Hiragana code, Katakana code, or period code. This determination result is stored in the result storage device 15.
(step 32).

Next, by referring to the contents of the accumulated character type codes and the determination points in the extraction determination table shown in FIG. 6, the extraction position of the clause is determined (step 33). That is, (1) a keyword break (a clause break) is inserted at the transition point from hiragana to kanji. (2) Add a keyword break at the transition point from hiragana to katakana. (3
) Insert a keyword break after the period.

Next, a cutting symbol, for example "/", is inserted at the break of the clause according to the processing of the cutting discrimination table, and the result is stored in the result storage device 15 (step 34).

The sentence into which the cutout symbol has been inserted is then displayed on the screen of the display device t7. FIG. 7 shows the results obtained by the phrase extraction process described above.

Next, if the end condition is n or o, that is, if there is a sentence to be segmented next, the next sentence is read out from the sentence storage device 10, and control is performed so that the storage positions do not overlap. (Step 35).

If YES in step 35, that is, there are no more targets to be cut out, the necessary information is stored in the result storage device 15, and the process ends (step 36).

Next, as a second embodiment, a configuration for cutting out phrases using the result of converting character types into digital values will be described with reference to FIG. Note that the same components as in FIG. 1 are designated by the same reference numerals, and the description thereof will be omitted. In the same figure, 40 is C
This is a character type digitization device that works together with the PU 13, and assigns a first code, specifically "H", to kanji and katakana as a result of character type discrimination by the character type discrimination device 14, and hiragana and katakana. A second code, specifically "L", is attached to the period and the period, thereby converting the character type discrimination result into one of two types of codes: "H" or "L".

The result storage device 41 stores symbol strings of codes “H” and “L” which are the character type discrimination results.The cutout position insertion device 4
2 inserts segment segmentation position information into the read sentence based on the transition points of codes "H" and "L".

In such a configuration, the phrase extraction process according to the second embodiment will be explained using the same example sentences as in the first embodiment and with reference to the flowchart of FIG. 13.

When a desired sentence is read out from the text storage device 10 according to the processing unit, such as one sentence, one paragraph, or one chapter (step 50), the character type code is determined (step 51). Each character in the read sentence is assigned a unique character code such as a JIS code, and the character type is determined by comparing that character code with each condition in the code discrimination table shown in Figure 4. is determined. The determined f-character type code is stored in the result storage device 41 (step 52).
), digitization is performed (step 53).

FIG. 10 shows a code digitization table that is referenced to digitize the determined output code. That is, if the character type is determined to be a kanji, it is converted to "H", if it is determined to be hiragana, it is converted to "L", and similarly, katakana is converted to "Ho" and phrase is converted to ``''L°. The sentence is digitized by comparison with the code digitization table, and the result is stored in the result storage device 4I as a symbol string shown in FIG. In addition, in FIG. 11, for explanation purposes,
The results of character type code discrimination are also shown.

Next, the digitized result is compared with the cutout determination table shown in the 12th [K, and the phrase cutout position is determined (step 54). To determine the cutting position, (1) insert a break in the keyword (phrase) at the transition point between "L" and "H" in the digital output. (2) Identification is made by inserting a keyword break next to a period.

Next, a cutting symbol, for example "/", is inserted based on the cutting position determined by comparison with the cutting discrimination table, and the sentence into which the cutting symbol has been inserted is stored in the result storage device 41 (step 55).

The results obtained by the above processing are the same as the display contents shown in FIG.

Next, if the end condition is no, that is, if there is a sentence that should be segmented next, the next sentence is stored in the sentence storage device 1.
The process of reading from 0 is performed, and control is performed so that the storage positions do not overlap (step 56).

If the answer is yes in step 56, that is, there are no more targets to be cut out, the necessary information is stored in the result storage device 41, and the process ends (step 57).

(g) Effects of the invention According to this invention, (1) when cutting out a phrase,
Since no dictionary is used, the configuration of the device can be simplified.

As a result, the present invention can be applied not only to word processors and office computers, but also to other small devices, specifically electronic notebooks and calculators with program functions. (2) Phrase extraction processing and keyword search processing can be performed at high speed. (3) The control program for segmenting phrases can be simplified.

(4) When cutting out bunsetsu, the disadvantage is that the position of the bunsetsu cannot be determined because Japanese is written solidly, and as a result, it requires a great deal of processing and time to determine where the bunsetsu begins and ends. There is.

According to the second invention, language processing can be performed after determining the bunsetsu position, so processing time can be significantly shortened. (5) Character type discrimination results are converted into 2 parts using a digital circuit.
In this case, the processing becomes faster, the circuit is simplified, and the phrase extraction device can be realized at low cost.

[Brief explanation of the drawing]

FIG. 1 is a block diagram showing the basic configuration of this invention, FIG. 2 is a block diagram showing the configuration of a word processor that is the first embodiment of this invention, and FIG. FIG. 4 is an explanatory diagram showing the contents of the character type discrimination table; FIG. 5 is an explanatory diagram showing the character type discrimination results; FIG. 6 is an explanatory diagram showing the contents of the cutout discrimination table; The figure is an explanatory diagram showing the cutout results, and Figure 8 is the first
FIG. 9 is a block diagram showing the configuration of a word processor according to the second embodiment, FIG. 10 is an explanatory diagram showing the contents of the code digitization table, and the first engineering drawing 12 is an explanatory diagram showing the result of character type discrimination, FIG. 12 is an explanatory diagram showing the contents of the extraction discrimination table, and FIG. 13 is a flow chart showing the phrase extraction process. ■... text storage means, 2... instruction means,
3. Reading means, 4. Character type discrimination means, 5.
. . . Discrimination result accumulating means, 6. . . Cutting position insertion means, 7 . . . Storage means, 8 . . . Output means. Figure 3 Figure 4 Figure 5 Figure 8 Figure 10 Figure 11 Figure 12 Figure 13

Claims (1)

[Scope of Claims] 1. A text storage means for storing sentences; an instruction means for instructing to read a desired sentence from the text storage means; a reading means for reading the instructed sentence from the text storage means; character type discriminating means for discriminating character types such as kanji, hiragana, katakana, etc. character by character for a given sentence, as well as determining a period; a discriminating result accumulating means for sequentially accumulating the discriminating results of the character discriminating means; and discriminating result accumulating means. a cutout position insertion means for inserting clause cutout position information into a read sentence based on the transition points and period points of character types stored in the character type, a storage means for storing the sentence in which the cutout position information has been inserted; A phrase extraction device comprising an output means for outputting a sentence into which information has been inserted. 2. The phrase cutting device according to claim 1, wherein the transition points of the character type are a position where the character type changes from hiragana to kanji and a position where hiragana changes to katakana. 3. The phrase segmentation device according to claim 1 converts kanji and katakana resulting from the character type discrimination into a first code, converts hiragana and full periods into a second code, and thereby converts the character type discrimination result into a binary code. The discrimination result storage means further comprises a means for storing the binarized code, and the cutout position insertion means performs the digitization based on the transition point and period position of the binarized code. A phrase extraction device comprising means for inserting phrase extraction position information into a read sentence.