JPS58223870A - Picture editing device - Google Patents

Abstract

PURPOSE:To facilitate an easy editing process, by correcting an address table of a character train in response to an editing process indication for editing processes of the shift, erasion and addition of the character train and deciding an output arrangement between the character train set after editing and an extracted drawing in response to an indication of output arrangement. CONSTITUTION:A memory 1 stores picture signals including a character train. A character train address table memory 4 stores a rectangular address extracted to the character train in the form of a table; and a drawing address table memory 10 stores the addresses of the diagonal two apexes of a rectangle enclosing the drawing in the form of a table. An editing process part 5 corrects a character train address table in response to an editing process indication for editing processes of the shift, erasion and addition of the character train. An output processing part 6 decides an output arrangement between the character train set after editing and an extracted drawing in response to an indication of output arrangement and then reads out picture signals based on the address table. Then an output picture signal is delivered in accordance with a decided output arrangement.

Description

DETAILED DESCRIPTION OF THE INVENTION The present invention relates to a text or text editing device using a processor. In particular, edits such as rearranging, deleting, or adding one character string to binary paintings or multivalued images including text and drawings input from a scanner etc., and edit the edited character strings and drawings in a specified arrangement. Conventional text editing processing involves storing characters as codes, such as in word processors, editing in code units, and generating characters corresponding to the codes using a pattern generator when outputting. How? Nine. On the other hand, there have not been many published methods for editing handwritten documents or printed documents in units of character string images by inputting them using a scanner or the like.

To input the characters of one page of manuscript as a code.

Unlike a Japanese typewriter, which requires keystrokes and is very time consuming, a handwritten document or a single sheet of already printed manuscript can be input from a scanner in a few seconds. Furthermore, what kind of drawings (graphs, table 1 figures, photographs, etc.) can be created using a scanner.

You can easily input things (other than text).

What would be great if we could use a scanner to cut out the text and drawings in documents manually and edit them image by image?

If it can be input as an image signal, such as a handwritten document or a printed document, it is possible to quickly rearrange, delete, or add character strings without having to rewrite them again.

Furthermore, by specifying the output layout of character strings and drawings, it is possible to create documents containing drawings in any format.

The purpose of the present invention is to
Wow. 7, 1 yo 1 □. Our objective is to provide a device that can perform 1.8A and 1.78.

The image editing device of the present invention includes one or more image storage means for storing an image signal including one character string, and a rectangle that surrounds each character string of the image signal stored in the image storage means. A character string address table storage means for storing diagonal 2 characters.

drawing extraction means for extracting addresses of two diagonal vertices of a rectangle surrounding each drawing in the image stored in the image storage means;
A drawing address table storage means for storing this drawing address as a table, and modification of the character string address table (dividing one rectangle, rearranging the table order,
(deletion, addition of other rectangular addresses to the table), determines the output arrangement of edited character strings and extracted drawings according to output arrangement instructions, and outputs the edited text from the image storage means according to the address table. The present invention is characterized by comprising an output processing means for reading an image signal and outputting an output image signal according to the determined output arrangement.

Hereinafter, the present invention will be explained in detail with reference to drawings of an embodiment of the apparatus.

FIG. 1 is a block diagram showing the configuration of an image editing apparatus according to the present invention. A human image signal (al is a 211i or multi-valued image signal that is manually input from a scanner etc. and includes characters and drawings.The original image of this signal is a character string such as a handwritten document or a printed document. The type of image does not matter as long as it is an object, and the size of the image is also arbitrary.

An example of the original image (including character strings and drawings) of the input image signal (at) is shown in Figure 2.

The character strings included in this original image are handwritten, and the size is not constant, and each character is not arranged in the same way that the eye first sees it. The image example shown in FIG. 2 includes a portion to be corrected, and will be used below to explain the procedure as an example of the object of the editing process of the present invention. Signals obtained from the image to be processed as shown in FIG. 2 are stored in the image memo IJ1.

Figure 3 includes character strings and drawings that perform additional processing on *iron in Figure 2 +1! It is lIwei. Such additional images are also input as input image signals (al) and stored in the auxiliary memory 2.

Fi image memory in character string extraction unit 3] and auxiliary memory 2
The image signal (bl) and the image i#! signal (cl) are read out from the image stored in the image signal, and the character string portion is cut out for each block from this image signal, and the cut character string address table (dl The unit of block for cutting out character strings is 9. If the character string is written horizontally, one line is one block, and if it is written vertically, one column is one block. Also, one character or multiple Characters may be cut out as one block.

The size of the characters included in the image signals (b) and (C),
Since the length of a character string in one column or line is not necessarily constant, the size of the block to be cut out is also not constant.

The shape of one block is set to be a rectangle (tanzak shape) in consideration of ease of editing processing, which will be explained later. The size of one book is variable; the width depends on the glossiness of the characters, and the length depends on the size of the characters, one line or one line.
When cutting out strings in a column, it depends on the length of the string.

, tC, and the width and length of the block may be forced to be constant.

There are two methods for cutting out character strings into blocks: a method in which a person instructs each block one by one, and a method in which the characters are cut out automatically. The automatic cutting method is 1. For example, + * image I δ is white.
In the case of a black binary signal, the proportion occupied by black pixels is 1
There is a simple method that cuts out one or more parts, and a more complex method that uses pattern recognition to recognize the shape of each character and cut them out.

Input [I! 11g1 When using a method to automatically cut out character strings for signals (a) that include character string parts and parts other than character strings, such as figures, etc., in order to avoid incorrect cutting out, It is preferable to configure the system so that a human can specify the character string area in advance.

'1 In the case of cutting out the character string part from the processing target image and the additional image shown in Figures 2 and 3 using one line of character string as a processing unit, the block frame is shown in Figure 4. and shown in FIG. Further, FIG. 6 shows a character string cut out from the image to be processed according to this frame, and FIG. 7 shows a character string cut out from the additional image. Each character string in Figure 6 has a cutout number, and then numbers [1] to [1]
0]. The cutout process in the character string cutout unit 3 is as follows.

In reality, this involves extracting the upper left address (start address) and lower right address (end address) t of each block in the image memory 1 and the auxiliary memory 2.

FIG. 8 shows an example of the address of the block to be cut out. Start address of character string [1] in image memory 1 (8X
ao, 8Yso) and end address (aXso, FiY
extract ao). Addresses are extracted for each character string in this manner to create a cut-out character string address table (d).

FIG. 9 shows a cutout character string address table for the character strings of the image to be processed in the image memory 1. FIG. 10 shows a cutout character string address table for character strings of additional images in the auxiliary memory 2. The order of the cut-out address table is the same as the numbers [1] to [10] shown in FIG. 6, indicating the cut-out order. The extracted character string address table (dl) created by the character string extraction unit is stored in one character string address table memory 4.

In drawing cutting s9, an image signal (b) and an image signal (
c) and extracts the drawing part from this image block by block and outputs the drawing address table (p). The block unit for cutting out a drawing is one drawing (
A rectangle that surrounds a graph, table 0 figure, photograph, etc.), and the size depends on the size of the drawing and can take any value.

There are two methods for cutting out a drawing block by block: a method in which a person instructs each block one by one, and a method in which the drawing is cut out automatically. For example, when the image is a binary signal of black and white, there is a simple method in which when the area where black pixels are connected exceeds a certain size, that area is used as a drawing. There is a complicated method that uses pattern recognition to draw a region that is not determined to be a character and that contains bear pixels.

11 and 1g1.
Shown in Figure 2. In addition, Figure 1@13 shows a diagram FfU cut out from the image to be processed according to this framework, and Figure 14 shows a diagram cut out 9 times from the additional image. The cutting process in the drawing cutting section 9 involves extracting the upper left address (start address) and the lower right address (end address) of each block in the same way as the character cutting section 3 to create a 9 drawing address table. It is.

FIG. 15 shows an example of the address of the block to be cut out.

Start address of the drawing in image memory 1 (G8X10
0 e G8Yt oo ) and end address x (GEX
Zoo, G]liiY1g□) is extracted. In this way, addresses are extracted for each drawing to create a nine-drawing address table (p).

FIG. 16 shows a drawing address table for drawings of images to be processed in the image memory 1. FIG. 17 shows a drawing address table for drawings of additional images in the auxiliary memory 2. The nine drawing address tables (p) created by the drawing cutting section 9 are stored in the drawing address table memory 10.

The editing processing unit 5 divides each block in the character string address table stored in the one character string address table memory 4 and cuts out the character string address table according to the editing processing instruction (f) from the outside, and rearranges the order of arbitrary parts. Deletion is performed by rewriting the character string address table, and further addition [1IIiI add a character string by inserting my character string address table at any position in the character string address table of processing Ryotsu, and 9 edited characters A column address table is created and written to the character string address table memory 4.

It is assumed that each editing instruction is directly given by a human being, but it is also possible to create a table of instructions for editing instructions in advance so that the editing instructions are automatically given according to the table.

(□・Using this example below, we will explain how to change the order, erase 9 character strings, and add them.

In order to rearrange the order of the two locations 7'C indicated by symbols in the Ryotsu to be processed shown in FIG. 2, it is necessary to divide the character string 31 and character string 350 shown in FIG. 6 as a first process. FIG. 18 shows the results of dividing each character string into new character strings. New ranks [1] to [12] are assigned, including the newly created character strings.

To perform this division process on the string address table,
First, as shown in FIG. 20, blocks of character strings 31 and 35 are divided into two according to the dividing position given by the editing processing instruction, and the start and end addresses of each are determined.

The start and end addresses of this string 31 are 1 (
8X31, 8Y3t), (EX31.EY31))
shall be.

The character string created by dividing this is 41. The start and end addresses of string 42 are ((8X4t・8Y41)・(BX4t, EY4t)
l・1 (8X4g, 8Yiz), (BX4z, EY4z
)1. However, □ (8X31 e SYs,) = (8X+t e 8Y4
1) (BX31*MY3t)=(EX42.j3Y4
z).

Similarly, the start and end addresses 1 (8X43.B) of character strings 43 and 44 created by dividing character string 35 are
Y4g), (EX4a・BY 43) I・((8X+
4,8Ya4)*(EX441Y4 is the month.

On the character string address table, the start and end addresses of character string 31 are deleted, and the start and end addresses of character string 419 and character string 42 after division are inserted in their place. Furthermore, the start and end addresses of character string 35 are erased.

Character string 43. The start and end addresses of string 44 are inserted. As a result, a character string address table as shown in FIG. 21 is created. This completes the creation of the string address table. The above is the division process on the character string address table.

The second process of rearranging the order is to place the character string 33 before the character string 42 and place the character string 44 before the character string 43 as shown in FIG. It is to move it in front of. To perform this process on the character string address table, move the start and end addresses of rank 5 before the start and end addresses of rank 3 in the character string address table after the division process shown in FIG.

Furthermore, the start and end addresses of rank 8 are added to rank 7.
Just move it before the start and end addresses of . The character string address table after this movement process is stored in the 22nd
As shown in the figure. The order replacement process is performed by the first division process and the second movement process described above.

Next, the erasing process will be explained. To erase one location shown in the image to be processed in FIG. 2, the first step is to convert the character string 38 in FIG. 19 to 459 characters in accordance with the editing processing instructions as shown in FIG. Column 46° Character string 470 Divide into three. Figure 23 shows the new order [1] including the character string after division.
] to [14] are attached.

Figure 25 shows the start and end addresses of character string 3B when character string 38 is divided.
3B) 1 is the start and end address 1 of the string 45, 46.47 (8X45eSY45) * (BX4StEYas)
Isl (5X46 w 8Y46) e (BX4
6 t gY4s ) l *IC8Xav*8Yat
)*CBXa□, EY47) Divided into 1. The character string address table after division is shown in FIG. 26. The second process in the deletion process is to delete the 23rd factor character string 46 created by the division process as shown in FIG. This process is performed by deleting the nine start and end addresses specified on the string address table.

The start and end addresses of rank 12 are set to 1' for the character string address table after division in Figure 26.
This is performed by a division process and a second erasing process.

Finally, additional processing will be explained. The process of adding the character string in the additional image shown in FIG. 3 to the processing target image shown in FIG. This is done by inserting into a column. The process of inserting the additional character string 40 cut out from the auxiliary memory 2 shown in FIG. 28 before the character string 47 cut out from the image memory 1 as shown in FIG. 29 according to the 9 editing processing instructions is one character string. On the address table, as shown in Figure 30, the start and end addresses 1 (8X4o, 8Y4o), (HX4o, EY4o) 1 of character string 40
start and end address 1 (8
X47 e 8Y47 ) * (BX4□, EY4y
) is executed by the process of inserting it into the position before 1.

In order to indicate that the start and end addresses of the character string 40 are addresses of the auxiliary memory 2, an addition flag (position 12) is set in the character string address table after the addition process shown in FIG. In the example of addition processing above, the position where the additional string is inserted is between two strings, but when inserting it in the middle of a string, it is the same as the reordering and deletion processing explained earlier. involves division processing.

As explained above, the extracted character string address table (g) is created and sent to the output processing section 6. In the above example of editing processing, the character string address table of the 30th prisoner becomes the edited address table.

Note that the order of order replacement, deletion, and addition processing during editing processing is arbitrary.

The output processing section in Figure 1 includes an edited character string address table (g), a drawing address table (p), and an output arrangement instruction (
An output image signal (n)' is generated according to il. To create a new image by arranging the edited text strings in order and combining them with the cut out drawings, specify the output placement instructions (0 The number of character arrangement areas within one stroke may be one or more. If there are more than one, it is necessary to specify the order of character arrangement between the areas.

FIG. 31 shows an example in which two character placement areas are designated.

The arrangement of character strings is in area 1. This will be done in the order of area 2. Next, the output processing section 6 determines the line spacing at which the character blocks 1j are arranged. The line spacing is automatically determined so that the width of each character string specified in the edited character string address table is within the range, but it may be set constant as shown in Figure 31, or it may be set depending on the width of each character string. Good too. Also, output arrangement instruction 0
) can also be used to specify the line spacing. With the above steps, the frame group in which the string will be placed is determined.

Next, for the edited character string, a character string that particularly requires a line break is designated by the output arrangement instruction (i).

According to the order of the edited string address table.

If you just connect each string in order and place it.

A document with no delimiters is created. Therefore, if you want to output a certain character string in a different row or column than the previous character string, specify a line change in advance.

FIG. 32 shows an example of a character string for which a line break is performed from among the edited character strings used to explain the processing procedure of the present invention. In the output processing section, 43
As shown in Figure 3, a line break flag is set for the character string to be changed according to the output arrangement instruction (i).

Next, according to the output arrangement instruction (i), an output drawing arrangement position is given to each drawing cut out by the drawing cutting section 9. FIG. 34 shows an example of output arrangement positions for drawings 100 and 101 cut out from the image to be processed and additional images. If the start address and end address in the output image printed on drawing 100 are 1 (GP8Xtoo, GPSYloo
).

(GPIi:
. 1. GPEYIOI)). The size of each drawing has already been determined by the drawing address team (-7-”fKietl).
ltL? Ina. Ya, 8-3-o (1) only needs to indicate either the start address or the end address.

After completing the processing related to the above output arrangement instruction (i)K, the arrangement address in the output image of each character string specified in the 9 editing source character string address table is determined and written in the output arrangement table. First, six character strings are applied to the boxes of the output arrangement shown in FIG. 31 according to the order of the character string address table shown in FIG.

Find the start and end addresses in the output image. FIG. 35 shows the process of determining the output address of a character string.

Figure 935 (a) shows the case where the character string 30 is inserted.

The character string 30 is outside the line break specification character, and the length of the character string is within one line of the next output area with a short width of the output area, and the start and end addresses in the output image ((P8X3g, P8Y3( 1) , (PEXs
o 5PEYao ) 1 is easily found.

FIG. 35(b) shows the case where the q-order character IIJ 41 t- is inserted. The character string 41 is a line change specification character string, but since the length of the character string is longer than the width of the output area, it does not fit within one line of the output area. It is necessary to divide the character string 41 at that ζ and divide it into two lines.

When I split this string directly by the width of the output area.

As shown in FIG. 35(b), there is a possibility that one character may be cut off in the middle. Also, if the character string is not a line break specification character string, the character string is inserted from the middle of one line in the output area, so even if the length of one character string is shorter than the width of the output area, one character string must be divided in the middle. There are times when it doesn't happen.

In this way, proper division of strings in output processing is the first step.
This is performed by the character amount separation unit 8 shown in the figure. When the output processing unit 6 determines that division is necessary, the start and end addresses of the character string and the remaining part of the length of one line in the output area to fit the character string are In the case of a long line change specification character string, the length of one line) is sent from the output processing section 6 to the character amount separation section 8 as a separation instruction 01.

The character amount separator 8 specifies the image signal of the specified character string from the 1 image memory ITo or the auxiliary memory 2 according to the start and end addresses of this character string.
)ib or specified image signal (1), monitor the connection of black pixels, etc. to avoid cutting in the middle of the character from the remaining length in one line, divide it appropriately, and set the separation address. It is sent to the output processing section 6.

Further, the character amount separation unit 8 may not read out all the image signals for one character string, but only read out the 1its signal necessary for determining one division position. The output processing unit 6 divides the character string according to separation addresses.

Insert the second half of the character string into the next line KTo 0 Figure 35 (c)
An example of appropriate division of the character string 41 is shown in FIG. String 41 as 1 (8X48 * 8Y48) * (BX4s
*EY4r) String 48 and 1 (8Xns, 8Y4s) with start and end addresses l, (FiX*s*F:Y4s
) string 4 with start and end address equal to 1
Divide into 9, start and end address 1 (P8X4B, P8Y48), (PEX4ssPEY) in the output image
ns) Isl(P8X4sIP8Y49)sCPBXa
9. Pgy4. )1.

While the character string is divided as necessary by the character amount separator 8, the output processor 6 calculates the start and end addresses of each character string in the image memory 1 or auxiliary memory 2, and the start and end addresses in the output image. The end address correspondence table is written into the output arrangement table memory 7 as a character string output arrangement table. 36th
The figure shows character strings after appropriate division as necessary and an output arrangement table for each character string.

Furthermore, the output processing unit 6 generates a correspondence table between the start and end addresses in the image memory 1 or the auxiliary memory 2 of each drawing and the start and end addresses in the output image and outputs the address table (p) in the 9 drawing address table memory. Created from the drawing placement position from instruction (i).

The drawing output arrangement table is written to the output arrangement table 7 (,) as the drawing output arrangement table. The drawing output arrangement table is shown in FIG. Add additional flags for differentiation.

Finally, the output processing unit 6 outputs the specified OH image signal (k) or the specified image signal (1) according to the output arrangement table written from the image memory 1 or the auxiliary memory 2 to the output arrangement table memory 7. Output as (n).

The output format of the output image signal (n) can be changed depending on the subsequent device. For example, in the case of a facsimile, the data can be output sequentially in scanning lines, and in the case of a memory, the data can be output in character string units. Furthermore, for white portions of the output image other than character strings and drawings, the output processing unit 6 generates and outputs a signal corresponding to the blank portion.

FIG. 39 shows an output image created as a result of the character string and drawing editing processing example used in the above explanation. To specify the output layout of a character string, open a white frame of arbitrary length on the left side of one line or on the top of one column. You can also specify that a white frame be inserted in the middle of one row or column.

Furthermore, in the above embodiment, an image including additional character strings and drawings is input to the auxiliary memory 2 as an input image flaw signal (a) separately from the image to be processed. Additional images can be created by connecting a pattern generator or by returning part of the output image signal to the auxiliary memory.As explained above, the present invention can generate image signals such as handwritten documents and printed documents. Character strings and figures that can be input [i[It-
If the document contains documents, you can quickly edit the order, delete, add, etc. by modifying the address table, and by specifying the next character string and the output layout of the drawing, you can edit it in any format without rewriting it. Enables editing and creation of documents.

[Brief explanation of the drawing]

Figure at is a block diagram showing the configuration of an apparatus according to an embodiment of the present invention. FIG. 2 is a diagram showing an example of an image to be processed. FIG. 3 is a diagram showing an example of an additional image. FIG. 4 is a diagram showing an example of a set of blocks for cutting out character strings in an image to be processed 1Iil. FIG. 5 is a diagram showing an example of a six-fold set of character string cutout blocks in the addition image. FIG. 6 is a diagram showing an example of a character string cut out from a psychological target image. FIG. 7 is a diagram showing an example of a character string cut out from an added image. FIG. 8 is a diagram showing an example of the start and end addresses of a letter IJ. FIG. 9 is a diagram showing an example of a cut-out character string address table for an image to be processed. FIG. 10 is a diagram showing an example of a cut-out character string address table for an additional image. FIG. 11 is a diagram illustrating an example of a set of cut-out blocks of a drawing in an image to be processed. FIG. 12 is a diagram showing an example of a frame set of cut-out blocks of a drawing in an additional image. FIG. 13 is a diagram showing an example of a drawing cut out from an image to be processed. Figure 14 shows an example of a drawing taken from an additional library. FIG. 15 is a diagram showing an example of the start and end addresses of the drawing. FIG. 16 is a diagram showing an example of a drawing address table for an image to be processed. FIG. 17 is a diagram showing an example of a drawing address table for additional images. FIG. 18 is a diagram showing an example of character string division due to order permutations. FIG. 19 is a diagram showing an example of character strings after the order has been changed. FIG. 20 is a diagram showing an example of start and end addresses after a character string is divided due to order permutations. FIG. 21 is a diagram showing an example of a character string address table after character strings are divided due to order permutations. FIG. 22 is a diagram showing an example of a character string address table after the order has been changed. Figure 23 shows an example of character string division due to deletion.
Figure. ''Figure 24 is a diagram showing an example of a character string after deletion. Figure 25 is a diagram showing an example of the start and end addresses after division of a character string due to deletion. Figure 26 is a diagram showing an example of a character string after deletion. A diagram showing an example of a character string address table after division. Figure 27 is a diagram showing an example of a character string address table after deletion. Figure 28 is a diagram showing an example of an added character string @ Figure 29 is a diagram after addition A diagram showing an example of a character string. Figure 30 is a diagram showing an example of a character string address table after addition or an edited character string address table. Figure 31 is a diagram showing an example of a character string area and line spacing of an output image. Fig. 32 is a diagram showing an example of a line break specification character string. Fig. 33 is a diagram showing an example of a character string address table with a line break flag. Fig. 34 is a diagram showing an example of the drawing arrangement position in the output image. c1+”1 FIG. 35 is a diagram showing an example of a procedure for determining the arrangement address of a character string in an output image. FIG. 36 is a diagram showing an example of the arrangement of each character string in an output image. FIG. 37 is a diagram showing an example of a character string output arrangement table. FIG. 38 is a diagram showing an example of an output arrangement table for drawings. FIG. 39 is a diagram showing an example of an output image. l... Selfish memory, 2... Auxiliary memory, 3-
・・Character clearing section, 4-・・Address table memory. 5... Editing processing section, 6-... Output processing section, 7.
. . . Output arrangement table memory, 8 . . . Character separation section - 9 . . . Drawing cutout section, io - . . Drawing address table memory. 40 O 2 Zuga 3 B 4th circle O 9 μs O lO 9μs / / En off 2 En o 13 Oka off 5 figure (GEXttyo, (,1:→'/DONO 160 O17 En' 320 En 21st Figure 22 Figure 25 Figure 26 Figure 27 Figure 30 [ ] Figure 31 Figure 33 Mouth 35 Concave (b) (C-)

Claims (1)

[Scope of Claims] Image storage means for storing time-series digital image signals obtained by scanning m space including the flying character U and the drawing; #
character string extraction means for extracting addresses of at least two diagonal vertices of a rectangle surrounding each character string for each character string in the M image signal; character string address table storage means for storing the character string addresses as a table; drawing extraction means for extracting addresses of at least two diagonal vertices of a rectangle surrounding each drawing with respect to the drawings in the image signal stored in the image storage means; and drawing address table storage means for storing the drawing addresses as a table. and. Editing processing means for modifying addresses on the table of the character string address table storage means in accordance with editing processing instructions for moving, deleting, and adding character strings, and editing pull storage in accordance with given output arrangement instructions. A one-image collection device 0 comprising an output processing means for outputting an image signal t-1iyi and an output image signal from the V# image storage means according to the storage contents of the means.