JP2006018522A - Image edition system, method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve operability and to reduce deterioration of image quality. <P>SOLUTION: A scan image is displayed on a display medium, and edition command processing, in which a plurality of edition target areas are designated, selected, released, or selected again by a device such as a pointing device, is carried out. The edition target area is selected when it is surrounded by a line. When the inside of the selected edition target area is pointed, the edition target area can be selected again. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image editing system, method, and program for editing image data read by a scanner.

  In recent years, devices for editing image data read by a scanner with a tablet / pen have appeared. For example, image data is displayed on a tablet display device in which a tablet that is a pointing device and a display device are integrated, and an image data area to be edited is enclosed with a pen, and image data is deleted or extracted from the area. There is a handwriting input device to which various editing operations can be applied (see Patent Document 1).

  As another example, the editing processing menu is printed on the temporary output paper together with the scanned image data, the editing range is marked on the temporary output paper with a marker / pen, and the editing processing item is checked / marked on the editing processing menu. Write. Thereafter, there is also an image editing apparatus that edits image data by scanning a temporary output sheet with a scanner of the image editing apparatus (see Patent Document 2).

  In recent years, devices (Notepad) for digitizing handwritten information have appeared due to the miniaturization and sophistication of electronic components (see Patent Document 3). In this apparatus, when writing on a recording paper on which a dot pattern of an image representing two-dimensional coordinates is recorded with a digital pen as a pointing device, the digital pen reads the dot pattern on the recording paper. Next, handwriting data (two-dimensional coordinate chain data) read by the pen is transmitted to a personal computer (PC) via a wireless communication device.

  To explain the outline of the digital pen, the digital pen is covered with a pen-shaped cover, the tip of the cover is open, and an optical reader and at least one light-emitting diode are stowed inside. . Furthermore, a central processing unit, a memory and a battery are confiscated. Furthermore, there is a pen tip with ink at the end of the open cover. The digital pen further has a button for controlling the pen and a communication unit for communicating with other devices.

JP-A-6-332611 JP-A-7-58938 International Publication No. 01/16691 Pamphlet

  However, in the handwriting input device of Patent Document 1, the selection range of the image data area surrounded by handwriting is reset by the editing process. For this reason, when editing processing is applied to the same selection range, it is necessary to specify the selection range by hand again, which is very troublesome.

  Further, in the image editing apparatus of Patent Document 2, in order to edit an image of a document, the document is scanned, the document image and the contents of the editing process are printed on the temporary output paper, and the area to be edited is set on the temporary output paper. Surround with a marker pen. Furthermore, after checking the temporary output paper with the editing processing marker pen, it is necessary to further scan the checked temporary output paper with the scanner of the image editing apparatus, which is very troublesome. In addition, when the edited image is edited again, it is necessary to read the output paper of the image output as a result of the previous editing again with the scanner and perform the same operation as the previous time, which is further troublesome. Furthermore, the image quality is deteriorated by repeating scanning and printing many times.

  Notepad of Patent Document 3 relates to processing for data written with a pen, cannot edit image data read with a scanner, and cannot select a processing target for an object already written with a pen.

  The conventional system has various problems as described above, and further improvement is desired.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide an image editing system, method, and program that improve operability and suppress deterioration of image quality.

  In order to achieve such an object, the image editing system of the present invention stores the image data read by the image reading means in the image data storage means, and sets an edit target area for editing the stored image data. When specifying, the image data and an area for selecting an editing function for the image data are displayed on a display medium, and the position indicated by the position indicating means on the display medium and the position on the image data are A corresponding image editing system, wherein a new region processing unit that selects one or a plurality of new editing target regions by surrounding the editing target region with a line by the position instruction unit, and a selection by the new region processing unit Instructed within the designated edit target area by the position indicating means, the selected one or more edit target areas are selected again. Characterized by comprising a that area selecting unit.

  In order to achieve the above object, the image editing system of the present invention stores the image data read by the image reading means in the image data storage means, and designates the editing target area for editing the stored image data. In doing so, a display medium displaying the image data and an area for selecting an editing function for the image data is used, and the position indicated by the position indicating means on the display medium and the position on the image data Is a corresponding image editing system, a communication unit communicating with the position indicating unit, and a locus of the position indicating unit moving on the display medium, which is sampled and received from the communication unit at regular intervals, When the position coordinate vector on the display medium is included in an editing area defined in advance on the display medium, the position coordinates When the vector of the position coordinates is included in an area for designating at least one editing function defined in advance on the display medium, Treating the vector of position coordinates as a second vector identifying the editing function and converting it into a token identifying the editing function, the state determined by the first vector or the token, and the received second Data analysis means for executing processing determined by one vector or the token, and the data analysis means is a rectangular area including the coordinates of the vector of the position coordinates, and the editing area or the editing function A coordinate conversion tube that manages a rectangular area that defines an area for designating a region and a process applied to the coordinates of the vector of the position coordinates And when the process managed by the coordinate transformation management means is executed, the process is determined by the state and the first vector or the token received next, wherein the first A vector adding means for temporarily storing a vector, a handwriting input processing means for performing processing for adding the first vector as an object included in the editing area, and a region to be edited by surrounding the editing target area with a line. A new area processing means for selecting one or a plurality of new editing target areas, and the position indicating means to indicate the inside of the editing target area selected by the new area processing means. A process by any of the area selection processing means for selecting a plurality of edit target areas again is executed.

  In order to achieve the above object, the image editing method of the present invention stores the image data read by the image reading means in the image data storage means, and designates an editing target area for editing the stored image data. In this case, the image data and an area for selecting an editing function for the image data are displayed on a display medium, and the position indicated by the position indicating means on the display medium corresponds to the position on the image data. An image editing method of the image editing system, wherein a new region processing step of selecting one or a plurality of new editing target regions by surrounding the editing target region with a line by the position indicating means, and the new region processing By instructing the editing target area selected in the step by the position indicating means, the one or more editing pairs specified Characterized in that it comprises a region selecting process step of selecting the region again.

  In order to achieve the above object, the image editing method of the present invention stores the image data read by the image reading means in the image data storage means, and designates an editing target area for editing the stored image data. In doing so, a display medium displaying the image data and an area for selecting an editing function for the image data is used, and the position indicated by the position indicating means on the display medium and the position on the image data Is an image editing method of the corresponding image editing system, wherein the position indicating means moves on the display medium, which is communicated with the position indicating means, and is sampled and received at regular times in the communication step. A vector of position coordinates on the display medium representing a trajectory is included in an editing area defined in advance on the display medium. The position coordinate vector is treated as the first vector to be edited, or the position coordinate vector is included in an area for designating at least one editing function defined in advance on the display medium. The position coordinate vector is treated as a second vector for identifying the editing function, converted to a token for identifying the editing function, and the state determined by the first vector or the token; A data analysis step for executing a process determined by the first vector or the token received next, wherein the data analysis step is a rectangular region including the coordinates of the position coordinate vector, Applied to the rectangular area that defines the editing area or the area that specifies the editing function, and the coordinates of the position coordinate vector A coordinate transformation management step for managing the processing, and when executing the processing managed in the coordinate transformation management step, it is determined by the state and the first vector or the token received next A vector adding step for temporarily storing the first vector; a handwriting input processing step for performing processing for adding the first vector as an object included in the editing area; A new region processing step for selecting one or a plurality of new editing target regions by surrounding the editing target region with a line, and the position indicating means instructing the editing target region selected in the new region processing step In either of the area selection processing steps for reselecting the specified one or more editing target areas. The processing is executed.

  With the above configuration of the present invention, there is no need to re-enclose and specify the editing area for the editing target area that has already been processed, and the editing target area can be simply touched with the pen or written with a check mark. Can be selected. Further, at the time of re-editing, it is not necessary to print and scan the temporary output paper, and only one original scan is required. In addition, it is possible to both edit image data read by a scanner and select a processing target for an object already written with a pen.

  According to the present invention, it is possible to improve the operability of the image editing system and suppress the deterioration of image quality.

  Embodiments to which the present invention can be applied will be described below in detail with reference to the drawings. In addition, the same code | symbol is attached | subjected to the location which has the same function in each drawing, and duplication of description is abbreviate | omitted.

(Device configuration)
FIG. 1 is a first configuration diagram of an image editing system according to an embodiment to which the present invention can be applied. The image editing system shown in FIG. 1 is a main body device 100 such as an MFP (Multi Functional Peripheral), a FAX apparatus, a printer apparatus, or the like that has a document scanning function and a printing function. However, it can also be realized by a peripheral device such as a document scanner or a printer or a PC equipped with an image processing peripheral board.

  The operation unit subsystem 101 includes a display medium and a keyboard on which a tablet (displaying an image editing screen denoted by reference numeral 500 in FIG. 5) for detecting pen handwriting is mounted on a liquid crystal panel. A hardware subsystem and a software subsystem that provide control related to display and operation of the hardware of the main body device 100 of the system and a function of controlling tablet input and keyboard input (hereinafter referred to as hardware subsystem). System and software subsystems are collectively referred to simply as subsystems).

  The editing command processing subsystem 102 is a processing unit that represents the features of this embodiment, and is a subsystem that manages editing command processing. Details of the edit command processing subsystem 102 will be described later. The image data storage subsystem 104 controls a secondary storage device (not shown) such as an HDD (hard disk drive), and stores and manages image data.

  The image processing subsystem 105 includes image processing software, image processing hardware, and control software. The image processing subsystem 105 includes image processing functions such as rectangular area extraction and background removal for the image data read by the scanner subsystem 106. Further, the image processing subsystem 105 cooperates with the form data generation subsystem 107, for example, a color space conversion function for converting RGB image data into color components composed of CMY components from which K (black component) is removed, and two-dimensional coordinates. A two-dimensional coordinate dot pattern generation function for generating an ID dot pattern is installed.

  The scanner subsystem 106 converts a document read from a document scanner (not shown) into image data in cooperation with the image processing subsystem 105 and stores the image data in the image data storage subsystem 104. The form data generation subsystem 107 manages form structure data for the image editing form (reference numeral 500 in FIG. 5), and further generates the print data and edit command form (reference numeral 600 in FIG. 6). Print data is generated.

  The printer subsystem 108 controls a printer device (not shown) to output print data to the printer device, and prints the print data for the image editing form and the editing command form on a recording sheet.

  The image data editing subsystem 103 performs image editing processing on the image data read by the scanner subsystem 106 and stored in the image data storage subsystem 104 in accordance with the instruction of the editing command processing 102, and the editing state of the image data is changed. The data is displayed on the operation unit subsystem 101 or a display device on the editing clients 300 and 400 described later with reference to FIGS. The image data editing subsystem 103 stores and manages a data / object management table shown in FIG. 8 (to be described later), an editing area management table shown in FIGS. 11 to 18 in a memory (not shown) or a secondary storage device.

  The job control subsystem 101 controls the jobs in the system, and includes an image bus, a system bus, and an image bus I / F for connecting them.

  FIG. 3 is a modification of the image editing system of FIG. 1 and is a second configuration diagram of the image editing system of the embodiment to which the present invention can be applied. A structural difference between the image editing systems of FIGS. 3 and 1 will be described. The image editing system in FIG. 3 is a system in which the editing command processing subsystem 102 and the image data editing subsystem 103 in FIG. 1 are separated from the main body device 100 as an editing client 300. In the image editing system of FIG. 3, the main body device 305 is provided with a network communication subsystem 306, and the editing client 300 is also provided with a network communication subsystem 303 to perform communication between the main body device 305 and the editing client 300. The editing client 300 can be realized on a PC or a dedicated terminal.

  Next, functional differences between the subsystems of the image editing system of FIGS. 3 and 1 will be described. In the image editing system of FIG. 1, key input and pen input to the editing command processing subsystem 102 are performed by superimposing a keyboard of the operation unit subsystem 101 and a display medium on the operation unit subsystem 101 (for example, a touch panel on the display unit). Tablet device) or a digital pen or the like for writing on an image editing paper on which the two-dimensional coordinate position disclosed in Patent Document 3 is printed with a dot pattern. In the image editing system in FIG. 1, the image data editing subsystem 103 displays the image data editing state on a display medium on the operation unit subsystem 101.

  On the other hand, in the image editing system of FIG. 3, key input and pen input to the editing command processing subsystem 301 are performed using the keyboard and display medium of the editing client 300, or connected to the editing client 300 via wireless communication. The above-described two-dimensional coordinate position is written with a digital pen or the like that writes on the image editing paper printed with a dot pattern. In the image editing system of FIG. 3, the image data editing subsystem 302 displays the image data editing state on the display medium of the editing client 300.

  FIG. 4 is a modification of the image editing system of FIG. 3 and is a third configuration diagram of the image editing system of the embodiment to which the present invention can be applied. A structural difference between the image editing systems of FIGS. 4 and 3 will be described. The image editing system of FIG. 4 includes an image data storage subsystem 401 in the editing client 400, and stores image data to be edited from the image data storage subsystem 403 of the main device 402 in the image data storage subsystem 401. The image data editing subsystem 405 performs image editing processing on the image data stored in the image data storage subsystem 401 in accordance with an instruction of the editing command processing 404.

  FIG. 2 is a configuration diagram of the edit command processing subsystem, and shows the internal configuration of the edit command processing subsystems 102, 301, and 404 of FIGS. The editing command processing subsystem 200 shown in FIG. 2 writes a tablet image editing screen or image editing form as shown by reference numeral 500 in FIG. 5 with the pen from the tablet or digital pen. Receive and analyze handwriting data.

  An outline of the processing contents will be described. A mode button (any one of the mode buttons 513 in FIG. 5) relating to the edit target area is selected for the handwriting written with the pen, and the edit target area is selected before the mode selection. A corresponding mode process is executed on the handwriting data written on the 599 with a pen.

  For example, if the pen around the figure 503 is enclosed (enclosure line 502) and the new area mode button 513 is checked with the pen, the image data and pen handwriting data in the enclosure line 502 are trimmed, figure shaping, etc. As a target to be applied, new area designation and area selection are executed. Thereafter, when a function button (any one of the function buttons 514 in FIG. 5) is checked with a pen, processing corresponding to the function button selected corresponding to the above-described selection area is executed. For example, when the trimming button in the function button area 514 in FIG. 5 is checked with a pen in the state where the enclosing line 502 is selected in the graphic area 503 in FIG. 5, the image data in the rectangular area 504 that is a circumscribed segment of the enclosing line 502 is displayed. Is trimmed.

  Next, each component shown in FIG. 2 will be described. The device communication unit 201 is a part that communicates with a keyboard, a tablet, and a digital pen. Wired communication such as RS-232C (Recommended Standard 232C) and USB (Universal Serial Bus), infrared communication such as iRDA (Infrared Data Association), Bluetooth Wireless communication such as (trademark) is used.

  The device data analysis unit 202 is one of the most prominent features of the present embodiment. The device data analysis unit 202 analyzes the pen data of a tablet or digital pen sampled and received from the device communication unit 201 at regular intervals, and is in an editing state. This is a part that manages execution control of a part from the management of the selected area and the free space management 203 to the data deletion 215. A detailed description of the device data analysis unit 202 will be described later with reference to FIG. 19 which is a state transition diagram of token and pen vector analysis processing.

  When the above-mentioned digital pen is used, the free space management unit 203 performs in-use area management and free area management of the two-dimensional coordinate space for specifying the above-described two-dimensional coordinate position. At least the two-dimensional coordinate space registered in the rectangular area of the coordinate conversion management table (described later) in FIG. 10 of this embodiment is managed as the above-described in-use area by the free space management unit 203. However, when a tablet is used, the free space management unit 203 is not used.

  The coordinate conversion management unit 204 manages data described in the coordinate conversion management table of FIG. 10, and for each hatched rectangular area of FIG. 5, an area ID, an area type, a substitute token, an area corresponding processing object, And comments are managed in association with each other. Details will be described later with reference to FIG.

  Details of the coordinate conversion management table of FIG. 10 will be described here. The area ID column is an ID for identifying a rectangular area. The rectangular area column is information relating to the areas of the editing area 599, each mode button 513, each function button 514, and the transmission button 516, which are hatched areas in FIG. For example, in a system using a digital pen, FIG. 5 shows an edit form paper, and a rectangular area column includes a set of IDs corresponding to dot patterns representing two-dimensional coordinates printed in each rectangular area. Is managed. However, the transmission button 516 is special in a system using a digital pen, and is used as a trigger to send pen handwriting data stored in the digital pen to the editing command processing unit 301 of the present embodiment. For example, the information indicating the set of IDs in the rectangular area column is the two-dimensional coordinates of the upper left corner, upper right corner, lower left corner, and lower right corner of the two-dimensional space.

  On the other hand, in a system using a tablet, information indicating the set of IDs in the rectangular area column is the two-dimensional information of the hatched rectangular area screen of the image editing screen of FIG. 5 displayed on the display device on the tablet. It is area information. For example, the two-dimensional area information is two-dimensional coordinates of the upper left corner, upper right corner, lower left corner, and lower right corner on the virtual display screen.

  The area type column is information for identifying whether it is an editing area or a button for mode designation or function designation.

  The substitute token is a token that abstracts the meaning of the buttons in the buttons 513 and 514 shown in FIG. 5 that substitutes a set of a plurality of two-dimensional coordinates as one token, and simplifies internal analysis processing. Used to do. This is because it is complicated to obtain a corresponding meaning by performing a region range check for each coordinate of a series and a plurality of two-dimensional coordinates input from a pointing device. When the rectangular area in each of the buttons 513 and 514 shown in FIG. 5 is checked with a pointing device such as a pen, the coordinate conversion management table of FIG. 10 is referred to using the coordinate information received from the pointing device as a key, As a result, the buttons in the buttons 513 and 514 are converted into alternative tokens. Conversion to an alternative token is performed before the device data analysis unit.

The explanation of the contents of each alternative token is shown below.
<T>: A token that means that any button in the button area (inside 515 in FIG. 5) is touched with a pen.
<FTx>: A token that means that any button in the function button area (514 in FIG. 5) is touched with a pen. “FT” “x” is a number for distinguishing various function buttons.
<MT>: A token that means that any button in the mode button area (inside 513 in FIG. 5) is touched with a pen.
<AT>: A token that means that a button related to an area (513 new area mode, area selection mode, area selection release mode) is touched with a pen.
<IT>: Token that means that the “handwriting input mode” (inside of 513 in FIG. 5) button is touched with a pen.
<ST>: A token indicating that the “area selection mode” (inside of 513 in FIG. 5) button is touched with a pen.
<NT>: A token indicating that the “new area mode” (inside of 513 in FIG. 5) button is touched with a pen.
<CT>: A token indicating that the “area selection release mode” (inside of 513 in FIG. 5) button is touched with a pen.

The relationship between the above tokens is shown below.
<T>-+-<FT>
|
+-<MT>-+-<AT>-+-<ST>
| +-<NT>
+-<IT>+-<CT>

  Further, the processing in the area corresponding processing object column in FIG. 10 is processing corresponding to each rectangular area. Specifically, information indicating a program entry of the device data analysis process of FIG. 2 is stored. A comment for identifying the meaning of the area is stored in the comment column.

  In the editing command processing subsystem 200 of FIG. 2, the handwriting input mode unit 206, the vector addition unit 207, the new region mode unit 208, the region selection cancellation mode unit 209, and the region selection mode unit 210 are activated and processed by each processing unit. This is parameter delivery, and the actual processing of each processing unit is executed by the image data editing subsystem (103 in FIG. 1, 302 in FIG. 3, and 405 in FIG. 4). Details of the processing contents of the image data editing subsystem will be described later with reference to FIGS.

  FIG. 7 is an editing screen diagram 700 after the editing process, which is displayed on the operation unit 101 or the editing clients 300 and 400. The processing results of the function processing units 211 to 213 and 215 will be described with reference to FIGS.

  The image → character code conversion unit 211 extracts a character part in the image whose area is specified and converts it into a character code. For example, when the area 509 in FIG. 5 is selected and image → character code conversion is performed, it is converted into a character code as shown in 707 in FIG. 7 and embedded as edit data as annotation, and as image data in a character font as shown in 706. Written.

  The handwriting → character code conversion unit 212 converts a handwriting vector of a pointing device such as a tablet or a digital pen in the designated area into a character code. For example, when the region 506 in FIG. 5 is selected and handwriting → character code conversion is performed, the character code “A” is converted as indicated by 703 in FIG. Written as image data.

  The figure shaping unit 213 shapes the handwriting vector of the above pointing device in the area designated area and converts it into figure vector data. For example, when the area 507 in FIG. 5 is selected and the figure is shaped, the triangle 508 written by the pointing device is shaped as shown by 704 in FIG. 7 and written as an image. Further, the shaped triangle graphic vector data is embedded in the editing data as an annotation.

  The trimming / masking unit 214 trims or masks an image in the area designated.

  The data deleting unit 215 deletes the image in the area designated and replaces it with the default fill color or dot pattern. For example, when the area 502 in FIG. 5 is designated and data is deleted, the designated area is deleted as indicated by 701 in FIG. As in 701, the image before deletion may be left on the display with a broken line, and the image data may be deleted, or may be deleted completely on the display.

(Description of operation)
In the system configuration described above, the operation content of the image editing system of this embodiment will be described.

  Details of the device data analysis unit 202, which is a feature of the present embodiment, will be described. First, a description will be given using the flowchart of the device data analysis process of FIG. In step S2001, pen data for one stroke is received from the device communication unit 201. The pen data referred to here is handwriting data of a pointing device (hereinafter referred to as a pen for the sake of simplicity) such as a tablet or a digital pen.

  Next, in step S2002, a coordinate conversion management process (described later with reference to FIG. 21) of the coordinate conversion management unit 204 is executed to convert pen data into a pen vector (PVn) or to convert the coordinate conversion management table of FIG. By referring to the converted token, the processing object corresponding to the area written with the pen is selected with reference to the coordinate conversion management table of FIG. Next, in step S2003, it is confirmed whether the processing object is Proc-A, which is a processing object for image editing. If NO, the process proceeds to step S2005, and other corresponding processing is executed and the process ends. On the other hand, if YES, the flow advances to step S2004 to execute a token and pen vector analysis process, and the process ends. The detailed description of step S2004 will be described later with reference to FIG.

  Next, the processing of the coordinate conversion management unit 204 will be described with reference to FIG. First, in step S2101, in order to search the coordinate conversion management table of FIG. 10, 1 is set to i which is an index variable of the table. Next, the process proceeds to step S2102, where it is checked whether all the last records have been searched by comparing with N, which is the maximum number of records in the table. If i exceeds N and all the last records have been searched (YES), the process jumps to step S2108. If NO, the process advances to step S2103 to check whether the pen data is within the rectangular area of the record (CTRi) pointed to by the index variable i in the coordinate conversion management table of FIG.

  Next, in step S2104, it is checked whether the pen vector exists in the rectangular area. If not (NO), the process jumps to step S2109. On the other hand, if YES, the flow shifts to step S2105 to check whether the area type of the record pointed to by the index variable i in the coordinate conversion management table of FIG. 10 is “edit”, and if NO, jump to step S2110. On the other hand, if YES, it is considered that the editing area has been written with a pen, the process proceeds to step S2106, pen data is converted into a pen vector (PVn), and stored in a temporary memory area (temporary storage area).

  Next, the process proceeds to step S2107, and the processing corresponding to the area indicated by the pen vector (PVn) or alternative token and the index variable i in the coordinate transformation management table of FIG. The object is passed as a parameter to the process of FIG.

  In step S2108, an error indicating that the pen data is not registered on the coordinate conversion management table in FIG. 10 and cannot be processed (or that the pen is to be written on the editing area or button) is displayed on the operation unit 101 or The information is displayed on the display device of the editing client 300 or 400. In step S2109, the index i is incremented to process the next record in the coordinate conversion management table of FIG. 10, and the process jumps to step S2102. In step S2110, since the area written with the pen is the above-described button area, in order to deliver it as end information, the substitute token of the record pointed to by the index variable i in the coordinate conversion management table of FIG. 10 is taken out, and the process jumps to step S2107. .

  Next, details of step S2004 of FIG. 20 will be described using the state transition diagram of the token and pen vector analysis processing of FIG.

  An area unselected state 1901 indicates a state where no area to be edited is selected. An editing input state 1 1905 shows a state in which no area is selected and the area to be edited (599 in FIG. 5) is written with a pointing device. An area designated state 1908 indicates a state in which an area to be edited is designated. An editing input state 2 1911 shows a state in which the editing target area has been designated and the editing target area (599 in FIG. 5) is being written with a pointing device.

  An arrow in FIG. 19 indicates a transition from one state to the next state, and a number given to the arrow indicates a number (X of X or X-Y) shown in the following IF-THEN expression. The expression with the branch number (X-Y) of the IF-THEN expression indicates that there are IF-THEN expressions for the branch number (Y). The process after IF is the transition condition and the process after THEN transitions. The parentheses “<>” represent an alternative token (see the description of the coordinate conversion management unit 204 described above). Further, PVn indicates a pen vector which is handwriting data written in the edit target area (599 in FIG. 5).

<< IF-THEN expression >>
(1) IF <T> THEN Notify user of error (2) Execute IF PVn THEN vector addition processing (3) -1 Execute IF PVn THEN vector addition processing (3) -2 IF <FT> THEN Notify user of error (4) -1 Ignore PVn and <CT> before IF <CT> THEN <CT> (4) -2 Handwritten input to PVn before IF <IT> THEN <IT> Execute mode processing (5) -1 Execute area selection mode processing for PVn before IF <ST> THEN <ST> (5) -2 For PVn before IF <NT> THEN <NT> Execute new area mode processing (6) IF <IT> or <ST> or <NT> THEN Notify user of error (7) Execute IF PVn THEN vector addition processing (8) -1 IF PVn THEN vector performing a region deselect mode processing for any additional process is executed (8) and notifies the error to -2 IF <FT> THEN user (8) -3 IF <CT> THEN <CT> previous PVn (9 IF <CT> THEN <CT> Execute area selection release mode processing for PVn before (10) -1 IF <ST> THEN <ST> Execute area selection mode processing for PVn before (10) ) -2 IF <NT> THEN <NT> Execute new area mode processing for PVn before (10) -3 IF <IT> THEN <IT> Execute handwriting input mode processing for PVn before (11) -1 IF <FT> THEN Various function processing is executed for the selected area. (11) -2 IF <CT> THEN Area selection release mode processing is executed for the selected area.

  Hereinafter, details of the underlined portion of the processing section described after THEN of the IF-THEN formula will be described with reference to the flowcharts of FIG. 2 and FIGS. Prior to that, first, the list diagram of the data / object management table of FIG. 8 will be described, and further, the editing area management tables of FIGS. 11 to 18 will be described.

  The data object management table for managing handwriting data other than the area related data written in the editing target area 599 in FIG. 5 will be described with reference to the list diagram of the data object management table in FIG.

  In FIG. 8, in the data object management table, a set of pen input data that is handwriting data to be edited is managed as a lump. Specifically, a set of pen input data until the function button 514 in FIG. 5 is selected is managed by one management record. The pen input data is stored in the “pen input data” column of the management record of the data object management table. In each of the “data type” and “data content” fields, the data type corresponding to the selected function button and the conversion processing result corresponding to the function button for the pen vector PVn to be edited are stored. .

  For example, for the object ID “Oa” in the first record in FIG. 8, the function button “handwriting → character string conversion” in 514 in FIG. 5 is applied to the pen vector in the area 506 in FIG. The “character string” is stored in the “column”, and the “character” “703” is stored in the “data content” column.

  For the object ID “Ob”, the function button “shape shaping” of 514 in FIG. 5 is applied to the pen vector in the area 508 in FIG. 5, and “graphic” and “data contents” are displayed in the “data type” column. A graphic vector of the triangle 705 is stored in the column.

  For the object ID “Oc”, the function button “image → character string conversion” of 514 in FIG. 5 is applied to the pen vector in the area 509 in FIG. 5, and “character string”, The converted character string 707 is stored in the “data content” column. However, since 512 in FIG. 5 is a character string of image data, no pen vector is stored in the “pen input data” column.

  Next, the setting contents of the editing area management table of FIGS. 11 to 18 will be described with reference to FIGS. 5, 8, and 9.

  FIG. 11 shows an initial state, and the editing target area 599 of FIG. 5 is the first line (first management record) of the management table of FIG. 11, and “b” (second line of the management table) is included as the “included area”. "Area ID") and "c" ("area ID" in the third row of the management table). The second line of the management table is a management record of the rectangular area 503 in FIG. 5, and the third line is a management record of the rectangular area 510 in FIG. Analysis and rectangular extraction of the rectangular areas 503 and 510 from the image data are processed by the image processing subsystem 105 in FIG. 1, the image processing subsystem in 305 in FIG. 3, and the image processing subsystem in 402 in FIG. The result is reflected in the management records in the second and third lines in FIG.

  FIG. 12 shows the state of the editing area management table immediately after the first new area designation (502 in FIG. 5) is drawn with the pen from the initial state of FIG. As a result, the fourth management record in FIG. 12 (“area ID” is “d”) is added, “selected” is “selected”, “type” is the handwritten area, and the figure circumscribes the area. The broken line rectangle 504 data of 5 is set in the “area vector”, and the enclosing line 502 includes the rectangle 503, so “b” is set in the “inclusive area”, and the first management record in FIG. “Inclusive area” of “a” is set to “c” and “d”.

  FIG. 13 is an editing area management table immediately after the character “A” of 505 in FIG. 5 is written with a pen. The pen vector of the character is set to “pen input data” in the newly added management record (first line in FIG. 8) of the data object management table of FIG. 8, and “Oa” is set to “Object ID”. Set. Next, “Oa” is set as the “included object” of the first management record in FIG.

  FIG. 14 shows the state of the editing area management table immediately after the area around the character 505 shown in FIG. In operation, the new area mode button in 513 is checked after the enclosing line 506 is written with a pen. Since the new area 506 is newly designated immediately below the edit target area 599, the fifth management record in FIG. 14 is added, and “e” is added to “area ID”, “selected” is set to “selected”, and “type” is selected. “Handwritten area” is set in “Handwritten area”, “circumscribed rectangle” is set in “area vector”, “None” is set in “Inclusive area”, and “Oa” is set in “Inclusive object”. Furthermore, “e” is added to the “included area” on the first line in FIG. 14, and “none” is set to the “included object”. This is because the new area “e” directly includes the object “Oa” and the editing area 599 includes the area “e” from the state in which the editing area 599 directly includes the object “Oa”. It is because it became.

  FIG. 15 shows the state of the editing area management table immediately after the figure 508 of FIG. 5 is written with a pen. The pen vector of the character is set in the “pen input data” of the newly added management record (second line in FIG. 8) of the data object management table of FIG. 8, and “Ob” is set in the “object ID”. Set. Next, “Ob” is set as the “included object” of the first management record in FIG.

  FIG. 16 shows the state of the editing area management table immediately after a new area is specified by writing a surrounding line 507 with the pen around the figure 508 of FIG. 5 written with the pen. In operation, the new area mode button in 513 is checked after the enclosing line 507 is written with a pen. Since the new area 507 is newly designated immediately below the edit target area 599, the sixth management record in FIG. 16 is added, and “area ID” is “f”, “selected state” is “selected”, and “type” “Handwritten area” is set in “Area”, circumscribed rectangle 507 is set in “Area vector”, “None” is set in “Inclusive area”, and “Ob” is set in “Inclusive object”. Further, “f” is added to the “included area” on the first line in FIG. 16, and “none” is set to the “included object”. In this configuration, the editing target area 599 directly includes the object “Ob”, and the new area “f” directly includes the object “Ob” and the editing target area 599 includes the area “f”. It is because it became.

  Next, FIG. 17 shows the state of the editing area management table immediately after the periphery of the sentence 512 in FIG. 5 is written with a surrounding line 509 and a new area is designated. As a result, the seventh management record in FIG. 17 ("area ID" is "g") is added, "selected" is "selected", "type" is handwritten area, and the area circumscribing that area The rectangular data shown in the figure is set in the “area vector.” Further, since the rectangular area 510 includes the enclosing line 509, the “inclusive area” of the third management record “c” in FIG. Is done.

  Finally, FIG. 18 shows the state of the editing area management table immediately after executing “image → character string conversion” in the function button area 514 for the image in the area designation 509. The character string that is the result of this conversion is set as the management record in the third row of the data / object management table in FIG. 8, and is set to “selected” in the seventh row (“area ID” is “g”) in FIG. “0c” in the third row of FIG. 8 is set as “unselected” and “included object”. The tree diagram showing the correlation between the data objects in FIG. 9 represents the relationship between the objects and the areas in FIG.

  Next, the vector addition process 207 will be described using the flowchart of the vector addition process of FIG. In step S2301, pen vector data (PVn) is stored in the pen vector temporary storage area. Next, proceeding to step S2302, an expression indicating that the pen vector (PVn) is in an indeterminate state in which the handwriting data is not the selected region or the handwriting object to be edited (for example, a green line if the display device is a color display) In the case of a monochrome display, a broken line) is displayed on the display device.

  Next, the handwriting input mode unit 206 will be described in detail using the flowchart of the handwriting input mode processing of FIG. First, N in step S2201 is the number of pen vectors input before checking the handwriting input mode button in FIG. When N is 0, it means that no pen vector has been input. Therefore, if N is checked at step S2201, and N is 0 or less, the process jumps to step S2208 and an error to that effect is displayed on the display device (101 in FIG. 1, image editing clients 300 and 400 in FIGS. 3 and 4). Display on the display device).

  On the other hand, if N> 0, the process proceeds to step S2202, and a new record is added to the data object management table of FIG. In step S2203, 1 is set to a variable (n) for counting the number of pen vectors extracted from the pen vector temporary storage area. In step S2204, n> N (the last pen vector has been extracted) is checked. If NO, the process jumps to step S2209.

  On the other hand, if YES, the flow advances to step S2205 to search the aforementioned editing area management table and check whether there is a management record of an area including all pen vectors extracted from the temporary storage area (step S2206). If there is no such management record, the process jumps to step S2212. On the other hand, if such a management record exists, the process proceeds to step S2207, and the object ID of the data / object management table described above is set as the “included object” of the management record matched in step S2205 of the editing area management table and processed. Exit.

  In step S2208, an error message is displayed on the aforementioned display device indicating that “writing is not performed with a pen before checking the handwriting input mode button”, and the process is terminated.

  In step S2209, the next pen vector (PVn) in the pen vector data temporary storage area is set in the management record of data object management added in step S2202. Next, proceeding to step S2210, the pen vector is displayed on the aforementioned display device with an expression indicating that it is handwriting input handwriting (for example, a blue line if the display device is a color display, or a solid line if it is a monochrome display). Next, in step S2211, n indicating the pen vector (PVn) is incremented, and the process jumps to step S2204.

  In step S2212, an error display indicating that “the pen vector (PVn) straddles a plurality of areas” is displayed on the above-described display device, and the process ends.

  Next, the new area mode unit 208 will be described using the flowchart of the new area mode process in FIG. First, in step S2501, it is checked whether N> 0 (N is the number of pen vectors (PVn) input before checking the new area mode button) and whether the number of pen vectors input exceeds zero. If NO, the process jumps to step S2507.

  On the other hand, if the check result in step S2501 is YES, the process advances to step S2502, and a variable n for designating the n-th pen vector (PVn) input before checking the new area mode button is set to 1. Next, the process proceeds to step S2503, where n> N is checked to check whether all the pen vectors (PVn) have been processed. If not (NO), the process jumps to step S2508.

  On the other hand, if completed (YES), the process moves to step S2504, where the area line specifying the new area intersects the start point and end point of the pen vector (PVn), or is within a predetermined distance range. Check if it exists and does not intersect with other areas at the same level (for example, c, d, e, f level or g, b level in the tree diagram showing the correlation of data objects in Fig. 9) To do. The result is checked in step S2505, and if not OK, the process jumps to step S2511.

  On the other hand, if the check result is OK in step S2505, the process advances to step S2506 to add a new management record in the editing area management table, and set “selected” in the “selected state” of the management record. Further, in order to confirm whether or not the area included in the new area exists, the editing area management table is searched. If there is an area included, the area ID is set in the “inclusive area” of the new management record. set. Further, the area ID of the new management record is set in the “include area” of the management record including the new area, and the process ends normally.

  In step S2507, an error message indicating that the new area mode button has not been written with the pre-check pen on the display device on the operation unit subsystem 101 or the editing clients 300 and 400 is displayed.

  In step S2508, the next pen vector (PVn) is extracted from the pen vector data temporary storage area and is set as a processing target. Next, the process proceeds to step S2509, and an expression for informing the user that the area of the edit target area is selected on the display unit on the operation unit subsystem 101 or the editing clients 300 and 400 (for example, If the display device is a color display, it is displayed with a red line, and if it is a black and white display, a long and short broken line) is displayed.

  In step S2511, an error message indicating that the handwritten check mark is not within the area is displayed on the display device on the operation unit subsystem 101 or the editing clients 300 and 400, and the process ends in error.

  Next, the region selection mode unit 210 will be described with reference to the flowchart of the region selection mode process in FIG. First, in step S2401, a variable n for designating the nth pen vector (PVn) input before checking the region selection mode button is set to 1, and the number of regions to be edited is selected. Set variable m to 0. Next, proceed to step S2402 to check if n> N (N is the number of pen vectors (PVn) input before checking the area selection mode button) and check if it is the final pen vector. If YES, step Jump to S2409.

  On the other hand, if NO, the process advances to step S2403 to search the area vector column of the edit area management table of FIGS. 11 to 18 to check whether there is a management record containing the pen vector (PVn) (step S2404). If there is no such record, the process jumps to step S2412. On the other hand, if there is such a record, the process proceeds to step S2405, and the selection state column of the edit region management record including the pen vector (PVn) is set to the “selected” state in order to indicate that the region is in the selected state. To do. At this time, an expression for notifying the display device on the operation unit subsystem 101 and the editing clients 300 and 400 that the region to be edited is selected (for example, if the display device is a color display). In the case of a red line or a black and white display, a long and short broken line is displayed.

  Next, the process proceeds to step S2406, and the variable m which is the selected area number counter is incremented. In step S2407, the next pen vector (PVn) is extracted from the pen vector data temporary storage area. In step S2408, the variable n for specifying the nth of the pen vector (PVn) is incremented. Jump to S2402.

  In step S2409, it is checked whether N> 0 (N is the number of pen vectors (PVn) input before checking the area selection mode button) and whether the number of pen vectors input exceeds 0. If NO, Jump to step S2411. On the other hand, if the result of step S2409 is YES, m> 0 is checked (step S2410) to check whether the selected area exists, and if NO, the process jumps to step S2411. On the other hand, if the result of step S2410 is YES, the process ends normally.

  In step S2411, an error message indicating that “no valid area selection has been made before checking the area selection mode button” is displayed on the display device on the operation unit subsystem 101 or the editing client 300 or 400, and the process ends in error. .

  In step S2412, the display device on the operation unit subsystem 101 and the editing clients 300 and 400 displays that “the handwritten check mark does not fit in the area such as straddling two areas” and jumps to step S2407. .

  Next, the area selection cancellation mode unit 209 will be described with reference to the flowchart of the area selection cancellation mode processing of FIG. First, in step S2601, a variable n for designating the n-th pen vector (PVn) input before checking the region selection release mode button is set to 1, and how many regions to be edited have been selected. Set the variable m to be counted to 0. Next, the process proceeds to step S2602, where n> N (N is the number of pen vectors (PVn) input before checking the area selection release mode button) is checked and the final pen vector is checked. Jump to step S2609.

  On the other hand, if the result of step S2602 is NO, the process proceeds to step S2603 to search the area vector column of the edit area management table of FIGS. 11 to 18 to check whether there is a management record containing the pen vector (PVn) ( Step S2604), if there is no such management record, jump to step S2612. On the other hand, if there is such a management record, the process proceeds to step S2605, and the selection state column of the editing area management record including the pen vector (PVn) is set to “unselected” to indicate that the area is not selected. Set to state. At this time, an expression for notifying the user that the area of the edit target area has been deselected is displayed on the display device on the operation unit subsystem 101 or the editing clients 300 and 400 (for example, the display device is a color display). If this is the case, it will be displayed as a gray line or a thin broken line in the case of a monochrome display.

  Next, the process proceeds to step S2606 to increment the variable m which is the selected area number counter. In step S2607, the next pen vector (PVn) is extracted from the pen vector data temporary storage area. In step S2608, the variable n for designating the nth vector of the pen vector (PVn) is incremented. Jump to S2602.

  In step S2609, it is checked whether N> 0 (N is the number of pen vectors (PVn) input before checking the area selection release mode button) and whether the number of input pen vectors exceeds 0 is checked. If so, the process jumps to step S2611. On the other hand, if the result is YES in step S2609, m> 0 is checked to check whether the selected area exists (step S2610), and if NO, the process jumps to step S2611. On the other hand, if the result of step S2610 is YES, the process ends normally.

  In step S2611, an error message indicating that “no valid area selection has been made before checking the area selection release mode button” is displayed on the display device on the operation unit subsystem 101 or the editing client 300 or 400, and the process ends in error. To do.

  In step S2612, the display device on the operation unit subsystem 101 and the editing clients 300 and 400 displays that “the handwritten check mark does not fit in the area, such as straddling two areas”, and jumps to step S2607. .

(Effect of embodiment)
As described above, according to the present embodiment, the image editing system reads an original by the scanner unit, stores the read image data in the image data storage unit, and edits the image data in the region to be edited. In order to select the image data and the editing function for the image data, an area is displayed on the display medium, and the position indicated on the display medium by the pointing device corresponds to the position on the image data. The editing system selects one or a plurality of new editing target areas by surrounding the editing target area with a line with the pointing device, and at least a part of the image data read by the scanner when selecting the editing target area. Pointing device checks the area to be edited or the newly specified area to be edited To select one or more editing target areas again, and then select one or more editing target areas that have already been specified and checked by using a pointing device in the selected or unselected editing target areas. Is selected, and at least one or more editing functions are selected and applied by the pointing device to the objects included in the selected one or more editing target areas.

  For this reason, it is not necessary to re-specify and select the editing area for the editing target area that has already been processed as in the handwriting input device of Patent Document 1, and touch the inside of the editing target area with a pen or write a check mark. This makes it possible to select an edit target area, and the operability is remarkably improved.

  Further, as compared with a system for editing with a marker pen such as the image editing apparatus of Patent Document 2, it is not necessary to scan the temporary output paper after filling in the temporary output paper with the marker pen, and the operability is remarkably improved. . Furthermore, in the system for editing with the marker pen of Patent Document 2, it is necessary to print and scan the temporary output paper every time the same document is re-edited, and the image quality deteriorates each time. In this embodiment, At the time of re-editing, not only printing and scanning of temporary output paper becomes unnecessary, but also the original image is scanned only once, so that the deterioration of image quality is remarkably improved.

  Compared with Notepad in Patent Document 3, image data read by a scanner can be edited, and a processing target for an object already written with a pen can be selected, so that the functionality and operability are remarkably improved.

(Other embodiments)
In the above-described embodiment to which the present invention can be applied, a storage medium (or recording medium) that stores a program code of software that realizes the function of the above-described form is supplied as a modification to the system or apparatus. Needless to say, this can also be achieved by reading and executing the program code stored in the storage medium by a computer (or CPU or MPU (micro processing unit)).

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an operating system (OS) operating on the computer is actually executed based on the instruction of the program code. It goes without saying that the case where the functions of the above-described embodiment are realized by performing a part or all of the processing and the processing is included in the configuration of the present invention.

  Furthermore, after the program code read from the storage medium is written to the storage medium provided in the function expansion card inserted into the computer or the function expansion unit connected to the computer, the program code is read based on the instruction of the program code. It goes without saying that the configuration of the present invention also includes a case where the CPU or the like provided in the function expansion card or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing. .

  In addition, the present invention distributes the program code of software that realizes the functions of the above-described embodiments via a network, so that storage means such as a hard disk or a memory of a system or apparatus or a CD-RW (CD-ReWritable), Also achieved by reading and executing the program code stored in a storage medium such as a CD-R (CD recordable) and the system (or CPU or MPU) of the system or apparatus. It goes without saying that it is done.

1 is a first configuration diagram of an image editing system according to an embodiment to which the present invention can be applied. It is an edit command processing subsystem configuration diagram of an embodiment to which the present invention can be applied. It is a 2nd block diagram of the image editing system of embodiment which can apply this invention. It is a 3rd block diagram of the image editing system of embodiment which can apply this invention. It is a figure which shows the screen for image editing or the form for image editing of embodiment which can apply this invention. It is a figure which shows the edit command form of the image edit form of embodiment which can apply this invention. It is an edit screen figure after the edit process of embodiment which can apply this invention. It is a list figure of the data object management table of embodiment which can apply this invention. It is a tree figure which shows the correlation of the data object of embodiment which can apply this invention. It is a coordinate conversion management table figure of embodiment which can apply this invention. It is a list figure of the edit area management table of the initial state of embodiment which can apply this invention. It is a list figure of the edit area management table immediately after the 1st area | region specification with the pen of embodiment which can apply this invention. It is a list figure of the edit area management table immediately after writing a character with the pen of embodiment which can apply this invention. It is a list figure of the edit area management table immediately after the area | region designation with the pen around the character written with the pen of embodiment which can apply this invention. It is a list figure of an edit area management table immediately after writing a figure with the pen of an embodiment which can apply the present invention. It is a list figure of the edit area management table immediately after area | region designation with the pen around the figure written with the pen of embodiment which can apply this invention. It is a list figure of the edit area management table immediately after area | region specification with the pen of the text of embodiment which can apply this invention. FIG. 11 is a list diagram of an editing area management table immediately after execution of “image → character string conversion” by specifying an area around a sentence with a pen according to an embodiment to which the present invention can be applied. It is a state transition diagram of token and pen vector analysis processing of an embodiment to which the present invention can be applied. It is a flowchart of the device data analysis process of embodiment which can apply this invention. It is a flowchart of the coordinate transformation management process of embodiment which can apply this invention. It is a flowchart of the handwriting input mode process of embodiment which can apply this invention. It is a flowchart of the vector addition process of embodiment which can apply this invention. It is a flowchart of the area | region selection mode process of embodiment which can apply this invention. It is a flowchart of the new area mode processing of an embodiment to which the present invention can be applied. It is a flowchart of the area | region selection cancellation | release mode process of embodiment which can apply this invention.

Explanation of symbols

200 Edit Command Processing Subsystem 201 Device Communication Unit 202 Device Data Analysis Unit 203 Free Space Management Unit 204 Coordinate Conversion Management Unit 206 Handwriting Input Mode Unit 207 Vector Addition Unit 208 New Region Mode Unit 209 Region Selection Cancel Mode Unit 210 Region Selection Mode Unit 211 image → character code conversion unit 212 handwriting → character code conversion unit 213 figure shaping unit 214 trimming / masking unit 215 data deletion unit

Claims (18)

The image data read by the image reading means is stored in the image data storage means, and when the editing target area is designated for editing the stored image data, the image data and the editing function for the image data are selected. An image editing system in which an area for displaying is displayed on a display medium, and a position on the display medium corresponds to a position on the image data and a position on the image data.
A new area processing means for selecting one or a plurality of new edit target areas by surrounding the edit target area with a line by the position indicating means;
And an area selection processing means for selecting again one or a plurality of editing target areas instructed by instructing the editing target area selected by the new area processing means by the position indicating means. A featured image editing system. An area selection cancellation processing unit that cancels selection of the specified one or more editing target areas by instructing the editing target area selected by the new area processing unit by the position instruction unit. The image editing system according to claim 1. One or a plurality of the editing target areas selected by the new area processing unit, or one or a plurality of the objects included in the one or a plurality of editing target areas selected by the region selection processing unit The editing function processing means for selecting at least one editing function from the editing functions by instructing the position indicating means and applying the selected editing function is further provided. The image editing system described in 1. Error notification means for notifying an error when there is no selected editing target area and at least one editing function is instructed and selected by the position indicating means from one or more of the editing functions; The image editing system according to claim 3, further comprising: The image editing system according to claim 3, wherein after the editing function is applied by the editing function processing unit, the selected editing target area is deselected. The image data read by the image reading means is stored in the image data storage means, and when the editing target area is designated for editing the stored image data, the image data and the editing function for the image data are selected. In an image editing system using a display medium displaying an area for the display, the position indicated by the position indicating means on the display medium corresponds to the position on the image data,
Communication means for communicating with the position indicating means;
A vector of position coordinates on the display medium, which is sampled and received from the communication means at regular intervals and represents the locus of movement of the position indicating means on the display medium, is defined in advance on the display medium. If it is included in the area, the position coordinate vector is treated as a first vector to be edited, or the position coordinate vector has at least one editing function defined in advance on the display medium. If included in the area to be specified, the vector of the position coordinates is treated as a second vector for identifying the editing function, and is converted into a token for identifying the editing function, and the first vector or the token Data analysis means for executing processing determined by the state determined by the following and the first vector or token received next Equipped with a,
The data analysis means includes
Managing a rectangular area including the coordinates of the position coordinate vector and defining the editing area or the area for designating the editing function, and processing applied to the coordinates of the position coordinate vector Having coordinate conversion management means,
A process determined by the state and the first vector or the token received next when executing the process managed by the coordinate transformation management means,
Vector adding means for temporarily storing the first vector;
Handwriting input processing means for performing processing for adding the first vector as an object included in the editing area;
A new region processing unit that selects one or a plurality of new editing target regions by surrounding the editing target region with a line by the position indicating unit;
Processing by any one of the area selection processing means for selecting again one or a plurality of editing target areas instructed by instructing the editing target area selected by the new area processing means by the position indicating means. An image editing system characterized by being executed. The display medium is an editing sheet on which a coordinate position pattern obtained by encoding two-dimensional coordinate data for specifying a two-dimensional coordinate position with respect to a display area is superimposed,
The position instructing means is a digital pen that reads the position coordinate pattern, stores a vector of the two-dimensional coordinate position on the editing sheet, and transmits the stored vector to the communication means. Item 6. The image editing system according to item 6. The display medium is a display device,
The image editing system according to claim 6, wherein the position instruction means has a position detection function on the display device. The image data read by the image reading means is stored in the image data storage means, and when the editing target area is designated for editing the stored image data, the image data and the editing function for the image data are selected. In the image editing method of the image editing system, the area for displaying is displayed on a display medium, and the position indicated on the display medium by the position indicating means corresponds to the position on the image data.
A new region processing step of selecting one or a plurality of new editing target regions by surrounding the editing target region with a line by the position indicating means;
A region selection processing step of reselecting the specified one or a plurality of editing target areas by instructing the editing target area selected in the new area processing step by the position indicating means. Image editing method. An area selection cancellation processing step for canceling selection of the specified one or a plurality of editing target areas by instructing the editing target area selected in the new area processing step by the position indicating means. The image editing method according to claim 9. One or more of the editing target areas selected in the new area processing step, or one or more of the objects included in the one or more editing target areas selected in the area selection processing step The edit function processing step of selecting at least one edit function from the edit functions by instructing the position instruction means and applying the selected edit function is further provided. The image editing method described. An error notification step of notifying an error when there is no selected editing target area and at least one editing function is instructed and selected from the one or more editing functions by the position indicating means; The image editing method according to claim 11, further comprising: The image editing method according to claim 11, wherein after the editing function is applied in the editing function processing step, the selection of the selected editing target area is canceled. The image data read by the image reading means is stored in the image data storage means, and when the editing target area is designated for editing the stored image data, the image data and the editing function for the image data are selected. In the image editing method of the image editing system, using a display medium displaying a region for, and the position on the display medium corresponding to the position indicated by the position indicating means and the position on the image data,
A communication step of communicating with the position indicating means;
A vector of position coordinates on the display medium, which represents the trajectory of the movement of the position indicating means on the display medium, sampled and received at regular intervals in the communication step, is defined in advance on the display medium. If it is included in the area, the position coordinate vector is treated as a first vector to be edited, or the position coordinate vector has at least one editing function defined in advance on the display medium. If included in the area to be specified, the vector of the position coordinates is treated as a second vector for identifying the editing function, and is converted into a token for identifying the editing function, and the first vector or the token Data for executing the processing determined by the state determined by, and the first vector or the token received next And an analysis step,
The data analysis step includes
Managing a rectangular area including the coordinates of the position coordinate vector and defining the editing area or the area for designating the editing function, and processing applied to the coordinates of the position coordinate vector A coordinate conversion management step;
When executing the process managed in the coordinate transformation management step, the process is determined by the state and the first vector or the token received next,
A vector adding step for temporarily storing the first vector;
A handwriting input processing step for performing processing for adding the first vector as an object included in the editing area;
A new region processing step of selecting one or a plurality of new editing target regions by surrounding the editing target region with a line by the position instruction means;
A process by any one of the area selection processing steps of selecting again one or a plurality of editing target areas instructed by instructing the editing target area selected in the new area processing step by the position indicating means. An image editing method characterized by being executed. The display medium is an editing sheet on which a coordinate position pattern obtained by encoding two-dimensional coordinate data for specifying a two-dimensional coordinate position with respect to a display area is superimposed,
The position instruction means reads the position coordinate pattern, stores a vector of the two-dimensional coordinate position on the editing sheet, and transmits the stored vector to the image editing system for processing of the communication step. The image editing method according to claim 14, wherein the image editing method is a pen. The display medium is a display device,
The image editing method according to claim 14, wherein the position instruction unit has a position detection function on the display device.   A program for causing a computer to execute each step of the image editing method according to claim 9. A program for causing a computer to execute each step of the image editing method according to claim 14.

Images