JP2007179261A - Image processor, image processing method and control program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processor allowing a copy of data on only an object as viewed from a user, with its hierarchical structure maintained, in a range designated by the user. <P>SOLUTION: Image data of one page is generated from the page of a paper document inputted to a scanner 105 by the user. The user converts the image data of the document page into an editable graphic data by use of a graphic data generation application 303. A part or the whole of the graphic data generated by the application 303 is selected by a mouse or the like, and the selected data are copied onto a clipboard 305. Taking of the graphic data held on the clipboard 305 into a graphic editing application 304 is instructed to the application 304. The processed/edited graphic data are outputted from a printer 103 as paper. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image processing apparatus and an image processing method for processing image data such as graphic data having a plurality of objects, and a control program for executing the image processing method.

  Conventionally, editing and processing graphic data having raster data in the background and vector data in the foreground using a document creation application on a personal computer is generally performed. In such a case, there are cases where the foreground and background of graphic data and display contents are switched and displayed so that the user can easily operate.

  At this time, there are many scenes in which the user wants to copy only the object as it is visible to the user within a range specified by the user while maintaining the hierarchical structure and to reuse it on different applications. For example, when processing graphic data having a vector image as a foreground on a background raster image, the following scene may occur. In other words, it is possible to copy only vector data displayed in the foreground only display mode, or to copy both vector data in the foreground and raster data in the background. In some cases, it is desired to copy data by cutting out only a partial area of the object without considering the area range of the object.

  Conventionally, as image processing methods for copying graphic data having a plurality of objects between a plurality of applications, for example, there have been proposed in Patent Document 1, Patent Document 2, and the like.

In Patent Document 1, the following processing is performed when data a copied from application A is pasted on application B. That is, even if the data c ′ created by another application C exists in the data a ′ to be pasted, the data nest structure is permitted, and the data of c ′ in the data a ′ to be pasted is the function of the application C. It is displayed based on. In Patent Document 2, a plurality of copy tools for copying an image area are provided, and the copy tool is switched depending on the image mode (color, monochrome, text).
JP-A-6-121144 JP 2002-230666 A

  However, in Patent Document 1, it is not possible to copy only an object that is visible to the user within a range designated by the user. In Patent Document 2, copying cannot be performed in a state where the hierarchical structure of data to be copied is retained.

  Among commercially available applications other than the above-mentioned Patent Documents 1 and 2, there are those that can copy only an object that is visible to the user while maintaining a hierarchical structure in a range specified by the user. The work procedure was complicated. For this reason, in order to significantly impair the user's work efficiency, the reusability of an object once created is reduced at present.

  In view of the above-described conventional problems, the present invention provides an image processing apparatus, an image processing method, and an image processing method capable of copying data while maintaining a hierarchical structure within a range specified by a user for only an object that is visible to the user. An object is to provide a control program.

  In order to achieve the above object, an image processing apparatus of the present invention designates a range of display selection means for displaying an object selected from image data having a plurality of objects, and an object displayed by the display selection means. A range selection unit for selecting, and a range designation copying unit for copying an object in the range selected by the range selection unit.

  The image processing method of the present invention includes a display selection step for displaying an object selected from image data having a plurality of objects, and a range selection for selecting the object displayed in the display selection step by specifying a range. And a range designation copying step for copying an object in the range selected in the range selection step.

  Further, the control program of the present invention includes a display selection step for displaying an object selected from image data having a plurality of objects, and a range selection step for selecting the object displayed in the display selection step by designating a range. And a range designation copying step for copying an object in the range selected in the range selection step.

  According to the present invention, it is possible to copy only an object as it is visible to the user within a range designated by the user, and it is also possible to copy in a state in which a hierarchical structure is maintained. This eliminates the need for the user to consider the hierarchy of objects that cannot be seen by the user and the types of objects, and allows the user to edit and process data with intuitive and easy-to-understand operations.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<Device configuration>
FIG. 1 is a block diagram showing a configuration of an image processing apparatus according to an embodiment of the present invention.

  In the figure, 101 is a computer device, 102 is a display device that displays image information produced by the computer device on a screen such as a cathode ray tube or a liquid crystal display, and 103 is a printer that prints image information produced by the computer device on paper. . Reference numeral 104 denotes an operation device such as a mouse or a keyboard for a user to send an instruction to the computer device. Reference numeral 105 denotes a scanner which photoelectrically converts the contents of the paper into image data and inputs the image data to the computer.

  FIG. 2 is a block diagram illustrating a hardware configuration of the computer apparatus 101.

  In the figure, 201 is a CPU that controls most of the apparatus by executing software, 202 is a memory that temporarily stores software and data executed by the CPU, and 203 is a hard disk that stores software and data. . An I / O unit 204 receives input information such as a keyboard, a mouse, and a scanner, and outputs information to the display device 102 and the printer 103.

  FIG. 3 is a block diagram showing an outline of a software configuration executed by the computer apparatus 101 in FIG.

  Reference numeral 301 in the figure denotes computer basic software (hereinafter referred to as OS). The OS 301 has a so-called window system, and the application software that operates on the OS 301 can display image information on the display device 102 and can perform a so-called GUI operation having a graphical operation function using a mouse or the like.

  Reference numerals 302 to 305 denote applications that operate on the OS 301. Reference numeral 302 denotes a scan application, 303 denotes a graphic data generation application, 304 denotes a graphic editing application, and 305 denotes a clipboard.

<Overall Operation Flow According to the Embodiment>
Next, an overall flow of processing according to the present embodiment executed using the applications 302 to 305 will be described with reference to FIG. FIG. 4 is a flowchart showing an overall flow of processing according to the present embodiment.

  First, in step S <b> 401, image data of the page is generated from one page of the paper document input by the user to the scanner 105 using the scan application 302. The image data is appropriately compressed and stored as a file in the hard disk 204 of FIG.

  In step S402, the image data of the document page is converted into editable graphic data using the graphic data generation application 303. The graphic data described here is data for composing visual information of one page, and particularly includes not only image data but also vector drawing commands such as paths and figures, or rendering information of character fonts. Point to the data. Also, “editable” means that an image, a vector drawing command, a character code, and the like can be changed. In particular, the document data originally provided as a single image is divided into various objects, and each of them is represented by graphic data in an optimal expression format, so that it can be changed. Point to. That is, it refers to a state in which it is easy to change the layout as a document or to change a character or a line drawing as a document object. Note that various objects refer to characters, line drawings, natural images, tables, backgrounds, and the like.

  In the next step S403, the user selects a part or all of the graphic data generated by the graphic data generation application 303 with a mouse or the like, and copies the selected data to the clipboard 305.

  In step S <b> 404, the user instructs the graphic editing application 304 to import the graphic data held on the clipboard 305 into the graphic editing application 304.

  In step S405, the graphic editing application 304 is used to output graphic data processed and edited by the user as paper from the printer 103. Processing / editing means, for example, changing a part of graphic data representing a line drawing or adding a part.

<Operation of Graphic Data Generation Application 303>
The operation of the graphic data generation application 303 that implements the essential part of the present invention will be described in detail below.

  The graphic data generation application 303 (hereinafter referred to as application 303) starts operation by an OS-specific activation method. The application 303 immediately after startup displays one unique window and waits for a user instruction operation.

(A) Example of Window FIG. 5 is a diagram illustrating an example of a window that forms the appearance of the application 303.

  In the figure, reference numeral 501 denotes a title bar that displays an application name and a processing file name. Reference numeral 502 denotes a menu bar for the user to instruct the application 303 to perform an operation using a hierarchical menu. Reference numeral 503 denotes a toolbar for the user to instruct the application 303 to perform an operation by clicking a button.

  Reference numeral 504 denotes a display area for rasterizing and displaying graphic data to be processed into two-dimensional image data, and reference numerals 505 and 506 denote scroll bars for scrolling the range displayed in the display area 504 vertically and horizontally by a mouse operation.

  On the menu bar 502, a character string roughly classifying the operation content is written as in 507 to 509. When you click each character string part with the mouse, a menu with items that specify the operation classification in more detail appears, and when you click the item, processing is actually performed, or more detailed items are displayed . Of the items in the hierarchical menu selectable from the menu bar 502, frequently used function items can be arranged on the toolbar 503. In addition, since the instruction from the hierarchical menu and the instruction with the corresponding button can be regarded as equivalent, the description of the instruction example with the button is omitted.

(B) Operations that can be instructed The operations that can be instructed by the user to the application 303 are classified into the following six types.
(1) File read operation (2) Graphic display operation (3) Graphic selection operation (4) Copy operation (5) File write operation (6) End operation These operations (1) to (6) are as shown in FIG. Has a transitional relationship. For example, a file reading operation is required prior to all operations, followed by a graphic display operation. The copy operation can be executed only after the graphic selection operation, and the file write operation and end operation can be executed at an arbitrary time after the file is read.

  The operations (1) to (6) will be described in detail below.

B-1. File reading operation (1)
First, an internal operation of the application 303 performed during the file reading operation (1) will be described with reference to the flowchart of FIG.

  First, in step S701, the user specifies a file to be read. As an actual operation in the embodiment, if a character string 507 of “File” is clicked on the menu bar 502 with a mouse, items 901 to 904 are expanded as shown in FIG. Subsequently, by clicking the item “Open” 901, a file selection dialog (not shown) is displayed. A file selected with the mouse or the keyboard on the file dialog is read into the application 303. Alternatively, the above operation may be an operation in which a file selected by another file system management software or the like is read by so-called drag and drop using a mouse.

  In the next step S702, it is determined whether the type of file to be read is an image file or a graphic data file. Specifically, the type may be determined by associating a part of the file name with the file type, such as a predetermined extension, or by reading the first few bytes of the file and identifying characters or codes You can decide the type by getting If the file is a graphic data file, the process proceeds to step S703. If the file is an image file, the process proceeds to step S704.

  If the process proceeds to step S703, the graphic data file is read to obtain graphic data, and then the process proceeds to step S706. In step S706, the graphic data is drawn on the screen, and the read operation process is terminated.

  When the process proceeds to step S704, the image file is read and developed as raster image data in an area available for the application 303 in the memory 202. If the image is in a compressed state, an expansion process is performed as appropriate. An example of the compression format is the JPEG format.

  In subsequent step S705, the raster image data is converted into graphic data. The processing content of this step will be described later. If the graphic data is obtained, the process proceeds to step S706, where the graphic data is drawn on the screen, and the reading operation process is terminated.

  Here, the contents of the conversion processing from raster image data to graphic data in step S705 of FIG. 7 will be described in detail with reference to the flowchart of FIG.

  The conversion from raster image data to graphic data means that the content of a single page image is separated into foreground objects such as text, line drawings, photos, and tables, and the remaining background objects, and each foreground object It is converted into a graphic representation suitable for. The graphic representation suitable for each object will be described in various parts of the processing according to the flowcharts that follow.

  In the first step S801, raster image data is input for conversion into graphic data. In the next step S802, if the raster image data is a full color or gray image, it is converted into a monochrome binary image. In binarization, for example, the luminance distribution of the entire image is examined to obtain a binarization threshold, and the character / line drawing portion (foreground portion) at the low luminance peak is black and the background portion (background) at the high luminance peak Binarization is performed so that (part) is white. Alternatively, binarization may be performed by dividing an image into several blocks and obtaining an optimal binarization threshold value for each block.

  In step S803, block selection processing is performed on the binary image. The block selection process is an area division process that recognizes blocks of document objects such as characters, line drawings, natural images, and tables described in raster image data representing a page and separates them into rectangular areas. It shall be shown. In this embodiment, the black pixel block is extracted by tracing the outline of the black pixel in the binary image, and the shape, size, black pixel density, distribution of the white pixel block inside the black pixel block, etc. Based on the above, areas such as characters, line drawings, tables, and natural images are identified.

  Thereafter, each area obtained by the block selection process is converted into graphic data by graphic representation suitable for each area type.

  In step S804, the first graphic data of the character code expression including the character code string and the font information is generated for the character area. The character code string can be obtained by performing OCR processing on the image in the character area. In addition, font information including size and font can be obtained by recognition processing similar to OCR processing.

  In step S805, vector-represented graphic data (vector data) including path drawing data for drawing and filling the outline of the character is generated as second graphic data different from the character code representation for the character region. The vector data of the character region is detected by performing contour tracking processing on the contour of the black pixel block corresponding to each character in the binary image of the character region, and approximating the detected contour line with a straight line and a curve. can get. For example, when the contour tracking of a character object such as “0” is performed, the outer contour (outer contour) and inner contour (inner contour) of the object are extracted, and the space between the outer contour and the inner contour is black. It is filled. A path defined by a pair of an outer contour path and an inner contour path is called a composite path.

  Further, an average pixel value inside the contour line is obtained based on the position of the contour line obtained by the contour tracking process in the character region on the binary image and the corresponding position on the original image. This average pixel value can be used as the color of each character, and this can be used as color information for drawing a path corresponding to each character.

  In step S806, as third graphic data for the character area, graphic data expressed by binary or N-value image data that can easily distinguish pixels inside the character line from pixels other than the character is generated. First, binary image data representing a character region is obtained by cutting out a character region portion from an image obtained by binarizing the entire page. It is also possible to obtain a binary image of a more optimal character region by obtaining the binarization threshold again based on the partial image in the original image corresponding to the character region position obtained in step S803.

  Based on the pixel value of the original image at the position corresponding to the character line (each black pixel constituting the character) of the character region determined in the binary image, the average pixel value inside each character line is obtained and Judge as the color of the text. Using the determined color information as a palette code, graphic data based on an N-value image that can take an N value for each pixel is generated.

  In this embodiment, an N-value image is generated. However, the binary image of the character area is divided into N planes based on the determined color information for each character, and N sheets having color information are obtained. Graphic data based on a binary image may be generated.

  In the next step S807, a vector representation consisting of path drawing data generated based on the contour (a path composed only of the outer contour or a composite bus composed of a pair of the outer contour and the inner contour) for the line drawing area. Create graphic data. The vector data composed of the path drawing can be obtained by approximating the outline of the black pixel block from the binary image of the line drawing area as in the character vector processing in step S805 described above. Further, based on the position of the pixels forming the line portion on the binary image, the pixel values obtained from the multi-valued original image are averaged to obtain pass drawing color information. When the line drawing is composed of a plurality of colors, one pixel value that is the main color is selected as color information.

  In step S808, vector representation graphic data including drawing data of shape elements is created as second graphic data for the line drawing area. The drawing data of the shape element is not a line vector data (outer contour vector data, vector data described by a pair of outer contour and inner contour path), but a line with a single thickness. This is vector expression data (vector data (core line vector) generated based on the center line of a line segment) expressed as a minute path. Alternatively, representative shapes such as squares and circles are vector expression data expressed not by a set of contour paths but by data for drawing various shapes.

  In step S809, as third graphic data for the line drawing area, graphic data represented by binary or N-value image data that can easily separate the line drawing portion and the background is generated. Specifically, the multi-valued original image in the line drawing area is divided into background color pixels and other pixels, the background pixels are values that virtually represent transparency, and otherwise the number of colors in the line drawing area is appropriately quantized. An N-value image with a palette assigned to a value corresponding to one of the generated N palette colors is generated.

  In the subsequent step S810, graphic data composed of images is created for a natural image (photo) area. Specifically, image data in a state in which the corresponding area portion is cut out from the original image is created.

  In step S811, vector-represented graphic data composed of drawing data for the table frame lines is created for the table area. As a specific processing method, pixels in a character part are deleted from a binary image in a table area, and an image having only a table frame is created. After that, as in the case of the line drawing, line segment extraction and approximation processing are performed, and if necessary, conversion into rectangular drawing vector data corresponding to the table cell is performed.

  In step S812, table area graphic data including data representing the character code of the characters in the table and the matrix arrangement structure is created for the table area. Regarding the characters in the table, it is assumed that in step S804, the character code and font information for the internal character region have been extracted for each region surrounded by a frame in the table, so-called cell. With regard to the matrix arrangement structure, since the positional relationship of the cells is already determined in the process of the block selection process for the table, what kind of arrangement relationship is obtained is obtained. Here, the cells in the table correspond to white pixel blocks in the table, and each has position information and cell area size information when the table is arranged in a matrix grid. The above-mentioned character code, cell position, and size information are combined into graphic data for the table area.

  In step S813, the foreground information converted into the various graphic data in steps S804 to 812 is removed from the original image, that is, graphic data including a background image is created. The concrete background is created as follows. In the character, table, and line drawing area, the binary image of the area is referred to, and the pixel of the original image at the position corresponding to the pixel corresponding to the black pixel is changed to the background color. The background color is the color of a pixel in the vicinity of the pixel (in the binary image, the color of the pixel of the original image at a position corresponding to a pixel corresponding to a white pixel). In the actual scan image, the pixel end near the line changes somewhat gently, so the pixel to be changed to the background color is better in the range where the black pixel on the actual binary image is thickened by about 1 dot, When obtaining the background color, it is better to obtain the average color of several pixels outside the fattened range. By performing such processing, a background image in which the color of a pixel corresponding to a character or a line drawing is replaced with the surrounding background color is generated.

  As described above, the graphic data generated in steps S804 to S813 is held as data referenced from the link to the graphic data. Here, any format of graphic data may be used. It may be a set of binary drawing data corresponding one-to-one with drawing commands on the application, or may be text data described in a graphic language such as SVG.

B-2. Graphic display operation (2)
Next, operations related to the graphic display operation (2) will be described.

  The graphic display means that a part or all of graphic data is rasterized into two-dimensional image data and drawn in the display area 504. At this time, the graphic display operation provides a function of selecting which portion of the page area that can be expressed by the graphic data held by the application 303 is to be displayed based on the user's intention. Alternatively, it provides a function of selecting which type of graphic data is drawn and displayed based on the user's intention when holding a plurality of types of graphic data representing a certain region.

  As a specific operation, when a 508 character string “display” is clicked on the menu bar 502, each process is executed by clicking each item of the expanded menu (FIG. 10). Details will be described below.

B-2a. Constant magnification display operation The graphic data can be freely changed in size after rasterization by drawing by multiplying the coordinate value of each drawing element by a certain ratio. Here, when the physical size of the original page and the apparent size on the display device 102 are equal, the magnification is set to 100%. The ratio value multiplied by the coordinate value when the magnification is 100% is uniquely determined from the ratio between the resolution of the graphic data and the display resolution.

  FIG. 10 is a screen diagram illustrating an example of a menu for instructing a constant magnification display operation.

  In this menu, there are seven items of “25%”, “50%”, “100%”, “200%”, “400%”, “800%”, and “Specify magnification” shown in 1001 to 1007, respectively. is there. These menus 1001 to 1006 are rasterized at the selected magnification and displayed on the display device 102. When the item “Specify magnification” 1007 is selected, a dialog for inputting a numerical value of the magnification is opened. The dialog is rasterized at a magnification according to the input value and displayed on the display device 102.

  If the page rasterized at the specified magnification does not fit in the display area 504, only the displayable range is drawn. In addition to moving the scroll bars 505 and 506 at the right and bottom of the display area where the user can change the drawing range, the drawing range can also be changed by a pan operation described later.

B-2b. Window-Dependent Display Operation The window-dependent display operation is an operation for rasterizing graphic data with a size depending on the current application window display size and displaying it on the display device 102. 1008 and 1009 in FIG. 10 are examples of menus for instructing window-dependent display operations. “Display entire page” 1008 is a size so that the entire page fits within the display area in the window, and “Display with fit width” 1009 is a size so that the display area width and the rasterized page width are equal. Now, each is rasterized and displayed. If you change the size of the application window, it will be re-rasterized and displayed in the same size.

B-2c. Loupe operation The loupe operation is an operation for enlarging and displaying a part of the graphic data currently displayed in the application window. After selecting the “Loupe” item 1010 in the menu in FIG. 10, when the mouse button is pressed at one point on the display area and dragged as it is to release the button, the pressed point and the released point are paired. Enlarges and displays a rectangular range that is a corner point. At this time, the graphic data is rasterized and displayed at a magnification at which the width of the enlarged region is equal to the width of the display region, a magnification at which the height of the enlarged region is equal to the height of the display region, and the smaller of the two. If the mouse button is pressed and then released without dragging, it is displayed at twice the magnification currently displayed.

B-2d. Pan operation This operation changes the display range of rasterized graphic data partially displayed in the application window by dragging the mouse. When the “pan” item 1011 in the menu in FIG. 10 is selected and then the mouse button is pressed and dragged at one point on the display area, the displayed range moves in conjunction therewith. When the page width is within the width of the display area, it does not move to the left or right. Similarly, when the page height is within the display area, it does not move up and down.

B-2e. Display selection operation As described above, the graphic data constituting the page is held as graphic data in each region divided into document objects as described above. Document objects are roughly divided into foreground and background.

  Menus 1012, 1013, and 1014 in FIG. 10 are items for selectively displaying the foreground and the background. When “Foreground” 1012 is selected, only the foreground graphic data is displayed. When “Background” 1013 is selected, only the background graphic data is displayed. When “Foreground + Background” 1014 is selected, the foreground graphic data is displayed on the background graphic. Is displayed in a drawn state.

  FIG. 11 is a screen diagram illustrating an example of display selection.

  For example, when “Foreground” 1012 is selected, a screen 1801 is displayed, and when “Background” 1013 is selected, a screen 1802 is displayed. Further, when “Foreground + Background” 1014 is selected, a screen 1803 is displayed.

  Also, by selecting “Foreground Details” 1015 from the menu in FIG. 10, it is possible to select which expression type is displayed as a drawing object when the foreground area holds a plurality of types of graphic data expressions. A dialog is opened. Reference numeral 1901 in FIG. 12 is an example of a dialog displayed when “Foreground Details” 1015 is selected. In FIG. 12, the user can select either the character outline path data expression or the image data expression for the character area. Furthermore, for the line drawing area, one of internal / external contour path data expression (contour vector expression), shape element data expression (core line vector expression), and image data expression can be selected.

  In the present embodiment, the character code representation in the character region, the in-table character code and the matrix arrangement structure representation in the table region are not treated as graphics drawn as the foreground, and are the options in FIG. Is not included.

(C) Graphic selection operation (3)
Next, the graphic selection operation (3) will be described.

  The user can selectively instruct a partial range or the whole of graphic data by graphic selection operation (3). This operation is performed for the purpose of using a part or all of graphic data held by the application 303 on another application such as the application 304 in combination with a copy operation (4) described later.

  Menus 1101 to 1103 in FIG. 13 are menus for designating graphic types to be selected. After clicking one of the three items “select drawing object” 1101, “select character code” 1102, or “select table” 1103, drag the mouse over the display area to indicate the selection range. The selected graphic data is selected. The selected graphic data is a target of a copy operation (4) described later.

  Hereinafter, each of the above three types of selection will be described.

  First, when “drawing object selection” 1101 is instructed, the range designation on the display area by the mouse, that is, among the graphic data existing in the rectangular range having the point separated from the point where the mouse button is pressed as a diagonal point, The graphic data currently drawn is selected. Here, the currently drawn graphic data matches the graphic data selected by the menus 1012 to 1014 and 1015 in the display selection operation. That is, when the display of “foreground” 1012 is selected, only graphic data corresponding to the foreground is displayed, only when graphic display of “background” 1013 is selected, only graphic data of the background is displayed, and when display of “foreground + background” 1014 is selected, graphic data of both foreground and background are displayed. Can be selected. Further, when the foreground graphic data including a plurality of types of expressions is included in the target area, the graphic data expression of the type selected by the “foreground details” 1015 is selected.

  When there is a graphic drawing element straddling the boundary of the specified selection range, the correspondence between the selection range and the graphic drawing element in the selected state is matched. Therefore, it is necessary to perform processing such as changing the selection range or cutting out a part of the graphic data drawing element itself so as to be within the selection range. Specifically, when the graphic drawing element to be selected is image representation data (raster image), new graphic data created by cutting only the portion within the selection range from the original data is selected. However, it is better to actually perform the cutting process when the copy operation (4) described later is executed, not at the time of selection.

  On the other hand, when the graphic drawing element to be selected is vector representation data, it is not easy to cut out the data within the selection range, so one of the following two measures is taken.

(Countermeasure 1) Graphic drawing elements that protrude from the selection range are excluded from selection. (Countermeasure 2) The rectangle that is the selection range is automatically included so that all graphic drawing elements that overlap the selection range that the user first specified are included. FIG. 14 is a diagram showing an example of the (Countermeasure 1). When the mouse button dragged in the state 1201 in the figure is released, the graphic elements 1202 and 1203 that protrude from the range are not selected. Become. FIG. 15 is a diagram showing an example of the (Countermeasure 2). When the mouse button dragged in the state of 1301 in the figure is released, the selection range includes the graphic elements 1302 and 1303 that protrude from the range. It is automatically enlarged as in 1304.

  It should be noted that which of (Countermeasure 1) and (Countermeasure 2) is performed may be fixed or may be selected by the user. The operation may be changed depending on whether image data such as a background is included, or a small element such as a character and a large element such as a table frame or a line drawing.

  When “Select drawing object” 1101 is selected, a square frame corresponding to the selected range is displayed over the display area in order to visually specify the specified selected range. In addition, in order to visually indicate to the user which graphic drawing element is in the selected state, some of the graphic drawing elements that are selected symmetrically are displayed in the display area with a modification such as color or shape. Drawn on. For example, for data expressed in vectors, such as characters, line drawings, and table frames, the graphic drawing element in the selected state is drawn in red instead of the original color. As a result, the user can easily distinguish the data in the selected state from the data in the non-selected state.

  The color is not limited to the above example, but may be a color obtained by inverting the R (red), G (green), and B (blue) values of the original color. In addition, if it is easy to visually distinguish the graphic drawing elements in the selected state and the non-selected state, the fill pattern in the outline instead of the color can be changed, or the thickness can be changed. May be.

  Furthermore, the graphic drawing elements selected by the range specification are limited to those selected by the display selection operation described with reference to FIG. 10 and the like, that is, the drawing data actually displayed. At this time, the type of the graphic drawing element to be selected may be difficult to understand simply by looking at the graphic drawn in the display area. For example, for a white background portion, it is not possible to visually distinguish between the case where only “foreground” is displayed and the case where “foreground + background” is displayed. Alternatively, in the setting of “foreground details” 1015 in FIG. 10, the difference in appearance such as whether contour path data representation is drawn or shape element data is drawn as data representing a line drawing. May be small and difficult to distinguish.

  Therefore, by further changing the expression method that clearly indicates the selection state in accordance with the type of data in the selection state, it becomes clear to the user which data is copied in the copy operation (4) described later. Present. This prevents copying different types of data that are not intended. For example, when “foreground” is displayed in the display selection operation described above, the display color of the square frame corresponding to the selected area is blue, and when “background” is displayed and “foreground + background” is displayed, red and green are used.

  Further, in the setting of “foreground details” 1015 in FIG. 10, for the setting of the drawing type for an object having a plurality of expression types, a color frame synchronized with the drawing type is drawn slightly inside the above frame. Double frame display. For example, the inner frame is displayed in a one-to-one color according to the drawing type, such as a yellow frame when contour path data is selected, and a purple frame when shape element data is selected. Of course, it is not limited to the above-mentioned double frame with color, but may be a combination of color, line type, blinking, and the like. Alternatively, not only the frame but also the color and shape of the graphic drawing element in the selected state may be changed according to the data type.

  Returning to FIG. 13, when “select character code” 1102 is instructed, data of character code expression in the range specified by dragging the mouse is selected. Since the character code expression is not drawn as a graphic, the character code at that position is in the selected state by, for example, blackening the range corresponding to each selected character or arithmetically inverting the pixel value. Present to the user. FIG. 16 is a diagram illustrating a display example of a character code selection state. When an area 2001 is designated with the mouse, portions corresponding to characters in the area are blackened as indicated by 2002 in the figure.

  In FIG. 13, when “table selection” 1103 is instructed, the data representing the internal character code and matrix arrangement structure is selected for the table in the range specified by dragging the mouse. In order to clearly indicate to the user that the table has been selected, a frame of a color different from the selection of other drawing objects is overwritten on the outer periphery of the table.

  When the “area information display” item 1104 in FIG. 13 is designated, the area information obtained as a result of the block selection (area division) process (step S803 in FIG. 9) is displayed on the graphic data drawn in the display area. The corresponding rectangular frame is displayed. At this time, by clicking an arbitrary rectangular frame with the mouse, the graphic data in the frame and the graphic data for each document object can be selected. Note that the graphic data type to be selected follows the selection of 1101 to 1103 in FIG. 13 described above and the display selection operation described in FIGS. FIG. 17 shows an example after the designation of the “area information display” item 1104. In FIG. 17, the display selection operation is “foreground” and is indicated by a dotted line instead of a color.

(D) Copy operation (4)
When at least one graphic data element is in a selected state by the graphic selection operation (3), when the “copy” 1105 in FIG. 13 is instructed, the content of the selected graphic data is copied to the clipboard 305. . The graphic data copied to the clipboard 305 can be pasted and used in any application that can interpret the data format of the copied graphic data, such as the graphic editing application 304.

  The internal operation for the copy operation (4) will be described with reference to FIG. FIG. 18 is a flowchart showing an internal operation for the copy operation (4).

  First, in step S1401, when raster image data is included in the selection target, it is determined whether or not the image data is within the selection area. If it is within the selection area, the process proceeds to step S1403. If not, the process proceeds to step S1402. In the next step S1402, an image obtained by cutting only a portion overlapping the selection area from the selection target image data is set as a new selection target, and the original image data is excluded from the selection target.

  In step S1403, the graphic data format in the application internal format is converted into a format suitable for saving to the clipboard 305. Here, the graphic editing application 304 that uses this data is converted into a format that can be interpreted. In the subsequent step S1404, the converted graphic data is copied to the clipboard 305.

  Next, an example of data types to be copied to the clipboard 305 when graphic data is selected and copied is described with reference to FIGS. 19, 20, and 21.

  What is to be processed here is the data of the page shown in FIG. 22, in which 2501 is a foreground character area, and 2502 is a background area indicated by a dotted frame. In the setting of “foreground details” 1015 in FIG. 10, it is assumed that the path drawing of the character area is selected. In the display selection operation described with reference to FIG. 10 and the like described above, when any of the menus 1012 to 1014 is selected, an operation when the solid line indicated by 2503 in FIG. Will be explained.

  FIG. 19 is an explanatory diagram for explaining the selection of the “foreground” display.

  In the figure, when a selection range 2202 is designated with a mouse in the display area 2201 and a copy operation is performed, path drawing data 2203 and 2204 for two characters in the selection range are displayed on the clipboard from the path expression graphic data in the character area 2501. 305 is copied.

  FIG. 20 is an explanatory diagram for explaining the selection of the “background” display.

  In this figure, when a selection range 2302 is designated with a mouse in the display area 2301 and a copy operation is performed, image data 2303 obtained by cutting only the selection range from the image data in the background area 2502 in FIG. 22 is copied to the clipboard 305. .

  FIG. 21 is an explanatory diagram for explaining the selection of “foreground + background” display. A selection range 2402 is designated with a mouse in the display area 2401, and a copy operation is performed. Then, graphic data 2403 obtained by combining the path drawing data 2404 and 2405 and the image data 2406 is copied to the clipboard 305 from the path expression graphic data in the character area 2501. Here, the path drawing data 2404 and 2405 are path drawing data for two characters in the selection range, and the image data 2406 is image data obtained by cutting only the selection range from the image data of the background area 2502.

  Since the graphic data 2403 in FIG. 21 is described so that the path data is drawn after drawing the background image data, the application receiving the graphic data 2403 can handle the character and the background separately. It is.

(E) Write operation (5)
When the “save” item 902 in FIG. 8 is designated, the graphic data held by the application 303 is saved in a file designated by the user in a dialog (not shown) displayed immediately after.

(D) Close operation (6)
When the “close” item 903 in FIG. 8 is instructed, the graphic data currently being read is discarded, and the process returns to the state of waiting for the file reading operation (1) described above. When the “end” item 904 is instructed, the graphic data is discarded as in the “close” item 903 and the application 303 is ended.

<Advantages of this embodiment>
According to the present embodiment, there are the following advantages when graphic data having a plurality of objects is copied between a plurality of applications. That is, when editing objects that have a hierarchical structure such as the background or foreground while switching the display between the background only, the foreground only, both the background and the foreground, etc., the user specifies only the object that is visible to the user. It is possible to copy within the range. Moreover, it is possible to copy while maintaining the hierarchical structure. Therefore, the user does not need to consider the hierarchy of objects that cannot be seen by the user and the types of objects, and can edit and process data with intuitive and easy-to-understand operations.

  Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the computer of the system or apparatus (or CPU, MPU, or the like). Is also achieved by reading and executing the program code stored in the storage medium.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention. .

  Examples of the storage medium for supplying the program code include a floppy (registered trademark) disk, a hard disk, a magneto-optical disk, a CD-ROM, a CD-R, a CD-RW, a DVD-ROM, a DVD-RAM, and a DVD. An optical disc such as RW or DVD + RW, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used. Alternatively, the program code may be downloaded via a network.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (Operating System) running on the computer based on the instruction of the program code Includes a case where the functions of the above-described embodiments are realized by performing part or all of the actual processing.

  Furthermore, after the program code read from the storage medium is written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the expanded function is based on the instruction of the program code. This includes a case where a CPU or the like provided on the expansion board or the expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

It is a block diagram which shows the structure of the image processing apparatus which concerns on embodiment. It is a block diagram which shows the hardware constitutions of a computer apparatus. It is a block diagram which shows the outline of the software structure performed with a computer apparatus. It is a flowchart which shows the whole flow of the process which concerns on embodiment. It is a figure which shows an example of the window which comprises the external appearance of an application. It is a figure which shows the transition relationship of each operation which can be instruct | indicated by a user. It is a flowchart which shows the operation | movement inside an application at the time of file reading operation. It is a figure which shows the detailed display screen when the file of a menu bar is selected. It is a flowchart which shows the conversion process from raster image data to graphic data. It is a figure which shows an example of the menu screen which instruct | indicates constant magnification display operation. It is a screen figure which shows the example of display selection. It is a figure which shows the detail selection screen of a foreground drawing object. It is a figure which shows the menu screen which instruct | indicates a graphic kind. It is a figure which shows the example of (handling 1). It is a figure which shows the example of (handling 2). It is a figure which shows the example of a display of a character selection state. It is a figure which shows the example after instruct | indicating an area | region information display item. It is a flowchart which shows the internal operation | movement with respect to copy operation. FIG. 11 is an explanatory diagram for explaining a selection of “foreground” display. It is explanatory drawing for demonstrating the time of selection of a "background" display. It is explanatory drawing for demonstrating the time of selection of "foreground + background" display. It is a figure which shows the example of a page used for the process of FIG.19, FIG.20 and FIG.21.

Explanation of symbols

101 Computer Device 102 Display Device 103 Printer 104 Operation Device 105 Scanner 201 CPU
202 Memory 203 Hard disk 301 OS
302 Scan Application 303 Graphic Data Generation Application 304 Graphic Editing Application 305 Clipboard

Claims (12)

Display selection means for displaying an object selected from image data having a plurality of objects;
Range selection means for selecting the object displayed by the display selection means by designating a range;
An image processing apparatus comprising: a range designation copying unit that copies an object in a range selected by the range selection unit.   The image processing apparatus according to claim 1, wherein the plurality of objects have a plurality of hierarchical structures.   The image processing apparatus according to claim 2, wherein the hierarchical structure is a structure in which a plurality of objects are overlapped including a background and a foreground.   4. The image processing apparatus according to claim 1, wherein the object displayed by the display selection unit is data selected in units of types, hierarchies, or objects. The range selection means, when there is an object that crosses the boundary of the specified selection range,
Performs processing that transforms the selection range to a range that matches the shape of the object, processing that selects a part of the object that overlaps the specified range, or processing that does not select objects that cross the boundary of the specified selection range The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.   6. The image processing apparatus according to claim 1, wherein when the selection range is a part of an object, the range designation copying unit copies image data obtained by cutting and converting only the selection range. .   7. The range designation copying means, when a plurality of objects are displayed in a selection range, copying by range designation for each object, and maintaining a hierarchical structure between the objects. An image processing apparatus according to claim 1.   The image processing apparatus according to claim 1, further comprising an object generation unit configured to generate a plurality of types of the objects from input raster image data.   The image processing apparatus according to claim 8, wherein the object generation unit divides the raster image into a plurality of areas for each attribute, and generates the plurality of types of objects based on the divided areas.   The object generation unit generates at least one of character code data, contour path data, and N-value image data from a character region in the raster image, and contour path data and core vector data from the line drawing region in the raster image. The at least one of image data and N-value image data is generated, and at least one of frame line data, character string data, and structure data is generated from a table area in the raster image. Image processing device. A display selection step of displaying an object selected from image data having a plurality of objects;
A range selection step of selecting the object displayed in the display selection step by designating a range; and
A range designation copying step of copying an object in the range selected in the range selection step. A display selection step for displaying an object selected from image data having a plurality of objects;
A range selection step of selecting the object displayed in the display selection step by designating a range; and
A computer-readable control program comprising: a range designation copying step for copying an object in a range selected in the range selection step.

Images