JP2007274405A - Image editing and printing processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve a conventional problem that editing possible for an editing processing method is restricted in a document processing system for reading and printing high-resolution image data, a long time is required for the editing processing and user's operational feelings are damaged. <P>SOLUTION: There are included an operating mode for directly modifying a source image by an image editor and an operating mode for recording an editing work process, and the operating modes can be switched even in the middle of editing. By including a date/time designating UI means, a time not to disturb user's work is selected and image editing work is carried out. Whether it is necessary to use the source image is discriminated in response to user operation, a mode switching caution is displayed and mode switching is automatically performed. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image editing method and system related to image editing processing of a document processing system that reads and prints high-resolution image data, and more particularly to an information processing apparatus such as a personal computer, a printer, a scanner, or a composite The present invention relates to an image editing method and a system thereof in a system comprising a machine.

  Conventionally, in a document processing system that directly edits a full-size image (original image) read by an image reading / editing apparatus, the original image is edited each time according to a user's editing operation. For this reason, there is a known problem that the user operation is interrupted while the editing process is being performed, and the operational feeling of the user's editing operation is impaired.

  Therefore, the user's editing operation is performed on a low-resolution image that has been reduced in advance separately from the original image, and the editing process such as enlargement / reduction / rotation / cutout is stored according to the operation. However, a system has been devised that edits an original image in accordance with the process of editing a low-resolution image immediately after the editing operation is completed or immediately before the data is printed.

In addition, it has been proposed to execute an editing operation that reflects the stored editing operation on the original image as a background job. (Patent Document 1)
Japanese Patent Publication No. 05-089441

  However, since these systems operate based on the low-resolution image, operations that require image recognition on the original image cannot be executed. Therefore, there has been a restriction on image editing operations.

  Also, editing of the original image requires a relatively large amount of computer resources. In a system that edits an original image immediately before printing, it takes time from the user's print execution instruction until the printing operation is started. In a system that executes an original image editing operation as a background job, the operation of the computer is slowed while the background job is being executed. In any case, processing time is required, but since the operation of each processing is uniquely specified by the system, it cannot be switched in the middle, let alone select the time that is convenient for the user to perform the processing. I couldn't.

  In addition to the original image, the user's editing operation is performed on the low-resolution image obtained by reducing the original image in advance, and the editing process such as enlargement / reduction / rotation / cutout is stored according to the operation, A system for editing an original image according to a low resolution image editing process immediately after the editing process or immediately before printing the data, an operation mode for directly modifying the original image, and an operation mode for recording the editing process The operation mode switching UI means for switching the operation mode in the middle of editing, and the low resolution image generation means for generating and holding a low resolution image corresponding to the correction of the original image, thereby directly correcting the original image. It is possible to hold a low-resolution image even in the operation mode in which the operation mode is applied, and the operation mode can be switched even during editing.

  In addition, by having a schedule means for executing image editing work on the original image at the designated date and time, and a date and time designation UI means that can designate the date and time in the schedule means, the user's work can be performed together with the operation mode switching designation. It is possible to select an uninterrupted time and execute an image editing operation.

  In addition, it is an operation mode that records the editing process, and has an original image necessity determination means that determines whether or not it is necessary to use the original image according to the user's operation. By having an automatic mode switching means for switching, operations that require image recognition on the original image can be seamlessly switched and executed even during editing operations in the operation mode that records the editing process. It becomes possible.

  As described above, according to the present invention, in an image editing system, a low-resolution image can be held even in an operation mode in which correction is directly performed on an original image, and the operation mode can be switched even during editing.

  It is possible to execute the image editing operation on the original image at the designated date and time, and it is possible to execute the image editing operation by selecting a time that does not hinder the user's operation.

  Furthermore, by determining the necessity of the original image according to the user's operation, operations that require image recognition on the original image can be seamlessly performed even during editing operations in an operation mode that records the editing operation process. It becomes possible to execute by switching the operation mode.

[Outline of Document Processing System of this Embodiment]
The outline of the document processing system according to the first embodiment of the present invention will be described with reference to FIGS.

<Software Configuration Example of Document Processing System According to this Embodiment>
FIG. 1 is a diagram showing a software configuration of the document processing system according to the present embodiment.

  The document processing system is realized by a digital computer 100 (hereinafter also referred to as a host computer) which is a preferred embodiment of a document processing apparatus (information processing apparatus) according to the present invention. The image data is converted into an electronic document file 103 by a bookbinding application 104 described later. As a substantial standard format of the electronic manuscript file, for example, a PDF format by Adobe Systems, an SVG format, or the like can be adopted as the electronic manuscript file. The electronic manuscript file at this point is merely a description of each page of the manuscript, and the bookbinding application 104 further completes the manuscript file in a format that can express the manuscript in page units with a detailed format. . Hereinafter, when it is necessary to clearly identify this point, a file describing each page of a document is called an electronic document file, and an electronic document file given a structure by a bookbinding application is called a book file. If there is no need to distinguish between them, they are called document files (or document data).

  The image is converted into an electronic document format in units of pages (hereinafter referred to as “logical pages” or “document pages”), and stored as an electronic document file 103 in a storage medium such as a hard disk.

  The hard disk may be a local drive included in a computer that implements the document processing system of the present embodiment, or may be a drive provided on the network when connected to the network. .

  The bookbinding application 104 provides a user with a function for generating an electronic document file from image data or reading a book file 103 and editing it. The bookbinding application 104 provides a function for editing a later-described chapter or book structure with a page as a minimum unit. In addition, a function of editing the contents of each page by starting the editor 108 is also provided. The editor 108 is a program module installed in the computer together with the bookbinding application, and is a module used for editing the page content itself of the electronic manuscript file.

  When the book file 103 edited by the bookbinding application 104 is printed, the bookbinding application 104 activates the electronic document despooler 105. The electronic document despooler 105 is a program module installed in the computer together with the bookbinding application, and is a module used to output drawing data to the printer driver when printing a document (book file) used in the bookbinding application. It is. The electronic manuscript despooler 105 reads out a designated book file from the hard disk and generates an output command suitable for the OS output module described above to print each page in the format described in the book file. Output to the output module. At that time, the driver 106 of the printer 107 used as an output device is designated as a device driver. The output module converts the output command received using the printer driver 106 of the designated printer 107 into a device command that can be interpreted and executed by the printer 107. The device command is transmitted to the printer 107, and an image corresponding to the command is printed by the printer 107.

  Alternatively, when the printer 107 can directly interpret the electronic document format, the electronic document despooler 105 transmits the electronic document format data and the print instruction to the printer 107. The electronic manuscript despooler 105 reads a designated book file from the hard disk, generates a device command suitable for the printer 107 in order to print each page in the format described in the book file, and outputs it to an output module (not shown). To do. The output module transmits a device command to the printer 107, and an image corresponding to the command is printed by the printer 107.

<Hardware Configuration Example of Document Processing System of this Embodiment>
FIG. 2 is a diagram illustrating a hardware configuration of the document processing system according to the present embodiment. In FIG. 2, the host computer 100 performs document processing in which graphics, images, characters, tables (including spreadsheets), etc. are mixed based on a document processing program stored in the ROM 203 or the external memory 211. The CPU 201 generally controls each device connected to the system bus 204. In addition, an operating system program or the like as a control program of the CPU 201 is stored in the program ROM or the external memory 211 in the ROM 203, and the font ROM or the external memory 211 in the ROM 203 is used for the document processing. Font data and the like are stored, and various data used when performing the document processing and the like are stored in the data ROM in the ROM 203 or the external memory 211. The RAM 202 functions as a main memory, work area, and the like for the CPU 201.

  A keyboard controller (KBC) 205 controls key input from a keyboard 209 or a pointing device (not shown). A CRT controller (CRTC) 206 controls display on a CRT display (CRT) 210. A disk controller (DKC) 207 is a hard disk (HD), a flexible disk (FD), etc. that stores a boot program, various applications, font data, user files, edit files, a printer control command generation program (hereinafter referred to as a printer driver), and the like. The access to the external memory 211 is controlled. A printer controller (PRTC) 208 is connected to the printer 107 via a bidirectional interface (interface) 21 and executes communication control processing with the printer 107. The NC 212 is connected to the network and executes communication control processing with other devices connected to the network.

  Note that the CPU 201 executes, for example, outline font development (rasterization) processing on the display information RAM set on the RAM 202 to enable WYSIWYG on the CRT 210. The CPU 201 opens various windows registered based on commands instructed by a mouse cursor (not shown) on the CRT 210 and executes various data processing. When executing printing, the user opens a window relating to print settings, and can set the print processing method for the printer driver including printer settings and print mode selection.

  The printer 107 is controlled by the CPU 312. The CPU 312 of the printer outputs as output information to a printing unit (printer engine) 317 connected to the system bus 315 based on a control program stored in the program ROM in the ROM 313 or a control program stored in the external memory 314. The image signal is output. The program ROM in the ROM 313 stores a control program for the CPU 312 and the like. The font ROM in the ROM 313 stores font data used when generating the output information, and the data ROM in the ROM 313 is a host computer in the case of a printer without the external memory 314 such as a hard disk. Information used above is stored.

  The CPU 312 can communicate with the host computer via the input unit 318 and can notify the host computer 100 of information in the printer. The RAM 319 is a RAM that functions as a main memory of the CPU 312, a work area, and the like, and is configured such that the memory capacity can be expanded by an optional RAM connected to an expansion port (not shown). The RAM 319 is used for an output information expansion area, an environment data storage area, NVRAM, and the like. Access to the external memory 314 such as the hard disk (HD) and the IC card described above is controlled by the memory controller (MC) 20. The external memory 314 is connected as an option and stores font data, an emulation program, form data, and the like. Reference numeral 321 denotes the above-described operation panel, on which switches for operation, LED indicators, and the like are arranged.

  The external memory 314 is not limited to one, and a plurality of external memories 314 are provided, and a plurality of external memories storing an option card and a program for interpreting a printer control language having a different language system in addition to the built-in font can be connected. May be. Furthermore, an NVRAM (not shown) may be provided, and printer mode setting information from the operation panel 321 may be stored.

<Example of electronic manuscript data format>
Before referring to details of the editing application 104, the data format of the book file will be described. The book file has a three-layer structure imitating a paper medium book. The upper layer is called a “book”, imitating one book, and attributes relating to the book as a whole are defined. The middle layer below it corresponds to the chapter in the book and is also called “chapter”. For each chapter, attributes for each chapter can be defined. The lower layer is a “page” and corresponds to each page defined by the application program. You can define attributes for each page. A book may contain multiple chapters, and a chapter may contain multiple pages.

  FIG. 3 is a diagram schematically showing an example of a book file format. The book, chapter, and page in the book file of this example are indicated by corresponding nodes. One book file contains one book. Since the book and chapter are concepts for defining the structure of the book, they include defined attribute values and links to lower layers as entities. The page includes a document page entity (document page data) and a link to each document page data in addition to the attribute value. Note that a print page when outputting to a paper medium or the like may include a plurality of document pages. This structure is not displayed by a link, but is displayed as an attribute in each hierarchy of a book, chapter, and page.

  In FIG. 3, since the book file does not have to be one complete book, “book” is generalized as “document”.

  First, the document information 401 is held at the top. The document information 401 can be roughly divided into three parts 402 to 404. The document control information 402 holds information such as a path name in the file system of the document file. The document setting information 403 holds layout information such as page layout and printing apparatus function setting information such as stapling, and corresponds to a book attribute. The chapter information list 404 holds a set of chapters constituting a document in a list format. The list holds chapter information 405.

  The chapter information 405 can be roughly divided into three parts 406 to 408. The chapter control information 406 holds information such as a chapter name. The chapter setting information 407 holds page layout information and stapling information unique to the chapter, and corresponds to chapter attributes. By having setting information for each chapter, it is possible to create a document having a complicated layout such that the first chapter has a 2UP layout and the other chapters have a 4UP layout. The page information list 408 is held in the form of a collection list of manuscript pages constituting each chapter. The page information list 408 indicates page information data 409.

  The page information data 409 is also roughly divided into three parts 410 to 412. The page control information 410 holds information such as page numbers to be displayed on the tree. The page setting information 411 holds information such as page rotation angle and page layout position information, and corresponds to an original page attribute. The page link information 412 is document data corresponding to a page. In this example, the page information 409 does not directly have document data, but has only link information 412, and actual document data is held in the page data 413.

  The page data 413 includes original image data 417, low resolution data 418, and a correction command list 419, and holds link information to each data. The correction command list 419 may not have a link destination when no correction work is performed.

<Example of Operation Procedure of Document Processing System of Present Embodiment>
FIG. 4 shows an example of a processing procedure when a user generates a document file from an image in the document processing system of this embodiment.

The image designated by the user is converted into the electronic document file 103 by the bookbinding application 104 (S401). The bookbinding application 104 further generates a book file by adding a detailed format (S402).
Next, a low resolution image is created from the original image data 417 of the book file (S 403) and saved as low resolution data 418.

  5 to 8 show an example of a processing procedure when the editor 108 is activated and the image of each page is corrected in the document processing system of the present embodiment.

  The editor 108 has an original image editing mode for directly correcting the original image data and an editing process recording mode for recording the editing work process and actually correcting the original image data at a later timing. The user can select whether to do so on the editor 108. In the initial state when the user starts the editor 108 for the first time, the editing process recording mode is selected. Thereafter, it is determined in which mode to start in accordance with the user's selection (S501).

  A case where the editing process recording mode is activated will be described with reference to the flowchart of FIG. First, the screen is displayed using the low resolution data 418 for the user's editing operation (S601). When the user performs an image correction operation, it is determined whether the operation performed by the user is an operation that requires correction of the original image (S602, S603). Here, the operations that require correction to the original image are processing that requires image recognition, such as black spot removal, strict inclination correction, and strict direction detection, or original processing such as filter processing, color processing, and pixel magnification This refers to processing that requires editing in units of pixels.

  If it is determined that the original image needs to be corrected (S603), a mode switching warning as shown in FIG. 11 is displayed (S611), and if the user selects switching of the editing mode (S612), a correction command list is displayed. The correction operations stored in 419 are sequentially applied to the original image (S613). Then, the original image is corrected in accordance with the user operation with respect to the updated original image (S614). Thereafter, the low-resolution image is updated based on the corrected original image (S615) and stored (S616). After that, it operates in the original image editing mode shown in FIG. If the user does not select the editing mode switching (S612), the user operation is canceled and the operation in the editing process recording mode is continued.

  If it is determined that no correction is required for the original image (S603), an image correction command is created according to the user's operation (S604) and added to the correction command list 419 (S605). Then, the stored correction operation is applied to the low resolution image (S606), and the updated low resolution image is stored (S607). Then, the preview is updated with the low resolution image (S608). Thereafter, when the user performs an editing mode switching operation (S609), the operation mode is changed, and the operation is performed in the original image editing mode. When the user does not perform the edit mode switching operation, the operation of the edit process recording mode is continued. Then, the operation of the editor is continued until the user selects the end of the editor 108 (S610).

By configuring the processing when the editor 108 is started in the editing process recording mode as described above, it is possible to switch to the original image editing mode at any time, and all image processing regardless of the current operation mode. Can be specified.
A case where the editing process recording mode is activated will be described with reference to the flowchart of FIG. First, the screen is displayed using the low resolution data 418 for the user's editing operation (S601). When the user performs an image correction operation, it is determined whether the operation performed by the user is an operation that requires correction of the original image (S602, S603). Here, the operations that require correction to the original image are processing that requires image recognition, such as black spot removal, strict inclination correction, and strict direction detection, or original processing such as filter processing, color processing, and pixel magnification This refers to processing that requires editing in units of pixels.

  If it is determined that the original image needs to be corrected (S603), a mode switching warning as shown in FIG. 11 is displayed (S611), and if the user selects switching of the editing mode (S612), a correction command list is displayed. The correction operations stored in 419 are sequentially applied to the original image (S613). Then, the original image is corrected in accordance with the user operation with respect to the updated original image (S614). Thereafter, the low-resolution image is updated based on the corrected original image (S615) and stored (S616). After that, it operates in the original image editing mode shown in FIG. If the user does not select the editing mode switching (S612), the user operation is canceled and the operation in the editing process recording mode is continued.

  As another example, if it is determined that corrections to these original images are necessary (S603), a mode switching warning as shown in FIG. 11 or a mode shown in FIG. It is also possible to adopt a configuration in which a warning that prompts switching is displayed and the operation is canceled.

  As another example, the preview and print result can be obtained by performing image recognition by regarding the low-resolution image as an original image and holding the processing content as a command even if the operation requires correction to the original image. It is also possible to adopt a configuration in which the editing process recording mode is maintained without causing any difference.

  If it is determined that no correction is required for the original image (S603), an image correction command is created according to the user's operation (S604) and added to the correction command list 419 (S605). Then, the stored correction operation is applied to the low resolution image (S606), and the updated low resolution image is stored (S607). Then, the preview is updated with the low resolution image (S608). After that, when the user performs an editing mode switching operation through the user interface on the editor 108 as illustrated in FIG. 12 (S609), the operation mode is changed and the original image editing mode is operated. When the user does not perform the edit mode switching operation, the operation of the edit process recording mode is continued. Then, the operation of the editor is continued until the user selects the end of the editor 108 (S610).

  By configuring the processing when the editor 108 is started in the editing process recording mode as described above, it is possible to switch to the original image editing mode at any time and to perform all image processing regardless of the current operation mode. Can be specified.

  Next, the case where the editor is activated in the original image editing mode (S501) will be described with reference to the flowchart of FIG. First, the original image data 418 is displayed on the screen for the user's editing operation (S701). When the user performs an image correction operation (S702), the original image is corrected according to the user's operation (S703). Thereafter, the low-resolution image is updated based on the corrected original image (S704) and stored (S705). Then, the preview is updated with the original image (S706). Thereafter, when the user switches the editing mode through the user interface on the editor 108 as illustrated in FIG. 12 (S707), the operation mode is changed and the editing process recording mode is operated. When the user does not perform the editing mode switching operation, the operation in the original image editing mode is continued. Then, the operation of the editor is continued until the user selects the end of the editor 108 (S708).

  By configuring the processing when the editor 108 is started in the original image editing mode as described above, it is possible to switch to the editing process recording mode at any time.

  Next, the processing of the correction command list 419 at the end of the editor 108 will be described with reference to FIG.

  When the user instructs the termination of the editor, it is confirmed whether or not the command exists in the correction command list 419 (S801). When there is a command, a UI for allowing the user to select a processing date and time as illustrated in FIG. 14 is displayed (S802). When it is instructed to process immediately (S803), the correction operations stored in the correction command list 419 are sequentially applied to the original image (S804). Thereafter, the low-resolution image is updated based on the corrected original image (S805) and stored (S806).

  When the processing reservation time is designated (S803), the processing reservation time is notified to a timer (not shown), the processing time is recorded (S807), and the process ends. FIG. 10 shows an example of processing executed by the editor 108 at the reserved time. When the reservation execution process is started, the correction operations stored in the correction command list 419 are sequentially applied to the original image (S1001). Based on the updated original image, the low-resolution image is updated (S1002) and stored (S1003).

  FIG. 9 shows an example of processing after the printing processing is started. When the printing process is started, it is confirmed whether a command exists in the correction command list 419 (S901). If there is a command, the correction operations stored in the correction command list 419 are sequentially applied to the original image (S902). Then, based on the updated original image, the low resolution image is updated (S903) and stored (S904). Thereafter, printing is performed (S905).

  The process of sequentially applying the correction operations to the original image takes time when the amount of the correction command list is large. Accordingly, it is possible to adopt a configuration for displaying a UI that allows the user to select whether to continue the printing process as illustrated in FIG.

  With the configuration described above, the image after applying the correction command list is saved as a low-resolution image regardless of the update of the original image. Therefore, the bookbinding application 104 can display a preview using the low-resolution image. It becomes possible to display as if all correction operations were performed on the original image.

  In addition, since editing can be performed by the editor a plurality of times before the application timing of the correction command list, even if the editing operation is divided into a plurality of times, the image quality degradation accompanying the conversion of the original image is minimal.

  In the flowchart shown in the present embodiment, before and after the processing can be switched as long as the processing is not completed.

Further, the present invention can be applied to a system (copier, printer, facsimile machine, etc.) consisting of a single device even if it is applied to a system consisting of a plurality of devices (eg, host computer, interface device, reader, printer, etc.). You may apply.

  Another object of the present invention is to read a program code stored in a storage medium by a computer (or CPU or MPU) of a system or apparatus, which stores a program code of software that realizes the functions of the above-described embodiments. It is also achieved by executing. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the storage medium storing the program code constitutes the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on the instruction of the program code. A case where part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion board is based on the instruction of the program code. Also included is a case where the CPU or the like provided in the function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

FIG. 3 is a block diagram illustrating a software configuration example of a stand-alone document processing system according to the present exemplary embodiment. It is a block diagram which shows the hardware structural example which implement | achieves the document processing system of this embodiment. It is a figure which shows an example of the structure of a document file. 6 is a flowchart illustrating an example of a document file creation process. It is a flowchart which shows an example of the starting process of an editor. It is a flowchart which shows an example of the edit process in the editor of edit process recording mode. It is a flowchart which shows an example of the edit process by the editor of an original image edit mode. It is a flowchart which shows an example of the completion | finish process of an editor. 6 is a flowchart illustrating an example of a printing process. It is a flowchart which shows an example of reservation processing execution of an image correction. It is a figure which shows the example of the user interface which showed the edit mode switching warning. It is a figure which shows the example of the user interface which designates switching operation of edit mode. It is a figure which shows the example of the user interface which showed the warning which prompts switching of edit mode. It is a figure which shows the example of the user interface which selects the process date of a correction command list. It is a figure which shows the example of the user interface which selects whether a printing process is continued.

Claims (3)

In a system that performs an editing operation on a low-resolution image obtained by reducing the original image in advance separately from the original image, stores the editing process, and edits the original image according to the editing process.
It has an operation mode that directly modifies the original image and an operation mode that records the editing process.
An operation mode switching UI means for switching the operation mode during editing;
An image editing system having low resolution image generation means for generating and holding a low resolution image corresponding to editing of an original image. The image editing system according to claim 1,
A scheduling means for executing image editing work on the original image at a specified date and time;
The schedule means has a date and time designation UI means that can designate the date and time,
An image editing system characterized in that a user can select a time and execute an image editing operation. The image editing system according to claim 1,
It has an original image necessity determination means for determining whether or not it is necessary to use the original image for each user operation,
UI means for displaying a mode switching warning;
With automatic mode switching means,
Even when editing operations are being performed in an operation mode that records the editing process, when an operation that requires image recognition is required for the original image, the operation mode is automatically switched to execute the image editing operation. An image editing system characterized by being capable.

Images