JP2005117623A - Document editing method, image processing apparatus, and document editing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a document editing method, an image processing apparatus and a document editing program which are suitable for editing a document including image data via a communication line. <P>SOLUTION: The document editing method edits a document including image data stored in the image processing apparatus at a communication destination communicating with the image processing apparatus. The method has a document-related information providing step in which the document-related information about the document stored in the image processing apparatus is provided to the communication destination, an editing step in which editing is performed at the communication destination on the basis of the provided document-related information, and an editing reflecting step in which the editing performed at the communication destination is reflected to the document. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a document editing method and an image processing apparatus for editing a document including image data via a communication line.

  In recent years, with the development of computers and networks, it has become possible to download and edit image data (hereinafter referred to as images) from a device storing images on a personal computer. Recently, it has become possible to download and display images on mobile terminals such as mobile phones and PDAs.

  The data size of such an image is a relatively large size, and an image having a size in megabytes is not uncommon.

  Therefore, when downloading and editing an image, it takes time to download. In addition, there is a possibility that even a terminal such as a mobile terminal that has limited memory resources cannot be downloaded. Even if it can be downloaded, depending on the performance of the processor and image editing software, it may not be easy to use due to the scrolling of images and the time required for editing.

  SUMMARY OF THE INVENTION In view of such problems, it is an object of the present invention to provide a document editing method, an image processing apparatus, and a document editing program suitable for editing a document including image data via a communication line.

  In order to solve the above problems, the present invention provides a document editing method for editing a document including image data stored in an image processing apparatus at a communication destination that communicates with the image processing apparatus. Document-related information relating to a document stored in the document is provided in a document-related information providing stage provided to the communication destination, an editing stage in which editing is performed in the communication destination based on the provided document-related information, and the communication The editing performed previously includes an editing reflection stage to be reflected in the document.

  In order to solve the above problem, the present invention is characterized in that the document related information is reduced image data converted to a size smaller than the data size of the image data.

  In order to solve the above problem, the present invention provides document list information in which document list information, which is a list of documents stored in the image processing apparatus, is provided to the communication destination before the document related information providing step. It is characterized by having a providing stage.

  In order to solve the above problem, the present invention is characterized in that the communication destination is provided with bibliographic information of a document in addition to the document list.

  In order to solve the above problem, the present invention is characterized in that, in the editing stage, graphic information relating to a graphic edited in the reduced image data is acquired.

  In order to solve the above problem, the present invention is characterized in that color information of the graphic is acquired in the editing stage.

  In order to solve the above problem, the present invention is characterized in that, in the editing reflection stage, the editing is reflected in the document based on the graphic information and color information.

  In order to solve the above problem, the present invention is characterized in that the graphic information includes a shape and coordinates of a graphic.

  In order to solve the above problem, the present invention is characterized in that the coordinates are converted according to the degree of reduction of the reduced image data.

  In order to solve the above problem, the present invention is characterized in that the color is converted according to the color space to which the color of the graphic belongs.

  In order to solve the above-described problem, the present invention provides a document storage unit for storing the document and a document related to the document in an image processing apparatus in which a document including stored image data can be edited at a communication destination. Document related information generating means for generating related information, document related information providing means for providing the document related information to the communication destination, and editing operation information which is information relating to editing performed at the communication destination. An editing operation information receiving unit and an editing reflecting unit that reflects the editing operation information in the image data are provided.

  In order to solve the above-described problem, the present invention includes reduced image data generation means for generating reduced image data converted to a size smaller than the data size of the image data, and the document related information includes the reduced image data. It is image data.

  In order to solve the above problem, the present invention is characterized by comprising document list information providing means for providing document list information, which is a list of documents to be stored, to the communication destination.

  In order to solve the above problems, the present invention is characterized by further comprising bibliographic information providing means for providing bibliographic information of documents in addition to the document list.

  In order to solve the above problems, the present invention is characterized in that the editing operation information receiving means receives graphic information relating to a graphic edited in the reduced image data.

  In order to solve the above problems, the present invention is characterized in that the editing operation information receiving means receives color information of the graphic.

  In order to solve the above problem, the present invention is characterized in that the graphic information includes a shape and coordinates of a graphic.

  In order to solve the above problem, the present invention is characterized in that the coordinates are converted according to the degree of reduction of the reduced image data.

  In order to solve the above problem, the present invention is characterized in that the color is converted according to the color space to which the color of the graphic belongs.

  In order to solve the above-described problem, the present invention provides a document editing method for editing a document by communicating with an image processing apparatus in which a document including image data is stored, the image processing apparatus storing the document A document-related information acquisition stage for acquiring document-related information regarding the document being processed, a document-related information display stage for displaying the document-related information, and an editing operation for reflecting the editing operation of the editor in the display of the document-related information The method includes a reflection stage, and a job creation execution stage for creating a job instruction for instructing the image processing apparatus to perform the editing and causing the image processing apparatus to execute the job instruction.

  In order to solve the above problem, the present invention is characterized in that the document related information is reduced image data converted to a size smaller than the data size of the image data.

  In order to solve the above problems, the present invention provides a document editing program for executing the document editing method according to claim 20 or 21 on a computer.

  According to the present invention, it is possible to provide a document editing method, an image processing apparatus, and a document editing program suitable for editing a document including image data via a communication line.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the embodiment of the present invention, the multi-function apparatus is described as an image processing apparatus, and the client is described as a communication destination. Further, in the following description, expressions such as image data and document are used, but the document includes image data.

  First, the document editing system in the present embodiment will be described with reference to FIG. FIG. 1 shows the MFP 1 and a client 102 that is connected to the MFP 1 and edits a document. The multi-function apparatus 1 has a hard disk 65 (hereinafter referred to as HDD) for storing images. The client 102 also has a mouse 103 that is used to edit a document.

  With such a configuration, the client 102 can edit a document in the HDD 65 of the multifunction machine 1. The client 102 may be a personal computer as shown in the figure, or may be a mobile phone or a PDA.

  Next, the configuration of the MFP 1 and the client 102 will be described.

  FIG. 2 shows a configuration diagram of an embodiment of the compound machine. The multi-function apparatus 1 is configured to include a software group 2, a multi-function apparatus activation unit 3, and hardware resources 4.

  The compound machine starting unit 3 is executed first when the compound machine 1 is powered on to activate the software. For example, the multi-function apparatus activation unit 3 reads the program of the application layer 5 and the platform layer 6 from the HDD or the like, transfers each read program to the memory area, and activates it. The hardware resource 4 includes a scanner 11, a plotter 12, an image distortion detection accelerator 43, an image processing accelerator 44, and other hardware resources 13 such as an ADF (Auto Document Feeder).

  The software group 2 is activated on an operating system (hereinafter referred to as OS 40) such as UNIX (registered trademark). The application layer 5 includes a program that performs processing unique to each user service related to image formation such as copying.

  The application layer 5 includes a copy application 22, which is a copy application, a WEB page application 25, a SOAP communication application 26, a document management service SF (Shared Function) 28, a document editing service SF (Shared Function) 29, and a WSF. (Web Service Function) 27.

  When both the document management service SF28 and the document editing service SF29 are expressed together, they are simply expressed as SF. The number of SFs is not limited to two as shown in the figure, and the number increases or decreases depending on the specification. The SF provides a common interface for programs such as applications and modules. SOAP is Simple Object Access Protocol.

  The WSF 27 has an application program interface (hereinafter referred to as API) 51 that receives processing requests from the WEB page application 25 and the SOAP communication application 26 using a predefined function. The SF also has an API 52 that receives a processing request from the WSF 27 using a predefined function.

  When the WSF 27 receives a processing request from the WEB page application 25 or the SOAP communication application 26 via the API 51, the WSF 27 selects one of the document management service SF28 and the document editing service SF29 according to the processing request. The WSF 27 transmits the processing request received via the API 51 via the API 52 to the SF selected according to the processing request. When the document management service SF28 and the document editing service SF29 receive a processing request via the API 52, the document management service SF28 and the document editing service SF29 perform processing according to the processing request. The SOAP communication application 26 is a higher-level module that generates and interprets a SOAP message as a Web service server and requests processing.

  The platform layer 6 interprets a processing request from the application layer 5 and generates a hardware resource 4 acquisition request, and manages one or more hardware resources 4 to control the control service layer 9. A handler layer 10 that arbitrates acquisition requests and manages hardware resources 4.

  The control service layer 9 is configured to include one or more service modules such as a network control service 34, a screen control service 33, an authentication service 35, a document control service 36, and a system control service 38.

  The platform layer 6 is configured to have an API 53 that can receive a processing request from the application layer 5 using a predefined function. The OS 40 executes the software of the application layer 5 and the platform layer 6 in parallel as processes.

  The process of the network control service 34 provides a service that can be commonly used for applications that require network I / O. Data received from the network side by each protocol is distributed to each application, and each application Mediation when sending data from the network to the network side.

  For example, the network control service 34 controls data communication with a network device connected via the network by HTTP (HyperText Transfer Protocol Daemon) by HTTP (HyperText Transfer Protocol).

  The process of the document control service 36 performs memory control such as acquisition and release of memory and use of the HDD. The process of the system control service 38 performs processing such as application management, operation unit control, system screen display, LED display, hardware resource management, and interrupt application control. The process of the authentication service 35 performs processing related to user authentication.

  In addition, the handler layer 10 controls the image memory handler 41 that performs the memory allocation to the process and the management of the memory allocated to the process, the image distortion detection unit 31 that controls the image distortion detection accelerator 43, and the image processing accelerator 44. Image processing means 32 for performing the above.

  The image distortion detection means 31 and the image processing means 32 corresponding to the document information detection means perform image data distortion and image data processing using each accelerator in response to an image data conversion request from the image memory handler 41.

  Specifically, the image processing accelerator 44 can convert the image to a size smaller than the original size, convert the image code format, and the like. When the image is converted into an image smaller than the original image size, an image smaller than the original image data size can be obtained, so that the memory of the client 102 can be suppressed and the network traffic can be suppressed. Can also be reduced.

  Further, the image distortion detection means 31 can detect that an image displayed as image data is tilted.

  The image distortion detection means 31 and the image processing means 32 can also be realized by software.

  The multi-function apparatus 1 can process the processing required for the copy application 22 in a unified manner by the platform layer 6. Next, a hardware configuration of the multifunction machine 1 will be described.

  FIG. 3 shows a hardware configuration diagram of an embodiment of the compound machine 1. The multi-function machine 1 includes a controller board 60, an operation panel 52, and an engine 71.

  The controller board 60 includes a CPU 61, an ASIC 66, an HDD 65, a system memory (MEM-P) 63, a local memory (MEM-C) 64, a north bridge (hereinafter referred to as NB) 62, and a south bridge. (Hereinafter referred to as SB) 73, NIC 74 (Network Interface Card), USB device 75, IEEE 1394 device 76, image processing accelerator 44, and image distortion detection accelerator 43.

  The operation panel 52 is connected to the ASIC 66 of the controller board 60. The SB 73, the NIC 74, the USB device 75, the IEEE 1394 device 76, the image processing accelerator 44, and the image distortion detection accelerator 43 are connected to the NB 62 via a PCI bus.

  The engine 71 and the plotter 72 are connected to the ASIC 66 of the controller board 60 via a PCI bus.

  In the controller board 60, the local memory 64, the HDD 65, and the like are connected to the ASIC 66, and the CPU 61 and the ASIC 66 are connected via the NB 62 of the CPU chip set. In this way, if the CPU 61 and the ASIC 66 are connected via the NB 62, it is possible to cope with a case where the interface of the CPU 61 is not disclosed.

  Further, the ASIC 66 and the NB 62 are not connected via a PCI bus, but are connected via an AGP (Accelerated Graphics Port) 67. As described above, in order to control execution of one or more processes forming the application layer 5 and the platform layer 6 in FIG. 2, the ASIC 66 and the NB 62 are connected via the AGP 67 instead of the low-speed PCI bus, thereby reducing the performance. It is preventing.

  The CPU 61 performs overall control of the compound machine 1. The CPU 61 activates the network control service 34, the screen control service 33, the authentication service 35, the document control service 36, the system control service 38, the image memory handler 41, the image distortion detection means 31, and the image processing means 32 as processes on the OS. And the copy application 22 web page application 25 and the SOAP communication application 26 forming the application layer 5 are activated and executed.

  The NB 62 is a bridge for connecting the CPU 61, the system memory 63, the SB 73, and the ASIC 66. The system memory 63 is a memory used as a drawing memory or the like of the multifunction machine 1. The SB 73 is a bridge for connecting the NB 62 to the PCI bus and peripheral devices. The local memory 64 is a memory used as a copy image buffer and a code buffer.

  The ASIC 66 is an IC for use in image processing having hardware elements for image processing. The HDD 65 is a storage for storing images, document data, programs, font data, forms, and the like. The operation panel 52 is an operation unit that accepts an input operation from the user and performs display for the user.

  Next, the software configuration of the client 102 in FIG. 1 will be described with reference to FIG.

  The software of the client 102 includes an OS 300, a SOAP communication module 301, a WS document editing service client module 302, a WS document management service client module 303, a reduced image management module 311, a document editing module 310, and a document management module 306. And a display control module 307.

  The OS 300 is an operating system of the client 102. The SOAP communication module 301 performs SOAP communication with the MFP. The WS document editing service client module 302 is a client module of the WS document editing service 131 described later. The WS document management service client module 303 is a client module of the WS document management service 132 described later.

  A document management module 306 is a module for managing documents in the client 102. The document editing module 310 is a module for editing, for example, a thumbnail acquired from the multi-function peripheral in the client 102. The reduced image management module 311 is a module for managing thumbnails in the client 102, for example. The display control module 307 is a module that controls what is displayed on the client screen.

  Next, the hardware configuration of the client 102 in FIG. 1 will be described with reference to FIG.

  As shown in FIG. 4, the hardware configuration of the computer system includes an input device 122, a display device 123, a drive device 124, a recording medium 125, and an auxiliary storage device 126 that are connected to each other via a bus B. A memory device 127, an arithmetic processing device 120, and an interface device 121.

  The input device 122 includes a keyboard and a mouse, and is used to input various operation signals to the computer system. The display device 123 displays various windows and data necessary for operating the computer system. The interface device 121 is an interface for connecting the computer system to a network or an interface for connecting other devices, and is composed of, for example, a NIC (Network Interface Card), a modem, a USB (Universal Serial Bus), or the like.

  A program for operating the computer system is provided by a recording medium 125 such as a CD-ROM or downloaded through a network. In addition, the recording medium 125 is set in the drive device 124, and data and programs are installed in the auxiliary storage device 126 from the recording medium 125 via the drive device 124.

  The auxiliary storage device 126 stores data and programs, and stores necessary files and the like. The memory device 127 reads the program from the auxiliary storage device 126 and stores it when the computer system is activated. The arithmetic processing unit 120 executes processing according to a program read and stored in the memory device 127.

  Next, with reference to FIG. 6, a software block for executing processing related to document editing processing in the multifunction machine 1 will be described. The MFP 1 includes a network control service 34, an operation panel 52, a screen control service 33, a SOAP I / F 133, a document editing application 130, a WS document editing service 131, a WS document management service 132, a document Editing service SF29, document management service SF28, system control service 38, document control service 36, image memory handler 41, image processing means 32, image distortion detection means 31, image processing accelerator 44, image distortion A detection accelerator 43 and an HDD 65 are shown. The WS document editing service 131 and the WS document management service 132 belong to the WSF 27. Further, the document editing application 130 is positioned similarly to the copy application 22. The WS document editing service 131 corresponds to an editing reflection unit.

  These will be described, but the description of the already-described ones will be omitted. First, the SOAP I / F 133 is included in the above-described SOAP communication application 26 and is a SOAP interface. The document editing application 130 is an application for executing image editing from the operation panel 52. The WS document editing service 131 is a service for executing image editing via communication. The WS document management service 132 manages documents in the HDD 65 and provides a document management service via communication.

  The document editing service SF29 is an SF used by the WS document editing service 131. The document management service SF28 is an SF used by the WS document management service 132.

FIG. 6 shows a network 134 that connects the client 102 and the multi-function peripheral, and a client application 135 installed in the client 102. The client application 135 is an application used when editing work is performed on the client 102. Note that the editing operation information receiving unit and the editing reflection unit correspond to the WS document editing service 131. The document related information generating unit, the document storage unit, the document related information providing unit, the document list information providing unit, the bibliographic information providing unit, and the reduced image data generating unit correspond to the WS document management service 132. Details of the WS document management service 132 and the WS document editing service 131 will be described. FIG. 7 is a block diagram showing details of the WS document management service 132. As shown in FIG. 7, the WS document management service 132 includes a Repository Server 140 (hereinafter referred to as “RS”), a Command Dispatcher 141 (hereinafter referred to as “CD”), and a Command processing function group 142.

  Among these, the RS 140 is a module that accepts communication from other services in the same multifunction peripheral. The CD 141 interprets commands requested by the client application 135 and other services in the multi-function peripheral and calls the corresponding Command processing function. The Command processing function group 142 is a function group that processes a command provided by a service.

  Next, details of the WS document editing service 131 will be described with reference to FIG. As shown in FIG. 8, the WS document editing service 131 includes a CD 143, a Repository Client 146 (hereinafter referred to as RC), a Job Controller 145 (hereinafter referred to as JC), and a Job Watcher 144 (hereinafter referred to as JW). , Job Interpreter 147 (hereinafter referred to as JI) and Image Editor 148 (hereinafter referred to as IE).

  The CD 143 interprets the command requested from the client application 135 and sends the command to the JC 145 and JW 144. The JC 145 receives a command from the CD 143, and controls creation of a job instruction, setting edit information in the job instruction, creation of a job, execution of a job, and cancellation of a job, which will be described later. The JW 144 monitors jobs managed using queues in the IE, and returns job information in response to job status reference and job result reference commands. The RC 146 is a module that communicates with the Repository service in the same device and uses the Repository service. The JI 147 interprets the job received from the JC 145, creates a job for each page and a plane job for each color plane of CMYK, and further creates an editing operation job corresponding to each editing operation. The IE 148 refers to the first plane job in the queue managed by the JI 147 and sequentially executes each editing job connected to the plane job with respect to the corresponding plane image, thereby achieving image editing processing. Also, the status of the plane job is updated according to the status of the editing process.

  The details of the WS document management service 132 and the WS document editing service 131 have been described above. Next, specific processing will be described. First, processing performed between the WS document management service 132, the WS document editing service 131, and the client 102 will be described with reference to a sequence diagram.

  The sequence diagram shown in FIG. 9 shows processing until an image to be displayed on the client is transmitted from the multi-function peripheral.

  In step S101, the client 102 notifies the WS document management service 132 of a command startSession for requesting the start of a session. The WS document management service 132 notifies the client 102 of the SessionID in step S102.

  In step S103, the client 102 notifies the WS document management service 132 of a command getDocList requesting a list of documents. In step S104, the WS document management service 132 notifies the client 102 of a list of documents. This list may be a thumbnail or a list of characters. Each document displayed in the list is assigned a unique ID docId.

  Next, in step S105, the client 102 notifies the WS document management service 132 of a command getProps for requesting a property of a specific document together with a docId for specifying the document. The property is bibliographic information of the document, and examples include a representative image of the document and information on the document expressed in XML.

  In step S106, the WS document management service 132 notifies the client 102 of the document properties corresponding to the docId. This property can be acquired as many times as the client 102 needs.

  In this way, the client 102 that has acquired the property and has determined the image to be edited, in step S107, manages the WS document management together with the docId of the image that locks the command lockObject that requests image locking. The service 132 is notified. In step S108, the client 102 notifies the WS document management service 132 of a command getDocTicket for requesting the ticket ID together with the docId. The ticket ID in this case confirms the existence of authority to execute editing of the locked image.

  In step S109, the WS document management service 132 notifies the client 102 of the ticket ID. In step S110, the client 102 notifies a command getPage for requesting an image to the WS document management service 132 together with docId, pageNo, and scaleFactor. Here, pageNo specifies the page when the document to be edited has a plurality of pages. scaleFactor specifies the scale of the image displayed on the client 102.

  The WS document management service 132 requested for the image by the command getPage transmits the image data to be displayed to the client 102 in step S111 corresponding to the document related information providing stage.

  Here, the transmitted data is reduced image data, which is not the data itself recorded in the HDD 65 but the data is converted by the image processing accelerator 44 and the data size is made smaller than the original data. . As a result, the memory usage of the client 102 can be reduced, and the traffic on the network for transmitting data can be reduced.

  Next, a sequence for editing an image to be edited and referring to an editing job will be described with reference to FIG. In step S201, the client 102 notifies the WS document editing service 131 of a command startSession that requests the start of a session. In step S202, the WS document editing service 131 notifies the client 102 of the Session ID. Next, in step S203, the client 102 notifies the WS document editing service 131 of a command createJobInstructionByTicket that requests creation of an editing job instruction.

  In step S204, the WS document editing service 131 notifies the WS document management service 132 of a command startSessionByTicket that requests a session ID. In step S205, the WS document management service 132 notifies the WS document editing service 131 of the session ID.

  Next, in step S206, the WS document editing service 131 notifies a command getDocIdsByTicket for requesting the document ID. The WS document management service 132 notifies the image editing service 131 of DocIds in step S207. Next, the WS document editing service 131 notifies the client 102 of jobInstructionId in step S208. In step S209, the client 102 notifies the WS document editing service 131 of a command SetJobInstruction for setting editing operation information in the image editing job instruction along with an operation list to be a job. In step S210, the WS document editing service 131 notifies the client 102 of JobInstructionId.

  In step S211, the client 102 notifies the WS document editing service 131 of a command createJob for creating and executing an image editing job together with JobInstructionId. The WS document editing service 131 notifies the client 102 of the jobId in step S212.

  In step S213, the client 102 notifies the WS document editing service 131 of a command getJobProperty for referring to the editing job status together with jobId. In step S214, the WS document editing service 131 notifies the client 102 of jobPropertyList. In step S215, the client 102 notifies the command terminateSession to end the session, and ends the session.

  In addition to the commands described above, between the client 102 and the document management service 132, there are a command getProps for acquiring document properties and a command unlockObject for unlocking documents. In addition, there is a command cancelJob that cancels the image editing job between the client 102 and the image editing service 131.

  Next, the operation of the client 102 will be described using the flowchart of FIG. In step S301 corresponding to the document list information providing stage, the client 102 acquires document list information. In step S <b> 302, the client 102 acquires the properties of each document to be listed and displays the list. Thus, in step S303, the user can select a document to be edited. When a document to be edited is selected, in step S304, the client 102 locks the selected document for writing. Next, in step S305, the client 102 acquires a document editing permission ticket for the document to be edited. In step S306, the client 102 acquires display image data for one page of the selected document and displays it on the display.

  Next, in step S307, the client 102 creates an image editing job instruction in the image editing service using the document editing permission ticket. Step S308 is reception of a document editing operation by the user. When accepting the editing operation, the client 102 processes the reduced image by reflecting the editing operation in step S310. In step S311, the client 102 sets information on the editing operation performed by the user in the image editing job instruction. Step S310 corresponds to the editing operation reflection stage.

  The processing from step S308 to step S311 is repeated until the editing operation is completed. When the editing operation is completed, the process proceeds to step S312, and the client 102 requests the execution of creating an image editing job using the image editing job instruction. In step S313, the client 102 deletes the ticket, and in step S314, unlocks the selected document. Step S312 corresponds to an editing stage and a job creation execution stage.

  Next, in step S315, the client 102 receives a job reference operation by the user. When the job reference operation is received, the client 102 refers to the job status of the image editing job in step S317. In step S318, the client 102 displays the job status of the referenced image editing job. In step S316, when the job reference operation by the user ends, the client 102 ends the process.

  The processing described above will be described for each client module. FIG. 12 is a flowchart showing processing of the document management module 306. In step S801, the document management module 306 acquires document list information. In step S <b> 802, the document management module 306 acquires the properties of each document to be listed and displays it as a list.

  Next, the document management module 306 enters an operation standby state in step S803. In step S804, the document management module 306 determines whether or not a document has been selected. If it has not been selected, the document management module 306 performs other processing in step S805, and again enters an operation standby state. When a document is selected, in step S806, the document management module 306 locks the selected document for writing.

  In step S807, the document management module 306 acquires a document edit permission ticket for the document to be edited. Then, the document management module 306 calls the document editing module 310 in step S808.

  Thereafter, the document management module 306 enters an operation standby state in step S809. When the editing is completed, the document management module 306 unlocks the selected document in step S810, and executes the process of step S803 again.

  Next, the processing of the document editing module 310 will be described using the flowchart of FIG. This flowchart shows the processing from when the document editing module 310 is called in step S808 in FIG.

  In step S901, when the document editing module 310 is notified of the reduced image acquisition request, the document editing module 310 displays the reduced image in step S902 corresponding to the document related information display unit. Next, in step S903, the document editing module 310 creates a job instruction. The next step S904 is a standby state by an editing operation.

  If the document editing module 310 determines that the editing operation is an editing operation in step S905, the document editing module 310 processes the reduced image by reflecting the editing operation in step S906. In step S907, the document editing module 310 sets the information of the editing operation performed by the user in the image editing job instruction, and again enters the operation standby state in step S904.

  If it is determined in step S905 that the operation is not an editing operation, the document editing module 310 requests the image editing job to be created and executed using the image editing job instruction in step S908. In step S909, the client 102 deletes the ticket.

  Next, processing of the reduced image management module 311 will be described with reference to the flowcharts of FIGS. The flowchart of FIG. 14 shows the processing from where the reduced image management module 311 is called in step S901 of FIG.

  The reduced image management module 311 is in a standby state for a reduced image acquisition request in step S1001. When a request is received from the document editing module 310, the reduced image management module 311 acquires a reduced image in step S1002 corresponding to the document related information acquisition stage. In the next step S1003, the reduced image management module 311 provides the reduced image to the document editing module 310.

  The process shown in the flowchart of FIG. 15 shows the process from where the reduced image management module 311 is called in step S906 of FIG. In step S1101, the reduced image management module 311 is in a standby state for a reduced image processing request. When a reduced image processing request is received from the document editing module 310, the reduced image management module 311 processes and saves the reduced image in step S1102. In step S1103, the reduced image management module 311 provides the processed reduced image to the document editing module 310.

  Next, the operation of the WS document management service 132 when using the service from the client 102 will be described with reference to the flowchart of FIG. In step S401, the SOAP I / F 133 receives a command using SOAP from the client. In step S402, the SOAP I / F 133 analyzes the SOAP envelope and extracts the command. In step S403, the WS document management service 132 analyzes the command. In step S404, the WS document management service 132 calls a command processing function corresponding to the command. In step S 405, the response of the command processing function is returned to the client 102 by being wrapped in SOAP by the SOAP I / F 133.

  Next, the operation of the WS document management service 132 when using a service from another service in the multi-function peripheral will be described with reference to the flowchart of FIG. In step S501, the WS document management service 132 receives a command from another service via the RS 140. In step S502, the WS document management service 132 analyzes the command, and in step S503, calls the command processing function corresponding to the command. In step S504, the document management service 132 returns a command processing function response.

  Next, the operation of the WS document editing service 131 will be described using the flowchart of FIG. In step S601, the SOAP I / F 133 receives a command using SOAP from the client 102. In step S602, the SOAP I / F 133 analyzes the SOAP envelope and extracts a command.

  In step S603, the CD 143 analyzes the command. In step S604, the CD 143 determines whether the job control process is job instruction creation. If it is job instruction creation, the JC 145 secures a memory area for the job instruction in step S605. In step S606, the JC 145 acquires the ID of the document corresponding to the ticket from the WS document management service 132, sets it in the job instruction, and the process proceeds to step S631.

  Returning to step S604, if the job instruction is not created, in step S607, the CD 143 determines whether the operation information is set in the job instruction. In the case of setting operation information, the JC 145 secures an area for operation information and sets operation information in step S608. In step S609, the JC 145 sets a pointer to the operation information in the job instruction, and the process proceeds to step S631.

  Returning to step S607, if the operation information is not set, the CD 143 determines in step S610 whether it is job creation execution. In the case of creating and executing a job, the JC 145 analyzes the target job instruction, creates a job in step S611, and connects it to the queue.

  In step S612, the JI 147 analyzes the job execution unit and determines whether the job is for a plurality of pages. If the job is for a plurality of pages, the JI 147 creates a page job for each page in step S613. If the job is for a single page, the JI 147 creates a single page job in step S614. Connect to the job list.

  Next, in step S615, the JI 147 analyzes the plane configuration of the operation target page. In step S616, the JI 147 creates a plane job for each plane to be configured, and connects it to the plane job list in the page job. Next, in step S617, the JI 147 extracts one piece of editing operation information from the job instruction sheet, creates an editing job, and connects it to the editing job list in the plane job. If the reference of all editing operation information is completed in step S618, the plane job is connected to the queue referenced from the IE 148 in step S619. If not completed, the process of step S617 is executed again.

  Next, in step S620, the JI 147 determines whether the creation of the plane job has been completed for all the planes. If not completed, the process of step S616 is executed again. If completed, the JI 147 determines in step S621 whether the creation of the page job has been completed for all target pages. If completed, the JI 147 returns the job ID, and the process proceeds to step S631. If not completed, the process of step S616 is executed again. Steps S611 to S621 described above correspond to the edit reflection stage.

  Returning to the process of step S610, if it is not the job creation execution, the CD 143 determines in step S622 whether the job is cancelled. In the case of canceling the job, in step S623, the JC 145 searches the execution queue for a job corresponding to the designated job ID, and checks the job status.

  In step S624, the JC 145 determines whether the job state is an unexecuted state. If the job is in an unexecuted state, the JC 145 deletes the job from the execution queue in step S625, and the process proceeds to step S631. If the job is being executed, the JC 145 transmits a forced end signal to the job in step S627 through step S626, deletes the job from the execution queue in step S628, and the process proceeds to step S631.

  Returning to the process of step S622, if the job is not canceled, the CD 143 determines in step S629 whether the job is to be referred to. In the case of job reference, the JW 144 searches the execution queue for a job corresponding to the given job ID, acquires the job status, and proceeds to step S631. Similarly, if the job is not referred to, the process proceeds to step S631.

  In step S631, a response based on the above-described processing is returned from the SOAP I / F 133.

  Next, the operation in IE 148 will be described using the flowchart of FIG. If there is a plane job in the Plane Job queue in step S701, the IE 148 selects a head job in step S702. In the next step S703, the IE 148 opens the document to be edited for the job. In step S704, the IE 148 opens a page to be edited for the job. Next, in step S705, the IE 148 opens the plane to be edited for the job. In step S706, the IE 148 secures a memory for reading a plain image, and reads the plain image on the secured memory in step S708.

  In step S709, the IE 148 determines whether there is a corresponding editing job. If there is a corresponding editing job, the IE 148 acquires editing information from this editing job in step S710. In step S711, the IE 148 performs an image editing operation on the memory in accordance with the editing information.

  In step S712, the IE 148 determines whether a forced termination signal is received. If accepted, the IE 148 interrupts the editing process, changes the job status to “suspended” in step S713, and advances the process to step S717.

  If the forcible termination signal has not been received, the IE 148 refers to the next editing job in step S714 and advances the process to step S717.

  If it is determined in step S709 that there is no corresponding editing job, the IE 148 has no editing job to be executed, and the edited plain image is written back to the HDD 65 in step S715. In step S716, the IE 148 changes the job status to “completed”. Next, IE 148 releases the memory used in step S717. The IE 148 closes the target plane in step S718, closes the target page in step S719, closes the target document in step S720, and advances the process to step S701 again.

  With the processing described above, the editing state in the client 102 will be described with reference to FIGS. 20 and 21. FIG. FIG. 20 is a diagram showing a state in which a document list is displayed on the display of the client 102, and after a document is selected, a display image for image editing is acquired and displayed.

  FIG. 20 shows the HDD 65, an image 160 recorded in the HDD 65, an editing image 161 transmitted to the client 102, the client 102 and the mouse 103.

  In FIG. 20, an image 160 is data in CMYK color space at 600 dpi. The display of the client 102 has a display resolution of 100 dpi. The editing image 161 transmitted along with this display is data in the sRGB color space equivalent to 100 dpi with the main and sub directions reduced to 1/6.

  As described above, the data size of the editing image 161 is smaller than the data size of the original image 160.

  Next, FIG. 21 will be described. 21 shows a job instruction 150, editing operation information 151 and 152, an operation type 153, editing screens 154 and 155, a rectangle 156, and a circle 157.

  The job instruction 150 includes Id, DocId, PageRange, OperationNum, & operation [0], and & operation [1]. Among these, Id is the ID of the job instruction itself. DocId is the ID of the document described above. PageRange represents the page range of the document. OperationNum is the number of operations indicated in this instruction.

  & operation [0] and & operation [1] both represent the head addresses of the editing operation information 151 and 152. This editing operation information will be described using the editing operation information 151. The editing operation information 151 includes OpId, Operation, Coordinate1, Coordinate2, lineColor, and AreaColor. OpId represents the ID of the editing operation information 151. Operation represents an operation type that is a type of a graphic to be drawn.

  As indicated by the operation type 153, “001” represents a line drawing, “002” represents a rectangular drawing, “003” represents a circle drawing, and “004” represents a broken line drawing.

  Therefore, the editing operation information 151 is rectangular drawing. Next, Coordinate represents coordinates, and in the case of the editing operation information 151, it is a rectangle. Therefore, if two coordinate positions facing each other on a diagonal line are known, a rectangle can be drawn. Therefore, there are two Coordinates.

  In the editing operation information 151, Coordinate1 and Coordinate2 are “120, 120” and “420, 420”, respectively.

  In the editing screen 154, the coordinates corresponding to Coordinate1 and Coordinate2 are (20, 20) and (70, 70), respectively. Thus, since the editing screen 154 is reduced to 1/6 in the main and sub directions, the editing operation information describes what has undergone coordinate transformation.

  lineColor represents the color of the side of the rectangle. This color is expressed in RGB. AreaColor represents the color inside the rectangle. This color is similarly expressed in RGB.

  The edit screen 155 represents a screen in which a circle 157 is drawn after drawing the rectangle described above.

  The above is the editing operation information. As described above, the editing operation information includes the shape, coordinates, and color of the graphic. The coordinates are converted according to the degree of reduction.

  Next, the job queue will be described with reference to FIG. First, the structure of this queue will be described. This cue is a cue of a type in which the queues are connected by a chain.

  For example, when A and B are queued in this order, A is to hold the head address of B in order to indicate that B is next to A. By doing so, you can get from A to B. Also, since B is the last of the queue and there is no next, NULL or 0xffffffff (hexadecimal number) or the like is used as the head address indicating the next of B to indicate the last.

  Further, B may hold A's head address so that B can reach A. In this case, the two chains of the chain from A to B described above and the chain from B to A are connected. In addition to the head address, an array number may be used.

  Next, the queue shown in FIG. 17 includes four queues: a job queue, a page job queue, a plain job queue, and an operation job queue. The job queue is a queue in which job control structures are arranged. The page job queue is a queue in which page job control structures are arranged. The plain job queue is a queue in which plain job control structures are arranged. The operation job queue is a queue in which operation job control structures are arranged.

  These queues do not exist separately. Each job control structure arranged in the job queue can have a page job queue. Each page job control structure arranged in the page job queue can have a plain job queue. Furthermore, each plain job control structure arranged in the plain job queue can have an operation job queue.

  That is, the page job queue is hung from the job queue, the plain job queue is hung from the page job queue, and the operation job queue is hung from the plain job queue.

  This will be specifically described with reference to FIG. FIG. 22 shows a job queue header 170, a job control structure 171, a page job control structure 176, a plain job control structure 179, and an operation job control structure 182.

  The header 170 represents the head of the job queue. The job control structure 171 includes next 172, prev 173, l-next 174, jobId, job instruction id, docId, status, and pageJobHeader.

  Next 172 represents the head address of the next job control structure. prev 173 represents the start address of the previous job control structure, but in the case of the job control structure 171, since the previous is the header, it is the start address of the header. l-next 174 represents the head address of the page job control structure. The difference between next and l-next is that next is used when the number of the chains connecting the control structures is two, and l-next is used when the number is one.

  Therefore, the job control structure is connected by two chains, and the page job control structure is connected by one chain.

  Returning to the description of the job control structure, jobId represents the ID of the job. The job instruction id represents the ID of the job instruction. docId represents the ID of the document. status represents the job status. pageJobHeader is the header of the page job queue because the page job queue hangs from here.

  Next, the page job control structure 176 will be described. The page job control structure 176 includes l-next 177 and 178, pageJobId, jobId, pageNo, status, and planeJobHeader. l-next 177 represents the start address of the next page job control structure. l-next 178 represents the head address of the plain job control structure.

  pageJobId represents the ID of the page job. jobId represents the ID of the job. pageNo represents the page number. status represents the job status. planeJobHeader is the header of the plane job queue because the plane job queue hangs from here.

  Next, the plain job queue will be described with reference to FIG. FIG. 23 shows a play job queue header 183 and a plain job control structure 184. The header 183 represents the head of the plain job queue. The plain job control structure 184 includes next 185, prev 186, l-next 187, 188, plane jobId, pagejobId, plane, status, and opJobHeader.

  next 185 represents the start address of the next plain job control structure. prev 186 represents the start address of the previous plain job control structure, but in the case of the plain job control structure 184, since the previous is the header, it becomes the start address of the header. l-next 187 is used when connecting with one chain.

  planejobId represents the ID of a plane job. pagejobId represents the ID of the page job. pageNo represents the page number. status represents the job status. opJobHeader is the header of the operation job queue because the operation job queue is suspended from here. l-next 188 represents the start address of the operation job control structure.

  Returning to FIG. 22, since the plain job control structure 179 shown in FIG. 22 uses l-next 180, the plain job queue is a queue connected by one chain. l-next 181 represents the head address of the operation job control structure 182.

  Next, the operation job control structure 182 will be described. The operation job control structure 182 includes l-next 183, opId, Operation, Coordinate1, Coordinate2, lineColor, and AreaColor. opId is an operation ID. Operation represents the order of the operation. Coordinate1, Coordinate2, lineColor, and AreaColor are information representing rectangles as shown in FIG.

As described above, the job queue is configured. Next, with reference to FIG. 24, a description will be given of how an RGB image manipulation job is translated into a CMYK job. The conversion from RGB system to CMYK is as shown in FIG.
C '= 255-R
M '= 255-G
Y '= 255-B
K = min (C ', M', Y ')
C = C'−K
M = M'−K
Y = Y'−K
It has become.

  Therefore, as shown in FIG. 24, when R is 255 and G and B are 0, C and K are 0, and M and Y are 255. By doing so, translation from RGB to CMYK becomes possible. In this way, the color is converted according to the color space to which the color belongs.

  There are three types of JPEG, which is one of the image data. One is a type composed of one piece of image data. The second is a type in which there is one piece of image data for each of CMYK, and one piece of RGB data is converted into JPEG for one piece of RGB. The third type is divided into a character part and an image part, and these are four types of CMYK.

  Thus, even one image data may be composed of a plurality of image data. This case can also be dealt with in the present embodiment.

1 is a configuration diagram of a system in an embodiment of the present invention. It is a block diagram of one Example of the compound machine by this invention. It is a hardware block diagram of one Example of the compound machine by this invention. It is a software block diagram of a client. It is a hardware block diagram of a client. It is a software block diagram of a compound machine. It is a figure which shows the structure of WS document management service. It is a figure which shows the structure of WS document edit service. It is a sequence diagram which shows a process until it refers to the display image of an edit object image. FIG. 10 is a sequence diagram illustrating a process of editing an image to be edited and referring to an editing job. It is a flowchart which shows a process of a client. It is a flowchart which shows the process of a document management module. It is a flowchart which shows the process of a document edit module. It is a flowchart which shows the process of a reduction image management module. It is a flowchart which shows the process of a reduction image management module. It is a flowchart which shows the process of WS document management service. It is a flowchart which shows the process of WS document management service. It is a flowchart which shows the process of WS document edit service. It is a flowchart which shows the process in Image Editor. It is a figure which shows a mode that an image is displayed on a client. It is a figure which shows a mode that an image is edited with a client. It is a figure which shows a Job queue. It is a figure which shows a Plane Job queue. It is a figure which shows the color conversion process at the time of Plane Job creation in Job Interpreter.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Fusion machine 2 Software group 3 Fusion machine starting part 4 Hardware resource 5 Application layer 6 Platform layer 9 Control service layer 10 Handler layer 11 Scanner 12 Plotter 13 Other hardware resources 22 Copy application 25 WEB page application 26 SOAP communication application 27 WSF
28 Document Management Service SF
29 Document editing service SF
31 Image distortion detection means 32 Image processing means 34 Network control service 35 Authentication control service 36 Document control service 38 System control service 40, 300 OS
41 Image memory handler 43 Image distortion detection accelerator 44 Image processing accelerator 51, 52, 53 Application program interface (API)
54 Engine I / F
60 Controller board 61 CPU
62 North Bridge (NB)
63 System memory (MEM-P)
64 Local memory (MEM-C)
65 Hard Disk Drive (HDD)
66 ASIC
67 AGP (Accelerated Graphics Port)
71 Engine 73 South Bridge (SB)
74 NIC
75 USB device 76 IEEE 1394 device 102 Client 103 Mouse 120 Arithmetic processing device 121 Interface device 122 Input device 123 Display device 124 Drive device 125 Recording medium 126 Auxiliary storage device 127 Memory device 130 Image editing application 131 WS document editing service 132 WS document management service 133 SOAP I / F
134 Network 135 Client application 140 RS
141, 143 CD
142 Command processing function group 144 JW
145 JC
146 RC
147 JI
148 IE
150 Job instructions 151, 152 Editing operation information 153 Operation type 154, 155 Editing screen 156 Rectangle 157 Yen 160 Image 161 Editing image 170, 183 Header 171 Job control structure 172, 185 next
173, 186 prev
174, 177, 178, 180, 181, 183, 187, 188 l-next
176 Page job control structure 179, 184 Plain job control structure 182 Operation job control structure 301 SOAP communication module 302 WS document editing service client module 303 WS document management service client module 306 Document management module 307 Display control module 310 Document editing module 311 Reduced Image Management Module

Claims (22)

A document editing method for editing a document including image data stored in an image processing apparatus at a communication destination communicating with the image processing apparatus,
Document related information providing step in which document related information related to a document stored in the image processing apparatus is provided to the communication destination;
An editing stage in which editing is performed at the communication destination based on the document-related information provided;
A document editing method comprising: an editing reflection step in which editing performed at the communication destination is reflected in the document. The document editing method according to claim 1, wherein the document related information is reduced image data converted to a size smaller than a data size of the image data. 3. The document list information providing step of providing document list information, which is a list of documents stored in the image processing apparatus, provided to the communication destination before the document related information providing step. Document editing method. The document editing method according to claim 3, wherein the communication destination is further provided with bibliographic information of a document in addition to the document list. 5. The document editing method according to claim 2, wherein, in the editing step, graphic information relating to a graphic edited in the reduced image data is acquired. 6. The document editing method according to claim 5, wherein color information of the graphic is acquired in the editing stage. The document editing method according to claim 6, wherein the editing is reflected in the document based on the graphic information and color information. The document editing method according to claim 5, wherein the graphic information includes a graphic shape and coordinates. The document editing method according to claim 8, wherein the coordinates are converted according to a degree of reduction of the reduced image data. The document editing method according to claim 7, wherein the color is converted according to a color space to which the color of the graphic belongs. In an image processing apparatus in which a document containing stored image data can be edited at a communication destination,
Document storage means for storing the document;
Document related information generating means for generating document related information related to the document;
Document related information providing means for providing the document related information to the communication destination;
Editing operation information receiving means for receiving editing operation information that is information relating to editing performed at the communication destination;
An image processing apparatus comprising: an editing reflection unit that reflects the editing operation information in the image data. Reduced image data generating means for generating reduced image data converted to a size smaller than the data size of the image data;
The image processing apparatus according to claim 11, wherein the document related information is the reduced image data. 13. The image processing apparatus according to claim 12, further comprising document list information providing means for providing document list information, which is a list of documents to be stored, to the communication destination. 14. The image processing apparatus according to claim 13, further comprising bibliographic information providing means for providing bibliographic information of documents in addition to the document list. 15. The image processing apparatus according to claim 12, wherein the editing operation information receiving unit receives graphic information related to a graphic edited in the reduced image data. The image processing apparatus according to claim 15, wherein the editing operation information receiving unit receives color information of the graphic. The image processing apparatus according to claim 15, wherein the graphic information includes a graphic shape and coordinates. The image processing apparatus according to claim 17, wherein the coordinates are converted according to a degree of reduction of the reduced image data. The image processing apparatus according to claim 16, wherein the color is converted according to a color space to which the color of the graphic belongs. A document editing method for communicating with an image processing apparatus in which a document containing image data is stored and editing the document,
A document related information acquisition step of acquiring document related information related to a document stored in the image processing apparatus;
A document related information display step for displaying the document related information;
An editing operation reflecting stage for reflecting the editing operation of the editor in the display of the document related information;
A document editing method, comprising: creating a job instruction for instructing the image processing apparatus to perform the editing, and causing the image processing apparatus to execute the job instruction. The document editing method according to claim 20, wherein the document related information is reduced image data converted to a size smaller than a data size of the image data. A document editing program for executing the document editing method according to claim 20 or 21 on a computer.