JP2012093838A - Image processing system, image processing device, image processing method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which, in an image processing device for providing plural functions such as printing and preview, when an object is output according to the functions, a processing method suitable for a hardware configuration such as the number of CPU cores of the image processing device in the process of processing for output has not been determined, so that it has been difficult to obtain processing performance with the functions and hardware configuration utilized.SOLUTION: According to the present invention, a converted object obtained by converting the object into a format suitable for a function is generated, information indicating a processing method for each pair of a function and a hardware configuration is created in advance, and they are stored as document information. When an object is output by a selected function, a processing method suitable for the function and a hardware configuration of an output device is selected.

Description

  The present invention relates to an image processing apparatus, an image processing method, and a computer program that control an electronic document processing method.

  The advanced functions of copiers have been remarkable. In addition to copying and printing functions, multifunction machines with scanner and fax functions and preview functions for displaying images on a display have become mainstream in the market. A multifunction device in an office has a function for creating and managing a large amount of electronic data as a database, and can form a document management system in cooperation with a personal computer (PC) connected to a network environment, other multifunction devices, and a printer. It is possible.

  A document converted into electronic data (electronic document) is generated by reading a paper document with a scanner of a multi-function peripheral or creating it with an application of a PC. This electronic document is stored in a database such as PDF (Portable Document Format) or the like on the network or in the multifunction peripheral itself.

  An electronic document created by an application includes various objects that can be classified into attributes such as graphics, photographs, and characters. Disclosed is a technique for generating an electronic document having optimal data that shortens processing time when executing each function such as printing and previewing on an electronic document having such various objects. Has been. In Patent Document 1, drawing objects suitable for each function are generated in advance from objects in the electronic document so that processing can be performed in a short time when each function such as printing and preview is executed. The process is executed using the optimum drawing object according to the function.

  In recent years, multi-core CPUs have been developed due to improvements in hardware technology, and a PC or the like can simultaneously execute a plurality of applications. Multi-function machines are also equipped with a multi-core CPU in order to improve the execution speed of a plurality of functions such as printing and preview. In printing, in order to efficiently perform parallel processing by a multi-core CPU, parallel processing is instructed by a page description language (PDL) (Patent Document 2).

JP2007-066188 JP 07-104987 A

  However, Patent Document 1 does not consider the number of cores such as a multi-core CPU, and does not disclose a processing method that makes full use of a hardware configuration such as a multi-core in a multi-function peripheral equipped with a multi-core CPU. In addition, the parallel processing instruction method disclosed in Patent Document 2 realizes optimal parallel processing for various functions including not only printing but also preview, even though optimal parallel processing can be realized for printing. I can't.

  In order to solve the above-described problems, an image processing system according to the present invention includes an acquisition unit for acquiring image information including a plurality of objects, and converts each of the plurality of objects into data corresponding to the function of the output unit. The object generation means for generating a plurality of converted objects, the intermediate code generation means including a plurality of processing units for generating intermediate code from the plurality of converted objects, and the plurality of processing units in the generation of the intermediate code, respectively Load prediction means for predicting a partial load applied to the load, and a load applied when the intermediate code is generated from the plurality of converted objects by the intermediate code generation means based on the partial load predicted by the load prediction means, Generate leveling information for leveling between the plurality of processing units Normalized information generating means, associating means for associating the leveled information with the plurality of converted objects, document information generating means for generating document information having the plurality of converted objects and the leveled information, It is characterized by having.

  The present invention can change the processing method executed by the apparatus in consideration of various functions such as printing and previewing an electronic document and the hardware configuration of the apparatus executing the process.

It is a figure which shows an example of the system configuration | structure of the image processing apparatus in this invention. 3 is a diagram illustrating an example of a format of document information stored in an image forming apparatus. FIG. It is the figure which showed the flow of document information generation. It is the figure which showed the flow of drawing object generation. It is the figure which showed the flow of calculation of the predicted load value in intermediate code generation. It is the figure which showed the flow of the process information generation for printing. It is the figure which showed the flow of the process information for a preview. It is the figure which showed the flow of load distribution estimation of a page parallel. It is the figure which showed the flow of load distribution estimation of object parallel. FIG. 5 is a diagram illustrating a flow of document information printing or preview processing. It is the figure which showed the flow of the process which the processor of CPU performs. It is the figure which showed an example of the flow which a processing method determines. It is the figure which showed an example of the drawing object of document information.

Example 1
The best mode for carrying out the present invention will be described below with reference to the drawings. FIG. 1 is a diagram illustrating an example of the configuration of the image forming apparatuses 102 and 103 according to the present invention.

  In this embodiment, the image forming apparatus 102 is an apparatus that executes image processing for generating document information 5000. The document information 5000 generated by the image forming apparatus 102 will be described later. Reference numeral 202 denotes a network I / F for inputting / outputting information to / from an external device such as a PC, and receives print image information (PDL data) transmitted from the external device. A scanner I / F 220 acquires document image read image information from a scanner 221 that is a document image reading unit, and transmits the read image information from the scanner 221 to a reception buffer. A central processing unit (CPU) 218 performs processing and control of the image forming apparatus 102. A RAM 203 temporarily stores various information. The RAM 203 has a reception buffer 204 and a work memory 205. The reception buffer 204 is a memory that stores print image information (PDL data) received via the network I / F 202 and read image information received via the scanner I / F. The PDL data is data written in a page description language (PDL), and the print image information describes information about an object to be printed by PDL. An object is, for example, a line segment connecting two points. The information about the object is, for example, a drawing command for designating two points and drawing a line segment connecting them. Reference numeral 205 denotes a work memory that is temporarily used when the CPU 218 executes processing.

  A ROM 208 stores a control program for the CPU 218 in the image forming apparatus 102. The ROM 208 stores an analysis program 209, an object generation program 210, a scheduler program 215, and a document management program 216. The CPU 218 loads these programs into the work memory 205 and executes them, thereby realizing the functions of the analysis unit, object generation unit, scheduler, and document management unit. The analysis unit analyzes the PDL data read from the reception buffer 204 and reads a drawing command in the PDL data. The object generation unit identifies an object from the drawing command of the object read by the analysis unit, and generates a drawing object from this object. Further, the object generation unit predicts a partial load when generating the intermediate code from the drawing object. The drawing object here is, for example, point sequence data for drawing a line segment. Based on the drawing object generated by the object generation unit and the partial load, the scheduler performs distributed processing estimation when performing parallel processing, and generates processing information (leveling information). The document management unit associates the drawing object generated by the object generation unit with the processing information, stores them in the HDD 217, and manages them as one document information 5000. In this embodiment, one piece of document information 5000 is generated for each piece of PDL data, and one or a plurality of drawing objects are included for each object. An engine I / F 212 inputs and outputs signals to and from the printer engine 213. Reference numeral 213 denotes a printer engine that forms a developer image on a photosensitive drum based on a raster image by a known electrophotographic process, transfers the developer image to a sheet, and fixes the image.

  In this embodiment, the image forming apparatus 103 is an apparatus that executes image processing for functions of an output unit such as printing and previewing in accordance with document information 5000 stored in the HDD 217. Reference numeral 302 denotes a network I / F for acquiring the document information 5000 from the HDD 217 of the image forming apparatus 102. A central processing unit (CPU) 318 performs arithmetic processing and control of the image forming apparatus 103, and includes a plurality of processors (processing units). A RAM 303 temporarily stores various information. The RAM 303 includes a reception buffer 304, a work memory 305, a frame buffer 306, and a raster memory 307. The reception buffer 304 is a memory that stores document information 5000 received via the network I / F 302. A work memory 305 is used in the process in which the CPU 318 executes each process. Reference numeral 306 denotes a frame buffer that stores an intermediate code generated by an intermediate code generation unit described later. A raster memory 307 stores a raster image in which the intermediate code stored in the frame buffer 306 is expanded.

  A ROM 308 stores a control program for the CPU 318 in the image forming apparatus 103. The ROM 308 stores a parallel processing management program 311, a document information analysis program 309, an intermediate code generation program 310, and a development processing program 314. The CPU 318 loads these programs into the work memory 305 and executes them, thereby realizing the functions of the parallel processing management unit, document information analysis unit, intermediate code generation unit, and expansion processing unit. The parallel processing management unit refers to the processing information 513 of the document information 5000 read from the reception buffer 304, and requests processing from the analysis unit and the intermediate data generation unit that operate on a plurality of processors of the CPU 318. The analysis unit analyzes the document information 5000 requested for processing from the parallel processing management unit. The intermediate code generation unit generates an intermediate code from the drawing object included in the document information 5000 and stores it in the frame buffer 306. The development processing unit stores a raster image obtained by developing the intermediate code stored in the frame buffer 306 in the raster memory 307.

  Reference numeral 312 denotes an engine I / F that inputs and outputs signals with the printer engine 313. Reference numeral 313 denotes a printer engine that forms a developer image on a photosensitive drum based on a raster image by a known electrophotographic process, and transfers and fixes the developer image onto a sheet. A display panel 321 displays the raster image on the panel based on the raster image. Reference numeral 320 denotes a panel I / F that inputs and outputs signals with the display panel 321. In the following embodiment, it is assumed that the image forming apparatus 103 has a dual-core CPU and only functions of printing and preview are described. However, the present invention describes such a number of cores (number of processors). ), Not limited to functions. In the present embodiment, the object attribute is described as being classified into one of a figure, a photograph, and a character, but the present invention is not limited to these attributes.

  FIG. 2 is a diagram showing an example of the format of the document information 5000 stored in the HDD 217 of the present embodiment. FIG. 2A is a diagram showing the overall format of the document information 5000, and includes a header 5100, an object part 5200 for storing a drawing object of the document information and the like, and an object table 5300 indicating the storage position of the drawing object.

  The header 5100 includes format specifying information 5110, an object table offset 5120, and a processing information offset 5130. The format specifying information 5110 is an identifier for specifying the format of the document information 5000. The object table offset 5120 indicates the storage position of the object table 5300 (the start address of the object table 5300). The processing information offset 5130 is a storage location of processing information 5220 that indicates a hardware configuration of a device that processes the document information 5000 such as a single core or dual core CPU, and a processing method suitable for each function such as printing and preview. (The start address of the processing information 5220).

  The object unit 5200 includes a drawing object unit 5210, processing information 5220, and a processing instruction unit 5230.

  The drawing object portion 5210 includes drawing objects (converted objects) corresponding to functions such as printing and preview. In this embodiment, since the functions of the image forming apparatus are printing and preview, the drawing object unit 5210 stores drawing objects for printing and previewing each object. FIG. 13 is a diagram illustrating an example of a drawing object of document information. The document information drawing object in FIG. 13 includes a point sequence 700, characters 701, and an image 702. The point sequence 700 includes a plurality of point sequence information of X and Y coordinates. A character 701 includes drawing positions X and Y, a font ID corresponding to the character to be drawn, and the number of points of the drawing size. The image 702 includes drawing positions X and Y, width, height, and gradation. The document information includes one or more of these drawing objects.

  The processing information 5220 includes a processing instruction offset 5221 for single printing, a processing instruction offset 5222 for single preview, a processing instruction offset 5223 for dual printing, and a processing instruction offset 5224 for dual preview. Each piece of information in the processing information 5220 is information (address) of a storage position of the processing instruction unit 5230 in which information indicating a processing method is stored. The single / print processing instruction offset 5221 indicates the storage position of the single / print processing instruction 5231 for instructing a processing method when the printing function is executed in the image forming apparatus of the single core CPU. The single preview processing instruction offset 5222 indicates the storage position of the single preview processing instruction 5232 for instructing a processing method when the preview function is executed in the image forming apparatus of the single core CPU. The dual-print processing instruction offset 5223 indicates the storage position of the dual-print processing instruction 5233 that instructs a processing method when the printing function is executed by the image forming apparatus of the dual-core CPU. The dual preview processing instruction offset 5224 indicates the storage position of the dual preview processing instruction 5234 that instructs the processing method when the preview function is executed in the image forming apparatus 103 of the dual core CPU.

  The processing instruction unit 5230 will be described. The content of the single / print processing instruction 5231 is an ID list (described later) of a print drawing object for each page. The content of the single preview processing instruction 5232 is an ID list of preview drawing objects for each page. The contents of the dual-print processing instruction 5233 are a parallel processing method and an ID list or a page ID list of print drawing objects processed by the processors 1 and 2 based on the parallel processing method. The contents of the dual preview processing instruction 5234 are a parallel processing method and an ID list of preview drawing objects processed by the processor 1 and the processor 2 based on the parallel processing method.

  The parallel processing method is a parameter for specifying a parallel processing method. In this embodiment, the parallel processing method is specified from two types of object parallel and page parallel. The object parallel is a method of assigning a plurality of drawing objects included in the same page to a plurality of processors in units of drawing objects and performing intermediate code generation processing in parallel. Page parallel is a method of assigning intermediate code generation processing in parallel to a plurality of processors in units of pages for document information of a plurality of pages. The difference in processing contents of each processor due to the parallel processing method will be described later with reference to FIGS. 2 (b1) and 2 (b2). The number of processing instructions of the processing instruction unit 5230 is four in this embodiment, but may be increased or decreased according to the number of cores and the number of functions of the image forming apparatus. That is, in addition to the dual core, the number of processing instructions may be increased for the hardware configuration of the quad core CPU. Further, the number of processing instructions may be increased for other functions of printing and previewing.

  Next, the object table 5300 will be described. The object table 5300 is a table indicating the storage position of each drawing object stored in the drawing object unit 5210 of the object unit 5200. This object table 5300 is used for referring to the storage position of the drawing object corresponding to this ID from the ID of the drawing object.

  A difference in processing contents of each processor according to the parallel processing method will be described with reference to FIGS. 2B1 and 2B2. FIG. 2B1 is a diagram showing the processing contents of each processor when the parallel processing method is object parallel. In FIG. 2B1, the ID list of the drawing object to be processed by the processor 1 is specified for each page as the processing contents of the processor 1, and the processing of the processor 2 is to be processed for each page as the processing contents of the processor 2. An ID list of drawing objects is designated.

  FIG. 2 (b2) is a diagram showing the processing contents of each processor when the parallel processing method is page parallel. In FIG. 2B2, a list of page IDs to be processed by the processor 1 is specified as the processing method of the processor 1, and a list of page IDs to be processed by the processor 2 is specified as the processing method of the processor 2. In this case, the designated page ID does not overlap between the processors 1 and 2. This page ID uniquely identifies a page to be processed, and corresponds to an address for acquiring all drawing object IDs in the page. For example, in the case of the page-parallel dual-print processing instruction 5233, the page ID is the address of the single-print processing instruction 5231 to the print drawing object ID list of the page corresponding to this page ID.

  FIG. 3 is a diagram illustrating a flow of generating document information 5000 in the image forming apparatus 102. In the flow of FIG. 3, the CPU 218 develops and executes each program (analysis program 209, object generation program 210, scheduler program 215, document management program 216) stored in the ROM 208 in advance on the work memory 205. This is realized by functioning as a function unit (analysis unit, object generation unit, scheduler, document management unit). In step S <b> 1001, the CPU 218 stores the PDL data input from the external device connected to the network 104 via the network I / F 202 in the reception buffer 204. In step S1002, the analysis unit reads the PDL data stored in the reception buffer 204 and executes an analysis process. In step S1003, the analysis unit determines whether the analysis of the PDL data is finished (job end). In cases other than job end, in step S1010, the object generation unit executes generation of a drawing object and prediction of a partial load of the generated drawing object (described later). If the analysis unit determines that the job is finished in step S1003, the scheduler generates processing information for printing (leveling information for the printing function) in step S1020, and processing information for previewing (leveling information for the preview function) in step S1021. To do. The processing information for printing and the processing information for preview are generated based on the predicted load value (described later) of the drawing object generated in step S1010. In step S1022, the document management unit associates the generated print processing information and preview processing information with the drawing object generated in step S1010. Note that the data generated in the above steps is temporarily stored in the work memory 205. In step S1023, the document management unit stores the data generated in the above steps as document information 5000 in the HDD 217, which is a database. The database is not limited to the inside of the image forming apparatus 102 but may be provided inside the image forming apparatus 103 or on the network 104.

  FIG. 4 is a diagram showing the flow of drawing object generation and partial load prediction in step S1010, which is realized by the CPU 218 developing and executing an object generation program stored in the ROM 208 in advance on the work memory 205. Is done. In step S1101, the object generation unit generates a print drawing object to be used at the time of printing from the analysis information (drawing object drawing command) acquired by the analysis unit, and stores it in the work memory 205 for the drawing object unit 5210 of the document information 5000. Store. In step S1102, the object generation unit predicts a partial load of the generated print drawing object. The partial load referred to here is a load applied to a processor that converts a drawing object into an intermediate code. In step S <b> 1103, the object generation unit adds information specifying the storage location of the print drawing object generated in step S <b> 1101 for the object table 5300 of the document information 5000 to the work memory 205. In step S1104, the object generation unit allocates an object ID to the stored print drawing object, and uses this object ID for the drawing object ID list for each page of the single / print processing instruction 5231 of the document information 5000. Is added to the work memory 205.

  In step S1105, the object generation unit determines whether the attribute of the drawing object is a graphic (point sequence data). If it is determined that the drawing object is point sequence data, in step S1110, the object generation unit converts the point sequence data of the drawing object into coordinates of a low resolution (for example, resolution of 75 dpi) for preview. In step S <b> 1111, the object generation unit determines whether there is a point sequence having the same or adjacent coordinates in the converted point sequence data. If it is determined that the object exists, in step S1112, the object generation unit generates a drawing object from which one point of the same or adjacent point sequence is deleted, and the work is used as the drawing object unit 5210 of the document information 5000. Store in the memory 205. That is, a preview drawing object is generated by thinning several points from the point sequence data of the printing drawing object. If it is determined that it does not exist, the process proceeds to step S1150, and the print drawing object is set as the preview drawing object.

  In step S1150, the object generation unit predicts a partial load of the generated preview drawing object. In step S1151, the object generation unit adds information for specifying the storage position of the drawing object that has been set as the drawing object for preview in step S1112 to the work memory 205 for the object table 5300 of the document information 5000. In step S1152, the object generation unit allocates an object ID to the stored preview drawing object, and uses this object ID as a drawing object ID list for each page of the single preview processing instruction 5232 of the document information 5000. Is added to the work memory 205.

  If it is determined in step S1105 that the drawing object attribute is not a graphic, in step S1120, the object generation unit determines whether the print drawing object is an image. If it is determined that the print drawing object is an image, in step S1121, the object generation unit determines whether the resolution of the image is equal to or higher than a predetermined resolution (for example, 300 dpi). If it is determined that the resolution is equal to or higher than the predetermined resolution, in step S1122, the object generation unit generates a preview drawing object in which the image is converted to a low resolution (for example, 75 dpi). If it is not determined that the resolution is equal to or higher than the predetermined resolution, the process proceeds to step S1150, and the drawing object for printing is used as the drawing object for preview. Similar to the point sequence data, the object generation unit adds each piece of information for preview to the work memory 205 in steps S1150 to S1152.

  If it is determined in step S1120 that the image is not an image, the object generation unit determines that the attribute of the print drawing object is a character, and the process proceeds to step S1131. In step S1131, the object generation unit determines whether the character size of the print drawing object is equal to or smaller than a predetermined size (for example, 10 pt). If it is determined that the size is equal to or smaller than the predetermined size, the object generation unit converts the drawing object for printing having this character attribute into a low-resolution (for example, 75 dpi) multi-valued image, and the multi-valued image is converted to the preview drawing object. And This multi-valued image of a character is an image whose gradation is adjusted so as to emphasize the edge portion of the character. If it is determined that the size is not less than the predetermined size, the process proceeds to step S1152, and the drawing object for printing is set as the drawing object for preview. Then, similarly to the point sequence data, the object generation unit adds each information for preview to the work memory 205 in steps S1150 to S1152.

FIG. 5 is a diagram showing a partial load prediction flow in steps S1102 and S1150, which is realized by the CPU 218 executing the object generation program 210 stored in advance in the ROM 208 on the work memory 205. In step S1201, the object generation unit determines whether the drawing object is a point sequence. If it is determined to be a point sequence, in step S1210, the object generation unit calculates a predicted load value using, for example, the following equation.
Predicted load value of point sequence = number of point sequences x 5
If it is determined in step S1201 that the drawing object is not a point sequence, in step S1220, the object generation unit determines whether the drawing object is an image. If it is determined that the image is an image, in step S1221, the object generation unit calculates a predicted load value using, for example, the following equation.
Predicted image load value = image width × image height × gradation × 0.1
If it is determined in step S1220 that the image is not an image, the object generation unit determines that the drawing object is a character, and shifts the processing to step S1222. In step S1222, the object generation unit calculates a predicted load value using, for example, the following equation.
Expected load value of character = character width × character height × 0.5
Note that the predicted load value calculated in the above steps is stored in the work memory 205 by the object generation unit.

  FIG. 6 is a diagram illustrating a flow of processing information generation for printing in step S1020 in FIG. 3, which is realized by the CPU 218 executing the scheduler program 215 stored in advance in the ROM 208 on the work memory 205. In step S1301, the scheduler determines whether the document information 5000 to be generated is a plurality of pages. If there are a plurality of pages, the scheduler determines the parallel processing method of the dual-print processing instruction 5233 stored in the work memory 205 in step S1310. Set in parallel. In step S1311, the scheduler initializes the page counter P of the page for calculating the predicted load value for each page to 1. The page counter P is secured in the work memory 205. In step S1312, the scheduler obtains an ID list of print drawing objects for page P of the single / print processing instruction 5231 on the work memory 205. In step S1313, the scheduler initializes a load value counter F for accumulating predicted load values of all drawing objects in the page P to zero. The load value counter F is secured in the work memory 205. In step S1314, the scheduler refers to the drawing object ID list of page P of the single / print processing instruction 5231 stored in the work memory 205 and calculates the drawing object calculated during generation of the drawing object in step S1010 of FIG. Each predicted load value is read from the work memory 205 and added to the load value counter F. Steps S1314 to S1316 are repeatedly executed until the addition of all drawing objects in the page is completed. When the addition of all objects in the page is completed, the scheduler stores the value of the load value counter F in the work memory 205 as the predicted load value of page P in step S1317, and increments the page counter P in step S1318. The next page is processed. Steps S1312 to S1319 are repeatedly executed until the addition of the predicted load values of all pages is completed. In step S1320, the scheduler performs page parallel load distribution estimation from the calculated predicted load values of all pages.

  On the other hand, if it is determined in step S1301 that the document information 5000 is a single page, in step S1330, the scheduler sets the parallel processing method of the dual-print processing instruction 5233 stored in the work memory 205 to object parallel. In step S1331, the scheduler performs an object parallel load distribution estimation.

  FIG. 7 is a diagram showing the flow of preview processing information generation in step S1021 of FIG. 3, which is realized by the CPU 218 executing the scheduler program 215 stored in advance in the ROM 208 on the work memory 205. In step S1401, the scheduler sets the parallel processing method of the dual preview processing instruction 5234 stored in the work memory 205 to object parallel. In step S1402, the scheduler initializes the page counter P of the page for calculating the load value for each page to 1. The page counter P is secured in the work memory 205. In step S1403, the scheduler acquires a list of drawing objects for preview on page P of the single preview processing instruction 5232 stored in the work memory 205. In step S1404, the scheduler performs object parallel load distribution estimation. In step S1405, the scheduler increments the page counter P and processes the next page. Steps S1402 to S1406 are repeatedly executed until the object-parallel load distribution estimation for all pages is completed.

FIG. 8 is a diagram showing a flow of page-parallel load distribution estimation in step S1320 of FIG. In step S1501, the scheduler calculates, for example, a total load value (predicted value of total load) of all pages obtained by summing the predicted load values of each page stored in step S1317, and calculates a load threshold value from the following equation: Fth is calculated.
Load threshold Fth = total load value of all pages / 2

  In step S1502, the scheduler initializes the load value counter F1 of the processor 1 of the multi-core CPU 318 to zero. Similarly, in step S1503, the scheduler initializes the load value counter F2 of the processor 2 of the multi-core CPU 318 to 0. In step S1504, the scheduler initializes a page counter P of a page for which load distribution is estimated to 1. In step S1505, the scheduler reads the predicted load value of the page P stored in the work memory 205, and determines whether the load value counter F1 of the processor 1 is smaller than a predetermined threshold (eg, 1.1 times the load threshold Fth). judge. If the load value counter F1 is smaller than the predetermined threshold, the scheduler adds the predicted load value of page P to the load value counter F1 of the processor 1 in step S1510. In step S1511, the scheduler adds the ID of page P to the page ID list of the processor 1 of the dual print processing instruction 5233 on the work memory 205 shown in FIGS. 2 (a) and 2 (b2). If the load value counter F1 is greater than or equal to the predetermined threshold value in step S1505, the scheduler adds the load value of page P to the load value counter F2 of the processor 2 in step S1520. In step S1521, the scheduler adds the ID of page P to the page ID list of the processor 2 of the dual print processing instruction 5233 on the work memory 205 shown in FIGS. 2 (a) and 2 (b2). The scheduler increments page P in step 1530, and repeatedly executes steps S1505 to 1531 until the load distribution estimation for all pages is completed. The processing information for printing generated by these processes is information (leveling information) for leveling the load on the intermediate code generation unit when page-parallel processing is executed, and dual printing of document information. The processing instruction 5233 takes the form of FIG.

  FIG. 9 is a diagram illustrating a flow of load distribution estimation in parallel with the object in step S1331 in FIG. 6, which is realized by the CPU 218 executing the scheduler program 215 stored in advance in the ROM 208 on the work memory 205.

First, load balancing estimation in parallel with objects in single page printing in step S1331 will be described. In step S1601, the scheduler initializes a load value counter F for calculating a load value and a page counter P for counting pages for calculating the load value to 1. This load value counter F is secured in the work memory 205. In step S1602, the scheduler refers to the drawing object ID list of page P of the single / print processing instruction 5231. In step S1603, the scheduler adds the load value of the drawing object calculated during the drawing object generation in step S1102 of FIG. In step S1604, the scheduler determines whether the load value addition for all objects in the page has been completed. The scheduler repeatedly executes steps S1602 to S1604 until the addition of all objects in the page is completed. When the addition of all objects in the page is completed, in step S1605, the scheduler calculates a load threshold Fth from the load values of all drawing objects in the page using the following formula. Since single-page printing (that is, processing for a single page), the load value of all drawing objects in the page is the predicted value of the total load.
Load threshold Fth = total load value of all objects / 2

  In step S1606, the scheduler initializes the load value counter F1 of the processor 1 of the CPU 318 to 0. Similarly, in step S1607, the scheduler initializes the load value counter F2 of the processor 2 of the CPU 318 to 0. The load value counters F1 and F2 are secured in the work memory 205. In step S 1608, the scheduler refers to the drawing object ID list of page P of the single / print processing instruction 5231 on the work memory 205. In step S1609, the scheduler adds a drawing object load value calculated during the drawing object generation in step S1010 of FIG. 3 to the load value counter F1 of the processor 1 based on the ID list to obtain a predetermined threshold value. It is determined whether it is smaller than (for example, 1.1 times the load threshold Fth). If it is smaller than the predetermined threshold, the scheduler adds the load value of the drawing object to the load value counter F1 of the processor 1 in step S1610. In step S <b> 1611, the scheduler adds the drawing object ID to the drawing object ID list of the processor 1 of page P of the dual / print processing instruction 5233 on the work memory 205. If it is equal to or greater than the predetermined threshold, the scheduler adds the load value of page P to the load value counter F2 of the processor 2 in step S1620. In step S1621, the scheduler adds the drawing object ID to the drawing object ID list of the processor 2 on page P of the dual / print processing instruction 5233 on the work memory 205. The scheduler repeatedly executes steps S1608 to S1630 until the load distribution of all the drawing objects in the page P is completed according to the determination in step S1630. The processing information for printing generated by these processes is information (leveling information) for leveling the load applied to the intermediate code generation unit when executing object parallel processing, and dual printing of document information. The processing instruction 5233 takes the form of FIG.

  The object parallel load distribution estimation in the preview of step S1404 in FIG. 7 will be described with reference to FIG. Although FIG. 9 dealt with object parallelism in single-page printing, the same applies to load parallel estimation of object parallelism in preview. Explain the differences. The first point is that the ID list to be referred to in step S1602 in FIG. 9 is the ID list of the drawing object on page P of the single preview processing instruction 5232 on the work memory 205. The second point is that the ID list to be referred to in step S1608 is the ID list of the drawing object on page P of the single preview processing instruction 5232 on the work memory 205. The third point is that the IDs added in steps S1611 and 1621 are the ID lists of the drawing objects of the processors 1 and 2 on page P of the dual preview processing instruction 5234 on the work memory 205. And it is a point which repeats the process of step S1601-S1630 over all the pages. The processing information for preview generated by these processes is information (leveling information) for leveling the load applied to the intermediate code generation unit when executing object parallel processing, and dual preview of document information The processing instruction 5234 takes the form as shown in FIG.

  In steps S1001 to S1023 of FIG. 2 described above, the document information 5000 for which the load distribution estimation has been performed is generated and stored in the database. It should be noted that the formula used for calculating the load value and estimating the load distribution is an example and does not limit the present invention, and calculating the load value or estimating the load distribution using another appropriate formula. Also good.

  Hereinafter, the execution of distributed processing will be described using document information 5000 stored in the database. FIG. 10 is a diagram illustrating a flow of printing or preview processing of document information 5000 in the image forming apparatus 103. In the flow of FIG. 10, the CPU 318 develops and executes each program (document information analysis program 309, intermediate code generation 310, parallel processing management program 311 and decompression processing program 314) stored in advance in the ROM 308 on the work memory 305. This is realized by causing the CPU to function as each functional unit (document information analysis unit, intermediate code generation unit, parallel processing management unit, development processing unit).

  In step S <b> 1701, the CPU 318 receives document information 5000 and a function instruction selected by the user using the display panel 321 via the panel I / F 320. When the instruction is received, in step S1702, the document information analysis unit acquires the document information 5000 selected by the user from the database (HDD 217 of the image forming apparatus 102) and stores it in the reception buffer 304. In step S1703, the document information analysis unit determines whether the function selected by the user is a preview. If the function selected by the user is preview, the document information analysis unit analyzes the document information 5000 in step S1704. FIG. 12 shows a flow of document information analysis in the case of preview. The processing flow in FIG. 12 is realized by the CPU 318 executing the document information analysis program 309 stored in advance in the ROM 308 on the work memory 305.

  In step S1900, the document information analysis unit acquires the hardware configuration (the number of CPU cores) of the image forming apparatus 103. In step S1901, the document information analysis unit reads the processing information offset 5130 of the header 5100. In step S1902, the document information analysis unit reads the processing information 5220 in the order of addresses according to the processing information offset 5130, and detects processing information (processing instruction offset) that matches the hardware configuration (number of cores) and function. In step S1903, the document information analysis unit determines whether matching process information is detected in step S1902. If it is detected in step S1902, in step S1904, the document information analysis unit stores the processing instruction of the processing instruction unit 5230 in the work memory 305 based on the detected processing instruction offset. If no processing information is detected in step S1902, the document information analysis unit stores a single preview processing instruction 5232 in the work memory 305 as a processing instruction in step S1905. In this embodiment, since processing is executed by the image processing apparatus 103 in the case of preview, a document information dual preview processing instruction 5234 is read out as parallel processing information.

  Returning to the description of the flow of FIG. In step S1710, the parallel processing management unit reads a processing instruction from the work memory 305 and determines whether the instruction is to instruct parallel processing by the multi-core CPU. If it is determined in step S1710 that the processing is parallel processing, in step S1711, the parallel processing management unit displays an ID list of preview rendering objects for each processor regarding the page to be previewed in accordance with the read processing instruction for parallel processing. get. In step S1712, the parallel processing management unit passes the processing instruction read in step S1704 and the ID list of the drawing object to be processed by the processor 1 to the processor 1 (intermediate code generation unit) of the CPU 318. Request processing of intermediate code generation. In step S1713, the parallel processing management unit passes the processing instruction read in step S1704 and the ID list of the drawing object to be processed by the processor 2 to the processor 2 (intermediate code generation unit) of the CPU 318. Request processing of intermediate code generation. In step S <b> 1714, the parallel processing management unit waits for an end notification of the intermediate code generation processing of the processors 1 and 2. When the processing end notification is received from the processors 1 and 2, in step S1715, the parallel processing management unit combines the intermediate codes generated by the intermediate code generation units of the processors 1 and 2 and stored in the frame buffer 306, and the work memory Stored in 305. In step S 1716, the development processing unit reads the combined intermediate code from the work memory 305, renders it, and stores the image in the raster memory 307. In step S1717, the parallel processing management unit reads the raster image stored in the raster memory 307 and displays the preview image on the display panel 321 via the panel I / F 320.

  If it is determined in step S1710 that the processing is not parallel processing, the parallel processing management unit in step S1751, based on the single preview processing instruction 5232 of the document information, the preview drawing object ID list for the page to be previewed. To get. In step S1752, the parallel processing management unit passes the processing instruction read in step S1704 and the ID list of the drawing object to be processed to the processor (intermediate code generation unit) of the CPU 318 to generate the intermediate code of the drawing object. Request processing. In step S1753, the parallel processing management unit waits for a process end notification of intermediate code generation. When the process end notification is received from the processor, the process proceeds to step S1716. The processing after step S1716 is as described above.

  On the other hand, if the function selected by the user is printing, the document information analysis unit analyzes the document information 5000 in step S1705. A flow of document information analysis in the case of printing will be described with reference to FIG. 12 in the case of preview. In the case of printing, the same processing flow as in the case of preview is taken. The difference is the processing in step S1905 when the processing information is not detected in step S1902. In step S 1905, the document information analysis unit stores a single / print processing instruction 5231 in the work memory 305 as a processing instruction. The rest is the same as in the preview. In this embodiment, in the case of printing, processing is executed by the image processing apparatus 103. Therefore, a dual-print processing instruction 5234 is read out as parallel processing information.

  Returning to the description of the flow of FIG. In step S1720, the parallel processing management unit reads the processing instruction in the work memory 305, and determines whether the instruction is for instructing parallel processing by the multi-core CPU. If it is determined in S1720 that the processing is parallel processing, the parallel processing management unit further determines in step S1721 whether the parallel processing method of the read processing instruction is page parallel. If it is determined in step S1721 that the pages are parallel, the parallel processing management unit acquires the page ID list of each processor in FIG. 2B2 in step S1730. In step S1731, the parallel processing management unit passes the processing instruction read in step S1705 and the acquired page list of processor 1 to the processor 1 (intermediate code generation unit) of the CPU 318, and generates the intermediate code of the drawing object. Request processing. In step S1732, the parallel processing management unit passes the processing instruction read in step S1705 and the acquired page list of processor 2 to the processor 2 (intermediate code generation unit) of the CPU 318, and generates the intermediate code of the drawing object. Request processing. In step S1733, the parallel processing management unit waits for an end notification of the intermediate code generation processing for each page from the processors 1 and 2 (intermediate code generation unit). If an end notification is received from either one of the processors 1 and 2 (intermediate code generation unit), the expansion processing unit renders the intermediate code stored in the frame buffer 306 and stores the raster image in the raster memory 307 in step S1734. To do. In step S1735, the parallel processing management unit waits for completion of rendering of all pages to be printed. When rendering of all pages is completed, the parallel processing management unit reads the raster image stored in the raster memory 307, outputs it to the printer engine 313 via the engine I / F 312 and prints it in step S1736. Step S1733 to step S1735 are repeatedly executed until it is determined in step S1735 that all pages have been completed.

  If the parallel processing method of the processing instruction is not page parallel, that is, object parallel in step S1721, the parallel processing management unit acquires the drawing object ID list of each processor in FIG. 2B3 in step S1740. In step S1741, the parallel processing management unit passes the processing instruction read in step S1705 and the acquired drawing object ID list of the processor 1 to the processor 1 (intermediate code generation unit) of the CPU 318, and Request intermediate code generation processing. In step S 1742, the parallel processing management unit passes the processing instruction read in step S 1705 and the acquired drawing object ID list of the processor 2 to the processor 2 (intermediate code generation unit) of the CPU 318. Request intermediate code generation processing. In step S1743, the parallel processing management unit waits for an end notification of the intermediate code generation processing of the processors 1 and 2. When the end notification of the intermediate code generation processing is received from the processors 1 and 2 in step S1743, the parallel processing management unit generates the intermediate code generated by the intermediate code generation unit of the processors 1 and 2 and stored in the frame buffer 306 in step S1744. The code is combined and stored in the work memory 305. In step S1745, the development processing unit reads the combined intermediate code from the work memory 305, renders it, and stores the image in the raster memory 307. Thereafter, in step S1736, the parallel processing management unit reads the image stored in the raster memory 307, outputs it to the printer engine 313 via the engine I / F 312 and prints it.

  If it is determined in step S1720 that the parallel processing is not performed, the parallel processing management unit acquires a print drawing object ID list for the page to be printed based on the single / print processing instruction 5231 in step S1761. In step S1762, the parallel processing management unit passes the processing instruction read in step S1705 and the ID list of the drawing object to be processed to the processor (intermediate code generation unit) of the CPU 318, and generates the intermediate code of the drawing object. Request processing. In step S1763, the parallel processing management unit waits for an end notification of the intermediate code generation processing for each page from the processor. If an end notification is received from the processor, the expansion processing unit renders the intermediate code stored in the frame buffer 306 and stores the raster image in the raster memory 307 in step S1764. In step S1765, the parallel processing management unit waits for completion of rendering of all pages to be printed. When rendering of all pages is completed, the parallel processing management unit reads the raster image stored in the raster memory 307, outputs it to the printer engine 313 via the engine I / F 312 and prints it in step S1736. Steps S1763 to S1765 are repeatedly executed until it is determined in step S1765 that all pages have been completed.

  FIG. 11 is a diagram illustrating a processing flow in each processor (intermediate code generation unit) of the CPU 318 in the image forming apparatus 103. The CPU 318 stores an intermediate code generation program 310 stored in advance in the ROM 208 on the work memory 305. It is realized by executing. The In step S1801, the intermediate code generation unit determines whether the processing method is object parallel based on the processing instruction passed from the parallel processing management unit in steps S1712, S1713, S1731, S1732, S1741, S1742, S1752, and S1762. Determine. In the case of object parallel, the intermediate code generation unit refers to the drawing object ID list passed together with the object parallel processing request in step S1811, and in step S1812, selects the drawing object based on the ID of the ID list and the object table 5300. get. In step 1814, the intermediate code generation unit generates an intermediate code from the acquired drawing object and stores it in the frame buffer 306. Steps S1811 to S1815 are repeatedly executed until intermediate code generation for all objects is completed. When the intermediate code generation for all objects is completed, in step S1816, the intermediate code generation unit transmits an end notification to the parallel processing management unit.

  On the other hand, if the parallel processing method is page parallel, in step S1820, the intermediate code generation unit refers to the page list of the processor shown in FIG. 2 (b2) delivered together with the page parallel processing request. In step S1821, the intermediate code generation unit refers to the ID list of the drawing object included in each page of the page list. In step S1822, the intermediate code generation unit determines that the drawing object is based on the ID list and the object table 5300. To get. In step 1824, the intermediate code generation unit generates an intermediate code from the acquired drawing object and stores it in the frame buffer 306. Steps S1821 to S1825 are repeatedly executed until intermediate code generation for all objects is completed. When the intermediate code generation for all objects is completed, in step S1826, the intermediate code generation unit transmits an end notification of the intermediate code generation process for the page to the parallel processing management unit. The processor repeatedly executes step S1820 to step S1827 until all pages in the passed page list are completed.

  According to the embodiment of the present invention described above, the multi-core CPU can realize efficient parallel processing and further improve the performance of various functions.

  In this embodiment, the image forming apparatus 102 analyzes the PDL data to generate the document information 5000. However, the image forming apparatus 102 analyzes the read image information read by the scanner 221, and uses the read image information to determine a plurality of objects (graphics, images, characters). May be read to generate the document information 5000.

  In this embodiment, the image processing apparatus according to the present invention is realized by the image forming apparatus 102 that generates the document information 5000 and the image forming apparatus 103 that executes output processing based on the processing information of the generated document information 5000. is doing. However, the present invention may be realized by causing the image forming apparatuses 102 and 103 described above to execute the image processing using the same image forming apparatus.

(Other examples)
The present invention can also be realized by executing the following processing. In this process, software (program) for realizing the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or apparatus executes the program. It is a process to read and execute. Moreover, this invention committee is implement | achieved also by the electronic circuit which fulfill | performs the function of the Example mentioned above which performs these functions.

Claims (8)

An acquisition means for acquiring image information including a plurality of objects;
Object generation means for generating a plurality of converted objects by converting each of the plurality of objects into data corresponding to the function of the output unit;
Intermediate code generation means comprising a plurality of processing units for generating intermediate code from the plurality of converted objects;
Load predicting means for predicting a partial load applied to each of the plurality of processing units in the generation of the intermediate code;
Based on the partial load predicted by the load predicting unit, the load applied when the intermediate code generating unit generates the intermediate code from the plurality of converted objects is leveled between the plurality of processing units. Leveling information generating means for generating leveling information of
Association means for associating the leveling information with the plurality of converted objects;
Document information generating means for generating document information having the plurality of converted objects and the leveling information;
An image processing system comprising: There are multiple functions,
The image processing system according to claim 1, wherein the leveling information generation unit generates leveling information for leveling the overall load for each of the plurality of functions.   The image processing system according to claim 1, wherein the document information generation unit stores the document information in a database.   The image processing system according to claim 1, wherein the partial load predicted by the load prediction unit is calculated based on an attribute of the converted object. An object generation step of generating an object after conversion, wherein the object generation means converts the object into data corresponding to the function of the output unit from image information including a plurality of objects;
An intermediate code generating step in which an intermediate code generating means having a plurality of processing units generates an intermediate code from the converted object;
A load prediction step in which a load prediction unit predicts a partial load applied to the intermediate code generation unit in the generation of the intermediate code;
Based on the partial load predicted in the load prediction step, the leveling information generation means leveles the overall load applied to the intermediate code generation means for the plurality of objects in the function among the plurality of processing units. Leveling information generating step for generating leveling information for
An associating unit associating the leveling information with the plurality of converted objects;
A document information generating unit that generates document information including the converted object and the leveling information;
An image processing method.   The program for functioning a computer as each means of any one of Claims 1 thru | or 4. An acquisition means for acquiring image information including a plurality of objects;
Object generating means for generating a converted object by converting each of the plurality of objects into data corresponding to the function of the output unit;
Document information generating means for generating document information having the plurality of converted objects;
An image processing apparatus comprising:
Load prediction means for predicting the load on the processing unit for converting the converted object into data for output by the output unit,
Based on the load predicted by the load prediction means, generates leveling information for leveling the load applied when the plurality of converted objects are converted by the plurality of processing units between the plurality of processing units. Leveling information generating means for
Association means for associating the leveling information with the plurality of converted objects;
An image processing apparatus comprising: An image processing apparatus comprising a plurality of processing units for generating intermediate codes from document information having converted objects obtained by converting a plurality of objects in image information according to the function of an output unit,
The document information includes leveling information for leveling a load in the generation process of the intermediate code among the processing units,
The image processing apparatus includes:
Obtaining means for obtaining the leveling information from the document information;
Object selection means for selecting the plurality of converted objects to be processed based on the acquired leveling information;
Intermediate code generating means for generating an intermediate code from the converted object selected by the object selecting means;
An image processing apparatus comprising:

Images