JP4770451B2 - Print control device - Google Patents

Description

  The present invention relates to image processing executed to print an image to be printed.

  In recent years, image data captured by an imaging device such as a digital camera and stored in a storage medium such as a memory card is directly read into a printer without using a personal computer, and an image represented by the read image data is printed. Printers capable of reading image data directly from an imaging device such as a digital camera or the like and printing the image represented by the read image data are becoming widespread. Hereinafter, an image captured by such an imaging apparatus is also referred to as a “photo image”, and image data representing the photo image is also referred to as “photo image data”. A printer capable of printing a photo image as described above is also referred to as a “photo printer”.

  In the photo printer as described above, as one of the image processes executed for printing the photo image, various correction processes are performed on the read photo image data in advance so that an appropriate print result can be obtained. It is carried out. As a correction technique for such photo image data, for example, a technique described in Patent Document 1 has been proposed.

JP 2001-165647 A

  By the way, in the photo printer as described above, as preprocessing for performing correction processing, first, photo image data is read, and a histogram is created by sampling at a predetermined rate from the read photo image data, and then The correction parameters are determined based on the created histogram. In the image processing executed for printing the photo image, the photo image data is corrected using the determined correction parameter. In addition, when correcting the eye color of a person with red eyes in a photo image to a normal eye color, a red-eye analysis process is further performed to perform a correction parameter (red-eye correction). The position and color correction amount) are added as pre-processing.

  Therefore, in the case of printing one photo image, the correction used for correcting the photo image data is always performed before the image processing including the correction processing, which is executed to print the photo image. It is necessary to execute preprocessing for obtaining parameters. For this reason, when printing a plurality of different photo images, the image processing of one photo image is completed and the actual print processing is started, and then the image processing of the next photo image is started. Since the pre-processing of the photo image is executed before the image processing is performed, the waiting time until the image processing is started is increased, and as a result, the waiting time until the actual printing processing is started. There is a problem that becomes longer.

  The present invention has been made in order to solve the above-described problems, and a technique for shortening the time from the end of image processing of one image to the start of image processing of the next one image. The purpose is to provide.

In order to solve at least a part of the above-described problems, an aspect of the present invention provides:
A print control apparatus that executes image processing for printing an image represented by print target image data,
It is composed of a multiprocessor system having a plurality of processors,
The image processing
In order to determine a correction parameter used to correct the image quality of the image represented by the print target image data, at least a development process for developing the print target image data compressed in a predetermined format is executed, and Preprocessing for executing face recognition processing for recognizing a face in the image based on original image data obtained by the expansion processing;
A main process for executing a developing process for developing the print target image data, and executing a correction process for correcting the original image data obtained by the developing process based on the correction parameter determined by the preprocessing; Including
A first processor that operates as an image processing unit including a preprocessing unit related to the preprocessing, a main processing unit related to the main processing, and an image processing management unit that manages operations of the preprocessing unit and the main processing unit. When,
In accordance with an instruction from the image processing unit, a second processor that operates as an image expansion unit that executes the expansion process in the pre-processing or the expansion process in the main process;
A third processor that operates as an image correction processing unit that executes the correction processing or a face recognition processing unit that executes the face recognition processing in accordance with an instruction from the image processing unit;
With
When printing images represented by a plurality of different print target image data in order,
The image processing management unit
For the first print target image data, the preprocessing by the preprocessing unit is executed, and the main processing by the main processing unit is executed after the preprocessing is completed.
The n-th print target image data (n is an integer of 2 or more) is printed by the pre-processing unit during the execution of the main process by the main processing unit of the (n−1) -th print target image data. Causing the preprocessing to be executed, and the main processing by the main processing unit to be executed after the preprocessing is completed,
The pre-processing unit is
In the pre-processing for the first print target image data, the development processing is executed by the development processing unit, and the face recognition processing is executed by the face recognition processing unit.
In the pre-processing for the n-th print image data, the development processing is executed by the development processing unit, and the face recognition processing is executed by the pre-processing unit itself.
It is characterized by that.

  According to the print control apparatus, the n-th print target image data is subjected to pre-processing by the pre-processing unit during execution of the main processing by the main processing unit of the (n−1) -th print target image data. Since the image processing can be executed, it is possible to shorten the time from the end of the image processing for one image to the start of the image processing for the next one image.

The face recognition process executed based on the original image data in the pre-processing executes a sampling process for sampling the original image data at a predetermined rate, and executes based on a result obtained by the sampling process. Process
The pre-processing unit is
In the pre-processing for the first print target image data, the expansion processing is performed by the expansion processing unit, the sampling processing is performed by itself, and the face recognition processing is performed by the face recognition processing unit. Let it run
In the pre-processing for the n-th print image data, the development processing is executed by the development processing unit, and the sampling processing and the face recognition processing are executed by the pre-processing unit itself. Good.

  In this way, the time required for the face recognition process can be shortened.

In the print control apparatus,
The pre-process is a process of executing the development process after the face recognition process is completed, and executing a red-eye analysis process for analyzing a person's red eyes based on the original image data obtained by the development process. Contains
The pre-processing unit is
In the pre-processing for the first print target image data, after instructing the face recognition processing unit to the face recognition processing unit, the expansion processing unit executes the expansion processing, and the red-eye analysis processing is performed. Executed by the pre-processing unit itself,
In the pre-processing for the n-th print image data, after the face recognition processing is finished, the development processing is executed by the development processing unit, and the red-eye analysis processing is executed by the pre-processing unit itself. It is also possible to do so.

  The present invention can be configured as an image processing apparatus in addition to the configuration as the print control apparatus. Further, the present invention is not limited to the aspects of the device invention, and may be realized by aspects of a method invention such as a print control method and an image processing method. Note that the various additional elements described above can also be applied to the method invention.

Hereinafter, embodiments of the present invention will be described in the following order based on examples.
A. Example:
A1. Configuration of print control device:
A2. Operation of each block when image processing is executed by the image processing unit:
A2.1. Image processing manager:
A2.2. This processing unit:
A2.3. Pre-processing section:
A2.4. Image processing control unit:
A2.5. Image decoding unit:
A2.6. Image correction processor:
A2.7. Face recognition processing unit:
A3. Specific examples of image processing operations:
A4. Effects of the embodiment:
B. Variations:

A. Example:
A1. Configuration of print control device:
FIG. 1 is an explanatory diagram showing a configuration example of a print control apparatus as an embodiment of the present invention. The print control apparatus 10 is a microprocessor in which a multiprocessor system including a plurality of processors is integrated on a single semiconductor substrate. Each processor means a unit including peripheral circuits such as a CPU, a memory, and a bus controller. In the present embodiment, as shown in FIG. 1, one main processor 100 and four sub processors 200A to 200D (indicated as “sub processor 1” to “sub processor 4” in the figure). As an example, a case is provided. The print control apparatus 10 includes a plurality of processors, a circuit for controlling the operation of the printing mechanism unit 20, a circuit for controlling an input operation by the input device 30 such as an operation panel, and a display by the display device 40 such as a liquid crystal panel. Although various peripheral circuits such as a circuit for controlling the operation and a circuit for controlling the reading operation from the storage device 50 such as a memory card are provided, they are not shown.

  Each processor constituting the print control apparatus 10 reads out and executes a predetermined program stored in a memory (not shown) that is a component of the processor, and functions as a functional block described below. Operate.

  The main processor 100 operates as a functional block (hereinafter referred to as “image print processing unit”) that controls the print processing operation as a whole. Hereinafter, the main processor 100 is also referred to as an “image print processing unit 100”.

  Specifically, the image print processing unit 100 includes a user interface unit (also referred to as “UI unit”) 110, a file access control unit 120, an image processing unit 130, a print image generation unit 140, and a print processing unit 150. Divided into functional blocks.

  The UI unit 110 controls display of a selection screen on the display device 40 in order to select photo image data that the user desires to print from photo image data stored in the storage device 50, and An operation corresponding to a selection operation executed via the input device 30 is controlled. In addition, when the user instructs to print a photo image represented by the selected photo image data via the input device 30, the UI unit 110 transfers the instruction to the image processing unit 130, thereby performing image processing. The start of the processing operation in the unit 130 is controlled.

  In response to an instruction from the image processing unit 130, the file access control unit 120 controls reading of photo image data stored in the storage device 50.

  The image processing unit 130 reads out the selected photo image data (hereinafter, also referred to as “print target image data”) via the file access control unit 120, and performs an image described later on the read print target image data. Process.

  The photo image data stored in the storage device 50 is, for example, compressed data in JPEG (Joint Photographic Coding Experts Group) format. Therefore, the image processing unit 130 executes image decoding processing for expanding the read print target image data into RGB format image data as one of the image processing.

  In addition to the image decoding process, the image processing unit 130 performs color correction, brightness correction, and image correction on image data (also referred to as “original image data”) obtained by developing the print target image data. Image correction processing that performs at least one of various correction processing such as contrast correction, saturation correction, noise removal, smoothing, and contour correction, resolution conversion processing that converts the resolution of print target image data, and print target image data Various image processing such as layout processing for generating image data (also referred to as “layout image data”) in which an image represented by is arranged at an actual printing position on the print medium is executed.

Note that the image processing unit 130 specifically includes an image processing manager 132 and a preprocessing unit that executes only image processing for determining correction parameters necessary for image correction processing under the management of the image processing manager. 136 and a main processing unit 134 that executes original image processing. However, the processing unit 134 does not actually execute image processing, but instructs the first sub-processor 200A operating as an image processing control unit to execute specific processing, as will be described later. Then, the first sub-processor 200A to the third sub-processor 200C operating as functional blocks corresponding to the instructed process execute the process. In addition, as will be described later, the preprocessing unit 136 instructs the first sub-processor 200A that operates as an image processing control unit to perform decoding processing for decoding processing among the processing executed in the preprocessing, and performs image decoding. The second sub-processor 200B that operates as a unit executes the processing. Furthermore, the pre-processing unit 136 is an image processing control unit for the face recognition process among the processes executed in the pre-processing, when the print target image data instructed for the pre-processing is the first sheet. When the third sub-processor 200C operating as the face recognition processing unit executes a processing instruction to the operating first sub-processor 200A and the processing is not the first one, that is, the second and subsequent ones In this case, the preprocessing unit 136 itself executes the processing.

  The print image generation unit 140 generates print image data based on the image data that has been subjected to image processing in the image processing unit 130. The print image data is data used to actually print an image on a print medium. For example, in the case of an ink jet type printing apparatus, it means binary data representing the arrangement of dots on the print medium. is doing. However, like the image processing unit 130, the print image generation unit 140 does not actually generate print image data, but the print image generation unit 140 operates as a print image generation execution unit as described later. By instructing the fourth sub-processor 200D to generate print image data, the fourth sub-processor 200D generates print image data.

  The print processing unit 150 executes actual printing by controlling the print mechanism unit 20 based on the print image data generated by the print image generation unit 140.

  The first sub-processor 200A operates as a functional block (image processing control unit) that controls an image processing operation in accordance with an instruction from the image processing unit 130. Hereinafter, the first sub-processor 200A is also referred to as “image processing control unit 200A”.

  The second sub-processor 200B is a functional block (hereinafter referred to as “image decoding unit” or “image development unit”) that executes image decoding processing (also referred to as “image development processing”) in accordance with an instruction from the image processing control unit 200A. It works as. Hereinafter, the second sub-processor 200B may be referred to as an “image decoding unit 200B”.

  The image decoding unit 200B actually executes the image decoding process when the image decoding process is instructed from the main processing unit 134 or the preprocessing unit 136 of the image processing unit 130 via the image processing control unit 200A.

  As will be described later, the third sub-processor 200C operates as a functional block (hereinafter referred to as an “image correction unit”) that executes image correction processing in accordance with an instruction from the image processing control unit 200A. Hereinafter, the third sub-processor 200C is also referred to as an “image correction unit 200C”.

  The image correction unit 200C is specifically divided into an image correction processing unit 210C and a face recognition processing unit 220C. The image correction processing unit 210C actually executes the image correction process when an image correction process is instructed from the main processing unit 134 of the image processing unit 130 via the image processing control unit 200A. When face recognition processing is instructed from the preprocessing unit 136 of the image processing unit 130 via the image processing control unit 200A, the face recognition processing unit 220C actually executes face recognition processing.

  As described above, the fourth sub-processor 200D performs a function block (print image generation execution unit) that executes processing for generating print image data based on the print target image data subjected to image processing in the image processing unit 130. ). Hereinafter, the fourth sub-processor 200D is also referred to as “print image generation execution unit 200D”.

  As can be seen from the above description, the main processor 100 corresponds to the first processor of the present invention, and the second and third sub-processors 200B and 200C correspond to the second and third processors of the present invention.

  Incidentally, the feature of the present invention resides in the image processing operation executed by the preprocessing unit 136 and the main processing unit 134 under the management of the image processing manager 132 in the image processing unit 130. Therefore, hereinafter, the operation of each block related to the image processing operation will be further described.

A2. Operation of each block when image processing is executed by the image processing unit:
A2.1. Image processing manager:
FIG. 2 is an explanatory diagram showing an image processing management operation executed by the image processing manager 132. In the following description, in order to facilitate the description of the image processing management operation, photo image data representing two different photo images are selected as print target image data, and images corresponding to these two print target image data are selected. A case where processing is executed will be described as an example.

  The image processing manager 132 (hereinafter also referred to as “OMT” in the figure) monitors the print processing instruction from the UI unit 110 (step S102), and the print processing instruction is received from the UI unit 110. (Step S102: YES), the processing from step S104 to step S120 described below is executed, and when the processing is completed (step S120: YES), the process returns to step S102 and a print processing instruction is issued. Repeat monitoring.

  When an instruction for the printing process is given (step S102: YES), it is first determined in the process of determining whether or not it is the first sheet (step S104) (step S104: YES), and this processing unit 134 ( Hereinafter, execution of pre-processing is instructed to (hereinafter also referred to as “DFT” in the figure) (step S106), and the end of pre-processing is monitored (step S108). At this time, as will be described later, the processing unit 134 instructs the preprocessing unit 136 (hereinafter also referred to as “SDFT” in the drawing) to execute the preprocessing, and the preprocessing unit 136 performs the preprocessing. When the end response is notified, the end response is notified to the image processing manager 132.

  When the preprocessing end response is notified from the preprocessing unit 136 via the main processing unit 134 (step S108: YES), the main processing is performed in order to perform image processing on the first print target image data. The unit 134 is instructed to execute this processing (step S110). Then, the end of the process instructed to execute is monitored (step S116). Here, since the print target image data is handled in units of a plurality of predetermined blocks (referred to as “bands”), the execution instruction for this processing is performed in units of the bands.

  In addition, during the period in which the completion of the instructed main process is monitored, along with this monitoring, two sheets generated at a timing when a predetermined time has elapsed since the main process for the first print target image data is started. Monitoring is also performed for the preprocessing timing of the image data to be printed for the eyes (step S112). When the preprocessing timing of the second print target image data occurs (step S112: YES), the main processing unit 134 is instructed to execute the preprocess of the second print target image data (step S112). S114).

  When the main processing unit 134 notifies the end of the main processing of the band instructed to be executed (step S116: YES), the main processing for each band is completed up to the end of the image of the first print target image data. Whether or not (step S118).

  If this processing has not been completed up to the end of the image (step S118: NO), the process returns to step S110 to instruct the main processing unit 134 to execute the main processing for the next band. On the other hand, when the process is completed up to the end of the image (step S118: YES), it is determined whether the process is completed (step S120).

  Here, since it is premised on the image processing for the two print target image data, it is determined that the processing is not completed (step S120: NO), and the process returns to step S104 to determine that it is not the first sheet (step S104: NO) and during the execution of this process for the first print target image data, the end of the pre-processing for the second print target image data instructed in step S116 is monitored (step S108).

  When the end of the pre-processing for the second print target image data is notified (step S108: YES), as with the first print target image data, the second print target image data is processed. Until the band-unit main process reaches the end of the image (step S118: NO), the execution instruction for the band-unit main process (step S110) and the end monitoring of the band-unit main process (step S116) are repeated.

  If the main process for the second print target image data is the end of the image (step S118: YES), it is determined in step S120 that the process is complete (step S120: NO), and the process returns to step S102. The next print processing instruction is monitored.

  In the above description, the image processing for the two print target image data has been described. However, in the case of the image processing for the three print target image data, as described above, the second print target image data is used. Preprocessing timing for the third print target image data in step S112 while repeating the execution instruction for the band-based main process (step S110) and the end monitoring of the band-unit main process (step S116). Monitor for. When the preprocessing timing of the third print target image data occurs (step S112: YES), the main processing unit 134 is instructed to execute the preprocess of the third print target image data. (Step S114). That is, in the image processing for a plurality of print target image data, the execution of the pre-processing for the next print target image data is instructed while the main processing for each print target image data is being performed. The pre-process that has been performed is started.

A2.2. This processing unit:
FIG. 3 is an explanatory diagram showing the main processing operation executed by the main processing unit 134.

  The processing unit 134 (DFT) monitors a preprocessing instruction from the image processing manager 132 (OMT) (step S132), monitors a preprocessing end response from the preprocessing unit 136 (SDFT) (step S134), Monitoring of the main processing instruction from the image processing manager 132 (step S136), and monitoring of the main processing end response from the image processing control unit 200A (hereinafter also referred to as “IMG” in the figure) (step S138). ) And the process described below is repeated.

  When there is a preprocessing instruction from the image processing manager 132 (step S132: YES), the preprocessing unit 136 is instructed to execute the preprocessing (step S142).

  If there is an end response of the preprocessing that has been instructed to be executed from the preprocessing unit 136 (step S134: YES), the end response of the instructed preprocessing is notified to the image processing manager 132 (step S144). ).

  If there is an instruction for this processing from the image processing manager 132 (step S136: YES), the image processing control unit 200A is instructed to execute image processing for the print target image data to be specified in band units ( Step S146).

  When there is an end response of the image processing that has been instructed to be executed from the image processing control unit 200A (step S138: YES), the end of the instructed main processing is notified to the image processing manager 132 (step S138). S148).

A2.3. Pre-processing section:
4 and 5 are explanatory diagrams showing the preprocessing operation performed by the preprocessing unit 136. FIG.

  The preprocessing unit 136 (SDFT) monitors a preprocessing instruction from the main processing unit 134 (DFT) (step S164), and the preprocessing instruction is received from the image processing manager 132 (OMT) via the main processing unit 134. If there is (step S164: YES), the processing from step S166 to step S202 described below is executed.

  When an instruction for pre-processing is given (step S164: YES), first, initialization processing such as memory used for pre-processing and subsequent main processing is executed (step S166).

  Then, the image processing control unit 200A (IMG) is instructed to perform image decoding processing (hereinafter also simply referred to as “decoding processing”) on the print target image data for which preprocessing is instructed (step S168). The end of the process is monitored (step S170). As described above, since the print target image data is handled in band units, an instruction for decoding processing is also performed in band units. In addition, as will be described later, the image processing control unit 200A that has received the instruction for decoding processing instructs the image decoding unit 200B (hereinafter also referred to as “IDEC” in the drawing) to execute decoding processing, and performs image decoding. The decoding processing end response notified from the unit 200B is notified to the preprocessing unit 136. Therefore, the end of the decoding process can be determined by monitoring the end response of the decoding process notified from the image decoding unit 200B via the image processing control unit 200A.

  Here, when a decoding processing end response is notified from the image decoding unit 200B via the image processing control unit 200A (step S170: YES), the decoding processing in units of bands is completed up to the end of the image of the print target image data. It is determined whether or not (step S172).

  If the decoding process has not yet been completed to the end of the image (step S172: NO), the image processing control unit 200A is instructed to decode the next band (step S174), and then the band for which the decoding process has been completed. Sampling processing is executed on the image data (step S176). This sampling process is a process of creating a histogram by sampling at a predetermined rate from the image data that has been decoded.

  On the other hand, when the decoding process is completed up to the end of the image (step S172: YES), the sampling process is immediately executed in step S176.

  Next, it is determined whether or not the sampling process has been completed for the entire print target image data instructed to be preprocessed (step S178).

  At this time, if there is a band for which the decoding process has not been completed and all the sampling processes have not been completed (step S178: NO), the process returns to step S170 to monitor the end of the decoding process (step S170). ) To the sampling process (step S176).

  On the other hand, when all the sampling processes are completed (step S178: YES), the statistical process is executed based on the created histogram (step S180). This statistical process is a process for determining correction parameters for correcting image quality such as brightness and sharpness of an image from the created histogram.

  Then, it is determined whether or not the image data to be printed for which preprocessing is instructed is the first sheet (step S182). If it is the first sheet (step S182: YES), face recognition processing is performed to the image processing control unit 200A. (Step S184), and the process proceeds to the next process. On the other hand, if it is not the first one (step S182: NO), the face recognition process is executed by itself (step S186), and the process proceeds to the next process after the face recognition process is completed. Here, when a face is recognized by the face recognition process, a correction parameter corresponding to the face is determined. Note that the face recognition process is a technique already known in the field of image processing, and therefore the description thereof is omitted here.

  Next, it is determined whether or not red-eye correction is performed (step S188). If red-eye correction is not performed (step S188: NO), the process of step S202 described later is performed. On the other hand, if red-eye correction is present (step S188: YES), the image processing control unit 200A is again instructed to perform band-by-band decoding processing (step S190), and the end of the decoding processing is monitored (step S192). The presence / absence of red-eye correction can be set in advance by the user making a selection via the input device 30 while viewing the red-eye correction selection screen displayed on the display device 40 by the UI unit 110.

  Then, when a decoding processing end response is notified from the image decoding unit 200B via the image processing control unit 200A (step S192: YES), it is determined whether or not the band-by-band decoding processing has been completed up to the end of the image. (Step S194).

  If the decoding process has not been completed up to the end of the image (step S194: NO), the image processing control unit 200A is instructed to decode the next band (step S196), and then the band for which the decoding process has been completed. The red-eye analysis process is executed on the image data (step S198). On the other hand, when the decoding process is completed up to the end of the image (step S194: YES), the red-eye analysis process for the last band is immediately executed (step S198). This red-eye analysis process is a process for determining a correction parameter for correcting the red eye. Since this red-eye analysis process is already known in the field of image processing, its description is omitted here.

  Next, it is determined whether or not the red-eye analysis process has been completed for the entire print target image data instructed to be preprocessed (step S200).

  At this time, if there is a band for which the decoding process has not been completed and all the red-eye analysis processes have not been completed (step S200: NO), the process returns to step S192 to monitor the completion of the decoding process (step S200). The process from S192) to the red-eye analysis process (step S198) is executed.

  On the other hand, when all the red-eye analysis processing is completed (step S200: YES), or when there is no red-eye correction (step S188: NO), the face recognition processing that should have been previously performed and executed is terminated. Monitor (step S202).

  If the face recognition process has been completed (step S202: YES), the end response of the instructed preprocess is notified to the processing unit 134 (step S204), the process returns to step S164, and the next previous Monitor processing instructions. If the instructed preprocessing is processing for the second and subsequent print target image data, the face recognition processing is executed by itself in step S186, and after the processing is completed, step S188 is executed. Since the subsequent red-eye correction process is executed, the face recognition process has already been completed when the red-eye correction process is started. Therefore, in this case, when the red-eye analysis process is completed, the process immediately returns to step S164 and the next pre-processing instruction is monitored.

A2.4. Image processing control unit:
FIG. 6 is an explanatory diagram showing an image processing control operation executed by the image processing control unit 200A.

  The image processing control unit 200A (IMG) monitors the face recognition processing instruction from the preprocessing unit 136 (SDFT) (step S212), and the face recognition processing unit 220C of the image correction unit 200C (hereinafter referred to as “FR” in the figure). Is also displayed (step S214), monitoring of the image processing instruction from the processing unit 134 (DFT) (step S216), and from the image decoding unit 200B (IDEC). Monitoring of the decoding process end response (step S218), and monitoring of the correction processing end response from the image correction processing unit 210C (hereinafter also referred to as “APF” in the drawing) of the image correction unit 200C (step S220). And the process described below is repeated.

  When there is an instruction for face recognition processing from the pre-processing unit 136 (step S212: YES), the face recognition processing unit 220C of the image correction unit 200C is instructed to perform face recognition processing (step S224).

  When the face recognition processing end response is received from the face recognition processing unit 220C (step S214: YES), the face recognition processing end response is notified to the preprocessing unit 136 (SDFT) that has instructed the execution. (Step S226).

  If there is an image processing instruction from the processing unit 134 (step S216: YES), the image decoding unit 200B is instructed to execute the decoding process (step S228).

  When there is a decoding processing end response from the image decoding unit 200B (step S218: YES), the image correction processing unit 210C of the image correction unit 200C is instructed to execute the correction processing (step S230).

  When there is a correction processing end response from the image correction processing unit 210C (step S220: YES), the processing unit 134 is notified of the instructed image processing end response (step S232).

A2.5. Image decoding unit:
FIG. 7 is an explanatory diagram showing an image decoding processing operation executed by the image decoding unit 200B.

  The image decoding unit 200B (IDEC) monitors an instruction for decoding processing from the image processing control unit 200A (IMG) (step S242).

  If there is an instruction for decoding processing (step S242: YES), the decoding processing is executed (step S246), and the end of the decoding processing is monitored (step S248).

  When the decoding process is completed (step S248: YES), the image processing control unit 200A is notified of the instructed decoding process end response (step S250), and the process returns to step S242 to return to the next step. Monitor decode processing instructions.

A2.6. Image correction processor:
The image correction processing operation by the image correction processing unit 210C of the image correction unit 200C is the same except that the decoding processing in the decoding processing operation of FIG. Omitted.

A2.7. Face recognition processing unit:
Also, the face recognition processing operation by the face recognition processing unit 220C of the image correction unit 200C is the same except that the decoding processing in the decoding processing operation of FIG. 7 is replaced with the face recognition processing. Is omitted.

A3. Specific examples of image processing operations:
Hereinafter, the image processing manager 132 (OMT), the main processing unit 134 (DFT), the preprocessing unit 136 (SDFT), the image processing control unit 200A (IMG), and the image decoding unit 200B (IDEC) of the image processing unit 130 will be described. ) And an image processing operation executed by the image correction processing unit 210C (APF) and the face recognition processing unit 220C (FR) of the image correction unit 200C will be described. In order to facilitate the description of the image processing operation, it is assumed that image processing is performed on two pieces of print target image data.

  8 to 10 are explanatory diagrams showing specific examples of the image processing operation.

  When the user instructs printing of the two selected print target images via the input device 30, the instructions are transferred from the UI unit 110 to the image processing unit 130, and the image processing operation in the image processing unit 130 is performed. As described below, (first preprocessing), (first main processing), (second preprocessing in parallel with the first main processing), and (second Is executed under the control of the image processing manager 132.

(First pre-processing)

  First, the image processing manager 132 (OMT) performs image processing (preprocessing) on the first print target image data (hereinafter abbreviated as “print target image data 1”) with respect to the main processing unit 134 (DFT). And the start of the pre-processing (denoted as “pre-processing: 1” in the figure).

  Receiving the pre-processing start instruction, the processing unit 134 instructs the pre-processing unit 136 (SDFT) to start pre-processing (“pre-processing: 1”) for the print target image data 1 that has received the instruction. .

  Upon receiving the preprocessing start instruction, the preprocessing unit 136 first instructs the image processing control unit 200A (IMG) about the first band of the print target image data 1 (hereinafter abbreviated as “band 1”). Instruct the decoding process.

  In the figure, the image data of band 1 of the image data 1 to be printed is denoted as “1_ # 1”. In this notation, “1” before “_” indicates that the first print target image data is a target, and “2” is displayed when the second print target image data is a target. write. In addition, “# 1” after “_” indicates a band number, and an n-th band (n is an integer of 1 or more) is expressed as “#n”. Therefore, for example, the decoding process for the band 1 of the print target image data 1 is expressed as “decode: 1_ # 1”. However, processing that is not in units of bands is expressed as “preprocessing: 1” as in the preprocessing of the print target image data 1, for example.

  Receiving the instruction for decoding processing, the image processing control unit 200A instructs the image decoding unit 200B (IDEC) to perform decoding processing for the band 1 of the print target image data 1 (“decode: 1_ # 1”).

  The image decoding unit 200B that has received the instruction for the decoding process executes the decoding process for the band 1 of the print target image data 1 that has received the instruction, and sends an end response (“decode” to the image processing control unit 200A. : 1_ # 1 end ").

  The image processing control unit 200A that has received the decoding processing end response (“decoding: 1_ # 1 end”) for the band 1 of the print target image data 1 sends the band of the print target image data 1 to the preprocessing unit 136. 1 is notified of the decoding process end response (“Decode: 1_ # 1 end”).

  The pre-processing unit 136 that has received the decoding process end response (“decode: 1_ # 1 end”) for the band 1 of the print target image data 1 decodes the decode process (“decode: 1_ # 2 ").

  Receiving the instruction for decoding processing, the image processing control unit 200A instructs the image decoding unit 200B to perform decoding processing for the band 2 of the print target image data 1 (“decode: 1_ # 2”).

  The image decoding unit 200B that has received the instruction for the decoding process executes the decoding process for the band 2 of the print target image data 1 that has received the instruction, and the image processing control unit 200A. An end response of this process (“decode: 1_ # 2 end”) is notified.

  The image processing control unit 200A that has received the decoding processing end response (“decoding: 1_ # 2 end”) for the band 2 of the print target image data 1 sends the band of the print target image data 1 to the preprocessing unit 136. 2 is notified of the decoding process end response (“decode: 1_ # 2 end”).

  Here, the pre-processing unit 136 that has instructed the decoding process (“decode 1_ # 2”) for the band 2 of the print target image data 1 until receiving the end response (“decode: 1_ # 2 end”). In addition, the sampling process (“Sampling: 1_ # 1”) for the band 1 of the print target image data 1 that has been completed first is executed.

  Then, after the sampling process for the band 1 of the print target image data 1 is completed, the preprocessing unit 136 sends a decoding process end response (“decode: 1_ # 2 end”) for the band 2 of the print target image data 1. Upon receipt, the decoding process (“decode: 1_ # 3”) for the band 3 of the print target image data 1 that is the target of the next decoding process is instructed, and the band 2 of the print target image data 1 that has been completed first is instructed. Sampling processing (“sampling: 1_ # 2”) is executed.

  Hereinafter, similarly, the preprocessing unit 136 sequentially applies to the image decoding unit 200B via the image processing control unit 200A from the first band of the print target image data 1 to the nth band that is the end of the image. By instructing the decoding process (“Decode: 1 — # 1” to “Decode: 1 — #n”), the image decoding unit 200B sequentially executes the decoding process for each designated band. Further, the preprocessing unit 136 performs a sampling process (“sampling: 1 — # 1” to “sampling: 1 — #n”) for each band for which the decoding process has been completed.

  Then, the preprocessing unit 136 performs statistical processing (“statistic: 1”) on the print target image data 1 based on the histogram obtained by the sampling processing.

  Next, the preprocessing unit 136 instructs the image processing control unit 200A to perform face recognition processing for the print target image data 1 (“face recognition: 1”).

  Receiving the face recognition processing instruction, the image processing control unit 200A has the face recognition processing unit 220C (FR) of the image correction unit 200C because the instruction target is the print target image data 1, that is, the first print target image. In response to this, a face recognition processing instruction (“face recognition: 1”) for the print target image data 1 is performed.

  Upon receiving the face recognition processing instruction, the face recognition processing unit 220 </ b> C executes the face recognition processing for the print target image data 1. When the face recognition process ends, the end response (“face recognition: 1 end”) is notified to the image processing control unit 200A.

  Upon receiving the face recognition processing end response for the print target image data 1, the image processing control unit 200 </ b> A similarly sends a face recognition processing end response (“face” to the print target image data 1 to the preprocessing unit 136. Recognition: 1 end ").

  On the other hand, the preprocessing unit 136 that has instructed the face recognition processing for the print target image data 1 again performs the image decoding unit 200B from the band 1 to the band n of the print target image data 1 via the image processing control unit 200A. On the other hand, by instructing the decoding process in order, the decoding process is repeatedly performed, and the red-eye analysis process (“red-eye analysis: 1_ # 1” to "Red-eye analysis 1_ # n") is executed.

  Note that the end response of the face recognition process (“face recognition: 1 end”) notified from the image processing control unit 200A to the preprocessing unit 136 is between red eye analysis processes in the preprocessing unit 136 or red eye analysis. Notified after processing is completed.

  The pre-processing unit 136 receives a notification of the end response of the face recognition process for the print target image data 1 and completes the red eye analysis process from the band 1 to the band n of the print target image data 1. The section 134 is notified of a preprocessing end response (“preprocessing: 1 end”) for the print target image data 1.

(First processing)
The image processing manager 132 that has received the preprocessing end response for the print target image data 1 next instructs the main processing unit 134 to start the main process for the print target image data 1.

  In the following description, first, pre-processing (second printing target image data 2) for the second printing target image data (abbreviated as “printing target image data 2”) executed in parallel with the main processing for the printing target image data 1 is described. Ignoring the instructions and responses related to “Pre-processing: 2” (indicated by broken arrows in FIGS. 9 and 10), first, the instructions and responses relating to the main processing for the print target image data 1 ( 9 and FIG. 10, only the solid line arrows) will be described, and then the preprocessing of the print target image data 2 will be described.

  Further, it is assumed that up to two instructions from the image processing manager 132 to the main processing unit 134 and from the main processing unit 134 to the image processing control unit 200A can be performed simultaneously.

  First, the main process of the print target image data 1 will be described.

  The image processing manager 132 instructs the main processing unit 134 to perform main processing (“main processing: 1_ # 1”) for band 1 of the image data 1 to be printed, and then continues to main processing for band 2. ("Main process: 1_ # 2") is performed.

  The main processing unit 134 that has received the instruction for the main processing for the band 1 and the band 2 of the print target image data 1 similarly applies the image processing for the band 1 of the print target image data 1 to the image processing control unit 200A. (“Image processing: 1_ # 1”) is instructed, and subsequently, image processing for band 2 (“Image processing: 1_ # 2”) is instructed.

  First, the image processing control unit 200A instructs the image decoding unit 200B to perform decoding processing (“decode: 1_ # 1”) for band 1 of the image data 1 to be printed.

  The image decoding unit 200B executes the decoding process on the band 1 of the print target image data 1 that has received the instruction, and when the process ends, the image decoding unit 200B sends an end response (“decode: 1_ # 1” to the image processing control unit 200A. End ”).

  Then, the image processing control unit 200A that has received the completion response of the decoding process for the band 1 of the print target image data 1 performs the image correction processing unit 210C ( A correction process (“APF: 1_ # 1”) is instructed to the APF), and the decoding process for the band 2 of the print target image data 1 that has been in the waiting state is performed to the image decoding unit 200B (“ Decode: 1_ # 2 ").

  The image decoding unit 200B executes the decoding process for the band 2 of the print target image data 1 that has received the instruction, and when the process ends, the image decoding unit 200B sends an end response (“decode: 1_ # 2” to the image processing control unit 200A. End ”).

  Further, in the image correction processing unit 210C that has received the instruction for the correction process for the band 1 of the print target image data 1 first, the image decoding unit 200B performs the decoding process for the band 2 of the print target image data 1 in parallel. The correction process is executed, and when the process ends, the end response (“APF: 1_ # 1 end”) is notified to the image processing control unit 200A.

  Then, the image processing control unit 200A that has received the response to end the correction process for the band 1 of the print target image data 1 ends the decoding process and the band 2 of the print target image data 1 that has been waiting for the correction process. The correction process (“APF: 1_ # 2”) is instructed.

  Further, the image processing control unit 200A that has received the correction processing end response for the band 1 of the print target image data 1 instructs the main processing unit 134 about the band 1 of the print target image data 1 that has been instructed. An image processing end response (“image processing: 1_ # 1 end”) is notified.

  The main processing unit 134 that has received the image processing end response for the band 1 of the print target image data 1 sends the book for the band 1 of the print target image data 1 that has been instructed to the image processing manager 132. A process end response (“main process: 1_ # 1 end”) is notified.

  Next, the image processing manager 132 that has received the end response of the main process for the band 1 of the print target image data 1 sends the main process for the next band 3 of the print target image data 1 to the main processing unit 134 ( “Main processing: 1_ # 3”) is instructed.

  The main processing unit 134 that has received the instruction for the main processing for the band 3 of the print target image data 1 similarly instructs the image processing control unit 200A to perform the image processing (“image Processing: 1_ # 3 ") is instructed.

  Then, the image processing control unit 200A first instructs the image decoding unit 200B to perform decoding processing (“decode: 1_ # 3”) for the band 3 of the image data 1 to be printed.

  Further, the image processing control unit 200A first notifies the image processing end response (“Image processing: 1_ # 1 end”) for the band 1 of the print target image data 1, and then the print target image data 1 Before receiving an instruction for image processing for band 3 (“image processing: 1_ # 3”), an end response (“APF: 1_ # 2 end”) for correction processing for band 2 of image data 1 to be printed is received. Therefore, after instructing the decoding process (“decode: 1_ # 3”) for the band 3 of the print target image data 1, the processing unit 134 is informed about the band 2 of the print target image data 1. An image processing end response (“image processing: 1_ # 2 end”) is notified.

  Then, the main processing unit 134 that has received the image processing completion response for the band 2 of the print target image data 1 sends the book for the band 2 of the print target image data 1 that has been instructed to the image processing manager 132. A processing end response (“main processing: 1_ # 2 end”) is notified.

  Next, the image processing manager 132 that has received a response to the completion of the main process for the band 2 of the print target image data 1 sends the main process for the next band 4 of the print target image data 1 to the main processing unit 134 ( “Main process: 1_ # 4”) is instructed.

  Hereinafter, in the same manner, the image processing manager 132 sequentially performs the main processing (“main processing: main processing: from the first band of the print target image data 1) to the n th band that is the end of the image. 1_ # 1 ”to“ main processing: 1_ # n ”), the main processing unit 134 that has received the main processing instruction performs image processing (“ image processing: 1_ # ”) on the image processing control unit 200A. 1 ”to“ image processing: 1_ # n ”), and the image processing control unit 200A receiving the image processing instruction performs decoding processing (“ decoding: 1_ # 1 ”to“ Decode: 1_ # n ”) and an instruction for correction processing (“ APF: 1_ # 1 ”to“ APF: 1_ # n ”) to the image correction processing unit 210C of the image correction unit 200C. Thus, the image decoding unit 20 B executes the decoding process in order, the image correction processing unit 210C executes the correction process in order, the process issues an instruction is executed.

(2nd sheet pre-processing)
By the way, the second print target image data (hereinafter abbreviated as “print target image data 2”) which has been determined in advance after the start of the main process for the print target image data 1 as described above. When the period up to the start timing of the preprocessing elapses, the image processing manager 132 performs preprocessing of the print target image data 2 (denoted as “preprocessing: 2” in the drawing) with respect to the processing unit 134. Give instructions. Note that FIG. 9 shows that the image processing manager 132 prints to the processing unit 134 immediately after the decoding processing end response (“decoding: 1_ # 2 end”) for the band 2 of the image data 1 to be printed. The case where the instruction | indication of the pre-processing of the object image data 2 is performed is shown.

  Receiving the preprocessing instruction, the main processing unit 134 instructs the preprocessing unit 136 to disclose the preprocessing for the print target image data 2 that has received the instruction (“preprocessing: 2”). The preprocessing for the print target image data 2 is executed in parallel with the main processing for the print target image data 1.

  The preprocessing unit 136 that has received an instruction to start the preprocessing of the print target image data 2 performs the sequence from band 1 to band n of the print target image data 2 in the same manner as the preprocessing of the print target image data 1 (FIG. 8). In addition, by instructing the image decoding unit 200B via the image processing control unit 200A to perform decoding processing (“decode: 2_ # 1” to “decode 2: 1_ # n”), the image decoding unit 200B The decoding process is executed in order. In addition, the preprocessing unit 136 performs a sampling process (“sampling: 2 — # 1” to “sampling: 2 — #n”) for each band for which the decoding process has been completed.

  However, the instruction for the decoding process from the pre-processing unit 136 to the image decoding unit 200B is a decoding process for the main process for the print target image data 1 performed from the image processing control unit 200A to the image decoding unit 200B ( This is performed between the instruction of “Decode: 1 — # 1” to “Decode: 1 — #n”) and the decoding process being executed in the image decoding unit 200B.

  For example, in FIG. 9, the print control unit 200A receives the end response (decode: 1_ # 2 end) of the decoding process for the band 2 of the print target image data 1 and performs the decoding process for the band 3 of the print target image data 1 In the period until the instruction (“decode: 1_ # 3”) is performed, the decoding process for the band 1 of the print target image data 2 (“decode: 2_ # 1” instruction and the band 2 of the print target image data 2) This shows a case where an instruction of decoding processing (“decode: 2_ # 2”) is being performed.

  Further, FIG. 9 illustrates an image before the image processing control unit 200A instructs the decoding process (“decode: 1 _ # (n−1)”) for the band (n−1) of the print target image data 1. The decoding unit 200B notifies the image processing control unit 200A of a decoding processing end response (“decoding: 2_ # n end”) for the band n of the print target image data 2, and the preprocessing unit 136 performs the printing target. The case where the sampling process (“Sampling: 2_ # n”) for the band n of the image data 2 is performed is shown.

  When the preprocessing unit 136 finishes the sampling process for the band n of the print target image data 2, the preprocessing unit 136 then performs a statistical process (“statistics:” on the print target image data 2 based on the histogram obtained by the sampling process. 2 ”), and then face recognition processing (“ face recognition: 2 ”) for the print target image data 2 is executed. Note that these processes are executed independently of the main process executed for the print target image data 1.

  Next, when the pre-processing unit 136 finishes the face recognition processing for the print target image data 2, the pre-processing unit 136 again performs the band 1 to band n of the print target image data 2 in the same manner as the pre-processing for the print target image data 1. In addition, the decoding process is instructed in order to the image decoding unit 200B via the image processing control unit 200A, so that the decoding process is repeatedly performed. Similarly to the sampling process, for each band for which the decoding process has been completed, Red-eye analysis processing (“red-eye analysis: 2_ # 1” to “red-eye analysis 2_ # n”) is executed.

  When the pre-processing unit 136 finishes the red-eye analysis process for the print target image data 2, the pre-processing end response for the print target image data 2 ("pre-processing: 2 end") is sent to the processing unit 134. ).

(The second main processing)
The image processing manager 132 that has received the end response of the preprocessing for the print target image data 2 next sends the processing unit 134 the print target image data 2 as in the case of the print target image data 1. Instructs the start of this process.

A4. Effects of the embodiment:
As described above, when the printing process of the two print target image data is instructed, the pre-process and the main process are sequentially executed as the image process of the first print target image data. In parallel with the execution of the main process of the first print target image data, the pre-process is executed out of the image processes of the second print target image data, and the first print target image data is recorded. After the process and the pre-processing of the second print target image data, the main process of the second print target image data is executed.

  As a result, when the physical printing process for a plurality of print target image data is instructed, the time required for the pre-process among the image processes for the second and subsequent print target image data can be shortened. It is possible to shorten the time from the end of printing of the photo image represented by the image data to be printed to the start of printing of the next one photo image.

B. Variations:
As mentioned above, although embodiment of this invention was described, this invention is not limited to such embodiment at all, In the range which does not deviate from the summary, it is possible to implement in various aspects. .

It is explanatory drawing which shows the structural example of the printing control apparatus as one Example of this invention. 6 is an explanatory diagram showing an image processing management operation executed by the image processing manager 132. FIG. FIG. 11 is an explanatory diagram showing the main processing operation executed by the main processing unit 134. FIG. 11 is an explanatory diagram showing a preprocessing operation executed by a preprocessing unit 136. FIG. 11 is an explanatory diagram showing a preprocessing operation executed by a preprocessing unit 136. It is explanatory drawing shown about the image process control operation performed by 200 A of image process control parts. It is explanatory drawing shown about the image decoding process operation performed in the image decoding part 200B. It is explanatory drawing shown about the specific example of image processing operation | movement. It is explanatory drawing shown about the specific example of image processing operation | movement. It is explanatory drawing shown about the specific example of image processing operation | movement.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Print control apparatus 20 ... Printing mechanism part 30 ... Input device 40 ... Display apparatus 50 ... Memory | storage device 100 ... Main processor (image printing process part)
DESCRIPTION OF SYMBOLS 120 ... File access control unit 130 ... Image processing unit 132 ... Image processing manager 134 ... Main processing unit 136 ... Pre-processing unit 140 ... Print image generation unit 150 ... Print processing 200A ... first sub processor (image processing control unit)
200B ... Second sub-processor (image decoding unit)
200C ... Third sub-processor (image correction unit)
200D ... Fourth sub-processor (print image generation execution unit)
210C ... Image correction processing unit 220C ... Face recognition processing unit

Claims (3)

A print control apparatus that executes image processing for printing an image represented by print target image data,
It is composed of a multiprocessor system having a plurality of processors,
The image processing
In order to determine a correction parameter used to correct the image quality of the image represented by the print target image data, at least a development process for developing the print target image data compressed in a predetermined format is executed, and Preprocessing for executing face recognition processing for recognizing a face in the image based on original image data obtained by the expansion processing;
A main process for executing a developing process for developing the print target image data, and executing a correction process for correcting the original image data obtained by the developing process based on the correction parameter determined by the preprocessing; Including
A first processor that operates as an image processing unit including a preprocessing unit related to the preprocessing, a main processing unit related to the main processing, and an image processing management unit that manages operations of the preprocessing unit and the main processing unit. When,
In accordance with an instruction from the image processing unit, a second processor that operates as an image expansion unit that executes the expansion process in the pre-processing or the expansion process in the main process;
A third processor that operates as an image correction processing unit that executes the correction processing or a face recognition processing unit that executes the face recognition processing in accordance with an instruction from the image processing unit;
With
When printing images represented by a plurality of different print target image data in order,
The image processing management unit
For the first print target image data, the preprocessing by the preprocessing unit is executed, and the main processing by the main processing unit is executed after the preprocessing is completed.
The n-th print target image data (n is an integer of 2 or more) is printed by the pre-processing unit during the execution of the main process by the main processing unit of the (n−1) -th print target image data. Causing the preprocessing to be executed, and the main processing by the main processing unit to be executed after the preprocessing is completed,
The pre-processing unit is
In the pre-processing for the first print target image data, the development processing is executed by the development processing unit, and the face recognition processing is executed by the face recognition processing unit.
In the pre-processing for the n-th print image data, the development processing is executed by the development processing unit, and the face recognition processing is executed by the pre-processing unit itself.
A printing control apparatus characterized by that. The print control apparatus according to claim 1,
The face recognition process executed based on the original image data of the pre-process executes a sampling process for sampling the original image data at a predetermined ratio, and executes based on a result obtained by the sampling process And
The pre-processing unit is
In the pre-processing for the first print target image data, the expansion processing is performed by the expansion processing unit, the sampling processing is performed by itself, and the face recognition processing is performed by the face recognition processing unit. Let it run
In the pre-processing for the n-th print image data, the development processing is executed by the development processing unit, and the sampling processing and the face recognition processing are executed by the pre-processing unit itself.
A printing control apparatus characterized by that. The print control apparatus according to claim 1 or 2,
The pre-process is a process of executing the development process after the face recognition process is completed, and executing a red-eye analysis process for analyzing a person's red eyes based on the original image data obtained by the development process. Contains
The pre-processing unit is
In the pre-processing for the first print target image data, after instructing the face recognition processing unit to the face recognition processing unit, the expansion processing unit executes the expansion processing, and the red-eye analysis processing is performed. Executed by the pre-processing unit itself,
In the pre-processing for the n-th print image data, after the face recognition processing is finished, the development processing is executed by the development processing unit, and the red-eye analysis processing is executed by the pre-processing unit itself. ,
A printing control apparatus characterized by that.

Images