JP2006181844A - Device and method for image processing and printing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a printing system capable of performing printing in a state that the consistency on arrangement between a photographed image and a frame image is attained. <P>SOLUTION: The image processing device, which receives and processes images for printing, obtains a main image and a sub-image relative to the main image and applies the main image with a fitting process so as to adapt the main image to a printing medium. The sub-image is applied with a change process so as to adapt the sub-image to the main image applied with a fitting process. Then, the main image applied with the fitting process and the sub-image applied with the change process are synthesized. Furthermore, the type of the sub-image is decided and the change process is applied corresponding to the type of the sub-image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus and method for combining image data supplied from an image supply device and composite data for printing, and a printing system having the image processing apparatus and the image supply device. .

  A photograph stored in a DSC or DSCP storage medium (memory card) by directly connecting a printer and a digital still camera (hereinafter referred to as DSC) or a mobile phone with camera (hereinafter referred to as DSCP) via an interface such as USB. A so-called direct print system in which an image is transmitted to a printer for printing is becoming common. Furthermore, a so-called direct composite printing system is becoming popular in which a composite image such as a frame is transmitted to a printer in addition to a photographic image, and the result of the composite on the printer side is printed.

  In such a print system, a JPEG file of an image to be printed and a PNG file (Portable Network Graphics File) of a composite image are generally transmitted from a DSC to a printer, and the JPEG file and the PNG file on the printer side. , Decompression, color conversion, resizing, rotation, and the like to convert to a printable data format, and print the result of combining JPEG and PNG.

  On the other hand, proposals, products and applications for printing by combining an image and a frame have been developed.

  For example, Patent Document 1 proposes a composite image method and program capable of creating a composite image in which an image having an arbitrary size or aspect ratio and a template such as a photo frame are combined in a balanced manner.

  Patent Document 2 proposes a multi-product printer apparatus having means for synthesizing a digital image and an enlarged or reduced template.

  As a frame composition application, a piece of frame data is pasted on a tile with respect to an outer frame of a photographic image (frame composition application 1), and a photographic image and frame data are enlarged and fitted to a paper size (frame composition application 2). ), Which has frame data of the same size as the paper size for each paper size and pastes the same size without enlargement (magnification change) processing (frame composition application 3) has been developed and commercialized.

The digital camera direct print system is becoming increasingly popular with PictBridge, which defines the communication procedure in the digital camera direct print system described above. Furthermore, a frame is added to a photographic image taken with DSCP, and the combined data is printed. Products that can be made are also becoming popular.
JP 2003-348334 A JP 2000-134455 A

  However, in such DSCP, since the CPU power is insufficient and the memory capacity is small, the image synthesized on the DSCP side has a poor resolution. If the result synthesized on the DSCP side is sent to a high-resolution printer and printed, The result is that the printing result is poor.

  In a system in which raw data of both a photographic image and a frame image are transmitted from the DSCP to the printer and combined and printed on the printer side, the deterioration of the print quality is eliminated, but the photographic image and the frame image When the aspect ratios are different, there is a problem that frames are combined in a photographic image.

  In particular, the processing described in Patent Documents 1 and 2 described above is to electronically scale the template according to the size of the photographic image, and the photographic image and the template are not fitted, and there is a gap between the two data. It is known that there are problems such as occurrence.

  Furthermore, it has been found that the frame composition application 1 has a problem that a frame with high designability cannot be generated because one pattern is arranged on a tile.

  Further, it has been found that the frame composition application 2 has a problem that a frame cannot be fitted to a photographic image and output.

  It has been found that the frame composition application 3 has a problem that a large amount of ROM capacity is required because it is necessary to have frame data for each paper size.

  The present invention has been made in view of the above-described problems, and when a plurality of images are combined and printed, even when there are circumstances such as the size of each image being different, the combined image is efficiently and naturally generated. The present invention provides an image processing apparatus and method that enable generation.

  In order to solve the above problems, an image processing apparatus according to the present invention is an image processing apparatus that receives an image and processes it for printing, an image receiving unit that receives a main image and a sub-image for the main image, and First image processing means for performing fitting processing so that the main image is adapted to the print medium, and second image processing for performing modification processing so that the sub image is adapted to the main image subjected to the fitting processing And an image composition means for synthesizing the main image subjected to the fitting process by the first image processing means and the sub-image subjected to the change process by the second image processing means. And

  An image processing method according to the present invention is an image processing method for receiving an image and processing it for printing, an image receiving step for receiving a main image and a sub-image for the main image, and the main image as a print medium. A first image processing step for performing a fitting process so as to conform to the second image processing step, a second image processing step for performing a changing process so that the sub-image conforms to the main image subjected to the fitting processing, and the first And an image synthesis step of synthesizing the main image subjected to the fitting process in the image processing step and the sub image subjected to the change process in the second image processing step.

  Furthermore, the printing system according to the present invention includes an image supply device and a printing apparatus, and prints an image with the printing apparatus based on image data supplied from the image supply device. A unit that acquires model information and function information of the printing apparatus according to a communication connection between the device and the printing apparatus, a unit that constructs and displays a UI based on the function information, and a composite image Means for constructing a UI to be displayed and displaying a composite image; and a transmission means for transmitting a plurality of image data selected by the UI to the printing apparatus in response to a data request from the printing apparatus. The apparatus synthesizes and prints the plurality of image data transmitted by the transmission unit in response to the data request.

  According to the image processing apparatus and method of the present invention, when a plurality of images are combined and printed, a combined image can be generated efficiently and naturally even when there are circumstances such as the size of each image being different. become.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present embodiment, the case where PictBridge that realizes direct printing between a mobile phone with a camera and a printer is used will be described. However, the present invention is not limited to this.

  FIG. 1 is a schematic perspective view of a photo direct printer apparatus (hereinafter referred to as PD printer) 1000 according to an embodiment of the present invention. The PD printer 1000 has a function as a normal PC printer that receives and prints data from a host computer (PC) and directly reads and prints image data stored in a storage medium such as a memory card, or It has a function to receive and print image data from a camera-equipped mobile phone.

  In FIG. 1, the main body that forms the outer shell of the PD printer 1000 according to the present embodiment includes an outer member of a lower case 1001, an upper case 1002, an access cover 1003, and a discharge tray 1004.

  The lower case 1001 forms a substantially lower half portion of the PD printer 1000, and the upper case 1002 forms a substantially upper half portion of the main body. A storage space for storing each mechanism to be described later by combining both cases. A hollow body structure is formed, and an opening is formed in each of the upper surface portion and the front surface portion.

  Further, one end of the discharge tray 1004 is rotatably held by the lower case 1001, and an opening formed on the front surface of the lower case 1001 can be opened and closed by the rotation. For this reason, when executing the recording operation, the discharge tray 1004 is rotated to the front side to open the opening, thereby including sheets (plain paper, special paper, resin sheet, etc.) recorded from here. (Hereinafter simply referred to as “sheets”) can be discharged, and the discharged sheets can be stacked one after another.

  In addition, the discharge tray 1004 stores two auxiliary trays 1004a and 1004b. By pulling out each tray as necessary, the sheet support area can be expanded and reduced in three stages. It has become.

  One end of the access cover 1003 is rotatably held by the upper case 1002 so that an opening formed on the upper surface can be opened and closed. By opening the access cover 1003, the access cover 1003 is accommodated inside the main body. It is possible to replace the print head cartridge (not shown) or the ink tank (not shown).

  Although not particularly shown here, when the access cover 1003 is opened and closed, a protrusion formed on the back surface rotates the cover opening and closing lever, and the rotation position of the lever is detected by a micro switch or the like. Thus, the open / closed state of the access cover 1003 can be detected.

  A power key 1005 is provided on the upper surface of the upper case 1002. On the right side of the upper case 1002, an operation panel 1010 including a liquid crystal display unit 1006 and various key switches is provided. The structure of the operation panel 1010 will be described in detail later with reference to FIG. Reference numeral 1007 denotes an automatic feeding unit that automatically feeds sheets into the apparatus main body. Reference numeral 1008 denotes a paper interval selection lever which is used to adjust the interval between the print head and the sheet. Reference numeral 1009 denotes a card slot, into which an adapter capable of mounting a memory card is inserted, through which image data stored in the memory card can be directly captured and printed. Examples of the memory card (PC) include a compact flash (registered trademark) memory, smart media, and a memory stick.

  A viewer (liquid crystal display unit) 1011 is detachable from the main body of the PD printer 1000. When searching for an image to be printed from images stored in the PC card, an image or index for each frame is displayed. Used to display images. Reference numeral 1012 denotes a USB terminal for connecting a camera-equipped mobile phone to be described later. In addition, a USB connector for connecting a personal computer (PC) is provided on the rear surface of the PD device 1000.

  FIG. 2 is an overview of the operation panel 1010 of the PD printer 1000 according to the present embodiment.

  In FIG. 2, the liquid crystal display unit 1006 displays menu items for setting various data relating to items printed on the left and right sides thereof. The items displayed here include, for example, the top number of a photo image to be printed, a designated frame number (start frame designation / print frame designation), and the last photo number to be printed (end) among a plurality of photo image files. ), The number of copies (number of copies), the type of sheet used for printing (paper type), the number of photos to be printed on one sheet (layout), the specification of print quality (quality), and the date of shooting For example (date printing), whether to correct a photo for printing (image correction), and the number of sheets required for printing (number of sheets). These items are selected or designated using the cursor keys 2001.

  2002 is a mode key, and each time this key is pressed, the type of printing (index printing, full-frame printing, single-frame printing, designated-frame printing, etc.) can be switched, and the LED corresponding to the LED 2003 changes accordingly. Illuminated. A maintenance key 2004 is a key for performing maintenance of the printer such as cleaning of the print head. Reference numeral 2005 denotes a print start key which is pressed when instructing the start of printing or when establishing maintenance settings. Reference numeral 2006 denotes a print cancel key which is pressed when printing is stopped or when maintenance is instructed.

  Next, with reference to FIG. 3, the configuration of the main part relating to the control of the PD printer 1000 according to the present embodiment will be described. In FIG. 3, parts common to the above-mentioned drawings are given the same symbols, and explanations thereof are omitted.

  FIG. 3 is a block diagram showing a configuration of a main part related to the control of the PD printer according to the present embodiment.

  In FIG. 3, reference numeral 3000 denotes a control unit (control board). Reference numeral 3001 denotes an ASIC (dedicated custom LSI). Reference numeral 3002 denotes a DSP (digital signal processor) having an internal CPU, and various control processes to be described later and images such as conversion from a luminance signal (RGB) to a density signal (CMYK), scaling, gamma conversion, and error diffusion. I am in charge of processing.

  A memory 3003 has a program memory 3003a that stores a control program for the CPU of the DSP 3002, a RAM area that stores a program at the time of execution, and a memory area that functions as a work memory that stores image data and the like. Reference numeral 3004 denotes a printer engine. Here, a printer engine of an ink jet printer that prints a color image using a plurality of color inks is installed.

  Reference numeral 3005 denotes a USB connector as a port for connecting a digital camera (DSC) 3012. Reference numeral 3006 denotes a connector for connecting the viewer 1011. Reference numeral 3008 denotes a USB hub (USBHUB). When the PD printer 1000 performs printing based on image data from the PC 3010, the data from the PC 3010 is directly passed through and output to the printer engine 3004 via the USB 3021. As a result, the connected PC 3010 can directly perform printing by exchanging data and signals with the printer engine 3004 (functions as a general PC printer).

  Reference numeral 3009 denotes a power connector which inputs a DC voltage converted from commercial AC by a power source 3019. A PC 3010 is a general personal computer, 3011 is a memory card (PC card) described above, and 3012 is a mobile phone with camera (hereinafter, DSCP).

  Note that the exchange of signals between the control unit 3000 and the printer engine 3004 is performed via the USB 3021 or the IEEE 1284 bus 3022 described above.

<Overview of camera-equipped mobile phone (DSCP)>
FIG. 4 is a block diagram showing a configuration of DSCP 3012 according to the present embodiment.

  In the figure, reference numeral 3100 denotes a CPU that controls the entire DSCP 3012, and reference numeral 3101 denotes a ROM that stores a processing procedure performed by the CPU 3100. Reference numeral 3102 denotes a RAM used as a work area of the CPU 3100. Reference numeral 3103 denotes a switch group for performing various operations, which includes a shutter, a mode change switch, a selection switch, a cursor key, and the like. Reference numeral 2700 denotes a liquid crystal display unit, which is used to display a video currently captured, an image captured and stored in a memory card, and a menu for performing various settings.

  A wireless unit 3120 includes a transmission / reception circuit for performing transmission / reception processing via the 3121 antenna. 3130BATT is a built-in power supply. Reference numeral 3105 denotes an optical unit mainly composed of a lens and its drive system. Reference numeral 3106 denotes a CCD element, and reference numeral 3107 denotes a driver that drives and controls the optical unit 3105 under the control of the CPU 3100. Reference numeral 3108 denotes a connector for connecting a storage medium 3109 (such as an SD card), and reference numeral 3110 denotes a USB interface (USB slave side) for connecting to a PC or the PD printer 1000 in the embodiment.

<Overview of direct printing>
FIG. 5 is a diagram for explaining a rough signal flow when printing is performed by issuing a print request from the DSCP 3012 to the PD printer 1000 in the printing system employing the PictBridge described above.

  This processing procedure is executed after the PD printer 1000 and the DSCP 3012 are connected via the USB cable, or after confirming that they are compliant with the DPS specification by performing wireless communication. First, the DSCP 3012 transmits “ConfigurePrintService” to the PD printer 1000 to check the state of the PD printer 1000 (600).

  In response to this, the PD printer 1000 is notified of the current state of the PD printer 1000 (here, “idle” state) (601). Here, since it is in the “idle” state, the DSCP 3012 inquires about the Capability of the PD printer 1000 (602) and issues a print start request (StartJob) corresponding to the Capability (603). This print start request is issued in 601 from the DSCP 3012 to the PD printer 1000 on condition that “newJobOK” in status information from the PD printer 1000 described later is “True”. The

  In response to this print start request, the PD printer 1000 requests file information from the DSCP 3012 based on the file ID of the image data instructed to be printed (GetFileInfo) (604). In response to this, the file information (FileInfo) is transmitted from the DSCP 3012. This file information includes information such as file capacity.

  When the PD printer 1000 determines that the file information can be received and processed, it requests the DSCP 3012 for the file information (GetFile) (605). As a result, the image data (ImageFile) of the requested file is sent from the DSCP 3012 to the PD printer 1000. As a result, when the PD printer 1000 starts print processing, status information indicating “Printing” is sent from the PD printer 1000 to the DSCP 3012 by “NotifyDeviceStatus” in 606.

  When the printing process for one page is completed, this is notified by the “NotifyJobStatus” 607 from the PD printer 1000 when the processing for the next page is started. If the printing of only one page is completed, when the printing of the requested one page is completed, the “NotifyDviceStatus” 608 notifies that the PD printer 1000 is in the “idle” state (NotifyDeviceStatus (Idle) ).

  For example, in the case of N-up printing in which a plurality of (N) images are laid out and printed on one page, “NotifyJobStatus” 607 is sent from the PD printer 1000 to the DSCP 3012 every time N images are printed. Will be. The issuance timing of “NotifyJobStatus” and “NotifyDeviceStatus” and the order of image data acquisition in this embodiment are examples, and various cases may occur depending on the product implementation.

  FIG. 6 shows processing when frame composition printing is performed by performing communication between the digital camera (DSC) 3012 and the PD printer 1000 according to the embodiment of the present invention, supplying image data from the DSCP 3012 to the PD printer 1000, and the like. FIG. In the figure, steps S1 to S13 indicate processing in the DSCP 3012, and steps S21 to S37 indicate processing in the PD printer 1000.

  In step S1 and step S21, it is confirmed that the DSCP 3012 and the PD printer 1000 mutually comply with the DPS specification and support frame synthesis. In this state, the DSCP 3012 inquires of the PD printer 1000 about the printer state and device information. In response to this, the PD printer 1000 notifies the PD printer 1000 status and device information at that time.

  In this device information, for example, the version of the connection protocol, the printer vendor name, the model name, etc. are notified. Thus, in step S 2, the DSCP 3012 stores information (information 1) necessary in the printer status and device information in the RAM 3102. This “information 1” includes information required later when the image file is converted by the DSCP 3012.

  Next, the DSCP 3012 requests the Capability of the PD printer 1000 as indicated by 602 in FIG. Accordingly, the PD printer 1000 creates capability information (Capability) related to the printing function of the PD printer 1000 and transmits it to the DSC 3012 in step S22. The DSCP 3012 receives this capability (step S3).

  In step S4, a UI is constructed based on this Capability and displayed on the display unit 2700. Here, for example, the paper sizes are A4 size and B5 size, the PD printer 1000 is loaded with plain paper and photographic paper, and 1-up, 2-up, 4-up layout printing is “no border”. Alternatively, when “with border” is possible and date printing is possible, a UI screen is displayed on the display unit 2700 so that these items can be arbitrarily selected and other items cannot be selected.

  In step S5, the user of the DSCP 3012 refers to the constructed UI screen, selects images to be printed, and sets the print format of these images. The setting of the print format of the image is based on the Capability of the PD printer 1000 received in step S3, such as the number of prints, the paper size, the layout, the presence / absence of date printing, and the like.

  When the user issues an instruction to start printing using this UI, the process advances to step S6 to create a print job file for instructing the printing. In step S7, the created print job file is stored in the PD printer 1000. Send to. This print job file is received by the PD printer 1000 in step S23.

  In step S24, the PD printer 1000 analyzes the received print job file and prepares for printing. Then, an “image file information acquisition request” (image file name) to be printed described in the print job file is issued to the DSCP 3012.

  The “image file information acquisition request” corresponds to “GetObjectInfo” defined in the PTP in a service that operates on a PTP (Pictutre Transfer Protocol) on USB such as PictBridge.

  However, the role of “image file information acquisition request” in this embodiment is to transmit the creation timing of an image file from the PD printer 1000 to the DSCP 3012. In the present embodiment, “image file information acquisition request” is used as one means for transmitting the creation timing. However, such means is not limited to this, and other dedicated commands or existing Communication commands may be used. This embodiment is characterized in that the timing of “image file creation for printing” is notified from the PD printer 1000 to the DSCP 3012.

  In step S8, when this “image file information acquisition request” is received by the DSCP 3012, the process proceeds to step S9 to create an image file for printing to be transmitted to the PD printer 1000, which is a feature of the present embodiment. Execute the process. Information about the created image file for printing (ObjectInfo Dataset: including image file name, data size, directory, date, etc.) is transmitted to the PD printer 1000 in step S9.

  Next, in step S25, when the PD printer 1000 receives the information of the image file for printing, the job file is analyzed in step S26 to determine whether normal printing or composite printing, and the state is stored in the internal flag. Subsequently, in step S27, a print start process such as memory reservation is performed, and an image file reception waiting state is entered from the DSCP 3012.

  In DSCP 3102, the JPEG image file (positioned as the main image) requested from the PD printer 1000 is transmitted in step S 10. The DSCP 3102 performs JPEG image reception processing in step S28, and in step S29, determines the enlargement and rotation direction with reference to the header information of the JPEG image, and decodes and enlarges (magnification change) the received JPEG image in step S30. ) Processing is performed.

  The enlargement (magnification change) process and the rotation process are obtained by calculation according to the relationship and direction between the size of the JPEG image and the paper size. When the JPEG image printing process is completed, the previously stored internal flag is determined, and in the case of frame composition printing, the process of receiving a PNG image file for composition into JPEG from step S31 to step S34 below. And a synthesis process is performed.

  When the transmission of the JPEG image file is completed, the DSCP 3012 performs a transmission process of a PNG image file (positioned as a sub image) serving as frame data in step S10. Since it is assumed that a plurality of PNG image files are transmitted and overlapped, it is determined whether all PNG images set in the UI in step S11 have been transmitted, and the PNG image file transmission process is repeated until completion. It is processed. As the plurality of PNG image files, for example, frame frames, one-point accent data, character string data, and the like can be considered in practical use.

  On the other hand, the PD printer 1000 in the PNG image file reception waiting state receives the PNG image file in step S31. Subsequently, PNG enlargement and rotation directions are determined in step S32, and based on the result, PNG enlargement and rotation processing is performed in step S33.

  Thereafter, a composition process with the JPEG image is performed (step S34). The PNG image file has a specification that allows an α value representing the transmittance to be stored for each pixel, but the synthesis process is generally performed by reflecting the transmittance by calculating the α value for the pixel value. Can be considered. Details of the PNG enlargement (magnification change) process in step S33 will be described later (FIGS. 7 to 11).

  As described above, since it is assumed that a plurality of PNG image files are received and combined, the processing from step S31 to step S34 is repeated for the received PNG image files, and the final process is performed. As a result, the synthesized data is generated.

  When the RGB-based composition processing is completed, conversion to CMYK format for output to the printer, quantization processing is performed in step S35, and then transmitted to the printer engine in step S36, so that the loaded paper is Printing processing is performed. With the above processing flow, the frame composition printing process for the 1UP layout is completed. Needless to say, in the case of 2UP, 4UP, etc., the above processing is repeated for NUP.

  When the printing process is completed, the DSCP 3102 transmits print end notification information to the PD printer 1000 in step S36, and the frame composition printing process is completed. On the other hand, in step S12, the PD printer 1000 completes the frame composition printing process by receiving the print end notification information.

  FIG. 7 is an explanatory diagram regarding frame composition printing in the present embodiment. FIG. 7A is a diagram illustrating a print result example of frame synthesis in the conventional bordered print mode.

  In the prior art, in order to perform enlargement (magnification change) processing on the output rectangle while maintaining the aspect ratio of the image and the frame, if each aspect ratio is different, the frame is included in the image as shown in the output result. Will cause a problem of printing.

  FIG. 7B is a diagram illustrating a print result example of frame synthesis in the framed printing mode in frame synthesis printing. Here, first, the image is enlarged in the framed mode with respect to the output rectangle to obtain the image output rectangle. Next, by performing an enlargement (magnification change) process on the obtained image output rectangle in the borderless enlargement mode, as shown in FIG. 7B, the frame does not enter the image, and the image and the frame It shows that a consistent output result is generated and output.

  Here, the bordered enlargement mode is a mode in which enlargement (magnification change) processing is performed until the short side of the output rectangle is reached when an image and a frame are enlarged. Therefore, when the aspect ratio of the image and the frame is different from that of the output rectangle, a blank is generated on the long side as shown in the output result of FIG. 7A.

  The borderless enlargement mode is a mode in which, when enlarging an image and a frame, enlargement (magnification change) processing is performed until it hits the long side of the output rectangle, and the protruding portion is not cut out / output. Accordingly, when the aspect ratio of the image and the frame is different from that of the output rectangle, as shown in the output result of FIG. 7B, the frame is output so as to stick to the image, and if there is an overhanging portion, it is cut out and output. .

  FIG. 7 is an explanatory diagram in the case of 1UP output (outputs one frame composition result per sheet) in this embodiment, but FIG. 8 shows 4UP output (four frames per sheet) in this embodiment. FIG. 11 is an explanatory diagram in the case of output of a synthesis result.

  FIG. 8 shows an output result when the image 1 and the frame are output in the first column of 4UP, and the image 2 and the frame are output in the second column. For the first column, the frame is expanded without margins for the output rectangle of image 1, and for the second column, the frame is expanded without margins for the output rectangle of image 2. As a result, as shown in the output result of FIG. 8, a print result in which the consistency between the image and the frame can be generated for the first column and the second column. Naturally, even if all the 4UP images and all the frames are different, it is needless to say that by implementing the present invention 1, it is possible to generate and output an optimum frame composite print result with consistency. Yes.

  FIG. 9 is an explanatory diagram regarding frame composition printing including composition of one-point images in the present embodiment. 7 and 8, the composition of the image and the frame has been described. On the other hand, FIG. 9 illustrates the case where a function for adding a one-point image and compositing is installed.

  When combining an image, a frame, and a one-point image, it is conceivable to combine the image by placing an image at the bottom, a one-point image thereon, and a frame image at the top. In this case, if the one-point image is subjected to the same enlargement (magnification change) processing as in the case of the frame described above, the one-point image may overlap the captured image or the one-point image may be covered with the frame. Will cause problems. Here, it is for solving the above problems.

  That is, for the one-point image, the print position information and the enlargement factor (magnification) information are acquired from the header of the transmitted PNG image and stored in the memory in the printer. In the frame composition process, when it is determined that the image is a one-point image, the information is referred to, an enlargement (magnification change) process and a position to the captured image are determined, and the composition process is performed. FIG. 9 shows a synthesis result of three types of data when it is described that the one-point image is output at a position of (X, Y) from the output rectangle origin at a magnification of 1.

  Whether the type of the composite image is frame or one point needs to be described in the header portion of the composite image. For example, when the composite image is a PNG file, the type may be described in the text chunk.

  FIG. 10 is an explanatory diagram regarding frame composition printing including character string composition in the present embodiment. In FIG. 9, the composition of an image, a frame, and a one-point image has been described. On the other hand, FIG. It is explanatory drawing. When combining three images of an image, a frame, and a character string, it can be considered that the image is arranged at the bottom, the character string is arranged thereon, and the frame image is arranged at the top.

  Even in the case of a character string image, the print position and enlargement ratio (magnification) information are acquired from the header of the transmitted PNG image and stored in the memory in the printer. Of course, by performing the same processing as in the case of the one-point image, it is possible to eliminate the overlap with the photographed image or the frame. Furthermore, in the case of a character string, when an enlargement (magnification change) process is simply performed, jaggy or blurring occurs as shown by the output result 1 in FIG. Here, in order to solve these problems, when it is determined that the image is a character string image, interpolation enlargement processing having a jaggy and blur elimination function is performed.

  The output result 2 in FIG. 10 shows the result of combining three types of data when it is described that the character string image is output at a position of (A, B) from the output rectangle origin at a magnification of 2 times. . Whether the type of the composite image is a frame, one point, or a character string needs to be described in the header portion of the composite image. For example, when the composite image is a PNG file, the type may be described in the text chunk.

  It is assumed in practical terms that the New Year's card data is created and printed by combining the photographed image, frame, one point, and character string. This is realized by combining the processing of FIG. 9 and the processing of FIG. it can.

  Next, the operation of the image composition process of this embodiment will be described using the flowchart of FIG. Note that the negotiation part and the file reception process in the DPS protocol are not directly related to the present invention, and the description thereof is omitted.

  This program is started when the PD printer 1000 has received a captured image, for example, a JPEG file and a composite image, for example, a PNG file, from the DSCP 3012 and has been stored in the reception memory in the PD printer.

  First, in step S40, width information and height information as an image size are acquired from JPEG image header information stored in the reception memory in the RAM 3102. Then, an image output rectangular size is obtained from the paper size information stored in the ROM 3101 and stored in the RAM 3102. As described above, the image output rectangular size in the bordered mode is obtained by obtaining an enlargement ratio (magnification) so that the short side of the JPEG image sticks to the paper output rectangle.

  Next, in step S 41, the width information, the height information, and the composite image type, which are composite image sizes, are acquired from the PNG image header information stored in the reception memory in the RAM 3102 and stored in the RAM 3102. Further, when the type is a one-point image or a character string image, the attached print position information and enlargement rate (magnification) information are also stored on the RAM 3102.

  Subsequent to the above preprocessing, JPEG data decoding processing, enlargement (magnification change) processing, placement processing, PNG data decoding processing, enlargement (magnification change) processing, and composition placement processing are performed from step S42 to step S51. The process is repeated.

  First, in step S42, JPEG data decoding processing is performed. Although the unit of the decoding process depends on the capacity of the RAM 3102, for example, the PD printer 1000 can consider that the process is performed in units of 16 lines. Therefore, the flowchart is repeated in that unit.

  Next, in step S43, the decoded JPEG data is enlarged (magnification change) in the bordered mode based on the image output rectangular size calculated and stored in step S40, and stored in the print output buffer on the RAM 3102. Process.

  Subsequent to the JPEG data processing, PNG data is decrypted in step S44. Note that the PNG data decoding process is also a flowchart assuming an embodiment in which, for example, 16 lines are performed in the same manner as JPEG data. Further, a flow chart assuming an embodiment in which a plurality of PNG data is received and combined is assumed.

  Next, the composite image type information determination process (PNG image type determination) acquired and stored in step S45 is performed. If it is determined to be a frame image, the process of step S46 is performed. If it is determined to be a one-point image, the process of step S47 is performed. If it is determined to be a character string image, the process is branched to step S48. Here, the PNG image type is determined by using, for example, the image type information added to the PNG image header information, or by analyzing the decoded PNG image and extracting its characteristics, and detecting the outer edge of the PNG image. If all or most (for example, 70% or more) is a transmission region, it is determined that the frame image is used, or the decoded image of PNG is analyzed, for example, most of the outer edge is colored data. If the vicinity of the center is transparent data, it can be determined that it is a frame image.

  If it is a frame image, in step S46, the decoded PNG data is referred to the image output rectangular size calculated and stored in step S40, and the frameless enlargement (magnification change) is performed so as to fit the size. Processing is performed and the result is stored in the RAM 3102 temporary work.

  If the image is a one-point image, in step S47, the decoded PNG data is enlarged (in accordance with the print position by referring to the print position information and enlargement factor (magnification) information calculated and stored in step S54). (Magnification change) processing is performed, and the result is stored in the RAM 3102 temporary work.

  If it is a character string image, in step S48, the decrypted PNG data is enlarged (in accordance with the print position by referring to the print position information and enlargement factor (magnification) information calculated and stored in step S54). (Magnification change) processing is performed, and the result is stored in the RAM 3102 temporary work. The processing is basically the same as that in the case of a one-point image, but in the case of a character string, it is characteristic to perform smoothing enlargement (magnification change) processing.

  The JPEG output result in step S43 and the PNG output result in steps S46 to S48 are combined in step S49. The PNG file has an α value indicating the transmittance for each pixel, and it is practically considered that the combining process is performed using the α value.

  Subsequent to the completion of the above synthesis process, a decoding process, an enlargement (magnification change) process, and a process for determining whether the synthesis process has been completed are performed on all PNG images received in step S50. If the processing has not been completed for all, the processing is repeated from step S44. If completed, the process proceeds to step S51.

  Step S51 is the final step of the program, and a determination process is performed to determine whether all processes have been completed for the JEPG and PNG images. If not completed, the process returns to step S42 to repeat the decoding process for the next 16 lines. If it is determined that the process is complete, control is returned to the calling program of this program.

  Through the operations described above, various composite images are generated so that they can be seen efficiently and more naturally.

  According to the present embodiment, image data and composite data are transmitted in a system in which composite data such as frames and images taken from a camera-equipped cellular phone DSCP or a digital camera is transmitted to the printing apparatus and combined and printed on the printing apparatus side. When the aspect ratios of the images are different from each other, a special effect can be produced in which a consistent image composition result can be generated and printed regardless of the bordered / borderless printing mode. In addition, even when the type and characteristics of the composite image are different, a special effect that enables generation and printing of a consistent image composite result is produced.

1 is a schematic perspective view of a PD printer according to an embodiment of the present invention. 2 is an overview of an operation panel of the PD printer according to the present embodiment. FIG. It is a block diagram which shows the structure of the principal part which concerns on control of PD printer which concerns on this embodiment. It is a block diagram which shows the structure of DSCP concerning this embodiment. FIG. 5 is a diagram for explaining a rough signal flow when printing is performed by issuing a print request from a DSCP to a PD printer in the printing system according to the present embodiment. It is a figure explaining the process in the case of communicating between the mobile phone with a camera (DSCP) and PD printer which concerns on embodiment of this invention, supplying image data from DSCP to PD printer, and printing. It is explanatory drawing regarding the frame synthetic | combination printing in this embodiment. It is explanatory drawing regarding the case of the NUP layout regarding the frame composite printing in this embodiment. It is explanatory drawing regarding the frame synthetic | combination printing including the one point image synthesis in this embodiment. It is explanatory drawing regarding the frame synthetic | combination printing including the character string synthesis | combination in this embodiment. It is a flowchart for demonstrating the synthetic | combination process of the synthetic | combination data of the image data which concerns on embodiment of this invention.

Claims (15)

An image processing apparatus that receives an image and processes it for printing,
Image acquisition means for acquiring a main image and a sub-image for the main image;
First image processing means for performing a fitting process so that the main image is adapted to a print medium;
A second image processing means for performing a changing process so that the sub-image is adapted to the main image subjected to the fitting process;
Image synthesizing means for synthesizing the main image subjected to the fitting process by the first image processing means and the sub-image subjected to the change process by the second image processing means;
An image processing apparatus comprising: Furthermore, a sub image type determining means for determining the type of the sub image is provided,
The image processing apparatus according to claim 1, wherein the second image processing unit performs the change processing based on a determination result of the sub image type determination processing unit.   3. The second image processing unit performs a fitting process so that the sub image matches the main image when the determination result indicates that the sub image is a frame image. An image processing apparatus according to 1.   When the determination result indicates that the sub-image is a one-point image, the second image processing unit is designated at a designated position in the main image without performing the fitting process of the sub-image. The image processing apparatus according to claim 2, wherein the processing is performed so that the images are arranged at a magnification.   When the determination result indicates that the sub-image is a character string image, the second image processing means performs a smoothing process on the sub-image so as to be arranged at a specified position in the main image. The image processing apparatus according to claim 2.   The image according to any one of claims 2 to 5, wherein the sub image type determination unit determines the type of the sub image based on image type information added to a header of the sub image. Processing equipment.   The image processing apparatus according to claim 2, wherein the sub image type determination unit analyzes a feature of the sub image and determines a type of the sub image based on the feature. . An image processing method for receiving an image and processing it for printing,
An image acquisition step of acquiring a main image and a sub-image for the main image;
A first image processing step of performing a fitting process so that the main image is adapted to a print medium;
A second image processing step for performing a changing process so that the sub-image is adapted to the main image subjected to the fitting process;
An image synthesis step of synthesizing the main image subjected to the fitting process in the first image processing step and the sub-image subjected to the change process in the second image processing step;
An image processing method comprising: Furthermore, a sub image type determining step for determining the type of the sub image is provided,
The image processing method according to claim 8, wherein the second image processing step performs the change processing based on a determination result in the sub image type determination processing step.   10. The second image processing step performs a fitting process so that the sub image matches the main image when the determination result indicates that the sub image is a frame image. An image processing method described in 1.   When the determination result indicates that the sub image is a one-point image, the second image processing step is not performed the fitting process of the sub image, and is specified at a specified position in the main image. The image processing method according to claim 9, wherein processing is performed so that the images are arranged at a magnification.   When the determination result indicates that the sub-image is a character string image, the second image processing step performs a smoothing process on the sub-image and processes the sub-image so that the sub-image is arranged at a specified position in the main image. The image processing method according to claim 9.   The image according to any one of claims 9 to 12, wherein the sub image type determining step determines the type of the sub image based on image type information added to a header of the sub image. Processing method.   The image processing method according to any one of claims 9 to 12, wherein the sub image type determination step analyzes a feature of the sub image and determines a type of the sub image based on the feature. . A printing system having an image supply device and a printing apparatus, and printing an image by the printing apparatus based on image data supplied from the image supply device,
Means for acquiring model information and function information of the printing apparatus according to a communication connection between the image supply device and the printing apparatus;
Means for constructing and displaying a UI based on the function information;
Means for constructing a UI for synthesizing a plurality of images and displaying the synthesized image;
Transmission means for transmitting a plurality of image data selected by the UI to the printing apparatus in response to a data request from the printing apparatus,
The printing system, wherein the printing apparatus synthesizes and prints the plurality of image data transmitted by the transmission unit in response to the data request.

Images