JP4582247B2 - Image processing system, image processing method, and image processing program - Google Patents

Description

  The present invention relates to an image processing system, an image processing method, and an image processing program.

2. Description of the Related Art Conventionally, printing systems that read and print image data stored in a removable memory or the like without connecting to a personal computer or the like are known. In such a printing system, if an attempt is made to accept selection of image data to be printed, setting of image processing conditions such as the number of copies to be printed, layout, etc. using a menu displayed on a small screen, the menu hierarchy becomes deep and the operation becomes complicated. There is a problem of becoming. On the other hand, if the menu is displayed on a large screen, there is a problem that the manufacturing cost increases.

In Patent Document 1, a list of thumbnail images of image files stored in a removable memory or the like and a mark sheet printed with selectable printing conditions are printed, and the marks written on the mark sheet are optically recognized. An image processing system that accepts various print condition setting operations is disclosed.
However, when trying to create a greeting card or the like with the image processing system disclosed in Patent Document 1, the following problems arise. In general, a greeting card is filled with not only an image recorded by a digital camera or the like but also a message of the sender. But,
It takes time and effort to hand-write a message for each card on which only an image is printed by the image processing system disclosed in Patent Document 1.

JP 2002-51283 A

The present invention has been created in view of the above problems, and an object thereof is to provide an image processing system, an image processing method, and an image processing program for combining and displaying an image such as a handwritten message on another image. .

(1) An image processing system for achieving the above object includes: a print control unit that prints an area notation and an identification notation indicating a free drawing area on a sheet of paper on a printing sheet; and the free drawing area. Read control means for causing the imaging unit to read the paper on which the object is recorded, an image representing the object read by the imaging unit based on the image of the identification notation read by the imaging unit, and the like Synthesizing means for synthesizing the image. The object is recorded in the free drawing area after printing of the region notation, such as handwriting of handwritten characters, magazine clipping, and printed characters.
According to the present invention, by printing the region notation on a sheet, the user can recognize a free drawing region as a region where an object such as a handwritten character is to be recorded. Further, according to the present invention, by printing the identification notation together with the area notation on the paper, based on the image read from the paper, according to the predetermined free drawing area, the image of the free drawing area and the other Images can be combined with images. That is, according to the present invention, for example, a predetermined free drawing area can be specified based on the image read from the identification notation, and the object recorded in the free drawing area can be read. Further, according to the present invention, based on the image read from the identification notation, for example, the object recorded in the free drawing area and the other image can be recognized with a synthesis condition that is predetermined according to the free drawing area. it can. Therefore, according to the present invention, if the user records a handwritten message or the like in the free drawing area, the result of combining the handwritten message or the like with another image can be obtained.

(2) The printing control unit causes the printing unit to print a plurality of synthesis condition notations representing different synthesis conditions for synthesizing the image of the free drawing area and the other image on the paper, and The processing system may further include synthesis condition recognition means for recognizing the synthesis condition represented by the synthesis condition notation instructed in the synthesis condition instruction recorded on the paper based on an image read by the imaging unit. . Specifically, the composition condition includes, for example, the arrangement, size, and shape of a region into which each image is inserted, the transmittance of a layer into which each image is inserted, and the like.
According to the present invention, since the user can record the synthesis condition instruction together with the handwritten message or the like on the sheet, the user's operation on the operation panel or the like necessary for the synthesis display is simplified.

(3) The reading control unit causes the imaging unit to read the identification notation at a first resolution,
You may make the said imaging part read the said free drawing area | region by 2nd resolution higher than said 1st resolution.
According to the present invention, since an image to be synthesized is read at a high resolution and an image for recognizing a synthesis condition or the like is read at a low resolution, a high-quality synthesized image can be obtained while suppressing a processing amount.

(4) The image processing apparatus further includes a combination condition instruction receiving unit that receives a combination condition instruction for combining the image of the object and the other image, and the print control unit is configured in accordance with the instructed combination condition. The area notation indicating the free drawing area is printed on the printing unit on the paper, and the combining unit combines the image of the object and the other image according to the specified combining condition. Also good.
According to the present invention, since the instruction of the synthesis condition is received from the user before the area notation is printed, the free drawing area can be diversified.

(5) The synthesis condition may include setting a superposition synthesis condition.
According to the present invention, a user's operation on an operation panel or the like necessary for composite display is simplified.

(6) The superposition and synthesis condition may include a boundary processing condition for two images to be superposed and synthesized.
According to the present invention, a user's operation on an operation panel or the like necessary for composite display is simplified.

(7) The superposition and synthesis condition may include transparency of two images to be superposed and synthesized.
According to the present invention, a user's operation on an operation panel or the like necessary for composite display is simplified.

(8) The image processing system further includes an image selection instruction receiving unit that receives an instruction to select any of the accessible image data, and the other image is an image represented by the selected image data. Also good.
According to the present invention, a user can obtain an image obtained by combining an image represented by the selected image data with a handwritten message or the like by selecting image data stored in an area accessible in advance through, for example, an operation panel. it can.

(9) The print control unit may cause the printing unit to print an image notation representing accessible image data on the paper. The image processing system further includes image selection instruction recognition means for recognizing the image data represented by the image notation instructed by an image selection instruction recorded on the paper based on an image read by the imaging unit. May be. The other image may be an image represented by image data represented by the image notation instructed by the image selection instruction.
According to the present invention, the user can record an image selection instruction for instructing image data stored in a previously accessible area on a sheet, so that the user can operate the operation panel or the like necessary for composite display. Simplified.

(10) The image selection instruction recognizing unit recognizes the plurality of image data represented by the plurality of image notations instructed by the image selection instruction, and the synthesizing unit includes the image of the object and the plurality of the other These images may be combined.
According to the present invention, the user can select two or more images to be combined with a handwritten message or the like.

(11) The reading control unit may cause the imaging unit to read the image selection instruction at a resolution lower than that of the free drawing area.
According to the present invention, it is possible to reduce a processing amount for obtaining a composite image while suppressing deterioration in quality of the composite image.

(12) The printing control unit may cause the printing unit to print a reference mark on the paper, and the reading control unit may recognize the free drawing area based on the reference mark.
According to the present invention, since the position of the free drawing area can be relatively recognized with reference to the reference mark printed on the paper, the free drawing area can be accurately recognized.

(13) The image processing system may further include an area extracting unit that extracts an object area recorded in the free drawing area from an image of the free drawing area read by the imaging unit. The image of the free drawing area may be an image of the object area.
According to the present invention, for example, a composite image of a design in which a message is handwritten directly on a photograph can be obtained.

(14) The area extraction unit recognizes a ground color of the paper based on an image of a blank area outside the free drawing area read by the imaging unit, and based on the ground color of the paper, The area may be recognized.
According to the present invention, the blank area outside the free drawing area is read to recognize the ground color of the paper.
The region of the object can be accurately extracted from the image of the free drawing region.

(15) The image processing system may further include the printing unit and the imaging unit.
(16) The image processing system may further include an interface for connecting the printing unit and the imaging unit.

(17) An image processing method for achieving the above object is an image processing method by a computer that controls a printing unit and an imaging unit, and includes one area notation and identification notation indicating a free drawing area on a paper surface. Printing the paper on the printing unit, causing the imaging unit to read the paper on which the object is recorded in the free drawing area, and based on the image of the identification notation read by the imaging unit Combining the image of the free drawing area read by the imaging unit with another image.

(18) An image processing program for achieving the above object includes: a computer that controls a printing unit and an imaging unit; the printing unit that includes a region notation indicating a free drawing region and an identification notation on a sheet of paper. Based on the print control means for printing on the image, the read control means for causing the imaging unit to read the paper on which the object is recorded in the free drawing area, and the image of the identification notation read by the imaging unit, It is made to function as a synthesis means for synthesizing the image of the free drawing area read by the imaging unit and another image.
The functions of the plurality of means provided in the present invention are realized by hardware resources whose functions are specified by the configuration itself, hardware resources whose functions are specified by a program, or a combination thereof. The functions of the plurality of means are not limited to those realized by hardware resources that are physically independent of each other.

The schematic diagram which shows the order sheet | seat which concerns on 5th Example of this invention. 1 is a front view of a multifunction machine according to a first embodiment of the present invention. 1 is a block diagram of a multifunction machine according to a first embodiment of the present invention. 1 is a functional block diagram of a multifunction machine according to a first embodiment of the present invention. The schematic diagram which shows the order sheet template which concerns on the 1st Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on the 1st Example of this invention. (A) is a schematic diagram which shows the synthetic | combination template concerning the 1st Example of this invention. (B) is a schematic diagram showing a synthesis result. The flowchart which concerns on the 1st Example of this invention. The schematic diagram which shows the screen transition which concerns on 1st Example of this invention. The flowchart which concerns on the 1st Example of this invention. The functional block diagram which concerns on the 2nd Example of this invention. The schematic diagram which shows the order sheet template which concerns on the 2nd Example of this invention. The schematic diagram which shows the order sheet which concerns on 2nd Example of this invention. The schematic diagram which shows the order sheet which concerns on 3rd Example of this invention. The schematic diagram which shows the order sheet template which concerns on 3rd Example of this invention. The schematic diagram which shows the synthetic | combination template concerning the 3rd Example of this invention. The flowchart which concerns on 3rd Example of this invention. The schematic diagram which shows the screen transition which concerns on 3rd Example of this invention. The schematic diagram which shows the order sheet which concerns on 4th Example of this invention. It is a flowchart which concerns on 4th Example of this invention. The schematic diagram which shows the screen transition which concerns on 4th Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on 5th Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on 6th Example of this invention. It is a functional block diagram concerning a 7th example of the present invention. It is a schematic diagram which shows the order sheet which concerns on 7th Example of this invention. It is a schematic diagram which shows the directory structure based on 7th Example of this invention. It is a flowchart which concerns on 7th Example of this invention. It is a schematic diagram which shows the screen transition based on 7th Example of this invention. It is a schematic diagram which shows the order sheet which concerns on 7th Example of this invention. It is a flowchart which concerns on 7th Example of this invention. It is a flowchart which concerns on 7th Example of this invention. It is a flowchart which concerns on 7th Example of this invention. It is a schematic diagram which shows the density histogram which concerns on 7th Example of this invention. It is a schematic diagram which shows the superimposition synthesis process which concerns on 7th Example of this invention. It is a schematic diagram which shows the screen transition which concerns on 8th Example of this invention. It is a schematic diagram which shows the order sheet which concerns on 8th Example of this invention. It is a schematic diagram which shows the image processing system by 9th Example of this invention. It is a schematic diagram which shows the screen transition which concerns on 10th Example of this invention. It is a flowchart which concerns on 10th Example of this invention. It is a schematic diagram which shows the screen transition based on the 11th Example of this invention. It is a flowchart which concerns on 11th Example of this invention. It is a schematic diagram which shows the order sheet | seat which concerns on 12th Example of this invention. It is a schematic diagram which shows the screen transition based on 12th Example of this invention. It is a flowchart which concerns on 12th Example of this invention. It is a schematic diagram which shows the user original document based on 12th Example of this invention.

Hereinafter, embodiments of the present invention will be described based on a plurality of examples. Constituent elements and processes corresponding to each embodiment are denoted by the same reference numerals, and redundant description of corresponding constituent elements and processes in each embodiment is omitted.
(First Example)
FIG. 2 is a front view showing an external appearance of the multifunction machine 1 as the first embodiment of the image processing system of the present invention. FIG. 3 is a block diagram showing the multifunction machine 1 according to the first embodiment of the present invention. MFP 1
Is a function of outputting image data read from a document to a personal computer (PC) (not shown), a function of copying a document, a function of printing data output from a PC, and image data input from the removable memory 3. And a function for printing.

The imaging unit 20 of the multifunction machine 1 includes an image sensor 21, an optical system 22, a sensor driving unit 23, a sensor carriage driving unit 24, an AFE (Analog Front End) unit 25, and a digital image processing unit 2.
6 etc.
The image sensor 21 driven by the sensor driving unit 23 is a linear image sensor including RGB three-channel light receiving elements, and is mounted on a sensor carriage 27 that moves in parallel with a document table (not shown). The image sensor 21 outputs an electrical signal correlated with the density of an optical image of a document placed on a document table formed on a light receiving surface by an optical system 22 including a lens and a mirror (not shown).

The sensor carriage drive unit 24 includes a motor, a drive belt, a drive circuit, and the like. The sensor carriage drive unit 24 reciprocates the sensor carriage 27 along a guide rod installed perpendicular to the scanning line. A two-dimensional image can be scanned by moving the image sensor 21 in a direction perpendicular to the scanning line.
The AFE unit 25 includes an analog signal processing unit, an A / D converter, and the like.
The digital image processing unit 26 performs processing such as shading correction on the output signal output from the AFE unit 25 to generate a digital image.

The printing unit 30 of the multifunction machine 1 includes a recording head 31, a head driving unit 32, a head carriage driving unit 33, a paper feeding unit 34, and the like for forming an image on a sheet by an inkjet method. still,
The printing unit 30 may have a configuration corresponding to another printing method such as a laser method.
The recording head 31 includes a head carriage 37 on which an ink cartridge (not shown) is mounted.
Provided with nozzles, piezo elements, ink passages and the like.
The head carriage drive unit 33 includes a motor, a drive belt, a drive circuit, and the like (not shown). The head carriage drive unit 33 reciprocates the recording head 31 perpendicular to the paper transport direction.

The paper feeding unit 34 includes a paper transport roller, a motor, a drive circuit, and the like (not shown). Paper feeding part 3
No. 4 conveys the sheet in a direction perpendicular to the moving direction axis of the recording head 31 by rotating the sheet conveying roller.
The card read / write unit 41 includes a card slot (not shown) for inserting the removable memory 3, a memory controller, and the like.

The operation unit 42 includes an LCD 14 for displaying a menu, and various buttons such as a determination button 10 and a cross button 12 for operating the menu (see FIG. 2).
The control unit 50 includes a CPU 51, a ROM 52, and a RAM 53. CPU51 is ROM
The program stored in 52 is executed to control each unit of the multifunction machine 1. The ROM 52 is a flash memory that stores various programs and data, and the RAM 53 is a memory that temporarily stores programs such as an image processing program and data such as image data. These various programs and data may be downloaded from a predetermined server via a network and stored in the ROM 52, or may be read from a computer-readable storage medium such as the removable memory 3 and stored in the ROM 52.

FIG. 4 is a functional block diagram showing a logical configuration of the multifunction machine 1.
The combination instruction receiving module 61 as a combination instruction receiving unit is a component part of an image processing program that receives a combination instruction. The composition instruction is an instruction for the user to request the multifunction device 1 to perform a series of processes for printing an order sheet for writing handwritten characters and the like, reading the order sheet, and compositing the handwritten characters and the like with another image.

The image selection instruction receiving module 60 as an image selection instruction receiving means is a component part of a program that receives an instruction (image selection instruction) for selecting an arbitrary image file from accessible image files. Specifically, the accessible image file is, for example, an image file stored in a predetermined folder of the removable memory 3. The image selection instruction receiving module 60 includes an internal memory such as a ROM 52 and a RAM 53, a memory of a portable electronic device such as a digital camera connected to the multifunction device 1, a mobile phone with a camera function, and the multifunction device 1.
The user may select image data stored in a hard disk device of a PC connected to the PC or a file server connected to the multifunction device 1 via a communication line.

A print control module 62 serving as a print control unit reads a template (order sheet template) 100 (see FIG. 5) for printing an order sheet from the ROM 52, and prints the order sheet on the printing unit 30 based on the order sheet template 113. This is a component of the image processing program to be executed.

The order sheet template 113 shown in FIG. 5 includes object information and layout information for printing the reference marks 82 and 107, the verification mark 81, and the area frame 110 on a sheet. A frame 112 means a printing paper size defined by the order sheet template 113. The area frame 110 as the area notation defined by the order sheet template 113 is a rectangular frame indicating the outer edge of the free drawing area 72 on the paper surface of the order sheet 70 (see FIG. 6). The free drawing area 72 may be a rectangular frame having an aspect ratio different from that of printing paper for printing a composite image, or may be a non-rectangular frame such as a circular frame. The area notation is
For example, four marks (cross shape, L shape, etc.) indicating the four corners of the free drawing area 72 may be used. The reference marks 82 and 107 defined by the order sheet template 113 are marks for specifying the positions of the free drawing area 72 and the verification mark 81 when the order sheet 70 is read. A frame 108 defined by the order sheet template 113 is a verification mark 81.
Is an area to be allocated. The verification mark 81 corresponds to the identification notation described in the claims, and carries information that can specify a composite template to be described later. That is, the pattern of the verification mark 81 is determined according to the composite template. Note that the composite machine 1 may select one composite template based on the verification mark 81 or a plurality of composite templates. In other words, it is sufficient that at least whether or not the order sheet can record handwritten characters can be determined based on the verification mark 81. From the verification mark 81, it may not be possible to determine whether the verification mark 81 is one of a plurality of types of order sheets corresponding to different composite templates and capable of recording handwritten characters. Further, the verification mark 81 corresponds to the composite template and, at the same time, naturally corresponds to the order sheet template 113.
A frame 128 for assigning an image of the free drawing area 72 defined by the composite template (see FIG. 7).
This is because the area frame 110 defined by the order sheet template 113 corresponds. That is, the verification mark 81 carries information capable of identifying the order sheet itself.
The verification mark 81 includes a removable memory 3 connected to the multifunction device 1 during execution of the process of printing the order sheet 70 and a removable memory 3 connected to the multifunction device 1 during execution of the process of printing a composite image. It is also a mark for verifying the identity with the memory 3. Specifically, for example, the verification mark 81 includes information that can specify a checksum calculated based on the file name, the number of files, and the like of all image files of a predetermined format stored in a predetermined folder of the removable memory 3. Carrying.

The reading control module 64 as reading control means is a component of the image processing program and has the following functions. First, the prescan image is acquired by causing the imaging unit 20 to read the entire surface (prescan area) of the document table at a low resolution. Second, the verification mark 81 is recognized based on the pre-scan image. Third, the free drawing area 72 of the order sheet 70 is specified based on the recognition result of the verification mark 81. Fourth, the free drawing area 72 is read by the imaging unit 20 with high resolution.

The compositing module 66 serving as a compositing unit and an area extracting unit is a component of an image processing program that acquires an image of the free drawing area 72 read by the imaging unit 20 and combines the image of the free drawing area 72 with another image. is there. Specifically, for example, the synthesis module 66 extracts an area of the object 116 (see FIG. 6) such as handwritten characters from the image of the free drawing area 72, and the image of the object 116 is extracted from the image of the object 116 based on a synthesis template described later. Is combined with the selected photographic image.
The functions of the control unit 50 realized by executing the combination instruction receiving module 61, the print control module 62, the reading control module 64, and the combination module 66 described above are the ASIC (Application Specific Integra) that does not involve the execution of a computer program.
ted Circuit) or other dedicated hardware.

FIG. 7 is a schematic diagram for explaining a composite template.
The composite template 120 is composed of layout information necessary for printing the composite image 132 on the paper 134. A frame 131 represents the print paper size defined by the composite template 120. A frame 128 defined by the composite template 120 is an area to which the image 122 of the free drawing area 72 and another image 126 are allocated. In the example shown in the figure, the area 122 to which the image 122 of the free drawing area 72 and the other image 126 are allocated are the same, but each image may of course be allocated to a different frame. Frame 128 defined by composite template 120
And the area frame 110 defined by the order sheet template 113 have the same aspect ratio. The alpha channel 124 is information that defines the transmittance of the layer of the image 122 in the free rendering area 72 for each pixel. The composition module 66 displays the image 1 of the free drawing area 72.
22, the region 130 of the object 116 such as a handwritten character is identified by the region division processing for 22,
The alpha channel 124 is generated by the process of setting the transmittance of the region 130 of the object 116 to be opaque and setting the other regions to be transparent. The composite image 132 is generated by weighting and adding the image 122 of the free rendering area 72 and the other image 126 with the alpha channel 124 for each pixel.

FIG. 8 is a flowchart showing an image processing method according to the first embodiment of the present invention. The process shown in FIG. 8 is executed by the control unit 50 executing the above-described image processing program.
First, the control unit 50 receives a composition instruction (step S100). Specifically, for example, the composition instruction receiving module 61 displays the menu screen 1000 shown in FIG. 9 on the LCD 14, and then the user selects “handwritten character composition printing” by operating the cross button 12 and presses the decision button 10. Thus, a signal output from the operation unit 42 is accepted as a synthesis instruction. In the drawing, the items selected by operating the cross button 12 among the items displayed on the LCD 14 are hatched.

When the control unit 50 receives the compositing instruction, the control unit 50 sets an order sheet template (step S103). Specifically, the composition instruction receiving module 61 reads the order sheet template from the ROM 52 into the RAM 53. By this processing, a free drawing area 72 of the order sheet 70 corresponding to the compositing instruction is set. In addition, the control part 50 is step S100.
Alternatively, a combination instruction corresponding to different order sheet templates may be received, and an order sheet template corresponding to the received combination instruction may be set.

In step S <b> 106, the multifunction machine 1 prints the order sheet 70. Specifically, the print control module 62 generates data of pages to which the reference marks 82 and 107, the verification mark 81, and the area frame 110 are allocated based on the order sheet template read into the RAM 53. At this time, the print control module 62 carries information that can specify a composite template according to the composite instruction and information that can specify a checksum corresponding to a group of image files stored in a predetermined directory of the removable memory 3. The pattern verification mark 81 is read from the ROM 53 and assigned to the frame 108 (see FIG. 5). The checksum is calculated based on a group of image files stored in a predetermined directory of the removable memory 3. Since the synthesis template is determined according to the synthesis instruction, it can be said that the pattern of the verification mark 81 is determined according to the synthesis instruction. Next, the print control module 6
2 generates print data by performing binarization processing, interlace processing, and the like on the data of the page to which the reference marks 82 and 107, the verification mark 81, and the area frame 110 are assigned. Next, the print control module 62 outputs print data to the printing unit 30 and causes the printing unit 30 to print the order sheet 70. Further, the printing control module 62 may display the screen 1040 shown in FIG. 9 on the LCD 14 until the printing unit 30 completes the printing of the order sheet 70.

The user records an object 116 such as a handwritten character in the free drawing area 72 of the order sheet 70 printed in step S106 as shown in FIG. The outer edge of the free drawing area 72 is clearly indicated by the area frame 110. In the free drawing area 72, in addition to handwritten characters, magazine clippings can be pasted, and characters and images can be printed.
In step S108, the control unit 50 receives a synthesis start instruction. Specifically, for example,
The combination instruction receiving module 61 displays a menu screen 1060 shown in FIG. 9 on the LCD 14 and then receives a signal output from the operation unit 42 when the user presses the enter button 10 as a combination start instruction. In addition, after receiving the synthesis start instruction, the control unit 50 performs the LC
The screen 1080 shown in FIG. 9 may be displayed on D14 to guide the progress status to the user.

In step S109, the multifunction device 1 reads the pre-scan area. Specifically, the reading control module 64 causes the imaging unit 20 to read the prescan area and obtain a prescan image.
In step S <b> 110, the control unit 50 specifies the free drawing area 72 of the order sheet 70. Specifically, the reading control module 64 specifies the positions of the reference marks 82 and 107 in the pre-scan image by pattern matching or the like. Next, the reading control module 64 identifies the range of the verification mark 81 based on the positions of the reference marks 82 and 107, and recognizes the verification mark 81 represented by the pre-scan image, thereby recognizing the order sheet 70. . That is, the reading control module 64 specifies the range of the free drawing area 72 determined according to the order sheet 70 based on the image obtained by reading the verification mark 81. At this time, the range of the free drawing area 72 corresponding to the relative positional relationship between the reference marks 82 and 107 and the area frame 110 defined in the order sheet template 113 corresponding to the verification mark 81 is specified.

In step S110, the identity of the checksum corresponding to the verification mark 81 and the checksum calculated based on the image file of a predetermined format stored in a predetermined folder of the removable memory 3 is verified. As a result, if the two checksums do not match, the control unit 50 performs error processing. Of course, such error determination and error processing may be omitted.
In step S <b> 111, the control unit 50 sets a composite template corresponding to the verification mark 81. Specifically, the synthesis module 66 reads a synthesis template corresponding to the verification mark 81 from the ROM 52 into the RAM 53. By this processing, the image 1 in the free drawing area 72 is displayed.
For 22 and other images 126, the arrangement according to the compositing instruction, the vertical relationship of the layers, the transmittance of each layer, the printing paper size, and the like are set.

In step S112, the multi function device 1 reads the free rendering area 72 with high resolution. Specifically, the reading control module 64 causes the imaging unit 20 to read the free drawing area 72 at a higher resolution than during pre-scanning and store the image of the free drawing area 72 in the RAM 53.
In step S <b> 114, the control unit 50 extracts an area 130 corresponding to the object 116 recorded in the free drawing area 72 from the image 122 (see FIG. 7) of the free drawing area 72. Specifically, the composition module 66 performs region division processing using a predetermined threshold on the image 122 of the free drawing region 72 and specifies the region 130 corresponding to the object 116. Note that the synthesis module 66 may specify a region corresponding to the object 116 using the pre-scan image. Next, the composition module 66 generates an alpha channel 124 in which the region 130 corresponding to the object 116 is set to be opaque and the other regions are set to be transparent.

In step S104, the multifunction device 1 receives an instruction to select an arbitrary image file from image files accessible by the user. Specifically, for example, the image selection instruction receiving module 60 displays the image selection screen 1020 shown in FIG. 9 on the LCD 14, and then is output from the operation unit 42 when the user presses the cross button 12 and the determination button 10. In accordance with the signal, an image file of a predetermined format stored in a predetermined folder of the removable memory 3 is selected. Note that the processing in step S104 may be performed before the order sheet 70 is printed as shown in FIG.

In step S <b> 116, the control unit 50 combines the image 122 (see FIG. 7) of the free drawing area 72 with another image 126. Specifically, the synthesis module 66 is configured to display the synthesis template 1.
20, the image 122 of the free drawing area 72 and the image 126 represented by the image file selected in step S104 are weighted and added for each pixel by the alpha channel 124, and the resultant composite image 132 is framed. Assign to 128. The composite template 120 used at this time is the one read by the control unit 50 from the ROM 52 into the RAM 53 according to the result of recognizing the verification mark 81 (see step S110 and step S111).
The composition of the image 122 in the free drawing area 72 and the other image 126 is performed based on the composition template 120 set according to the verification mark 81. That is, the control unit 50 combines the image 122 of the free drawing area 72 and another image 126 according to the verification mark 81.

In step S118, the multifunction device 1 prints the composite image. Specifically, the control unit 50 generates data of a page in which the composite image 132 is allocated to the frame 128 based on the composite template 120, and performs binarization processing, interlace processing, and the like on the data to generate print data. The composite image 132 is printed on the paper 134 by generating and outputting the print data to the printing unit 30.

According to the first embodiment of the present invention described above, the user combines the handwritten characters with other images by causing the multifunction device 1 to read the order sheet 70 in which the handwritten characters are written in the free drawing area 72. The obtained image can be printed on the multifunction device 1. Therefore,
A large amount of printed matter on which the composite image obtained in this way is printed can be easily created. In addition, it is difficult to cleanly overwrite handwritten characters on a photographic image printed on glossy paper due to the nature of paper and ink. However, according to the above-described embodiment, a user can write handwritten characters on a photographic image printed on glossy paper. It is possible to easily create a print that has been overwritten cleanly.
Further, in the first embodiment, after the composite print instruction is received, the composite template setting and the image selection are executed, so that the processing after step S108 and the processing before step S106 need not be continuous. . That is, completely different processing may be performed between step S106 and step S108, or the power of the multi-function device 1 may be turned off.

(Second embodiment)
FIG. 11 is a functional block diagram of the MFP 1 according to the second embodiment of the present invention.
In step S106 described above, the print control module 62 also prints the image selected by the image selection instruction receiving module 60 on the order sheet based on the order sheet template 113 shown in FIG. A frame 200 defined by the order sheet template 113 shown in FIG. 12 is a frame to which an image 202 indicating a file selected by the image selection instruction receiving module 60 is assigned. The order sheet template 113 may be defined such that a frame indicating the outer edge of the sheet is printed outside the frame 200. By doing so, the user can confirm how the image 126 (see FIG. 7) of the selected file is arranged on the printing paper before printing. Note that the print control module 62 may assign a reduced image generated based on the image 126 of the image file selected by the user to the frame 200. Further, if the selected image file is an image file storing thumbnail data such as an Exif file, the print control module 62 may assign the thumbnail image to the frame 200.

According to the second embodiment of the present invention described above, the multi-function device 1 orders the image 202 indicating the selected image data and the area frame 110 indicating the free rendering area 72 on one sheet as shown in FIG. Print on the sheet 70. Therefore, the user can record the object 116 such as a handwritten character to be combined with the selected image in the free drawing area 72 while confirming the selected image on the order sheet 70. That is, the user can predict the synthesis result while free drawing area 7
2 can record the object.

(Third embodiment)
The MFP 1 according to the second embodiment of the present invention prints on the order sheet 70 a sample 111 of the combination result of the image represented by the selected image file and the image of the object such as a handwritten character (FIG. 14).
reference).
In the third embodiment of the present invention, the composition instruction receiving module 61 corresponds to a composition condition instruction receiving unit. That is, the compositing instruction reception module 61 receives an instruction to select a compositing condition for compositing the image 122 representing the object recorded in the free drawing area 72 and another image 126. The composition conditions are image arrangement, layer vertical relationship, layer transmittance, and the like, specifically, for example, the contents of a composition template. The composition instruction receiving module 61 sets a composition template and an order sheet template according to an instruction for selecting a composition condition.

FIG. 15 is a schematic diagram showing an order sheet template 113 for printing the order sheet 70. FIG. 16 is a schematic diagram for explaining a composite template corresponding to the order sheet template 113 shown in FIG. That is, the order sheet template 113 shown in FIG. 15 and the composite template 120 shown in FIG. 16 are templates read from the ROM 52 in response to an instruction to select the same composite condition.
The order sheet template 113 defines a frame 206 to which an image 208 representing a sample of the free drawing area 72 in which handwritten characters are recorded is assigned. A frame 200 to which an image 202 indicating a file selected by the image selection instruction receiving module 60 is allocated;
The frame 206 is defined inside the rectangular frame 204 that represents the outer edge of the printing paper for printing the composite image. The aspect ratio of the rectangular frame 204 matches the aspect ratio of the printing paper for printing the composite image. A frame 206 to which an image 208 representing a sample of the free drawing area 72 is allocated, and an image 20 indicating a file selected by the image selection instruction receiving module 60.
When the frame 2 to which 2 is assigned overlaps, the order sheet template 1
13 defines an alpha channel for setting the transmittance of two images.

A frame 128a defined by the composite template 120 is an area to which another image 126 is allocated. The frame 128b defined by the composite template 120 is the image 1 of the free drawing area 72.
22 is an area to be allocated. The relationship between the relative size and relative position of the frame 131, the frame 128a, and the frame 128b corresponding to the print paper size defined by the composite template 120 is as follows: the rectangular frame 204 defined by the order sheet template 113; 200 and frame 2
It is equal to the relative size and relative position relationship of 06. That is, the frames 128a and 128
When b and 131 are regarded as one figure and the frames 204, 200, and 206 are regarded as one figure,
These two figures are similar to each other. Therefore, the user can predict the synthesis result by the sample 111 (see FIG. 14) printed on the order sheet 70 based on the frames 204, 200, and 206.

FIG. 17 is a flowchart showing an image processing method according to the third embodiment of the present invention.
In step S <b> 101, the multifunction device 1 accepts instructions for different synthesis conditions for synthesizing the image 122 of the object and the other image 126. Specifically, the compositing instruction receiving module 61 displays the menu screen 1100 shown in FIG. 18 on the LCD 14, and then the user selects any compositing condition by operating the cross button 12 and presses the decision button 10. A signal output from the operation unit 42 is accepted as a synthesis condition instruction. The composition instruction receiving module 61 may guide the user to select a composition condition by displaying a sample 111 specifically indicating the composition result on the screen, or may include “upper and lower two columns”, “superposition”, and the like. The user may be guided to selectable synthesis conditions by displaying a character string on the screen.

In step S102, the composition instruction receiving module 61 receives the order sheet template 113 and the composition template 120 corresponding to the composition condition instruction received in step S101.
Are read from the ROM 52 into the RAM 53. By this processing, the free drawing area 72 of the order sheet 70 corresponding to the compositing condition instruction is set, and for the image 122 and the other image 126 of the free drawing area 72, the arrangement according to the compositing condition instruction, the layer vertical relationship, The transmittance of each layer, the print paper size, etc. are set.

According to the third embodiment of the present invention described above, the sample sheet 111 is printed on the order sheet 70 as a composite result of the image represented by the selected image file and the object such as handwritten characters.
The user can record the object in the free drawing area 72 while specifically imagining the synthesis result.

(Fourth embodiment)
FIG. 19 shows an order sheet 70 printed by the multifunction machine 1 according to the fourth embodiment of the present invention.
It is a schematic diagram which shows. In the multifunction machine 1 according to the fourth embodiment of the present invention, a plurality of samples 111 are printed on the order sheet 70, and a synthesis condition instruction is received via an identifier 136 attached to each sample 111. The template for printing the order sheet 70 is substantially the same as that of the third embodiment except that there are a plurality of pieces of definition information for printing the sample 111, and the description thereof will be omitted.

FIG. 20 is a flowchart showing an image processing method according to the fourth embodiment of the present invention.
After receiving the composite print instruction in step S108, the multifunction machine 1 executes step S101 and receives the composite condition instruction. Specifically, the compositing instruction receiving module 61 is configured as shown in FIG.
The menu screen 1110 shown in FIG. On the menu screen 1110, each sample 11 of the order sheet 70 is pressed by pressing the cross button 12 and the determination button 10.
One of the identifiers 136 attached to 1 can be selected. The combination instruction receiving module 61 receives any combination condition instruction according to a signal output from the operation unit 42 when the user presses the cross button 12 and the determination button 10.
In step S111, the control unit 50 sets a synthesis template according to the synthesis condition instruction received in step S110. Specifically, the composition module 66 performs step S.
A composite template corresponding to the identifier selected by the user in 110 is read from the ROM 52 to the RAM 53.
Read in.

According to the fourth embodiment of the present invention described above, a plurality of samples 111 corresponding to the synthesis conditions that can be selected by the user are printed on the order sheet 70. Therefore, the user can specifically recognize selectable synthesis conditions even when the resolution of the LCD 14 is low and the screen size is small.

(Fifth embodiment)
FIG. 1 is a schematic diagram showing an order sheet 70 printed by the multifunction machine 1 according to the fifth embodiment of the present invention. In the multi function device 1 according to the fifth embodiment of the present invention, a plurality of check boxes 88 for selecting a synthesis condition are printed on the order sheet 70, and the handwriting 88m filled with the check boxes 88 is optically recognized to synthesize. Set conditions. In the template for printing the order sheet 70, a check box 88 is arranged immediately below each of the plurality of samples 111 representing the synthesis result. The sample 111 corresponds to the composition condition notation described in the claims. The user can select a synthesis condition corresponding to the sample 111 arranged immediately above the check box 88 by painting one of the check boxes 88. The handwriting 88m in which the check box 88 is filled corresponds to the synthesis condition instruction.

FIG. 22 is a flowchart showing an image processing method according to the fifth embodiment of the present invention.
In step S <b> 111, the control unit 50 sets a composite template corresponding to the filled check box 88. Specifically, the synthesis module 6 as a synthesis condition recognition means.
6 determines which check box 88 is filled based on the pre-scan image, and determines a composite template corresponding to the filled check box 88 as R
Read from the OM 52 to the RAM 53. As a result, the control unit 50 recognizes the composition condition represented by the sample 111 instructed by the composition condition instruction recorded on the order sheet 70.

According to the fifth embodiment of the present invention described above, since the user can indicate the composition condition by filling the check box 88 before and after recording the handwritten character or the like in the free drawing area 72, the composition condition is easily set. be able to.

(Sixth embodiment)
FIG. 23 shows an order sheet 70 printed by the multifunction machine 1 according to the sixth embodiment of the present invention.
It is a schematic diagram which shows. In the multifunction machine 1 according to the sixth embodiment of the present invention, check boxes 91 and 76 for selecting printing conditions are printed on the order sheet 70, and the check boxes 91,
Printing conditions are set by optically recognizing the handwriting 91m and 76m filled with 76. The user can paint any one of the check boxes 91 to
Any one of a plurality of types of printing paper can be selected. Further, the user can select the number of prints by painting any one of the plurality of check boxes 76.
According to the sixth embodiment of the present invention, the user can instruct the printing conditions by filling the check boxes 91 and 76 before and after recording the handwritten characters or the like in the free drawing area 72.
Printing conditions can be set easily.

(Seventh embodiment)
FIG. 24 is a functional block diagram of the multifunction machine 1 according to the seventh embodiment of the present invention.
The third operation unit 304 includes the operation unit 42, the control unit 50 that executes the compositing instruction reception module, and the like, and selects a layout between an image selected in the image selection area 71 and an image representing the free drawing area 72 described later. A predetermined button operation is accepted.
The first operation unit 300 includes a control unit 50 that executes a synthesis instruction receiving module, an operation unit 42, and the like, and receives a predetermined button operation as an order sheet request.

The first output unit 310 includes a control unit 50 that executes a print control module, a card read / write unit 41, a printing unit 30, and the like. When an order sheet request is received by the first operation means 300, the first output means 310 reads the image data stored in the removable memory 3 and the template stored in the ROM 52 and prints an order sheet described later.

The second operation unit 302 includes a control unit 50 that executes a combination instruction reception module, an operation unit 42, and the like, and receives a predetermined button operation as a composite image print request.
The order reading unit 306 includes a control unit 50 that executes a reading control module and an image selection instruction recognition module, the imaging unit 20, and the like. When the second operation unit 302 receives a print request for a composite image, the order reading unit 306 receives the order sheet 70. Read, verification mark 81, reference mark 82, filled check boxes 74m, 76m, 79m, 86 described later
m and 87m are optically recognized, and an image of the free drawing area 72 is output. The image selection instruction recognition module as an image selection instruction recognition unit is a component of an image processing program that recognizes an image file selected by the user based on an image obtained by reading the check box 74.

The second output unit 308 includes a control unit 50 that executes a synthesis module, a printing unit 30, and the like, and prints a composite image of the image selected in the image selection area 71 and the image representing the free drawing area 72. In the preview described later, the second output means 308 does not print the composite image and prints the L
Display on CD14.

FIG. 25 is a schematic diagram showing an example of an order sheet 70 printed by the multifunction machine 1 in a state where the removable memory 3 having the directory structure shown in FIG. 26 is connected. The layout of the order sheet 70 is defined by an order sheet template stored in the ROM 52. FIG. 29 is a schematic diagram showing an example of an order sheet 70 in which necessary items are entered by the user. The arrangement of each element written on the order sheet 70 is the reference mark 8.
2 is set as a reference.

The reference mark 82 is laid out in the upper left corner of the order sheet 70. When the order reading means 306 recognizes the position of the reference mark 82, the order sheet 70
The position of each element described in can be recognized relatively.
In the image selection area 71, image files (for example, tree.jpg, face.jpg, flower.jpg, sea.jpg, maple, etc.) stored in the DCIM folder 90 of the removable memory 3 are displayed.
jpg, sunrise. jpg, mountain. jpg, person. thumbnail image 7 stored in jpg)
3 and a check box 74 are laid out. By painting the check box 74, the main image of the image file corresponding to the thumbnail image 73m (for example, the sunrise.jpg thumbnail image) laid out immediately above the check box 74m can be selected as a compositing target. The thumbnail image 73 corresponds to the image notation described in the claims.
The handwriting that fills the check box 74m corresponds to the image selection instruction described in the claims.
The image file stored in the DCIM folder 90 of the removable memory 3 may be expressed as a main image or may be expressed by printing a file name or an internal identifier.

The free drawing area 72 is a blank area for drawing a handwritten character (for example, “Kagasho”) or pasting a magazine cutout, and is surrounded by a rectangular frame. Characters and figures handwritten in the free drawing area 72, printed matter pasted in the free drawing area 72, and characters and figures printed in the free drawing area correspond to the objects described in the claims.

In the area 75 for selecting the number of printed sheets, a check box 76 corresponding to each digit of the number of printed sheets from 0 to 99 and a check box 84 for selecting a preview are laid out. The tens digit of the number of printed sheets is selected by filling the check box 76 laid out in the left column, and the first digit of the number of printed sheets is filled in by filling the check box 76 laid out in the right column. Can be selected.

In the layout selection area 77, an image 78 and a check box 79 schematically showing the layout are laid out. By filling the check box 79, a layout corresponding to the image 78m laid out immediately above the check box 79m can be selected. The handwriting (79m) in which the check box 79 is filled corresponds to the composition condition instruction described in the claims.

A check box 86 and a check box 87 are displayed in the superimposition synthesis condition selection area 85. By filling the check box 86, it is possible to select a boundary processing condition as to whether or not to perform white bordering when a handwritten character is superimposed and synthesized on the image selected in the image selection area 71. Further, by filling the check box 87, the transparency (for example, 0%) of the layer representing the handwritten character can be selected. Note that the width of the white border may be set as the boundary processing condition, or another transparency may be selected as the superposition synthesis condition.

FIG. 27 is a flowchart showing a process of printing a composite image by the multifunction machine 1 according to the seventh embodiment of the present invention. FIG. 28 is a schematic diagram showing screen transition of the LCD 14.
When the removable memory 3 is connected to the multifunction device 1 and the user selects “print order sheet” with the cross button 12 on the menu screen 100 and presses the enter button 10, the LCD 1
4, a screen 102 for selecting a template of the order sheet 70 is displayed. Screen 10
2, the user selects a template (for example, New Year's card) with the cross button 12 and presses the enter button 1.
When 0 is pressed, the first operation means 300 receives a print request for the order sheet 70. When the first operation means 300 receives the print request for the order sheet 70, the process proceeds to step S12 (
Step S10).

In step S12, the screen 104 indicating that the order sheet 70 is being printed is displayed on the LC screen.
D1 is displayed, and the first output unit 310 prints the order sheet 70.
In step S14, the user fills the check boxes 74, 76, 79, 86, 87 of the printed order sheet 70 according to the image processing conditions to be set,
A handwritten character is drawn in the free drawing area 72 (see FIG. 29).

Next, when the user places the order sheet 70 at a predetermined position on the document table (not shown), selects “print composite image” with the cross button 12 on the menu screen 100 and presses the enter button 10, the second operation means 302 accepts a composite image print request. When the second operation means 302 receives the composite image print request, the process proceeds to step S18 (step S16).

In step S18, a screen 106 indicating that the composite image is being printed is displayed on the LCD 14, and the second output means 308 prints the composite image. When printing of the composite image is completed, the menu screen 100 is displayed on the LCD 14.
FIG. 30 is a flowchart showing details of the process of printing the order sheet 70 (step S12).

When the print request for the order sheet 70 is received by the first operation unit 300, the first output unit 310 gives an identifier to the image file stored in the DCIM folder 90 of the removable memory 3 (step S200). At this time, a serial number as an identifier is assigned to each image file in the ASCII code order of the file name of the image file.

Next, a checksum is set (step S201). The checksum is calculated according to the content of the data stored in the DCIM folder 90 of the removable memory 3, and the RA
It is stored in a predetermined area of M53.
Next, the template selected in step S10 is read from the ROM 52 into the RAM 53 (step S202), and the first output means 310 assigns the thumbnail image of the image file and the verification mark 81 to the layout frame defined by the template and orders them. The sheet 70 is printed (step S203).

FIG. 31 is a flowchart showing details of the process (step S18) for printing a composite image.
In step S300, the order reading unit 306 reads the order sheet 70 as a low-resolution monochrome binary image, and the positions of the verification mark 81 and the check boxes 74, 76, 79, 86, 87 on the image based on the reference mark 82. Then, the verification mark 81 and the filled check boxes (see FIG. 1) 74m, 76m, 79m, 86m
And the processing conditions selected by 87m are optically recognized.

In step S302, the checksum corresponding to the verification mark 81 recognized in step S300 is compared with the checksum set in step S201, and the image file written in the order sheet 70 is stored in the removable memory 3. It is determined whether the image files match. If they match, the process proceeds to step S304. If they do not match, a screen is displayed on the LCD 14 that warns that the image file written in the order sheet 70 is different from the image file stored in the removable memory 3 (step 14). S3
06).

In step S304, it is determined whether or not two or more image files are selected in the image selection area 71. If only one image file is selected, the process proceeds to step S308.
If one or more are selected, a screen warning that effect is displayed on the LCD 14 (step S31).
0).
Next, the range of the free drawing area 72 is recognized based on the reference mark 82 recognized in step S300 (step S308). A free drawing area 7 on the image using the reference mark 82
By specifying the range 2, the position of the free drawing area 72 can be accurately specified even when the order sheet 70 is not placed at a predetermined position on the document table.

Next, the order reading unit 306 reads the free drawing area 72 and the margin area 83 (see FIG. 25) in the vicinity thereof with high resolution (step S312).
Next, a region of an object such as a handwritten character is extracted from the image representing the free drawing region 72 (step S314). If the image representing the free drawing area 72 is directly combined with the image selected in the image selection area 71 without performing step S314, the image representing the entire area including the margin of the free drawing area 72 is selected in the image selection area 71. An image (see FIG. 13A) synthesized with the selected image can be created.

In step S316, the object such as the handwritten character in the area extracted in step S314 and the image to be combined selected in the image selection area 71 are combined according to the layout selected in the layout selection area 77.
Next, the second output unit 308 repeats printing of the composite image until the composite image is printed by the number of prints selected in the area 75 for selecting the number of prints (steps S318 and 320).

FIG. 32 is a flowchart showing details of processing (step S314) for extracting a handwritten character region from an image representing the free drawing region 72 and superimposing the extracted region on the image selected in the image selection region 71. is there.
In step S400, a threshold value for separating the blank area 83 where the ground color of the order sheet 70 appears and the handwritten character is determined. Specifically, first, a luminance histogram of the margin area 83 is created. In this luminance histogram, as shown in FIG.
The distribution is concentrated on the luminance value corresponding to the ground color of 0. Therefore, next, a threshold value for extracting the object region from the image representing the free drawing region 72 is set in the vicinity of the range where the distribution is concentrated. Thereby, it is possible to set an appropriate value according to the ground color of the printing paper used for the order sheet 70.

In step S402, based on the specified threshold value, an area of handwritten characters is extracted from the image representing the free drawing area 72, and the alpha channel value of the area is selected by the check box 87 of the superposition synthesis condition selection area 85. And set the alpha channel value for all other areas to be completely transparent. The alpha channel is a channel that represents the transparency of the layer of the image for each pixel.

In step S403, noise included in the region extracted as handwritten characters is removed. Specifically, the transparency of the island-shaped region composed of a predetermined number or less of the extracted regions is set to be completely transparent. Here, FIG. 34 (b) is a schematic diagram showing the superimposition synthesis process when the transparency of the area corresponding to noise in the alpha channel is not changed, that is, when noise removal is not performed. FIG. 10 is a schematic diagram showing a superposition and synthesis process when the transparency of a region corresponding to noise in the alpha channel is made completely transparent, that is, when noise is removed.

Next, if white bordering is selected as the superposition synthesis condition, the opaque region of the alpha channel is expanded (step S404). As a result, in step S316, the ground color of the order sheet 70 around the handwritten character is superimposed and synthesized on the image selected in the image selection area 71, so that the handwritten character is trimmed to form a synthesized image. (Fig. 34 (d
)reference). The processing in step S314 has been described in detail above.

According to the multifunction device 1 according to the seventh embodiment of the present invention described above, the user can easily recognize the image processing conditions such as accessible image data, selectable layout, number of prints, and boundary processing conditions. . Further, the user can easily select an image to be combined from accessible image data, select an image processing condition, and input a handwritten message to be combined with the image to be combined. Therefore, even if the hardware providing the HMI is a simple system, the user can easily display a desired image and a handwritten message on the system.

Further, since the order sheet 70 has the reference mark 82, the position of the free drawing area 72 in which a handwritten message or the like is written can be relatively recognized on the image representing the order sheet 70. The region 72 can be recognized accurately.
Furthermore, since superimposition and synthesis can be selected as the image processing condition, for example, a printed matter with a design in which a message is handwritten directly on a photograph can be created.

Furthermore, since the blank area 83 is read to recognize the ground color of the order sheet 70, the handwritten character area can be accurately extracted from the image representing the free drawing area 72.
Furthermore, by reading the order sheet 70 at a low resolution and reading the free drawing area 72 and the margin area 83 in the vicinity thereof at a high resolution, the reading time of the order sheet 70 can be shortened without degrading the image quality of the composite image. it can.
Further, the image processing system of the present invention may be configured by a single printer including a paper position detection optical sensor provided in the paper transport path. That is, a check box filled with an order sheet may be recognized by such a paper position detection optical sensor.

Further, instead of laying out the thumbnail image 73 in the image selection area 71, an identifier or a file name may be laid out. In this case, it is desirable that the thumbnail image 73 and an identifier corresponding to the thumbnail image 73 can be displayed on the LCD 14.
(Eighth Example)
The multi-function device 1 according to the eighth embodiment uses an order sheet 70 that can select two image files in the image selection area 71.

FIG. 35 is a schematic diagram showing screen transitions according to the eighth embodiment of the present invention.
When the user selects “print order sheet” with the cross button 12 and presses the decision button 10 while the menu screen 100 is displayed, a screen 2021 for selecting a layout is displayed on the LCD 14. On the screen 2021, an icon 203 schematically representing the layout is displayed. When the user selects any one icon with the cross button 12 and presses the enter button 10 in a state where the screen 2021 is displayed, the layout indicated by the icon is selected, and the layout in which the first operation unit 300 is selected. A print request for the order sheet 70 corresponding to the request is accepted (step S10).

FIG. 36 is a schematic diagram showing an example of an order sheet 70 according to the eighth embodiment of the present invention.
In the image selection area 71, check boxes 74a and 74b are printed for each thumbnail image 73. The user can select two image files by painting any one of the check boxes 74a and painting any one of the check boxes 74b.

In the free drawing area 72, a rectangular frame indicating areas 89a and 89b in which an image represented by the image file selected in the image selection area 71 is laid out is written. User is in region 8
Handwritten characters can be drawn in the free drawing area 72 outside 9a and 89b.
In the image processing system according to the eighth embodiment of the present invention described above, since the order sheet 70 according to the layout selected by the user is output, the user can select the free drawing area 72.
When a handwritten message or the like is written on the screen, it is possible to easily imagine the synthesis result with the image to be synthesized. Further, two images to be combined can be selected simply by painting the check boxes 74a and 74b of the order sheet 70.

(Ninth Example)
An order sheet receiving terminal as a ninth embodiment of the image processing system of the present invention is an apparatus that reads an order sheet and receives a print order.

FIG. 37 is a schematic diagram showing a printing system using an order sheet receiving terminal according to the ninth embodiment of the present invention. The printing system 6 includes an order sheet reception terminal 4, a printer 212 connected to the order sheet reception terminal 4, a PC 210, and a printer 211 connected to the PC 210.
The order sheet reception terminal 4 is installed, for example, in a store that provides a digital image print service, a convenience store, or the like. The order sheet reception terminal 4 includes an input unit 213, an operation unit 214, an order reading unit 306, and an output unit 215.
The operation means 214 has substantially the same function as the second operation means of the seventh embodiment. Output means 2
15 has substantially the same function as the second output means of the seventh embodiment. The input unit 213 is an interface for inputting data stored in the removable memory 3.

The order sheet accepting terminal 4 accepts a predetermined button operation by the user as a request for reading the order sheet 70 by the operating means 214, and outputs the composite image to a display device (not shown) provided in the order sheet accepting terminal 4 by the output means 215. Display a preview of the print result. The composite image is generated based on the image input from the removable memory 3 by the input unit 213 and printed by the printer 212 connected to the order sheet receiving terminal 4.

In the image processing system according to the ninth embodiment of the present invention described above, the user can easily print a high-quality composite image in which handwritten characters and the like are laid out even if the user does not have a printer capable of high-quality printing. Available.
(Tenth embodiment)
In the image processing system according to the tenth embodiment, the setting of the number of prints is accepted by a key operation.

FIG. 38 is a schematic diagram showing screen transition of the LCD 14 in the tenth embodiment of the present invention, and FIG. 39 is a flowchart showing processing for printing a composite image in the image processing system in the tenth embodiment of the present invention.
In step S330 of the process of printing the composite image, the multifunction machine 1
If it is recognized that the check box 84 for selecting a preview of 0 is filled, it is determined as a preview request, and the process proceeds to step S332. If it is determined that it is not a preview request, the process proceeds to step S318. In step S <b> 332, the multifunction device 1 displays the test mode screen 220 on the LCD 14. On the test mode screen 220, a composite image 228 of the image represented by the handwritten character described in the free drawing area 72 and the image file selected in the image selection area 71 is displayed. The test mode screen 220 includes a “print” button 222 and a number setting box 2.
24 is displayed. On the test mode screen 220, the desired number of prints can be set in the number setting box 224 by operating the cross button 12 up and down. When the cross button 12 is operated left and right, the “print” button 222 or the “return” button 226 is selected. When the enter button 10 is pressed while the “print” button 222 is selected, a print request for the set number of prints is accepted, and the process proceeds to step S318 (step S33).
4). In steps S318 and S320, the second output unit 308 repeats printing of the composite image until the composite image is printed for the set number of prints.

In step S332, the composite image 228 is displayed on the test mode screen 220. However, the composite image 228 may be printed and displayed by the second output unit.
In the image processing system according to the tenth embodiment of the present invention described above, the composite image is displayed on the screen or printed in response to the preview request set in the order sheet 70.
When the user sets a desired number of printed sheets, it is not necessary to read the order sheet again just to set the number of printed sheets. That is, when setting a desired number of printed sheets, the user does not need to read an order sheet that takes a long time, and the number of printed sheets can be set by a simple button operation, so the work time can be shortened.

(Eleventh Example)
In the image processing system according to the eleventh embodiment, the image of the free drawing area 72 obtained when the order sheet 70 is read at a low resolution and the thumbnail image of the image file selected in the image selection area 71 are combined and displayed on the screen. Thereafter, when a user's print request is received, the image of the free drawing area 72 obtained when the order sheet 70 is read at high resolution and the main image of the image file selected in the image selection area 71 are combined and printed.

FIG. 40 is a schematic diagram showing screen transition of the LCD 14 in the eleventh embodiment of the present invention.
These are the flowcharts which show the process which prints a synthesized image with the image processing system in 11th Example of this invention.
In step S340, the multi function device 1 uses the image of the free drawing area 72 read at low resolution in step S300 and the thumbnail image of the image file selected in the image selection area 71 as the image processing conditions set in the order sheet 70. A synthesized image 238 synthesized based on
It is displayed on the test mode screen 230 of the LCD 14. When the “print” switch 232 displayed on the test mode screen 230 is selected by operating the cross button 12 and the enter button 10 is pressed, a print request is accepted (step S342), and the process proceeds to step S312. In steps S312, S314, S316, S318, and S320, as described in the seventh embodiment, the free drawing area 72 is read with high resolution, and the main image and the free drawing area of the image file selected in the image selection area 71 are read. 72 high-resolution images are combined, and the set number of sheets are printed. The test mode screen 230 also includes a “return” switch 236. When the user selects the “return” switch 236 using the cross button 12 and presses the enter button 10, printing is not performed (step S342), and the menu screen 1000 is displayed. indicate.

In the image processing system according to the eleventh embodiment of the present invention described above, the order sheet 70
The image of the free drawing area 72 obtained when the image is read at a low resolution and the thumbnail image of the image file selected in the image selection area 71 are synthesized based on the image processing conditions set in the order sheet 70, and the test mode It is displayed on the screen 230. For this reason, the user can make a print request after confirming an approximate print result. Therefore, the image processing system according to the eleventh embodiment of the present invention can save printing paper and ink consumed in test printing. Further, in the image processing system according to the eleventh embodiment of the present invention, the composite image 238 on the test mode screen 230 is displayed based on the low resolution read image and the thumbnail image. It can be shortened.

(Twelfth embodiment)
In the image processing system according to the twelfth embodiment, it is possible to select an image to be combined in the order sheet 70, set the layout, the number of printed sheets, and the boundary processing conditions as image processing conditions. After reading 70, a handwritten message or the like is separately read and combined with the selected image.

FIG. 42 is a schematic diagram showing an order sheet 70 according to the twelfth embodiment of the present invention. The order sheet 70 includes an image selection area 71, an area 75 for selecting the number of copies, a layout selection area 77, and a superimposition / combination condition selection area 85.
FIG. 43 is a schematic diagram showing screen transition of the LCD 14 according to the twelfth embodiment of the present invention, and FIG. 44 is a flowchart showing processing for printing a composite image by the image processing system according to the twelfth embodiment of the present invention. FIG. 45 is a schematic diagram showing the user document 260.

In the multifunction machine 1, the user places the order sheet 70 on a document table (not shown), and the menu screen 1
When the user selects “print a composite image” with the cross button 12 and presses the enter button 10, the second operation unit 302 receives a print request for the composite image and starts a process for printing the composite image. In step S300 of the process of printing the composite image, the multifunction device 1 reads the order sheet 70 as a low-resolution monochrome binary image, recognizes the image to be combined and the image processing conditions, and performs various processes in steps S302 and S304. When the error is checked, a document set standby screen 240 is displayed on the LCD 14. Next, when the user places the user document 260 on a document table (not shown) and presses the enter button 10, it is determined that the setting of the user document 260 is completed (step S350), and the process proceeds to step S352. Here, the rectangular user document 260 may be a rectangular document placed at a predetermined position on the document table, or a document of an arbitrary shape placed at an arbitrary position on the document table. Next, the multi-function device 1 includes an LCD 14
A screen 242 indicating that the composite image is being printed is displayed. In addition, the multi function device 1 reads an image of the entire document table as a low-resolution monochrome binary image, and specifies a composition target area of the document table from the read image (step S352). At this time, the entire user document 260 may be the synthesis target area, or an area excluding the area corresponding to the mount of the user original 260 may be the synthesis target area. Thereafter, the process of reading the synthesis target area as a target area such as a handwritten character with high resolution, generating a synthesized image, and printing is the same as in the first embodiment.

In the image processing system according to the twelfth embodiment of the present invention described above, the objects to be synthesized can be diversified.

In the plurality of embodiments described above, an example in which the result of combining the image of the free drawing area 72 and the image selected in the image selection area 71 has been described has been described. Data representing an image obtained by combining the images selected in the image selection area 71 may be simply output to a removable memory, a communication line, or the like.
In addition, the image processing system of the present invention may be configured by a PC, a printer connected to the PC, and an image scanner, instead of the MFP 1 alone. In this case, an interface such as a USB (Universal Serial Bus) interface for connecting the PC and the image scanner and a USB interface for connecting the PC and the printer are described in the claims.
This corresponds to an interface that connects the printing unit and the imaging unit.

DESCRIPTION OF SYMBOLS 1 Multifunction device, 20 Image pick-up part, 30 Printing part, 50 Control part, 60 Image selection instruction | indication reception module (Image selection instruction | indication reception means), 61 Synthesis | combination instruction | indication reception module (Combination instruction | indication reception means, synthetic | combination condition instruction | indication reception means), 62 printing Control module (printing control means), 64 reading control module (reading control means), 66 composition module (composition means, composition condition recognition means, region extraction means), 70 order sheet, 81 verification mark (identification notation), 82, 1
07 reference mark, 85 superimposition synthesis condition selection area, 88 m handwriting (synthesis condition instruction), 10
0 order sheet template, 110 area frame (area notation), 111 sample (composition condition notation), 116 object.

Claims (17)

Printed on one sheet a region notation and identification notation indicating a free drawing area on paper and a plurality of composition condition notations representing different composition conditions for compositing the image of the free drawing area and the other image. Printing control means for printing on a copy;
Reading control means for causing the imaging unit to read the paper on which the object is recorded in the free drawing area;
Synthesis condition recognition means for recognizing the synthesis condition represented by the synthesis condition notation designated in the synthesis condition instruction recorded on the paper based on an image read by the imaging unit ;
Based on the identification notation read by the imaging unit, the composition condition notation instructed by the composition condition instruction represents the image of the free drawing area read by the imaging unit and another image. An image processing system comprising: a combining unit configured to combine according to conditions .   The reading control unit causes the imaging unit to read the identification notation at a first resolution, and causes the imaging unit to read the free rendering area at a second resolution higher than the first resolution. The image processing system described in 1. Print control means for printing on the printing unit the area notation indicating the free drawing area on the paper and the identification notation on one sheet;
Reading control means for causing the imaging unit to read the paper on which the object is recorded in the free drawing area;
Synthesis condition instruction receiving means for selecting a synthesis condition for synthesizing the image of the object and the other image from a plurality of different synthesis conditions ;
The print control unit causes the printing unit to print the area notation indicating the free drawing area in a mode according to the instructed synthesis condition;
The synthesizing unit synthesizes the image of the free drawing area read by the imaging unit and another image based on the specified synthesis condition based on the identification notation read by the imaging unit. An image processing system characterized by that.   The image processing system according to claim 1, wherein the synthesis condition includes setting of a superposition synthesis condition.   The image processing system according to claim 4, wherein the superposition and synthesis condition includes a boundary processing condition between two images to be superposed and synthesized.   6. The image processing system according to claim 4 or 5, wherein the superposition and synthesis condition includes transparency of two images to be superposed and synthesized. An image selection instruction receiving unit that receives an instruction to select any of the accessible image data;
The image processing system according to claim 1, wherein the other image is an image represented by the selected image data. The print control unit causes the printing unit to print an image notation representing accessible image data on the paper,
Image selection instruction recognition means for recognizing the image data represented by the image notation instructed by the image selection instruction recorded on the paper based on the image read by the imaging unit;
The image processing system according to claim 1, wherein the other image is an image represented by image data represented by the image notation instructed by the image selection instruction. The image selection instruction recognition means recognizes the plurality of image data represented by the plurality of image notations instructed by the image selection instruction;
The image processing system according to claim 8, wherein the synthesizing unit synthesizes the image of the object and the plurality of other images.   The image processing system according to claim 8, wherein the reading control unit causes the imaging unit to read the image selection instruction at a resolution lower than that of the free drawing area. The printing control unit causes the printing unit to print a reference mark on the paper;
The image processing system according to claim 1, wherein the reading control unit recognizes the free drawing area based on the reference mark. An area extracting means for extracting the area of the object recorded in the free drawing area from the image of the free drawing area read by the imaging unit;
The image processing system according to claim 1, wherein the image of the free drawing area is an image of the area of the object.   The area extraction unit recognizes the background color of the paper based on an image of a blank area outside the free drawing area read by the imaging unit, and recognizes the area of the object based on the ground color of the paper. The image processing system according to claim 12, wherein:   The image processing system according to claim 1, further comprising the printing unit and the imaging unit.   The image processing system according to claim 1, further comprising an interface for connecting the printing unit and the imaging unit. An image processing method by a computer that controls a printing unit and an imaging unit,
The area notation and identification notation indicating the free drawing area on the paper, and a plurality of composition condition notations representing different composition conditions for compositing the image of the free drawing area and the other image on one sheet. Printing the printing section; and
Causing the imaging unit to read the paper on which an object is recorded in the free drawing area;
Recognizing the composition condition represented by the composition condition notation designated in the composition condition instruction recorded on the sheet based on the image read by the imaging unit ;
Based on the image of the identification notation read by the imaging unit, the image of the free drawing area read by the imaging unit and the other image are represented by the synthesis condition notation instructed by the synthesis condition instruction. Synthesizing according to the synthesis condition . A computer that controls the printing unit and the imaging unit,
The area notation and identification notation indicating the free drawing area on the paper, and a plurality of composition condition notations representing different composition conditions for compositing the image of the free drawing area and the other image on one sheet. Print control means for printing on the printing unit;
Reading control means for causing the imaging unit to read the paper on which the object is recorded in the free drawing area;
Synthesis condition recognition means for recognizing the synthesis condition represented by the synthesis condition notation designated in the synthesis condition instruction recorded on the paper based on an image read by the imaging unit ;
Based on the image of the identification notation read by the imaging unit, the image of the free drawing area read by the imaging unit and the other image are represented by the synthesis condition notation instructed by the synthesis condition instruction. An image processing program that functions as a synthesis unit that performs synthesis in accordance with the synthesis condition .

Images