JP2006054690A - System, method and program for image processing - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing system, an image processing method and an image processing program for synthesizing an image such as a hand-written message with another image and displaying the composite image. <P>SOLUTION: The image processing system is provided with a print control unit for causing a printer unit to print an area notation indicating a free depicting area on paper and an identification notation on one form; a read control unit for causing an image pickup unit to read the form on which a subject is recorded in the free depicting area; and a synthesis unit for synthesizing an image of the free depicting area read by the image pickup unit with the other image or images on the basis of the image on the identification notation area read by the image pickup unit. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing system, an image processing method, and an image processing program.

  2. Description of the Related Art Conventionally, printing systems that read and print image data stored in a removable memory or the like without connecting to a personal computer or the like are known. In such a printing system, if an attempt is made to accept selection of image data to be printed, setting of image processing conditions such as the number of copies to be printed, layout, etc., from a menu displayed on a small screen, the menu hierarchy becomes deep and the operation is complicated. There is a problem of becoming. On the other hand, if the menu is displayed on a large screen, there is a problem that the manufacturing cost increases.

In Patent Document 1, a list of thumbnail images of image files stored in a removable memory or the like and a mark sheet printed with selectable printing conditions are printed, and a mark written on the mark sheet is optically recognized. An image processing system that accepts various print condition setting operations is disclosed.
However, when trying to create a greeting card or the like with the image processing system disclosed in Patent Document 1, the following problems arise. In general, a greeting card is filled with not only an image recorded by a digital camera or the like but also a message of the sender. However, it is troublesome to hand-write a message for each card on which only an image is printed by the image processing system disclosed in Patent Document 1.

JP 2002-51283 A

  The present invention has been created in view of the above problems, and an object thereof is to provide an image processing system, an image processing method, and an image processing program for combining and displaying an image such as a handwritten message on another image. .

(1) An image processing system for achieving the above object includes: a print control unit that prints an area notation and an identification notation indicating a free drawing area on a sheet of paper on a printing sheet; and the free drawing area. Read control means for causing the imaging unit to read the paper on which the object is recorded, an image representing the object read by the imaging unit based on the image of the identification notation read by the imaging unit, and the like Synthesizing means for synthesizing the image. The object is recorded in the free drawing area after printing of the region notation, such as handwriting of handwritten characters, magazine clipping, and printed characters.
According to the present invention, by printing the region notation on a sheet, the user can recognize a free drawing region as a region where an object such as a handwritten character is to be recorded. Further, according to the present invention, by printing the identification notation together with the area notation on the paper, based on the image read from the paper, according to the predetermined free drawing area, the image of the free drawing area and the other Images can be combined with images. That is, according to the present invention, for example, a predetermined free drawing area can be specified based on the image read from the identification notation, and the object recorded in the free drawing area can be read. Further, according to the present invention, based on the image read from the identification notation, for example, the object recorded in the free drawing area and the other image can be recognized with a synthesis condition that is predetermined according to the free drawing area. it can. Therefore, according to the present invention, if the user records a handwritten message or the like in the free drawing area, the result of combining the handwritten message or the like with another image can be obtained.

(2) The printing control unit causes the printing unit to print a plurality of synthesis condition notations representing different synthesis conditions for synthesizing the image of the free drawing area and the other image on the paper, and The processing system may further include synthesis condition recognition means for recognizing the synthesis condition represented by the synthesis condition notation instructed in the synthesis condition instruction recorded on the paper based on an image read by the imaging unit. . Specifically, the composition condition includes, for example, the arrangement, size, and shape of a region into which each image is inserted, the transmittance of a layer into which each image is inserted, and the like.
According to the present invention, since the user can record the synthesis condition instruction together with the handwritten message or the like on the sheet, the user's operation on the operation panel or the like necessary for the synthesis display is simplified.

(3) The reading control unit may cause the imaging unit to read the identification notation at a first resolution, and cause the imaging unit to read the free drawing area at a second resolution higher than the first resolution.
According to the present invention, since an image to be synthesized is read at a high resolution and an image for recognizing a synthesis condition or the like is read at a low resolution, a high-quality synthesized image can be obtained while suppressing a processing amount.

(4) The image processing apparatus further includes a combination condition instruction receiving unit that receives a combination condition instruction for combining the image of the object and the other image, and the print control unit is configured in accordance with the instructed combination condition. The area notation indicating the free drawing area is printed on the printing unit on the paper, and the combining unit combines the image of the object and the other image according to the specified combining condition. Also good.
According to the present invention, since the instruction of the synthesis condition is received from the user before the area notation is printed, the free drawing area can be diversified.

(5) The synthesis condition may include setting a superposition synthesis condition.
According to the present invention, a user's operation on an operation panel or the like necessary for composite display is simplified.

(6) The superposition synthesis condition may include a boundary processing condition for two images to be superposed and synthesized.
According to the present invention, a user's operation on an operation panel or the like necessary for composite display is simplified.

(7) The superposition synthesis condition may include transparency of two images to be superposed and synthesized.
According to the present invention, a user's operation on an operation panel or the like necessary for composite display is simplified.

(8) The image processing system further includes image selection instruction receiving means for receiving an instruction to select any of the accessible image data, and the other image is an image represented by the selected image data. Also good.
According to the present invention, a user can obtain an image obtained by combining an image represented by the selected image data with a handwritten message or the like by selecting image data stored in an area accessible in advance through, for example, an operation panel. it can.

(9) The print control unit may cause the printing unit to print an image notation representing accessible image data on the paper. The image processing system further includes image selection instruction recognition means for recognizing the image data represented by the image notation instructed by an image selection instruction recorded on the paper based on an image read by the imaging unit. May be. The other image may be an image represented by image data represented by the image notation instructed by the image selection instruction.
According to the present invention, the user can record an image selection instruction for instructing image data stored in a previously accessible area on a sheet, so that the user can operate the operation panel or the like necessary for composite display. Simplified.

(10) The image selection instruction recognizing unit recognizes a plurality of the image data represented by the plurality of image notations instructed by the image selection instruction, and the synthesizing unit includes the image of the object and the plurality of the other These images may be combined.
According to the present invention, the user can select two or more images to be combined with a handwritten message or the like.

(11) The reading control unit may cause the imaging unit to read the image selection instruction with a resolution lower than that of the free drawing area.
According to the present invention, it is possible to reduce a processing amount for obtaining a composite image while suppressing deterioration in quality of the composite image.

(12) The printing control unit may cause the printing unit to print a reference mark on the paper, and the reading control unit may recognize the free drawing area based on the reference mark.
According to the present invention, since the position of the free drawing area can be relatively recognized with reference to the reference mark printed on the paper, the free drawing area can be accurately recognized.

(13) The image processing system may further include an area extracting unit that extracts an area of the object recorded in the free drawing area from an image of the free drawing area read by the imaging unit. The image of the free drawing area may be an image of the object area.
According to the present invention, for example, a composite image of a design in which a message is handwritten directly on a photograph can be obtained.

(14) The area extraction unit recognizes the ground color of the paper based on an image of a blank area outside the free drawing area read by the imaging unit, and determines the object color based on the ground color of the paper. The area may be recognized.
According to the present invention, since the blank area outside the free drawing area is read to recognize the ground color of the paper, the area of the object can be accurately extracted from the image of the free drawing area.

(15) The image processing system may further include the printing unit and the imaging unit.
(16) The image processing system may further include an interface for connecting the printing unit and the imaging unit.

(17) An image processing method for achieving the above object is an image processing method by a computer that controls a printing unit and an imaging unit, and includes one area notation and identification notation indicating a free drawing area on a paper surface. Printing the paper on the printing unit, causing the imaging unit to read the paper on which the object is recorded in the free drawing area, and based on the image of the identification notation read by the imaging unit Combining the image of the free drawing area read by the imaging unit with another image.

(18) An image processing program for achieving the above object includes: a computer that controls a printing unit and an imaging unit; and the printing unit that includes a region notation indicating a free drawing area on a paper surface and an identification notation on one sheet of paper. Based on a print control means for printing on the sheet, a read control means for causing the imaging unit to read the paper on which the object is recorded in the free drawing area, and an image of the identification notation read by the imaging unit, It is made to function as a synthesis means for synthesizing the image of the free drawing area read by the imaging unit and another image.
The functions of the plurality of means provided in the present invention are realized by hardware resources whose functions are specified by the configuration itself, hardware resources whose functions are specified by a program, or a combination thereof. The functions of the plurality of means are not limited to those realized by hardware resources that are physically independent of each other.

Hereinafter, embodiments of the present invention will be described based on a plurality of examples. Constituent elements and processes corresponding to each embodiment are denoted by the same reference numerals, and redundant description of corresponding constituent elements and processes in each embodiment is omitted.
(First Example)
FIG. 2 is a front view showing an external appearance of the multifunction machine 1 as the first embodiment of the image processing system of the present invention. FIG. 3 is a block diagram showing the multifunction machine 1 according to the first embodiment of the present invention. The multifunction device 1 has a function of outputting image data read from a document to a personal computer (PC) (not shown), a function of copying a document, a function of printing data output from a PC, and a removable memory 3 And a function of printing image data.

The imaging unit 20 of the multifunction machine 1 includes an image sensor 21, an optical system 22, a sensor driving unit 23, a sensor carriage driving unit 24, an AFE (Analog Front End) unit 25, a digital image processing unit 26, and the like.
The image sensor 21 driven by the sensor driving unit 23 is a linear image sensor including RGB three-channel light receiving elements, and is mounted on a sensor carriage 27 that moves in parallel with a document table (not shown). The image sensor 21 outputs an electrical signal that correlates with the density of an optical image of a document placed on a document table formed on a light receiving surface by an optical system 22 including a lens and a mirror (not shown).

The sensor carriage drive unit 24 includes a motor, a drive belt, a drive circuit, and the like. The sensor carriage drive unit 24 reciprocates the sensor carriage 27 along a guide rod installed perpendicular to the scanning line. A two-dimensional image can be scanned by moving the image sensor 21 in a direction perpendicular to the scanning line.
The AFE unit 25 includes an analog signal processing unit, an A / D converter, and the like.
The digital image processing unit 26 performs processing such as shading correction on the output signal output from the AFE unit 25 to generate a digital image.

The printing unit 30 of the multifunction machine 1 includes a recording head 31, a head driving unit 32, a head carriage driving unit 33, a paper feeding unit 34, and the like for forming an image on a sheet by an inkjet method. The printing unit 30 may be configured to support other printing methods such as a laser method.
The recording head 31 is provided on a head carriage 37 on which an ink cartridge (not shown) is mounted, and includes a nozzle, a piezo element, an ink passage, and the like.
The head carriage drive unit 33 includes a motor, a drive belt, a drive circuit, and the like (not shown). The head carriage drive unit 33 reciprocates the recording head 31 perpendicular to the paper transport direction.

The paper feeding unit 34 includes a paper transport roller, a motor, a drive circuit, and the like (not shown). The paper feeding unit 34 conveys the paper in a direction perpendicular to the moving direction axis of the recording head 31 by rotating the paper carrying roller.
The card read / write unit 41 includes a card slot (not shown) for inserting the removable memory 3, a memory controller, and the like.

The operation unit 42 includes an LCD 14 for displaying a menu, and various buttons such as a determination button 10 and a cross button 12 for operating the menu (see FIG. 2).
The control unit 50 includes a CPU 51, a ROM 52, and a RAM 53. The CPU 51 executes programs stored in the ROM 52 to control each unit of the multifunction machine 1. The ROM 52 is a flash memory that stores various programs and data, and the RAM 53 is a memory that temporarily stores programs such as an image processing program and data such as image data. These various programs and data may be downloaded from a predetermined server via a network and stored in the ROM 52, or may be read from a computer-readable storage medium such as the removable memory 3 and stored in the ROM 52.

FIG. 4 is a functional block diagram showing a logical configuration of the multifunction machine 1.
The combination instruction receiving module 61 as a combination instruction receiving unit is a component part of an image processing program that receives a combination instruction. The composition instruction is an instruction for the user to request the multifunction device 1 to perform a series of processes for printing an order sheet for writing handwritten characters and the like, reading the order sheet, and compositing the handwritten characters and the like with another image.

  The image selection instruction receiving module 60 as an image selection instruction receiving means is a component part of a program that receives an instruction (image selection instruction) for selecting an arbitrary image file from accessible image files. Specifically, the accessible image file is, for example, an image file stored in a predetermined folder of the removable memory 3. The image selection instruction receiving module 60 is connected to the ROM 52 and RAM 53 which are internal memories, the memory of a portable electronic device such as a digital camera connected to the multifunction device 1, a mobile phone with a camera function, or the multifunction device 1. The user may select image data stored in a hard disk device of a PC or a file server connected to the multifunction device 1 via a communication line.

  A print control module 62 serving as a print control unit reads a template (order sheet template) 100 (see FIG. 5) for printing an order sheet from the ROM 52, and prints the order sheet on the printing unit 30 based on the order sheet template 113. This is a component of the image processing program to be executed.

  The order sheet template 113 shown in FIG. 5 includes object information and layout information for printing the reference marks 82 and 107, the verification mark 81, and the area frame 110 on a sheet. A frame 112 means a printing paper size defined by the order sheet template 113. The area frame 110 as the area notation defined by the order sheet template 113 is a rectangular frame indicating the outer edge of the free drawing area 72 on the paper surface of the order sheet 70 (see FIG. 6). The free drawing area 72 may be a rectangular frame having an aspect ratio different from that of printing paper for printing a composite image, or may be a non-rectangular frame such as a circular frame. The area notation may be, for example, four marks (cross shape, L shape, etc.) indicating the four corners of the free drawing area 72. The reference marks 82 and 107 defined by the order sheet template 113 are marks for specifying the positions of the free drawing area 72 and the verification mark 81 when the order sheet 70 is read. A frame 108 defined by the order sheet template 113 is an area to which the verification mark 81 is assigned. The verification mark 81 corresponds to the identification notation described in the claims, and carries information that can specify a composite template to be described later. That is, the pattern of the verification mark 81 is determined according to the composite template. Note that the composite machine 1 may select one composite template based on the verification mark 81 or a plurality of composite templates. That is, it is sufficient that at least whether or not the order sheet can record handwritten characters can be determined based on the verification mark 81. From the verification mark 81, it may not be possible to determine whether the verification mark 81 is one of a plurality of types of order sheets corresponding to different composite templates and capable of recording handwritten characters. Further, the verification mark 81 corresponds to the composite template and, at the same time, naturally corresponds to the order sheet template 113. This is because the frame 128 (see FIG. 7) for assigning the image of the free drawing area 72 defined by the composite template and the area frame 110 defined by the order sheet template 113 correspond to each other. That is, the verification mark 81 carries information capable of identifying the order sheet itself. The verification mark 81 includes a removable memory 3 connected to the multifunction device 1 during execution of the process for printing the order sheet 70 and a removable memory 3 connected to the multifunction device 1 during the processing for printing the composite image. It is also a mark for verifying the identity with the memory 3. Specifically, for example, the verification mark 81 includes information that can specify a checksum calculated based on the file names, the number of files, and the like of all image files of a predetermined format stored in a predetermined folder of the removable memory 3. Carrying.

  The reading control module 64 as reading control means is a component of the image processing program and has the following functions. First, the prescan image is acquired by causing the imaging unit 20 to read the entire surface (prescan area) of the document table at a low resolution. Second, the verification mark 81 is recognized based on the pre-scan image. Third, the free drawing area 72 of the order sheet 70 is specified based on the recognition result of the verification mark 81. Fourth, the free drawing area 72 is read by the imaging unit 20 with high resolution.

The compositing module 66 serving as a compositing unit and an area extracting unit is a component of an image processing program that acquires an image of the free drawing area 72 read by the imaging unit 20 and combines the image of the free drawing area 72 with another image. is there. Specifically, for example, the synthesis module 66 extracts an area of the object 116 (see FIG. 6) such as handwritten characters from the image of the free drawing area 72, and the image of the object 116 is extracted from the image of the object 116 based on a synthesis template described later. Is combined with the selected photographic image.
The functions of the control unit 50 realized by executing the synthesis instruction receiving module 61, the print control module 62, the reading control module 64, and the synthesis module 66 described above are ASIC (Application Specific Integrated) that does not involve execution of a computer program. It can also be realized by dedicated hardware such as Circuit).

FIG. 7 is a schematic diagram for explaining a composite template.
The composite template 120 is composed of layout information necessary for printing the composite image 132 on the paper 134. A frame 131 represents the print paper size defined by the composite template 120. A frame 128 defined by the composite template 120 is an area to which the image 122 of the free drawing area 72 and another image 126 are allocated. In the example shown in the figure, the area 122 to which the image 122 of the free drawing area 72 and the other image 126 are allocated are the same, but each image may of course be allocated to a different frame. The aspect ratio of the frame 128 defined by the composite template 120 and the area frame 110 defined by the order sheet template 113 are the same. The alpha channel 124 is information that defines the transmittance of the layer of the image 122 in the free rendering area 72 for each pixel. The compositing module 66 specifies the region 130 of the object 116 such as handwritten characters by region dividing processing on the image 122 of the free drawing region 72, sets the transmittance of the region 130 of the object 116 to opaque, and makes the other regions transparent. The alpha channel 124 is generated by the process of setting to. The composite image 132 is generated by weighting and adding the image 122 of the free rendering area 72 and the other image 126 with the alpha channel 124 for each pixel.

FIG. 8 is a flowchart showing an image processing method according to the first embodiment of the present invention. The process shown in FIG. 8 is executed by the control unit 50 executing the above-described image processing program.
First, the control unit 50 receives a composition instruction (step S100). Specifically, for example, the composition instruction receiving module 61 displays the menu screen 1000 shown in FIG. 9 on the LCD 14, and then the user selects “handwritten character composition printing” by operating the cross button 12 and presses the decision button 10. Thus, a signal output from the operation unit 42 is accepted as a synthesis instruction. In the drawing, the items selected by operating the cross button 12 among the items displayed on the LCD 14 are hatched.

  When the control unit 50 receives the compositing instruction, the control unit 50 sets an order sheet template (step S103). Specifically, the composition instruction receiving module 61 reads the order sheet template from the ROM 52 into the RAM 53. By this processing, a free drawing area 72 of the order sheet 70 corresponding to the compositing instruction is set. Note that the control unit 50 may alternatively receive a combining instruction corresponding to different order sheet templates in step S100 and set an order sheet template corresponding to the received combining instruction.

  In step S <b> 106, the multifunction machine 1 prints the order sheet 70. Specifically, the print control module 62 generates data of pages to which the reference marks 82 and 107, the verification mark 81, and the area frame 110 are allocated based on the order sheet template read into the RAM 53. At this time, the print control module 62 carries information that can specify a composite template according to the composite instruction and information that can specify a checksum corresponding to a group of image files stored in a predetermined directory of the removable memory 3. The pattern verification mark 81 is read from the ROM 53 and assigned to the frame 108 (see FIG. 5). The checksum is calculated based on a group of image files stored in a predetermined directory of the removable memory 3. Since the synthesis template is determined according to the synthesis instruction, it can be said that the pattern of the verification mark 81 is determined according to the synthesis instruction. Next, the print control module 62 generates print data by performing binarization processing, interlace processing, and the like on the data of the page to which the reference marks 82 and 107, the verification mark 81, and the area frame 110 are assigned. Next, the print control module 62 outputs print data to the printing unit 30 and causes the printing unit 30 to print the order sheet 70. Further, the printing control module 62 may display the screen 1040 shown in FIG. 9 on the LCD 14 until the printing unit 30 completes the printing of the order sheet 70.

The user records an object 116 such as a handwritten character in the free drawing area 72 of the order sheet 70 printed in step S106 as shown in FIG. The outer edge of the free drawing area 72 is clearly indicated by the area frame 110. In the free drawing area 72, in addition to handwritten characters, magazine clippings can be pasted, and characters and images can be printed.
In step S108, the control unit 50 receives a synthesis start instruction. Specifically, for example, the composition instruction receiving module 61 displays a menu screen 1060 shown in FIG. 9 on the LCD 14 and then uses the signal output from the operation unit 42 when the user presses the enter button 10 as a composition start instruction. Accept. Note that after receiving the synthesis start instruction, the control unit 50 may display a screen 1080 shown in FIG.

In step S109, the multifunction device 1 reads the pre-scan area. Specifically, the reading control module 64 causes the imaging unit 20 to read the prescan area and obtain a prescan image.
In step S <b> 110, the control unit 50 specifies the free drawing area 72 of the order sheet 70. Specifically, the reading control module 64 specifies the positions of the reference marks 82 and 107 in the pre-scan image by pattern matching or the like. Next, the reading control module 64 identifies the range of the verification mark 81 based on the positions of the reference marks 82 and 107, and recognizes the verification mark 81 represented by the pre-scan image, thereby recognizing the order sheet 70. . That is, the reading control module 64 specifies the range of the free drawing area 72 determined according to the order sheet 70 based on the image obtained by reading the verification mark 81. At this time, the range of the free drawing area 72 corresponding to the relative positional relationship between the reference marks 82 and 107 and the area frame 110 defined in the order sheet template 113 corresponding to the verification mark 81 is specified.

In step S110, the identity of the checksum corresponding to the verification mark 81 and the checksum calculated based on the image file of a predetermined format stored in a predetermined folder of the removable memory 3 is verified. As a result, if the two checksums do not match, the control unit 50 performs error processing. Of course, such error determination and error processing may be omitted.
In step S <b> 111, the control unit 50 sets a composite template corresponding to the verification mark 81. Specifically, the synthesis module 66 reads a synthesis template corresponding to the verification mark 81 from the ROM 52 into the RAM 53. By this processing, the arrangement according to the compositing instruction, the layer vertical relationship, the transmittance of each layer, the printing paper size, and the like are set for the image 122 and the other image 126 in the free drawing area 72.

In step S112, the multi function device 1 reads the free rendering area 72 with high resolution. Specifically, the reading control module 64 causes the imaging unit 20 to read the free drawing area 72 at a higher resolution than during pre-scanning and store the image of the free drawing area 72 in the RAM 53.
In step S <b> 114, the control unit 50 extracts an area 130 corresponding to the object 116 recorded in the free drawing area 72 from the image 122 (see FIG. 7) of the free drawing area 72. Specifically, the composition module 66 performs region division processing using a predetermined threshold on the image 122 of the free drawing region 72 and specifies the region 130 corresponding to the object 116. Note that the synthesis module 66 may specify a region corresponding to the object 116 using the pre-scan image. Next, the composition module 66 generates an alpha channel 124 in which the region 130 corresponding to the object 116 is set to be opaque and the other regions are set to be transparent.

  In step S104, the multifunction device 1 receives an instruction to select an arbitrary image file from image files accessible by the user. Specifically, for example, the image selection instruction receiving module 60 displays the image selection screen 1020 shown in FIG. 9 on the LCD 14, and then is output from the operation unit 42 when the user presses the cross button 12 and the determination button 10. In accordance with the signal, an image file of a predetermined format stored in a predetermined folder of the removable memory 3 is selected. Note that the processing in step S104 may be performed before the order sheet 70 is printed as shown in FIG.

  In step S <b> 116, the control unit 50 combines the image 122 (see FIG. 7) of the free drawing area 72 with another image 126. Specifically, the composition module 66 weights the image 122 of the free rendering area 72 and the image 126 represented by the image file selected in step S104 with an alpha channel 124 for each pixel based on the composition template 120. Addition is performed, and the resultant composite image 132 is assigned to the frame 128. The composite template 120 used at this time is the one read by the control unit 50 from the ROM 52 into the RAM 53 according to the result of recognizing the verification mark 81 (see step S110 and step S111). The composition of the image 122 in the free drawing area 72 and the other image 126 is performed based on the composition template 120 set according to the verification mark 81. That is, the control unit 50 combines the image 122 of the free drawing area 72 and another image 126 according to the verification mark 81.

  In step S118, the multifunction device 1 prints the composite image. Specifically, the control unit 50 generates data of a page in which the composite image 132 is allocated to the frame 128 based on the composite template 120, and performs binarization processing, interlace processing, and the like on the data to generate print data. The composite image 132 is printed on the paper 134 by generating and outputting the print data to the printing unit 30.

According to the first embodiment of the present invention described above, the user combines the handwritten characters with other images by causing the multifunction device 1 to read the order sheet 70 in which the handwritten characters are written in the free drawing area 72. The obtained image can be printed on the multifunction device 1. Therefore, it is possible to easily produce a large amount of printed matter on which the composite image obtained in this way is printed. In addition, it is difficult to cleanly overwrite handwritten characters on a photographic image printed on glossy paper due to the nature of paper and ink. It is possible to easily create a print that has been overwritten cleanly.
Further, in the first embodiment, after the composite print instruction is received, the composite template setting and the image selection are executed, so that the processing after step S108 and the processing before step S106 need not be continuous. . That is, completely different processing may be performed between step S106 and step S108, or the power of the multi-function device 1 may be turned off.

(Second embodiment)
FIG. 11 is a functional block diagram of the MFP 1 according to the second embodiment of the present invention.
In step S106 described above, the print control module 62 also prints the image selected by the image selection instruction receiving module 60 on the order sheet based on the order sheet template 113 shown in FIG. A frame 200 defined by the order sheet template 113 shown in FIG. 12 is a frame to which an image 202 indicating a file selected by the image selection instruction receiving module 60 is assigned. The order sheet template 113 may be defined such that a frame indicating the outer edge of the sheet is printed outside the frame 200. By doing so, the user can confirm how the image 126 (see FIG. 7) of the selected file is arranged on the printing paper before printing. Note that the print control module 62 may assign a reduced image generated based on the image 126 of the image file selected by the user to the frame 200. Further, if the selected image file is an image file storing thumbnail data such as an Exif file, the print control module 62 may assign the thumbnail image to the frame 200.

  According to the second embodiment of the present invention described above, the multi-function device 1 orders the image 202 indicating the selected image data and the area frame 110 indicating the free rendering area 72 on one sheet as shown in FIG. Print on the sheet 70. Therefore, the user can record the object 116 such as a handwritten character to be combined with the selected image in the free drawing area 72 while confirming the selected image on the order sheet 70. That is, the user can record the object in the free drawing area 72 while predicting the synthesis result.

(Third embodiment)
The MFP 1 according to the second embodiment of the present invention prints on the order sheet 70 a sample 111 of the synthesis result of the image represented by the selected image file and the image of the object such as handwritten characters (see FIG. 14).
In the third embodiment of the present invention, the composition instruction receiving module 61 corresponds to a composition condition instruction receiving unit. That is, the compositing instruction reception module 61 receives an instruction to select a compositing condition for compositing the image 122 representing the object recorded in the free drawing area 72 and another image 126. The composition conditions are image arrangement, layer vertical relationship, layer transmittance, and the like, specifically, for example, the contents of a composition template. The composition instruction receiving module 61 sets a composition template and an order sheet template according to an instruction for selecting a composition condition.

FIG. 15 is a schematic diagram showing an order sheet template 113 for printing the order sheet 70. FIG. 16 is a schematic diagram for explaining a composite template corresponding to the order sheet template 113 shown in FIG. That is, the order sheet template 113 shown in FIG. 15 and the composite template 120 shown in FIG. 16 are templates read from the ROM 52 in response to an instruction for selecting the same composite condition.
The order sheet template 113 defines a frame 206 to which an image 208 representing a sample of the free drawing area 72 in which handwritten characters are recorded is assigned. A frame 200 to which an image 202 indicating a file selected by the image selection instruction receiving module 60 is allocated, and a frame 206 are defined inside a rectangular frame 204 that represents the outer edge of a print sheet for printing a composite image. The aspect ratio of the rectangular frame 204 matches the aspect ratio of the printing paper for printing the composite image. When the frame 206 to which the image 208 representing the sample of the free drawing area 72 is allocated and the frame 200 to which the image 202 indicating the file selected by the image selection instruction receiving module 60 overlaps, the order sheet Template 113 defines an alpha channel for setting the transmittance of two images.

  A frame 128a defined by the composite template 120 is an area to which another image 126 is allocated. A frame 128b defined by the composite template 120 is an area to which the image 122 of the free drawing area 72 is allocated. The relationship between the relative size and relative position of the frame 131, the frame 128a, and the frame 128b corresponding to the print paper size defined by the composite template 120 is as follows: the rectangular frame 204 defined by the order sheet template 113; 200 is equal to the relationship between the relative size and relative position of the frame 206. That is, if the frames 128a, 128b, and 131 are regarded as one graphic and the frames 204, 200, and 206 are regarded as one graphic, the two graphics are similar to each other. Therefore, the user can predict the synthesis result by the sample 111 (see FIG. 14) printed on the order sheet 70 based on the frames 204, 200, and 206.

FIG. 17 is a flowchart showing an image processing method according to the third embodiment of the present invention.
In step S <b> 101, the multifunction device 1 accepts instructions for different synthesis conditions for synthesizing the image 122 of the object and the other image 126. Specifically, the compositing instruction receiving module 61 displays the menu screen 1100 shown in FIG. 18 on the LCD 14, and then the user selects any compositing condition by operating the cross button 12 and presses the decision button 10. A signal output from the operation unit 42 is accepted as a synthesis condition instruction. The composition instruction receiving module 61 may guide the user to select a composition condition by displaying a sample 111 specifically indicating the composition result on the screen, or may include “upper and lower two columns”, “superposition”, and the like. The user may be guided to selectable synthesis conditions by displaying a character string on the screen.

  In step S102, the composition instruction receiving module 61 reads the order sheet template 113 and the composition template 120 corresponding to the composition condition instruction received in step S101 from the ROM 52 into the RAM 53. By this processing, the free drawing area 72 of the order sheet 70 corresponding to the compositing condition instruction is set, and for the image 122 and the other image 126 of the free drawing area 72, the arrangement according to the compositing condition instruction, the layer vertical relationship, The transmittance of each layer, the print paper size, etc. are set.

  According to the third embodiment of the present invention described above, the order sheet 70 is printed with the sample 111 of the combination result of the image represented by the selected image file and the target object such as handwritten characters. The object can be recorded in the free drawing area 72 while specifically imagining.

(Fourth embodiment)
FIG. 19 is a schematic diagram showing an order sheet 70 printed by the multifunction machine 1 according to the fourth embodiment of the present invention. In the multifunction machine 1 according to the fourth embodiment of the present invention, a plurality of samples 111 are printed on the order sheet 70, and a synthesis condition instruction is received via an identifier 136 attached to each sample 111. The template for printing the order sheet 70 is substantially the same as that of the third embodiment except that there are a plurality of pieces of definition information for printing the sample 111, and the description thereof will be omitted.

FIG. 20 is a flowchart showing an image processing method according to the fourth embodiment of the present invention.
After receiving the composite print instruction in step S108, the multifunction machine 1 executes step S101 and receives the composite condition instruction. Specifically, the composition instruction receiving module 61 displays a menu screen 1110 shown in FIG. 21 on the LCD 14. On the menu screen 1110, one of the identifiers 136 attached to each sample 111 of the order sheet 70 can be selected by pressing the cross button 12 and the determination button 10. The combination instruction receiving module 61 receives any combination condition instruction according to a signal output from the operation unit 42 when the user presses the cross button 12 and the determination button 10.
In step S111, the control unit 50 sets a synthesis template according to the synthesis condition instruction received in step S110. Specifically, the synthesis module 66 reads a synthesis template corresponding to the identifier selected by the user in step S110 from the ROM 52 into the RAM 53.

  According to the fourth embodiment of the present invention described above, a plurality of samples 111 corresponding to the synthesis conditions that can be selected by the user are printed on the order sheet 70. Therefore, the user can specifically recognize selectable synthesis conditions even when the resolution of the LCD 14 is low and the screen size is small.

(Fifth embodiment)
FIG. 1 is a schematic diagram showing an order sheet 70 printed by the multifunction machine 1 according to the fifth embodiment of the present invention. In the multi function device 1 according to the fifth embodiment of the present invention, a plurality of check boxes 88 for selecting a synthesis condition are printed on the order sheet 70, and the handwriting 88m filled with the check boxes 88 is optically recognized to synthesize. Set conditions. In the template for printing the order sheet 70, a check box 88 is arranged immediately below each of the plurality of samples 111 representing the synthesis result. The sample 111 corresponds to the composition condition notation described in the claims. The user can select a synthesis condition corresponding to the sample 111 arranged immediately above the check box 88 by painting one of the check boxes 88. The handwriting 88m in which the check box 88 is filled corresponds to the synthesis condition instruction.

FIG. 22 is a flowchart showing an image processing method according to the fifth embodiment of the present invention.
In step S <b> 111, the control unit 50 sets a composite template corresponding to the filled check box 88. Specifically, the composition module 66 as the composition condition recognizing means determines which check box 88 is filled based on the pre-scanned image, and sets the composition template corresponding to the filled check box 88 to the ROM 52. To RAM 53. As a result, the control unit 50 recognizes the composition condition represented by the sample 111 instructed by the composition condition instruction recorded on the order sheet 70.

  According to the fifth embodiment of the present invention described above, since the user can indicate the composition condition by filling the check box 88 before and after recording the handwritten character or the like in the free drawing area 72, the composition condition is easily set. be able to.

(Sixth embodiment)
FIG. 23 is a schematic diagram showing an order sheet 70 printed by the multifunction machine 1 according to the sixth embodiment of the present invention. In the multi function device 1 according to the sixth embodiment of the present invention, check boxes 91 and 76 for selecting printing conditions are printed on the order sheet 70, and handwriting 91m and 76m in which the check boxes 91 and 76 are filled are optically recognized. To set the printing conditions. The user can select any one of a plurality of types of printing paper by painting any one of the plurality of check boxes 91. Further, the user can select the number of prints by painting any one of the plurality of check boxes 76.
According to the sixth embodiment of the present invention, since the user can instruct the printing condition by filling the check boxes 91 and 76 before and after recording the handwritten character or the like in the free drawing area 72, the printing condition can be easily set. Can do.

(Seventh embodiment)
FIG. 24 is a functional block diagram of the multifunction machine 1 according to the seventh embodiment of the present invention.
The third operation unit 304 includes the operation unit 42, the control unit 50 that executes the compositing instruction reception module, and the like, and selects a layout between an image selected in the image selection area 71 and an image representing the free drawing area 72 described later. A predetermined button operation is accepted.
The first operation unit 300 includes a control unit 50 that executes a synthesis instruction receiving module, an operation unit 42, and the like, and receives a predetermined button operation as an order sheet request.

  The first output unit 310 includes a control unit 50 that executes a print control module, a card read / write unit 41, a printing unit 30, and the like. When an order sheet request is received by the first operation means 300, the first output means 310 reads the image data stored in the removable memory 3 and the template stored in the ROM 52 and prints an order sheet described later.

The second operation unit 302 includes a control unit 50 that executes a combination instruction reception module, an operation unit 42, and the like, and receives a predetermined button operation as a composite image print request.
The order reading unit 306 includes a control unit 50 that executes a reading control module and an image selection instruction recognition module, the imaging unit 20, and the like. When the second operation unit 302 receives a print request for a composite image, the order reading unit 306 receives the order sheet 70. Read, optically recognize a verification mark 81, a reference mark 82, and filled check boxes 74m, 76m, 79m, 86m, and 87m, which will be described later, and output an image of the free drawing area 72. The image selection instruction recognition module as an image selection instruction recognition unit is a component of an image processing program that recognizes an image file selected by the user based on an image obtained by reading the check box 74.

  The second output unit 308 includes a control unit 50 that executes a synthesis module, a printing unit 30, and the like, and prints a composite image of the image selected in the image selection area 71 and the image representing the free drawing area 72. In the preview described later, the second output unit 308 displays the composite image on the LCD 14 without printing.

  FIG. 25 is a schematic diagram showing an example of an order sheet 70 printed by the multifunction machine 1 in a state where the removable memory 3 having the directory structure shown in FIG. 26 is connected. The layout of the order sheet 70 is defined by an order sheet template stored in the ROM 52. FIG. 29 is a schematic diagram showing an example of an order sheet 70 in which necessary items are entered by the user. The arrangement of each element written on the order sheet 70 is set with reference to the reference mark 82.

The reference mark 82 is laid out in the upper left corner of the order sheet 70. When the order reading unit 306 recognizes the position of the reference mark 82, the position of each element written on the order sheet 70 can be relatively recognized.
In the image selection area 71, image files (for example, tree.jpg, face.jpg, flower.jpg, sea.jpg, maple.jpg, sunrise.jpg, mountain.jpg) stored in the DCIM folder 90 of the removable memory 3 are displayed. jpg, person.jpg) are laid out and thumbnail images 73 and check boxes 74 are laid out. By painting the check box 74, the main image of the image file corresponding to the thumbnail image 73m (for example, the sunrise.jpg thumbnail image) laid out immediately above the check box 74m can be selected as a compositing target. The thumbnail image 73 corresponds to the image notation described in the claims. The handwriting that fills the check box 74m corresponds to the image selection instruction described in the claims. Note that the image file stored in the DCIM folder 90 of the removable memory 3 may be expressed as a main image or may be expressed by printing a file name or an internal identifier.

  The free drawing area 72 is a blank area for drawing a handwritten character (for example, “Kagasho”) or pasting a magazine cutout, and is surrounded by a rectangular frame. Characters and figures handwritten in the free drawing area 72, printed matter pasted in the free drawing area 72, and characters and figures printed in the free drawing area correspond to the objects described in the claims.

  In the area 75 for selecting the number of printed sheets, a check box 76 corresponding to each digit of the number of printed sheets from 0 to 99 and a check box 84 for selecting a preview are laid out. The tens digit of the number of printed sheets is selected by filling the check box 76 laid out in the left column, and the first digit of the number of printed sheets is filled in by filling the check box 76 laid out in the right column. Can be selected.

  In the layout selection area 77, an image 78 and a check box 79 schematically showing the layout are laid out. By filling the check box 79, a layout corresponding to the image 78m laid out immediately above the check box 79m can be selected. The handwriting (79m) in which the check box 79 is filled corresponds to the composition condition instruction described in the claims.

  A check box 86 and a check box 87 are displayed in the superimposition synthesis condition selection area 85. By filling the check box 86, it is possible to select a boundary processing condition as to whether or not to perform white bordering when a handwritten character is superimposed and synthesized on the image selected in the image selection area 71. Further, by filling the check box 87, the transparency (for example, 0%) of the layer representing the handwritten character can be selected. Note that the width of the white border may be set as the boundary processing condition, or another transparency may be selected as the superposition synthesis condition.

FIG. 27 is a flowchart showing a process of printing a composite image by the multifunction machine 1 according to the seventh embodiment of the present invention. FIG. 28 is a schematic diagram showing screen transition of the LCD 14.
When the removable memory 3 is connected to the multifunction device 1 and the user selects “print order sheet” with the cross button 12 and presses the enter button 10 on the menu screen 100, the template of the order sheet 70 is selected on the LCD 14. A screen 102 is displayed. When the user selects a template (for example, a New Year's card) with the cross button 12 on the screen 102 and presses the enter button 10, the first operation unit 300 receives a print request for the order sheet 70. When the first operation means 300 accepts the print request for the order sheet 70, the process proceeds to step S12 (step S10).

In step S <b> 12, the screen 104 indicating that the order sheet 70 is being printed is displayed on the LCD 14, and the first output unit 310 prints the order sheet 70.
In step S14, the user fills the check boxes 74, 76, 79, 86, and 87 of the printed order sheet 70 according to the image processing conditions to be set, and draws handwritten characters in the free drawing area 72 (FIG. 29).

  Next, when the user places the order sheet 70 at a predetermined position on the document table (not shown), selects “print composite image” with the cross button 12 on the menu screen 100 and presses the enter button 10, the second operation means 302 accepts a composite image print request. When the second operation means 302 receives the composite image print request, the process proceeds to step S18 (step S16).

In step S18, a screen 106 indicating that the composite image is being printed is displayed on the LCD 14, and the second output means 308 prints the composite image. When printing of the composite image is completed, the menu screen 100 is displayed on the LCD 14.
FIG. 30 is a flowchart showing details of the process of printing the order sheet 70 (step S12).

  When the print request for the order sheet 70 is received by the first operation unit 300, the first output unit 310 gives an identifier to the image file stored in the DCIM folder 90 of the removable memory 3 (step S200). At this time, a serial number as an identifier is assigned to each image file in the ASCII code order of the file name of the image file.

Next, a checksum is set (step S201). The checksum is calculated according to the content of data stored in the DCIM folder 90 of the removable memory 3 and stored in a predetermined area of the RAM 53.
Next, the template selected in step S10 is read from the ROM 52 into the RAM 53 (step S202), and the first output means 310 assigns the thumbnail image of the image file and the verification mark 81 to the layout frame defined by the template and orders them. The sheet 70 is printed (step S203).

FIG. 31 is a flowchart showing details of the process (step S18) for printing a composite image.
In step S300, the order reading unit 306 reads the order sheet 70 as a low-resolution monochrome binary image, and the positions of the verification mark 81 and the check boxes 74, 76, 79, 86, 87 on the image based on the reference mark 82. Then, the verification mark 81 and the processing conditions selected by the filled check boxes (see FIG. 1) 74m, 76m, 79m, 86m, and 87m are optically recognized.

  In step S302, the checksum corresponding to the verification mark 81 recognized in step S300 is compared with the checksum set in step S201, and the image file written in the order sheet 70 is stored in the removable memory 3. It is determined whether the image files match. If they match, the process proceeds to step S304. If they do not match, a screen is displayed on the LCD 14 that warns that the image file written in the order sheet 70 is different from the image file stored in the removable memory 3 (step 14). S306).

In step S304, it is determined whether or not two or more image files are selected in the image selection area 71. If only one image file has been selected, the process proceeds to step S308. If two or more image files have been selected, a screen for warning that effect is displayed on the LCD 14 (step S310).
Next, the range of the free drawing area 72 is recognized based on the reference mark 82 recognized in step S300 (step S308). By specifying the range of the free drawing area 72 on the image using the reference mark 82, the position of the free drawing area 72 can be accurately determined even when the order sheet 70 is not placed at a predetermined position on the document table. Can be specified.

Next, the order reading unit 306 reads the free drawing area 72 and the margin area 83 (see FIG. 25) in the vicinity thereof with high resolution (step S312).
Next, a region of an object such as a handwritten character is extracted from the image representing the free drawing region 72 (step S314). If the image representing the free drawing area 72 is directly combined with the image selected in the image selection area 71 without performing step S314, the image representing the entire area including the margin of the free drawing area 72 is selected in the image selection area 71. An image (see FIG. 13A) synthesized with the selected image can be created.

In step S316, the object such as the handwritten character in the area extracted in step S314 and the image to be combined selected in the image selection area 71 are combined according to the layout selected in the layout selection area 77.
Next, the second output unit 308 repeats printing of the composite image until the composite image is printed by the number of prints selected in the area 75 for selecting the number of prints (steps S318 and 320).

FIG. 32 is a flowchart showing details of processing (step S314) for extracting a handwritten character region from an image representing the free drawing region 72 and superimposing the extracted region on the image selected in the image selection region 71. is there.
In step S400, a threshold value for separating the blank area 83 where the ground color of the order sheet 70 appears and the handwritten character is determined. Specifically, first, a luminance histogram of the margin area 83 is created. In this luminance histogram, as shown in FIG. 33, the distribution is concentrated on the luminance values corresponding to the ground color of the order sheet 70. Therefore, next, a threshold value for extracting the object region from the image representing the free drawing region 72 is set in the vicinity of the range where the distribution is concentrated. Thereby, it is possible to set an appropriate value according to the ground color of the printing paper used for the order sheet 70.

  In step S402, based on the specified threshold value, an area of handwritten characters is extracted from the image representing the free drawing area 72, and the alpha channel value of the area is selected by the check box 87 of the superposition synthesis condition selection area 85. And set the alpha channel value for all other areas to be completely transparent. The alpha channel is a channel that represents the transparency of the layer of the image for each pixel.

  In step S403, noise included in the region extracted as handwritten characters is removed. Specifically, the transparency of the island-shaped region composed of a predetermined number or less of the extracted regions is set to be completely transparent. Here, FIG. 34 (b) is a schematic diagram showing the superimposition synthesis process when the transparency of the area corresponding to noise in the alpha channel is not changed, that is, when noise removal is not performed. FIG. 10 is a schematic diagram showing a superposition and synthesis process when the transparency of a region corresponding to noise in the alpha channel is made completely transparent, that is, when noise is removed.

  Next, if white bordering is selected as the superposition synthesis condition, the opaque region of the alpha channel is expanded (step S404). As a result, in step S316, the ground color of the order sheet 70 around the handwritten character is superimposed and synthesized on the image selected in the image selection area 71, so that the handwritten character is trimmed to form a synthesized image. (See FIG. 34 (d)). The processing in step S314 has been described in detail above.

  According to the multifunction device 1 according to the seventh embodiment of the present invention described above, the user can easily recognize the image processing conditions such as accessible image data, selectable layout, number of prints, and boundary processing conditions. . Further, the user can easily select an image to be combined from accessible image data, select an image processing condition, and input a handwritten message to be combined with the image to be combined. Therefore, even if the hardware providing the HMI is a simple system, the user can easily display a desired image and a handwritten message on the system.

Further, since the order sheet 70 has the reference mark 82, the position of the free drawing area 72 in which a handwritten message or the like is written can be relatively recognized on the image representing the order sheet 70. The region 72 can be recognized accurately.
Furthermore, since superimposition and synthesis can be selected as the image processing condition, for example, a printed matter with a design in which a message is handwritten directly on a photograph can be created.

Furthermore, since the blank area 83 is read to recognize the ground color of the order sheet 70, the handwritten character area can be accurately extracted from the image representing the free drawing area 72.
Furthermore, by reading the order sheet 70 at a low resolution and reading the free drawing area 72 and the margin area 83 in the vicinity thereof at a high resolution, the reading time of the order sheet 70 can be shortened without degrading the image quality of the composite image. it can.
Further, the image processing system of the present invention may be configured by a single printer including a paper position detection optical sensor provided in the paper transport path. That is, a check box filled with an order sheet may be recognized by such a paper position detection optical sensor.

Further, instead of laying out the thumbnail image 73 in the image selection area 71, an identifier or a file name may be laid out. In this case, it is desirable that the thumbnail image 73 and an identifier corresponding to the thumbnail image 73 can be displayed on the LCD 14.
(Eighth Example)
The multi-function device 1 according to the eighth embodiment uses an order sheet 70 that can select two image files in the image selection area 71.

FIG. 35 is a schematic diagram showing screen transitions according to the eighth embodiment of the present invention.
When the menu screen 100 is displayed and the user selects “print order sheet” with the cross button 12 and presses the enter button 10, a screen 2021 for selecting a layout is displayed on the LCD 14. On the screen 2021, an icon 203 schematically representing the layout is displayed. When the user selects any one icon with the cross button 12 and presses the enter button 10 in a state where the screen 2021 is displayed, the layout indicated by the icon is selected, and the layout in which the first operation unit 300 is selected. A print request for the order sheet 70 corresponding to the request is accepted (step S10).

FIG. 36 is a schematic diagram showing an example of an order sheet 70 according to the eighth embodiment of the present invention.
In the image selection area 71, check boxes 74a and 74b are printed for each thumbnail image 73. The user can select two image files by painting any one of the check boxes 74a and painting any one of the check boxes 74b.

In the free drawing area 72, a rectangular frame indicating areas 89a and 89b in which an image represented by the image file selected in the image selection area 71 is laid out is written. The user can draw handwritten characters in the free drawing area 72 outside the areas 89a and 89b.
In the image processing system according to the eighth embodiment of the present invention described above, since the order sheet 70 according to the layout selected by the user is output, when the user describes a handwritten message or the like in the free drawing area 72, The result of the synthesis with the image to be synthesized can be easily imaged. Further, two images to be combined can be selected simply by painting the check boxes 74a and 74b of the order sheet 70.

(Ninth Example)
An order sheet receiving terminal as a ninth embodiment of the image processing system of the present invention is an apparatus that reads an order sheet and receives a print order.

FIG. 37 is a schematic diagram showing a printing system using an order sheet receiving terminal according to the ninth embodiment of the present invention. The printing system 6 includes an order sheet reception terminal 4, a printer 212 connected to the order sheet reception terminal 4, a PC 210, and a printer 211 connected to the PC 210.
The order sheet reception terminal 4 is installed, for example, in a store that provides a digital image print service, a convenience store, or the like. The order sheet reception terminal 4 includes an input unit 213, an operation unit 214, an order reading unit 306, and an output unit 215. The operation means 214 has substantially the same function as the second operation means of the seventh embodiment. The output means 215 has substantially the same function as the second output means of the seventh embodiment. The input unit 213 is an interface for inputting data stored in the removable memory 3.

  The order sheet accepting terminal 4 accepts a predetermined button operation by the user as a request for reading the order sheet 70 by the operating means 214, and outputs the composite image to a display device (not shown) provided in the order sheet accepting terminal 4 by the output means 215. Display a preview of the print result. The composite image is generated based on the image input from the removable memory 3 by the input unit 213 and printed by the printer 212 connected to the order sheet receiving terminal 4.

In the image processing system according to the ninth embodiment of the present invention described above, the user can easily print a high-quality composite image in which handwritten characters and the like are laid out even if the user does not have a printer capable of high-quality printing. Available.
(Tenth embodiment)
In the image processing system according to the tenth embodiment, the setting of the number of prints is accepted by a key operation.

FIG. 38 is a schematic diagram showing screen transition of the LCD 14 in the tenth embodiment of the present invention, and FIG. 39 is a flowchart showing processing for printing a composite image in the image processing system in the tenth embodiment of the present invention.
In step S330 of the process of printing the composite image, the multifunction device 1 determines that the request is a preview request when it recognizes that the check box 84 for selecting the preview of the order sheet 70 is filled, and proceeds to step S332 to determine that it is not a preview request. Then, it progresses to step S318. In step S <b> 332, the multifunction device 1 displays the test mode screen 220 on the LCD 14. On the test mode screen 220, a composite image 228 of the image represented by the handwritten character described in the free drawing area 72 and the image file selected in the image selection area 71 is displayed. In addition, a “print” button 222 and a number setting box 224 are displayed on the test mode screen 220. On the test mode screen 220, the desired number of prints can be set in the number setting box 224 by operating the cross button 12 up and down. When the cross button 12 is operated left and right, the “print” button 222 or the “return” button 226 is selected. When the enter button 10 is pressed while the “print” button 222 is selected, a print request for the set number of prints is accepted, and the process proceeds to step S318 (step S334). In steps S318 and S320, the second output unit 308 repeats printing of the composite image until the composite image is printed for the set number of prints.

In step S332, the composite image 228 is displayed on the test mode screen 220. However, the composite image 228 may be printed and displayed by the second output unit.
In the image processing system according to the tenth embodiment of the present invention described above, when the user sets the desired number of prints after displaying the composite image on the screen or printing in response to the preview request set in the order sheet 70, There is no need to read the order sheet again just to set the number of prints. That is, when setting a desired number of printed sheets, the user does not need to read an order sheet that takes a long time, and the number of printed sheets can be set by a simple button operation, so the work time can be shortened.

(Eleventh Example)
In the image processing system according to the eleventh embodiment, the image of the free drawing area 72 obtained when the order sheet 70 is read at a low resolution and the thumbnail image of the image file selected in the image selection area 71 are combined and displayed on the screen. Thereafter, when a user's print request is received, the image of the free drawing area 72 obtained when the order sheet 70 is read at high resolution and the main image of the image file selected in the image selection area 71 are combined and printed.

FIG. 40 is a schematic diagram showing screen transition of the LCD 14 in the eleventh embodiment of the present invention, and FIG. 41 is a flowchart showing processing for printing a composite image by the image processing system in the eleventh embodiment of the present invention. .
In step S340, the multi function device 1 uses the image of the free drawing area 72 read at low resolution in step S300 and the thumbnail image of the image file selected in the image selection area 71 as the image processing conditions set in the order sheet 70. The synthesized image 238 synthesized based on the result is displayed on the test mode screen 230 of the LCD 14. When the “print” switch 232 displayed on the test mode screen 230 is selected by operating the cross button 12 and the enter button 10 is pressed, a print request is accepted (step S342), and the process proceeds to step S312. In steps S312, S314, S316, S318, and S320, as described in the seventh embodiment, the free drawing area 72 is read with high resolution, and the main image and the free drawing area of the image file selected in the image selection area 71 are read. 72 high-resolution images are combined, and the set number of sheets are printed. The test mode screen 230 also includes a “return” switch 236. When the user selects the “return” switch 236 using the cross button 12 and presses the enter button 10, printing is not performed (step S342), and the menu screen 1000 is displayed. indicate.

  In the image processing system according to the eleventh embodiment of the present invention described above, the image of the free drawing area 72 and the thumbnail image of the image file selected in the image selection area 71 obtained when the order sheet 70 is read at a low resolution. Are combined based on the image processing conditions set in the order sheet 70 and displayed on the test mode screen 230. For this reason, the user can make a print request after confirming an approximate print result. Therefore, the image processing system according to the eleventh embodiment of the present invention can save printing paper and ink consumed in test printing. Further, in the image processing system according to the eleventh embodiment of the present invention, the composite image 238 on the test mode screen 230 is displayed based on the low resolution read image and the thumbnail image. It can be shortened.

(Twelfth embodiment)
In the image processing system according to the twelfth embodiment, it is possible to select an image to be combined in the order sheet 70, set the layout, the number of printed sheets, and the boundary processing conditions as image processing conditions. After reading 70, a handwritten message or the like is separately read and combined with the selected image.

FIG. 42 is a schematic diagram showing an order sheet 70 according to the twelfth embodiment of the present invention. The order sheet 70 includes an image selection area 71, an area 75 for selecting the number of copies, a layout selection area 77, and a superimposition / combination condition selection area 85.
FIG. 43 is a schematic diagram showing screen transition of the LCD 14 according to the twelfth embodiment of the present invention, and FIG. 44 is a flowchart showing processing for printing a composite image by the image processing system according to the twelfth embodiment of the present invention. FIG. 45 is a schematic diagram showing the user document 260.

  When the user places the order sheet 70 on a document table (not shown), selects “print composite image” with the cross button 12 and presses the enter button 10 on the menu screen 1000, the second operation unit 302 A print request for the composite image is received, and processing for printing the composite image is started. In step S300 of the process of printing the composite image, the multifunction device 1 reads the order sheet 70 as a low-resolution monochrome binary image, recognizes the image to be combined and the image processing conditions, and performs various processes in steps S302 and S304. When the error is checked, a document set standby screen 240 is displayed on the LCD 14. Next, when the user places the user document 260 on a document table (not shown) and presses the enter button 10, it is determined that the setting of the user document 260 is completed (step S350), and the process proceeds to step S352. Here, the rectangular user document 260 may be a rectangular document placed at a predetermined position on the document table, or a document of an arbitrary shape placed at an arbitrary position on the document table. Next, the multifunction device 1 displays a screen 242 indicating that a composite image is being printed on the LCD 14. In addition, the multi function device 1 reads an image of the entire document table as a low-resolution monochrome binary image, and specifies a composition target area of the document table from the read image (step S352). At this time, the entire user document 260 may be the synthesis target area, or an area excluding the area corresponding to the mount of the user original 260 may be the synthesis target area. Thereafter, the process of reading the synthesis target area as a target area such as a handwritten character with high resolution, generating a synthesized image, and printing is the same as in the first embodiment.

  In the image processing system according to the twelfth embodiment of the present invention described above, the objects to be synthesized can be diversified.

In the plurality of embodiments described above, an example in which the result of combining the image of the free drawing area 72 and the image selected in the image selection area 71 has been described has been described. Data representing an image obtained by combining the images selected in the image selection area 71 may be simply output to a removable memory, a communication line, or the like.
In addition, the image processing system of the present invention may be configured by a PC, a printer connected to the PC, and an image scanner, instead of the MFP 1 alone. In this case, an interface such as a USB (Universal Serial Bus) interface for connecting the PC and the image scanner, a USB interface for connecting the PC and the printer, and the like are described in the claims “Printer and Imager”. Corresponds to “the interface to which is connected”.

The schematic diagram which shows the order sheet | seat which concerns on 5th Example of this invention. 1 is a front view of a multifunction machine according to a first embodiment of the present invention. 1 is a block diagram of a multifunction machine according to a first embodiment of the present invention. 1 is a functional block diagram of a multifunction machine according to a first embodiment of the present invention. The schematic diagram which shows the order sheet template which concerns on the 1st Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on the 1st Example of this invention. (A) is a schematic diagram which shows the synthetic | combination template concerning the 1st Example of this invention. (B) is a schematic diagram showing a synthesis result. The flowchart which concerns on the 1st Example of this invention. The schematic diagram which shows the screen transition which concerns on 1st Example of this invention. The flowchart which concerns on the 1st Example of this invention. The functional block diagram which concerns on the 2nd Example of this invention. The schematic diagram which shows the order sheet template which concerns on the 2nd Example of this invention. The schematic diagram which shows the order sheet which concerns on 2nd Example of this invention. The schematic diagram which shows the order sheet which concerns on 3rd Example of this invention. The schematic diagram which shows the order sheet template which concerns on 3rd Example of this invention. The schematic diagram which shows the synthetic | combination template concerning the 3rd Example of this invention. The flowchart which concerns on 3rd Example of this invention. The schematic diagram which shows the screen transition which concerns on 3rd Example of this invention. The schematic diagram which shows the order sheet which concerns on 4th Example of this invention. It is a flowchart which concerns on 4th Example of this invention. The schematic diagram which shows the screen transition which concerns on 4th Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on 5th Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on 6th Example of this invention. It is a functional block diagram concerning a 7th example of the present invention. It is a schematic diagram which shows the order sheet which concerns on 7th Example of this invention. It is a schematic diagram which shows the directory structure based on 7th Example of this invention. It is a flowchart which concerns on 7th Example of this invention. It is a schematic diagram which shows the screen transition based on 7th Example of this invention. It is a schematic diagram which shows the order sheet which concerns on 7th Example of this invention. It is a flowchart which concerns on 7th Example of this invention. It is a flowchart which concerns on 7th Example of this invention. It is a flowchart which concerns on 7th Example of this invention. It is a schematic diagram which shows the density histogram which concerns on 7th Example of this invention. It is a schematic diagram which shows the superimposition synthesis process which concerns on 7th Example of this invention. It is a schematic diagram which shows the screen transition which concerns on 8th Example of this invention. It is a schematic diagram which shows the order sheet which concerns on 8th Example of this invention. It is a schematic diagram which shows the image processing system by 9th Example of this invention. It is a schematic diagram which shows the screen transition which concerns on 10th Example of this invention. It is a flowchart which concerns on 10th Example of this invention. It is a schematic diagram which shows the screen transition based on the 11th Example of this invention. It is a flowchart which concerns on 11th Example of this invention. It is a schematic diagram which shows the order sheet | seat which concerns on 12th Example of this invention. It is a schematic diagram which shows the screen transition based on 12th Example of this invention. It is a flowchart which concerns on 12th Example of this invention. It is a schematic diagram which shows the user original document based on 12th Example of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Multifunction device, 20 Image pick-up part, 30 Printing part, 50 Control part, 60 Image selection instruction | indication reception module (Image selection instruction | indication reception means), 61 Synthesis | combination instruction | indication reception module (Combination instruction | indication reception means, synthetic | combination condition instruction | indication reception means), 62 printing Control module (printing control means), 64 reading control module (reading control means), 66 composition module (composition means, composition condition recognition means, region extraction means), 70 order sheet, 81 verification mark (identification notation), 82, 107 Reference mark, 85 superimposition composition condition selection area, 88m handwriting (composition condition instruction), 100 order sheet template, 110 area frame (area notation), 111 sample (composition condition notation), 116 object,

Claims (18)

Print control means for printing on the printing unit the area notation indicating the free drawing area on the paper and the identification notation on one sheet;
Reading control means for causing the imaging unit to read the paper on which the object is recorded in the free drawing area;
Based on the image of the identification notation read by the imaging unit, a synthesis unit that synthesizes the image of the free drawing area read by the imaging unit and another image;
An image processing system comprising: The print control means causes the printing unit to print a plurality of synthesis condition notations representing different synthesis conditions for synthesizing the image of the free drawing area and the other image,
A synthesis condition recognizing unit for recognizing the synthesis condition represented by the synthesis condition notation instructed in the synthesis condition instruction recorded on the paper based on an image read by the imaging unit;
The synthesizing unit synthesizes the image of the free drawing area read by the imaging unit and another image in accordance with the synthesis condition represented by the synthesis condition notation designated in the synthesis condition instruction. The image processing system according to claim 1.   The reading control unit causes the imaging unit to read the identification notation at a first resolution, and causes the imaging unit to read the free rendering area at a second resolution higher than the first resolution. Or the image processing system of 2. Further comprising synthesis condition instruction accepting means for accepting an instruction of a synthesis condition for synthesizing the image of the object and the other image;
The print control unit causes the printing unit to print the area notation indicating the free drawing area in a mode according to the instructed synthesis condition;
The image processing system according to claim 1, wherein the synthesizing unit synthesizes the image of the object and the other image according to the instructed synthesis condition.   The image processing system according to claim 2, wherein the synthesis condition includes setting of a superposition synthesis condition.   The image processing system according to claim 5, wherein the superposition and synthesis condition includes a boundary processing condition between two images to be superposed and synthesized.   The image processing system according to claim 5, wherein the superposition and synthesis condition includes transparency of two images to be superposed and synthesized. An image selection instruction receiving unit that receives an instruction to select any of the accessible image data;
The image processing system according to claim 1, wherein the other image is an image represented by the selected image data. The print control unit causes the printing unit to print an image notation representing accessible image data on the paper,
Image selection instruction recognition means for recognizing the image data represented by the image notation instructed by the image selection instruction recorded on the paper based on the image read by the imaging unit;
The image processing system according to claim 1, wherein the other image is an image represented by image data represented by the image notation designated in the image selection instruction. The image selection instruction recognition means recognizes the plurality of image data represented by the plurality of image notations instructed by the image selection instruction;
The image processing system according to claim 9, wherein the synthesizing unit synthesizes the image of the object and the plurality of other images.   The image processing system according to claim 9, wherein the reading control unit causes the imaging unit to read the image selection instruction at a resolution lower than that of the free drawing area. The printing control unit causes the printing unit to print a reference mark on the paper;
The image processing system according to claim 1, wherein the reading control unit recognizes the free drawing area based on the reference mark. An area extracting means for extracting the area of the object recorded in the free drawing area from the image of the free drawing area read by the imaging unit;
The image processing system according to claim 1, wherein the image of the free drawing area is an image of the area of the object.   The area extraction unit recognizes the background color of the paper based on an image of a blank area outside the free drawing area read by the imaging unit, and recognizes the area of the object based on the ground color of the paper. The image processing system according to claim 13.   The image processing system according to claim 1, further comprising the printing unit and the imaging unit.   The image processing system according to claim 1, further comprising an interface for connecting the printing unit and the imaging unit. An image processing method by a computer that controls a printing unit and an imaging unit,
Printing the area notation indicating the free drawing area on the paper and the identification notation on a sheet of paper on the printing unit;
Causing the imaging unit to read the paper on which an object is recorded in the free drawing area;
Based on the image of the identification notation read by the imaging unit, combining the image of the free drawing area read by the imaging unit with another image;
An image processing method comprising: A computer that controls the printing unit and the imaging unit,
Print control means for causing the printing section to print an area notation indicating a free drawing area on the paper and an identification notation on a sheet of paper;
Reading control means for causing the imaging unit to read the paper on which the object is recorded in the free drawing area;
Based on the image of the identification notation read by the imaging unit, a synthesis unit that synthesizes the image of the free drawing area read by the imaging unit and another image;
An image processing program characterized by being made to function.

Images