JP2006094466A - Image processing system and image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing system and an image processing method capable of composing and displaying an image such as a hand-written message with other image. <P>SOLUTION: The image processing system comprises: a first receiving unit that receives an order-sheet request; a print control unit that causes a printer portion to print an area notation indicating a free rendering area on paper in accordance with the order-sheet request; a second receiving unit that receives a scan request; a read control unit that causes an image pickup portion to read the paper on which a subject is recorded in the free rendering area in accordance with the scan request; and a composition unit that composites an image of the free rendering area read by the image pickup portion in accordance with the scan request and the other image or images. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing system and an image processing method.

  2. Description of the Related Art Conventionally, a printing system that reads and prints image data stored in a removable memory or the like without connecting to a personal computer (PC) or the like is known. In such a printing system, if an attempt is made to accept setting operations such as selection of image data to be printed, the number of copies to be printed, and a layout from a menu displayed on a small screen, there is a problem that the menu hierarchy becomes deep and the operation becomes complicated. is there. On the other hand, if the menu is displayed on a large screen, there is a problem that the manufacturing cost increases.

Patent Document 1 prints a mark sheet on which a list of thumbnail images of image files stored in a removable memory or the like and selectable printing conditions are printed, and optically recognizes the mark written on the mark sheet. Discloses an image processing system that accepts various print condition setting operations.
However, when trying to create a greeting card or the like with the image processing system disclosed in Patent Document 1, the following problems arise. In general, a greeting card is filled with not only an image recorded by a digital camera or the like but also a message of the sender. However, it is troublesome to repeatedly hand-write the same message for each card on which only an image is printed by the image processing system disclosed in Patent Document 1.

JP 2002-51283 A JP 2003-80789 A

  The present invention has been created in view of the above problems, and an object thereof is to provide an image processing system and an image processing method capable of combining and displaying an image such as a handwritten message on another image.

(1) An image processing system for achieving the above object includes a first receiving unit that receives an order sheet request, and print control that causes a printing unit to print an area notation indicating a free drawing area in response to the order sheet request on a sheet. Means, a second receiving means for receiving a scan request, a reading control means for causing the imaging unit to read the paper on which an object is recorded in the free drawing area in response to the scan request, and the response in response to the scan request Synthesis means for synthesizing the image of the free drawing area read by the imaging unit with another image.
According to the present invention, by printing the region notation, it is possible to allow the user to recognize a free drawing region that is a region where an object such as a handwritten character is to be recorded and that can be specified at the time of reading. According to the present invention, the image of the free drawing area is read in response to the scan request, and the image of the free drawing area and another image are combined. That is, according to the present invention, by causing the user to record an object such as a handwritten character in a predetermined free drawing area, an image of the object such as a handwritten character recorded in the free drawing area and another image are obtained. Enables composite display.

(2) The image processing system may further include an image selection instruction receiving unit that receives support for selecting any one or more of accessible images. The other image may be the selected image.
According to the present invention, a user selects arbitrary image data stored in advance in an accessible area by using, for example, an operation panel, thereby displaying an image obtained by combining an image represented by the selected image data with a handwritten message or the like. be able to.

(3) The print control unit may cause the printing unit to print an image notation representing an accessible image on the paper. The image processing system further includes image selection instruction recognition means for recognizing the image represented by the image notation instructed by the image selection instruction recorded on the paper based on the image read by the imaging unit. Also good. The other image may be an image represented by the image notation instructed by the image selection instruction.
According to the present invention, the user can designate image data to be synthesized by recording on the paper an image selection instruction that designates arbitrary image data stored in advance in an accessible area. Therefore, according to the present invention, the operation using the operation panel or the like can be simplified.

(4) The image selection instruction recognizing unit recognizes the images represented by the plurality of image notations instructed by the image selection instruction, and the synthesizing unit includes the image of the object, the plurality of other images, and the like. May be synthesized.
According to the present invention, the user can select two or more images to be combined with a handwritten message or the like.

(5) The reading control unit may cause the imaging unit to read the image selection instruction at a resolution lower than that of the free drawing area.
According to the present invention, it is possible to reduce the amount of processing for obtaining a composite image without causing quality degradation of the composite image.

(6) The printing control unit may cause the printing unit to print a plurality of synthesis condition notations representing different synthesis conditions for synthesizing the image of the free drawing area and the other image. . The image processing system further includes synthesis condition recognition means for recognizing the synthesis condition represented by the synthesis condition notation designated in the synthesis condition instruction printed on the paper based on an image read by the imaging unit. Also good. The synthesizing unit may synthesize the image of the free drawing area read by the imaging unit and the other image according to the synthesis condition represented by the synthesis condition notation instructed by the synthesis condition instruction. .
According to the present invention, since the user can set the synthesis condition by recording the synthesis condition instruction on the paper together with the handwritten message or the like, the user's operation on the operation panel or the like necessary for the synthesis display is simplified. Note that the composition condition specifically includes, for example, the arrangement, size, and shape of a region into which each image is inserted, the transmittance of a layer into which each image is inserted, and the like.

(7) The reading control unit may cause the imaging unit to read the combination condition instruction at a first resolution, and cause the imaging unit to read the free rendering area at a second resolution higher than the first resolution.
According to the present invention, it is possible to reduce the amount of processing for obtaining a composite image without causing quality degradation of the composite image.

(8) The image processing apparatus further includes a combination condition instruction receiving unit that receives a combination condition instruction for combining the image of the object and the other image, and the print control unit is configured in accordance with the instructed combination condition. The area notation indicating the free drawing area may be printed on the paper on the printing unit. The synthesizing unit may synthesize the image of the object and the other image according to the instructed synthesis condition.
According to the present invention, an instruction for a composition condition is accepted before an area notation is printed, an area notation indicating a free drawing area in a mode corresponding to the instruction is printed, and an image recorded in the free drawing area is synthesized. Therefore, the user can record an object such as a handwritten character in a free drawing area in a desired form and synthesize it with another image.

(9) The synthesis condition may include a superposition synthesis condition.
(10) The superposition and synthesis condition may include a boundary processing condition for two images to be superposed and synthesized.
(11) The superposition synthesis condition may include transparency of two images to be superposed and synthesized.

(12) The printing control unit may cause the printing unit to print a reference mark on the paper. The reading control means may recognize the free drawing area based on the reference mark.
According to the present invention, since the position of the free drawing area is relatively recognized based on the reference mark printed on the paper, the image recorded in the free drawing area and another image can be accurately synthesized. .

(13) The image processing system may further include an area extracting unit that extracts an area of the object recorded in the free drawing area from an image of the free drawing area read by the imaging unit. The image of the free drawing area may be an image of the object area.
According to the present invention, for example, it is possible to display a composite image of a design in which a message is handwritten directly on a photograph.

(14) The image processing system may further include an area extracting unit that extracts an area of the object recorded in the free drawing area from an image of the free drawing area read by the imaging unit. The print control unit causes the printing unit to print the image selected by the image selection instruction accepting unit on the free drawing area so as to be thin enough for the area extraction unit to extract the area of the object. Also good. The image of the free drawing area may be an image of the object area.
According to the present invention, when recording a handwritten character or the like to be combined with another image in the free drawing area, the other image to be combined is printed thinly in the free drawing area. It is possible to record an object such as a handwritten character in the free-drawing area while accurately grasping.

(15) The area extraction unit recognizes the ground color of the paper based on an image of a blank area outside the free drawing area read by the imaging unit, and determines the object color based on the ground color of the paper. The area may be recognized.
According to the present invention, since the area of the object is recognized based on the background color of the paper existing in the blank area outside the free drawing area, the area of the object such as a handwritten character is accurately extracted from the image of the free drawing area. Is done.

(16) The image processing system may further include the printing unit and the imaging unit.
(17) The image processing system may further include an interface for connecting the printing unit and the imaging unit.

(18) An image processing method for achieving the above object includes: a first receiving stage for receiving an order sheet request; and print control for causing a printing unit to print an area notation indicating a free drawing area in response to the order sheet request. A second receiving step for receiving a scan request, a reading control step for causing the imaging unit to read the paper on which an object is recorded in the free drawing area in response to the scan request, and the response in response to the scan request And a synthesis step of synthesizing the image of the free drawing area read by the imaging unit with another image.

The functions of the plurality of means provided in the present invention are realized by hardware resources whose functions are specified by the configuration itself, hardware resources whose functions are specified by a program, or a combination thereof. The functions of the plurality of means are not limited to those realized by hardware resources that are physically independent of each other.
In addition, the present invention can be specified not only as an apparatus invention, but also as a program invention and a recording medium recording the program.

Hereinafter, embodiments of the present invention will be described based on a plurality of examples. Constituent elements and processes corresponding to each embodiment are denoted by the same reference numerals, and redundant description of corresponding constituent elements and processes in each embodiment is omitted.
(First Example)
FIG. 2 is a front view showing an external appearance of the multifunction machine 1 as the first embodiment of the image processing system of the present invention. FIG. 3 is a block diagram showing the multifunction machine 1 according to the first embodiment of the present invention. The multifunction device 1 has a function of outputting image data read from a document to a personal computer (PC) (not shown), a function of copying a document, a function of printing data output from a PC, and a removable memory 3 And a function of printing image data.

The imaging unit 20 of the multifunction machine 1 includes an image sensor 21, an optical system 22, a sensor driving unit 23, a sensor carriage driving unit 24, an AFE (Analog Front End) unit 25, a digital image processing unit 26, and the like.
The image sensor 21 driven by the sensor driving unit 23 is a linear image sensor including RGB three-channel light receiving elements, and is mounted on a sensor carriage 27 that moves in parallel with a document table (not shown). The image sensor 21 outputs an electrical signal that correlates with the density of an optical image of a document placed on a document table formed on a light receiving surface by an optical system 22 including a lens and a mirror (not shown).

The sensor carriage drive unit 24 includes a motor, a drive belt, a drive circuit, and the like. The sensor carriage drive unit 24 reciprocates the sensor carriage 27 along a guide rod installed perpendicular to the scanning line. A two-dimensional image can be scanned by moving the image sensor 21 in a direction perpendicular to the scanning line.
The AFE unit 25 includes an analog signal processing unit, an A / D converter, and the like.
The digital image processing unit 26 performs processing such as shading correction on the output signal output from the AFE unit 25 to generate a digital image.

The printing unit 30 of the multifunction machine 1 includes a recording head 31, a head driving unit 32, a head carriage driving unit 33, a paper feeding unit 34, and the like for forming an image on a sheet by an inkjet method. The printing unit 30 may be configured to support other printing methods such as a laser method.
The recording head 31 is provided on a head carriage 37 on which an ink cartridge (not shown) is mounted, and includes a nozzle, a piezo element, an ink passage, and the like.
The head carriage drive unit 33 includes a motor, a drive belt, a drive circuit, and the like (not shown). The head carriage drive unit 33 reciprocates the recording head 31 perpendicular to the paper transport direction.

The paper feeding unit 34 includes a paper transport roller, a motor, a drive circuit, and the like (not shown). The paper feeding unit 34 conveys the paper in a direction perpendicular to the moving direction axis of the recording head 31 by rotating the paper carrying roller.
The card read / write unit 41 includes a card slot (not shown) for inserting the removable memory 3, a memory controller, and the like.

The operation unit 42 includes an LCD 14 for displaying a menu, and various buttons such as a determination button 10 and a cross button 12 for operating the menu (see FIG. 2).
The control unit 50 includes a CPU 51, a ROM 52, and a RAM 53. The CPU 51 executes a control program stored in the ROM 52 to control each unit of the multifunction machine 1. The ROM 52 is a non-volatile memory that stores a control program, and the RAM 53 is a volatile memory that temporarily stores a program such as an image processing program and data such as image data. The control program may be stored in the ROM 52 from a predetermined server via the network, or may be read from a computer-readable storage medium such as the removable memory 3 and stored in the ROM 52.

FIG. 4 is a functional block diagram showing the configuration of the control program of the multifunction machine 1.
The composition instruction receiving module 61 as the first receiving unit and the second receiving unit is a program component that receives an order sheet request and a scan request. The order sheet request is an instruction for the user to request the multifunction device 1 to print an order sheet for writing handwritten characters or the like. The scan request is an instruction for the user to request the multifunction device 1 to perform a series of processes for reading an order sheet and combining handwritten characters and other images.

  The image selection instruction receiving module 60 as an image selection instruction receiving unit is a program component that receives an instruction (image selection instruction) for selecting an arbitrary image file from accessible image files. Specifically, the accessible image file is, for example, an image file stored in a predetermined folder of the removable memory 3. The image selection instruction receiving module 60 is connected to the ROM 52 and RAM 53 which are internal memories, the memory of a portable electronic device such as a digital camera connected to the multifunction device 1, a mobile phone with a camera function, or the multifunction device 1. The user may select image data stored in a hard disk device of a PC or a file server connected to the multifunction device 1 via a communication line.

A print control module 62 serving as a print control unit reads a template (order sheet template) 100 (see FIG. 5) for printing an order sheet from the ROM 52, and prints the order sheet on the printing unit 30 based on the order sheet template 113. It is a program part to be made.
The order sheet template 113 shown in FIG. 5 includes object information and layout information for printing the reference marks 82 and 107, the verification mark 81, and the rectangular frame 110 on a sheet. A frame 112 represents the printing paper size defined by the order sheet template 113. A rectangular frame 110 as a region notation defined by the order sheet template 113 is a rectangular frame indicating the outer edge of the free drawing region 72 on the paper surface of the order sheet 70 (see FIG. 6). The free drawing area 72 may be a rectangular frame having an aspect ratio different from that of printing paper for printing a composite image, or may be a non-rectangular frame such as a circular frame. The area notation may be, for example, four marks (cross shape, L shape, etc.) indicating the four corners of the free drawing area 72. The reference marks 82 and 107 defined by the order sheet template 113 are marks for specifying the positions of the free drawing area 72 and the verification mark 81 when the order sheet 70 is read. A frame 108 defined by the order sheet template 113 is an area to which the verification mark 81 is assigned. The verification mark 81 includes a removable memory 3 connected to the multifunction device 1 during execution of the process of printing the order sheet 70 and a removable memory 3 connected to the multifunction device 1 during execution of the process of printing a composite image. This is a mark for verifying the identity with the. Specifically, for example, the verification mark 81 is information that can specify a checksum calculated based on the file name, the number of files, etc. of all image files of a predetermined format stored in a predetermined folder of the removable memory 3. Carrying.

  The read control module 64 as a read control means is a program component having the following functions. First, the prescan image is acquired by causing the imaging unit 20 to read the entire surface (prescan area) of the document table at a low resolution. Second, the free drawing area 72 of the order sheet 70 is specified based on the pre-scan image. Third, the verification mark 81 is verified based on the pre-scan image. Fourth, the free drawing area 72 is read by the imaging unit 20 with high resolution, and a high-resolution scan image is acquired.

The synthesizing module 66 as the synthesizing unit and the area extracting unit is a program component that acquires the image of the free drawing area 72 read by the imaging unit 20 and synthesizes the image of the free drawing area 72 and another image. Specifically, for example, the synthesis module 66 extracts an area of the object 116 (see FIG. 6) such as handwritten characters from the image of the free drawing area 72, and the image of the object 116 is extracted from the image of the object 116 based on a synthesis template described later. Is combined with the selected photographic image.
Some of the functions of the control unit 50 realized by executing the combination instruction receiving module 61, the print control module 62, the reading control module 64, and the combination module 66 described above are a DSP, an ASIC (Application Specific Integrated Circuit). It can also be realized by a dedicated circuit.

FIG. 7 is a schematic diagram for explaining a composite template.
The composite template 120 is composed of layout information necessary for printing the composite image 132 on the paper 134. A frame 131 represents the print paper size defined by the composite template 120. A frame 128 defined by the composite template 120 is an area to which the image 122 of the free drawing area 72 and another image 126 are allocated. In the example shown in the figure, the area 122 to which the image 122 of the free drawing area 72 and the other image 126 are allocated are the same, but each image may of course be allocated to a different frame. The aspect ratio of the frame 128 defined by the composite template 120 and the rectangular frame 110 defined by the order sheet template 113 are the same. The alpha channel 124 is information that defines the transmittance of the layer of the image 122 in the free rendering area 72 for each pixel. The compositing module 66 specifies the region 130 of the object 116 such as handwritten characters by region dividing processing on the image 122 of the free drawing region 72, sets the transmittance of the region 130 of the object 116 to opaque, and makes the other regions transparent. The alpha channel 124 is generated by the process of setting to. The composite image 132 is generated by weighting and adding the image 122 of the free rendering area 72 and the other image 126 with the alpha channel 124 for each pixel.

FIG. 8 is a flowchart showing an image processing method according to the first embodiment of the present invention. The process shown in FIG. 8 is executed by the control unit 50 executing the above-described control program.
First, the control unit 50 receives an order sheet request (step S100). Specifically, for example, the composition instruction receiving module 61 displays the menu screen 1000 shown in FIG. 9 on the LCD 14, and then the user selects “handwritten character composition printing” by operating the cross button 12 and presses the decision button 10. Accordingly, the signal output from the operation unit 42 is accepted as an order sheet request. In the drawing, the items selected by operating the cross button 12 among the items displayed on the LCD 14 are hatched.

  When receiving the order sheet request, the control unit 50 sets an order sheet template and a composite template (step S102). Specifically, the composition instruction receiving module 61 reads the order sheet template and the composition template from the ROM 52 into the RAM 53. By this processing, the free drawing area 72 of the order sheet 70 corresponding to the order sheet request is set. In addition, with this processing, the arrangement according to the order sheet request, the vertical relationship of layers, the transmittance of each layer, the printing paper size, and the like are set for the image 122 and other images 126 in the free drawing area 72. Note that the control unit 50 may alternatively accept order sheet requests corresponding to different order sheet templates in step S100 and set an order sheet template corresponding to the received order sheet request.

  In step S104, the multifunction device 1 receives an instruction to select an arbitrary image file from image files accessible by the user. Specifically, for example, the image selection instruction receiving module 60 displays the image selection screen 1020 shown in FIG. 9 on the LCD 14, and then is output from the operation unit 42 when the user presses the cross button 12 and the determination button 10. In accordance with the signal, an image file of a predetermined format stored in a predetermined folder of the removable memory 3 is selected.

  In step S <b> 106, the multifunction machine 1 prints the order sheet 70. Specifically, the print control module 62 generates data of pages to which the reference marks 82 and 107, the verification mark 81, and the rectangular frame 110 are allocated based on the order sheet template read into the RAM 53. Next, the print control module 62 performs binarization processing, interlace processing, and the like on the page data to generate print data. Next, the print control module 62 outputs print data to the printing unit 30 and causes the printing unit 30 to print the order sheet 70. At this time, the print control module 62 calculates a checksum based on an image file stored in a predetermined directory of the removable memory 3 and assigns an image representing the verification mark 81 corresponding to the checksum to the frame 108. Further, the printing control module 62 may display the screen 1040 shown in FIG. 9 on the LCD 14 until the printing unit 30 completes the printing of the order sheet 70.

The user records an object 116 such as a handwritten character in the free drawing area 72 of the order sheet 70 printed in step S106 as shown in FIG. The outer edge of the free drawing area 72 is clearly indicated by a rectangular frame 110. In the free drawing area 72, in addition to handwritten characters, magazine clippings can be pasted, and characters and images can be printed.
In step S108, the control unit 50 receives a scan request. Specifically, for example, the composition instruction receiving module 61 displays a menu screen 1060 shown in FIG. 9 on the LCD 14 and then receives a signal output from the operation unit 42 when the user presses the enter button 10 as a scan request. . Note that after receiving the scan request, the control unit 50 may display a screen 1080 shown in FIG. 9 on the LCD 14 to guide the progress status to the user.

In step S109, the multifunction device 1 reads the pre-scan area. Specifically, the reading control module 64 causes the imaging unit 20 to read the prescan area and obtain a prescan image.
In step S <b> 110, the control unit 50 specifies the free drawing area 72 of the order sheet 70. Specifically, the reading control module 64 specifies the positions of the reference marks 82 and 107 in the pre-scan image by pattern matching or the like. Next, the reading control module 64 specifies the range of the free drawing area 72 based on the positions of the reference marks 82 and 107. At this time, the reading control module 64 specifies the range of the free drawing area 72 according to the relative positional relationship between the reference marks 82 and 107 and the rectangular frame 110 defined in the order sheet template 113 set in step S102. To do. That is, since the order sheet template 113 is set in response to an order sheet request being received, the control unit 50 specifies the range of the free drawing area 72 in response to the order sheet request.

  In step S110, the control unit 50 identifies the range of the verification mark 81 based on the pre-scanned image, recognizes the verification mark 81, and stores it in a checksum corresponding to the verification mark 81 and a predetermined folder in the removable memory 3. The identity with the checksum calculated based on the image file of the predetermined format is verified. As a result, if the two checksums do not match, the control unit 50 performs error processing. Of course, such error determination and error processing may be omitted.

In step S112, the multi function device 1 reads the free rendering area 72 with high resolution. Specifically, the reading control module 64 causes the imaging unit 20 to read the free drawing area 72 at a higher resolution than during pre-scanning and store the image of the free drawing area 72 in the RAM 53.
In step S <b> 114, the control unit 50 extracts an area 130 corresponding to the object 116 recorded in the free drawing area 72 from the image 122 (see FIG. 7) of the free drawing area 72. Specifically, the composition module 66 performs region division processing using a predetermined threshold on the image 122 of the free drawing region 72 and specifies the region 130 corresponding to the object 116. Note that the synthesis module 66 may specify a region corresponding to the object 116 using the pre-scan image. Next, the composition module 66 generates an alpha channel 124 in which the region 130 corresponding to the object 116 is set to be opaque and the other regions are set to be transparent.

  In step S <b> 116, the control unit 50 combines the image 122 (see FIG. 7) of the free drawing area 72 with another image 126. Specifically, the composition module 66 weights the image 122 of the free rendering area 72 and the image 126 represented by the image file selected in step S104 with an alpha channel 124 for each pixel based on the composition template 120. Addition is performed, and the resultant composite image 132 is assigned to the frame 128. The composite template 120 used at this time is the one read by the control unit 50 from the ROM 52 into the RAM 53 when the order sheet request is received. That is, since the composition of the image 122 in the free drawing area 72 and the other image 126 is performed based on the composition template 120, the control unit 50 uses the image 122 in the free drawing area 72 and the other image 126 as an order sheet request. It is to synthesize accordingly.

  In step S118, the multifunction device 1 prints the composite image. Specifically, the control unit 50 generates data of a page in which the composite image 132 is allocated to the frame 128 based on the composite template 120, and performs binarization processing, interlace processing, and the like on the data to generate print data. The composite image 132 is printed on the paper 134 by generating and outputting the print data to the printing unit 30.

  According to the first embodiment of the present invention described above, the user combines the handwritten characters with other images by causing the multifunction device 1 to read the order sheet 70 in which the handwritten characters are written in the free drawing area 72. The obtained image can be printed on the multifunction device 1. Therefore, it is possible to easily produce a large amount of printed matter on which the composite image obtained in this way is printed. In addition, it is difficult to cleanly overwrite handwritten characters on a photographic image printed on glossy paper due to the nature of paper and ink. However, according to the above-described embodiment, a user can write handwritten characters on a photographic image printed on glossy paper. It is possible to easily create a print that has been overwritten cleanly.

(Second embodiment)
In the second embodiment of the present invention, the verification mark 81 (see FIG. 5) described above corresponds to the identification notation described in the claims, and carries information for specifying the composite template. This will be specifically described below.
The pattern of the verification mark 81 is determined according to the composite template. Note that the composite machine 1 may select one composite template based on the verification mark 81 or a plurality of composite templates. In other words, it is sufficient that at least whether or not the order sheet can record handwritten characters can be determined based on the verification mark 81. From the verification mark 81, it may not be possible to determine whether the verification mark 81 is one of a plurality of types of order sheets corresponding to different composite templates and capable of recording handwritten characters. Further, the verification mark 81 corresponds to the composite template and, at the same time, naturally corresponds to the order sheet template 113. This is because the frame 128 (see FIG. 7) for assigning the image of the free drawing area 72 defined by the composite template and the rectangular frame 110 defined by the order sheet template 113 correspond to each other. That is, the verification mark 81 carries information capable of identifying the order sheet itself.

FIG. 10 is a flowchart showing an image processing method according to the second embodiment of the present invention.
In step S103, the control unit 50 sets an order sheet template. At this time, unlike the first embodiment, no synthesis template is set.
In step S <b> 106, the multifunction machine 1 prints the order sheet 70. At this time, the print control module 62 reads a verification mark 81 of a pattern carrying information for specifying a composite template corresponding to the order sheet request from the ROM 53 and assigns it to the frame 108 (see FIG. 5).

  In step S <b> 110, the control unit 50 specifies the free drawing area 72 of the order sheet 70. At this time, the control unit 50 specifies the free drawing area 72 based on the verification mark 81. Specifically, the reading control module 64 specifies the positions of the reference marks 82 and 107 in the pre-scan image by pattern matching or the like. Next, the reading control module 64 specifies the range of the verification mark 81 based on the positions of the reference marks 82 and 107, recognizes the verification mark 81 represented by the pre-scan image, and performs free drawing corresponding to the verification mark 81. The range of the area 72 is specified. At this time, the reading control module 64 specifies the range of the free drawing area 72 according to the relative positional relationship between the reference marks 82 and 107 and the rectangular frame 110 defined in the order sheet template 113 corresponding to the verification mark 81. To do. That is, the control unit 50 specifies the range of the free drawing area 72 based on the image of the verification mark 81.

In step S <b> 111, the control unit 50 sets a composite template corresponding to the verification mark 81. Specifically, the synthesis module 66 reads a synthesis template corresponding to the verification mark 81 from the ROM 52 into the RAM 53. That is, in the second embodiment, the composite template is not determined until the order sheet 70 is read.
The control unit 50 performs the process of step S104 (image selection process) described in the first embodiment after receiving the composite print instruction, for example, immediately before the composite process (S116).

In the second embodiment described above, since the setting of the composite template and the selection of the image are executed after receiving the composite print instruction, the processing after step S108 and the processing before step S106 are not continuous. Good. That is, completely different processing may be performed between step S106 and step S108, or the power of the multi-function device 1 may be turned off.
In step S111, instead of processing for setting a composite template based on the verification mark 81, a composite template selection instruction is received from the user when a scan request is received in step S108. In step S111, a composite template selection instruction content is received. The consistency with the composite template corresponding to the order sheet 70 may be checked. Further, when there is only one type of order sheet handled by the multifunction machine 1, the consistency check may be omitted.

(Third embodiment)
FIG. 11 is a functional block diagram of the multifunction machine 1 according to the third embodiment of the present invention.
In step S106 described above, the print control module 62 also prints the image selected by the image selection instruction receiving module 60 on the order sheet based on the order sheet template 113 shown in FIG. A frame 200 defined by the order sheet template 113 shown in FIG. 12 is a frame to which an image 202 indicating a file selected by the image selection instruction receiving module 60 is assigned. The order sheet template 113 may be defined such that a frame indicating the outer edge of the sheet is printed outside the frame 200. By doing so, the user can confirm how the image 126 (see FIG. 7) of the selected file is arranged on the printing paper before printing. Note that the print control module 62 may assign a reduced image generated based on the image 126 of the image file selected by the user to the frame 200. Further, if the selected image file is an image file storing thumbnail data such as an Exif file, the print control module 62 may assign the thumbnail image to the frame 200.

  According to the third embodiment of the present invention described above, as shown in FIG. 13, the multi-function device 1 orders the image 202 indicating the selected image data and the rectangular frame 110 indicating the free drawing area 72 on one sheet. Print on the sheet 70. Therefore, the user can record the object 116 such as a handwritten character to be combined with the selected image in the free drawing area 72 while confirming the selected image on the order sheet 70. That is, the user can record the object in the free drawing area 72 while predicting the synthesis result.

(Fourth embodiment)
The multi function device 1 according to the fourth embodiment of the present invention prints the image represented by the selected image file lightly in the free drawing area.
In step S106 described above, the print control module 62 prints the image selected by the image selection instruction receiving module 60 on the order sheet based on the order sheet template 113 shown in FIG. A frame 200 defined by the order sheet template 113 shown in FIG. 12 is a frame to which an image 202 indicating a file selected by the image selection instruction receiving module 60 and a rectangular frame 110 indicating a free drawing area are allocated. An image 202 indicating a file selected by the image selection instruction receiving module 60 is a monochrome image obtained by performing binarization processing by the print control module 62 on the luminance value of the image of the selected file. The binarization threshold value is set low enough that the image 202 indicating the file selected in the process of extracting the object region in step S114 is not extracted. Note that the image 200 printed in the free drawing area 72 may be a light color image. When printing a color image in the free rendering area 72, the print control module 62 performs a lightening process at a light and shade level on each channel of the image of the selected file instead of the binarization process.
According to the fourth embodiment of the present invention described above, the multi function device 1 prints the image 202 indicating the selected image data in the free rendering area 72 as shown in FIG. Therefore, the user can record the object 116 such as a handwritten character to be combined with the selected image in the free drawing area 72 while accurately grasping the arrangement with respect to the selected image.

(Fifth embodiment)
The multi-function device 1 according to the fifth embodiment of the present invention prints on the order sheet 70 a sample 111 of the synthesis result of the image represented by the selected image file and the image of the object such as a handwritten character (see FIG. 16).
In the fifth embodiment of the present invention, the composition instruction receiving module 61 corresponds to a composition condition instruction receiving unit. That is, the compositing instruction reception module 61 receives an instruction to select a compositing condition for compositing the image 122 representing the object recorded in the free drawing area 72 and another image 126. The composition conditions are image arrangement, layer vertical relationship, layer transmittance, and the like, specifically, for example, the contents of a composition template. The composition instruction receiving module 61 sets a composition template and an order sheet template according to an instruction for selecting a composition condition.

FIG. 17 is a schematic diagram showing an order sheet template 113 for printing the order sheet 70. FIG. 18 is a schematic diagram for explaining a composite template corresponding to the order sheet template 113 shown in FIG. That is, the order sheet template 113 shown in FIG. 17 and the composite template 120 shown in FIG. 18 are templates read from the ROM 52 in response to an instruction to select the same composite condition.
The order sheet template 113 defines a frame 206 to which an image 208 representing a sample of the free drawing area 72 in which handwritten characters are recorded is assigned. A frame 200 and a frame 206 to which an image 202 indicating a file selected by the image selection instruction receiving module 60 is allocated are defined inside a rectangular frame 204 that represents an outer edge of a print sheet for printing a composite image. The aspect ratio of the rectangular frame 204 matches the aspect ratio of the printing paper for printing the composite image. When the frame 206 to which the image 208 representing the sample of the free drawing area 72 is allocated and the frame 200 to which the image 202 indicating the file selected by the image selection instruction receiving module 60 overlaps, the order sheet Template 113 defines an alpha channel for setting the transmittance of two images.

  A frame 128a defined by the composite template 120 is an area to which another image 126 is allocated. A frame 128b defined by the composite template 120 is an area to which the image 122 of the free drawing area 72 is allocated. The relationship between the relative size and relative position of the frame 131, the frame 128a, and the frame 128b corresponding to the print paper size defined by the composite template 120 is as follows: the rectangular frame 204 defined by the order sheet template 113; 200 is equal to the relationship between the relative size and relative position of the frame 206. That is, if the frames 128a, 128b, and 131 are regarded as one graphic and the rectangular frames 204, 200, and 206 are regarded as one graphic, the two graphics are similar to each other. Therefore, the user can predict the synthesis result by the sample 111 (see FIG. 16) printed on the order sheet 70 based on the rectangular frames 204, 200, and 206.

FIG. 19 is a flowchart showing an image processing method according to the fifth embodiment of the present invention.
In step S <b> 101, the multifunction device 1 accepts instructions for different synthesis conditions for synthesizing the image 122 of the object and the other image 126. Specifically, the composition instruction receiving module 61 displays the menu screen 1100 shown in FIG. 20 on the LCD 14, and then the user selects any composition condition by operating the cross button 12 and presses the decision button 10. A signal output from the operation unit 42 is accepted as a synthesis condition instruction. The composition instruction receiving module 61 may guide the user to select a composition condition by displaying a sample 111 specifically indicating the composition result on the screen, or may include “upper and lower two columns”, “superposition”, and the like. The user may be guided to selectable synthesis conditions by displaying a character string on the screen.

  In step S102, the composition instruction receiving module 61 reads the order sheet template 113 and the composition template 120 corresponding to the composition condition instruction received in step S101 from the ROM 52 into the RAM 53. By this processing, the free drawing area 72 of the order sheet 70 corresponding to the compositing condition instruction is set, and for the image 122 and the other image 126 of the free drawing area 72, the arrangement according to the compositing condition instruction, the layer vertical relationship, The transmittance of each layer, the print paper size, etc. are set.

  According to the fifth embodiment of the present invention described above, the order sheet 70 is printed with the sample 111 of the combination result of the image represented by the selected image file and the target object such as handwritten characters. The object can be recorded in the free drawing area 72 while specifically imagining.

(Sixth embodiment)
FIG. 21 is a schematic diagram showing a state in which an object is recorded on an order sheet 70 printed by the multifunction machine 1 according to the sixth embodiment of the present invention. In the multifunction machine 1 according to the sixth embodiment of the present invention, a plurality of samples 111 are printed on the order sheet 70, and a synthesis condition instruction is received via the identifier 136 attached to each sample 111. The template for printing the order sheet 70 is substantially the same as that of the fifth embodiment except that a plurality of pieces of definition information for printing the sample 111 are provided, and the description thereof will be omitted.

FIG. 22 is a flowchart showing an image processing method according to the sixth embodiment of the present invention.
After receiving the scan request in step S108, the multi-function device 1 executes step S101 and receives a synthesis condition instruction. Specifically, the composition instruction receiving module 61 displays a menu screen 1110 shown in FIG. On the menu screen 1110, one of the identifiers 136 attached to each sample 111 of the order sheet 70 can be selected by pressing the cross button 12 and the determination button 10. The combination instruction receiving module 61 receives any combination condition instruction according to a signal output from the operation unit 42 when the user presses the cross button 12 and the determination button 10.
In step S111, the control unit 50 sets a synthesis template according to the synthesis condition instruction received in step S110. Specifically, the synthesis module 66 reads a synthesis template corresponding to the identifier selected by the user in step S110 from the ROM 52 into the RAM 53.

  According to the sixth embodiment of the present invention described above, a plurality of samples 111 corresponding to the synthesis conditions that can be selected by the user are printed on the order sheet 70. Therefore, the user can specifically recognize selectable synthesis conditions even when the resolution of the LCD 14 is low and the screen size is small.

(Seventh embodiment)
FIG. 1 is a schematic diagram showing a state in which an object 116 is recorded on an order sheet 70 printed by the multifunction machine 1 according to the seventh embodiment of the present invention. In the multi function device 1 according to the seventh embodiment of the present invention, a plurality of check boxes 88 for selecting a synthesis condition are printed on the order sheet 70, and the handwriting 88m filled with the check boxes 88 is optically recognized to synthesize. Set conditions. In the template for printing the order sheet 70, a check box 88 is arranged immediately below each of the plurality of samples 111 representing the synthesis result. The sample 111 corresponds to the composition condition notation described in the claims. The user can select a synthesis condition corresponding to the sample 111 arranged immediately above the check box 88 by painting one of the check boxes 88. The handwriting 88m in which the check box 88 is filled corresponds to the synthesis condition instruction.

FIG. 24 is a flowchart showing an image processing method according to the seventh embodiment of the present invention.
In step S <b> 111, the control unit 50 sets a composite template corresponding to the filled check box 88. Specifically, the composition module 66 as the composition condition recognizing means determines which check box 88 is filled based on the pre-scanned image, and sets the composition template corresponding to the filled check box 88 to the ROM 52. To RAM 53. As a result, the control unit 50 recognizes the composition condition represented by the sample 111 instructed by the composition condition instruction recorded on the order sheet 70.

  According to the seventh embodiment of the present invention described above, since the user can indicate the synthesis condition by filling the check box 88 before and after recording the handwritten character or the like in the free drawing area 72, the synthesis condition is easily set. be able to.

(Eighth Example)
FIG. 25 is a schematic diagram showing an order sheet 70 printed by the multifunction machine 1 according to the eighth embodiment of the present invention. In the multi function device 1 according to the eighth embodiment of the present invention, check boxes 91 and 76 for selecting printing conditions are printed on the order sheet 70, and handwriting 91m and 76m in which the check boxes 91 and 76 are filled are optically recognized. To set the printing conditions. The user can select any one of a plurality of types of printing paper by painting any one of the plurality of check boxes 91. Further, the user can select the number of prints by painting any one of the plurality of check boxes 76.
According to the eighth embodiment of the present invention, since the user can instruct the printing condition by filling the check boxes 91 and 76 before and after recording the handwritten character or the like in the free drawing area 72, the printing condition can be easily set. Can do.

(Ninth Example)
FIG. 26 is a functional block diagram of the multifunction machine 1 according to the ninth embodiment of the present invention.
The third operation unit 304 includes the operation unit 42, the control unit 50 that executes the compositing instruction reception module, and the like, and selects a layout between an image selected in the image selection area 71 and an image representing the free drawing area 72 described later. A predetermined button operation is accepted.
The first operation unit 300 includes a control unit 50 that executes a synthesis instruction receiving module, an operation unit 42, and the like, and receives a predetermined button operation as an order sheet request.

  The first output unit 310 includes a control unit 50 that executes a print control module, a card read / write unit 41, a printing unit 30, and the like. When an order sheet request is received by the first operation means 300, the first output means 310 reads the image data stored in the removable memory 3 and the template stored in the ROM 52 and prints an order sheet described later.

The second operation unit 302 includes a control unit 50 that executes a combination instruction reception module, an operation unit 42, and the like, and receives a predetermined button operation as a composite image print request.
The order reading unit 306 includes a control unit 50 that executes a reading control module and an image selection instruction recognition module, the imaging unit 20, and the like. When the second operation unit 302 receives a print request for a composite image, the order reading unit 306 receives the order sheet 70. Read, verify mark 81, reference mark 82, and filled check boxes 74m, 76m, 79m, 86m, and 87m are optically recognized, and an image of free drawing area 72 is output. The image selection instruction recognition module as an image selection instruction recognition unit is a program component that recognizes an image file selected by the user based on an image obtained by reading the check box 74.

  The second output unit 308 includes a control unit 50 that executes a synthesis module, a printing unit 30, and the like, and prints a composite image of the image selected in the image selection area 71 and the image representing the free drawing area 72. In the preview described later, the second output unit 308 displays the composite image on the LCD 14 without printing.

  FIG. 27 is a schematic diagram showing an example of an order sheet 70 printed by the multifunction machine 1 in a state where the removable memory 3 having the directory structure shown in FIG. 28 is connected. The layout of the order sheet 70 is defined by an order sheet template stored in the ROM 52. FIG. 31 is a schematic diagram showing an example of an order sheet 70 in which necessary items are entered by the user. The arrangement of each element written on the order sheet 70 is set with reference to the reference mark 82.

The reference mark 82 is laid out in the upper left corner of the order sheet 70. When the order reading unit 306 recognizes the position of the reference mark 82, the position of each element written on the order sheet 70 can be relatively recognized.
In the image selection area 71, image files (for example, tree.jpg, face.jpg, flower.jpg, sea.jpg, maple.jpg, sunrise.jpg, mountain.jpg) stored in the DCIM folder 90 of the removable memory 3 are displayed. jpg, person.jpg) are laid out and thumbnail images 73 and check boxes 74 are laid out. By painting the check box 74, the main image of the image file corresponding to the thumbnail image 73m (for example, the sunrise.jpg thumbnail image) laid out immediately above the check box 74m can be selected as a compositing target. The thumbnail image 73 corresponds to the image notation described in the claims. The handwriting that fills the check box 74m corresponds to the image selection instruction described in the claims. Note that the image file stored in the DCIM folder 90 of the removable memory 3 may be expressed as a main image or may be expressed by printing a file name or an internal identifier.

  The free drawing area 72 is a blank area for drawing a handwritten character (for example, “Kagasho”) or pasting a magazine cutout, and is surrounded by a rectangular frame. The handwriting of characters and figures handwritten in the free drawing area 72, the printed matter pasted in the free drawing area 72, and the characters and figures printed in the free drawing area 72 correspond to the objects described in the claims.

  In the area 75 for selecting the number of printed sheets, a check box 76 corresponding to each digit of the number of printed sheets from 0 to 99 and a check box 84 for selecting a preview are laid out. The tens digit of the number of printed sheets is selected by filling the check box 76 laid out in the left column, and the first digit of the number of printed sheets is filled in by filling the check box 76 laid out in the right column. Can be selected.

  In the layout selection area 77, an image 78 and a check box 79 schematically showing the layout are laid out. By filling the check box 79, a layout corresponding to the image 78m laid out immediately above the check box 79m can be selected. The handwriting (79m) in which the check box 79 is filled corresponds to the composition condition instruction described in the claims.

  A check box 86 and a check box 87 are displayed in the superimposition synthesis condition selection area 85. By filling the check box 86, it is possible to select a boundary processing condition as to whether or not to perform white bordering when a handwritten character is superimposed and synthesized on the image selected in the image selection area 71. Further, by filling the check box 87, the transparency (for example, 0%) of the layer representing the handwritten character can be selected. Note that the width of the white border may be set as the boundary processing condition, or another transparency may be selected as the superposition synthesis condition.

FIG. 29 is a flowchart showing a process of printing a composite image by the multifunction machine 1 according to the ninth embodiment of the present invention. FIG. 30 is a schematic diagram showing screen transition of the LCD 14.
When the removable memory 3 is connected to the multifunction device 1 and the user selects “print order sheet” with the cross button 12 and presses the enter button 10 on the menu screen 100, the template of the order sheet 70 is selected on the LCD 14. A screen 102 is displayed. When the user selects a template (for example, a New Year's card) with the cross button 12 and presses the enter button 10 on the screen 102, the first operation means 300 accepts an order sheet request. When the first operation means 300 accepts the order sheet request, the process proceeds to step S12 (step S10).

In step S <b> 12, the screen 104 indicating that the order sheet 70 is being printed is displayed on the LCD 14, and the first output unit 310 prints the order sheet 70.
In step S14, the user fills the check boxes 74, 76, 79, 86, and 87 of the printed order sheet 70 according to the image processing conditions to be set, and draws handwritten characters in the free drawing area 72 (FIG. 31).

  Next, when the user places the order sheet 70 at a predetermined position on the document table (not shown), selects “print composite image” with the cross button 12 on the menu screen 100 and presses the enter button 10, the second operation means 302 accepts a scan request. When the second operation means 302 receives the scan request, the process proceeds to step S18 (step S16).

In step S18, a screen 106 indicating that the composite image is being printed is displayed on the LCD 14, and the second output means 308 prints the composite image. When printing of the composite image is completed, the menu screen 100 is displayed on the LCD 14.
FIG. 32 is a flowchart showing details of the process for printing the order sheet 70 (step S12).

  When the order sheet request is accepted by the first operation means 300, the first output means 310 gives an identifier to the image file stored in the DCIM folder 90 of the removable memory 3 (step S200). At this time, a serial number as an identifier is assigned to each image file in the ASCII code order of the file name of the image file.

Next, a checksum is set (step S201). The checksum is calculated according to the content of data stored in the DCIM folder 90 of the removable memory 3 and stored in a predetermined area of the RAM 53.
Next, the template selected in step S10 is read from the ROM 52 into the RAM 53 (step S202), and the first output means 310 assigns the thumbnail image of the image file and the verification mark 81 to the layout frame defined by the template and orders them. The sheet 70 is printed (step S203).

FIG. 33 is a flowchart showing details of the process for printing the composite image (step S18).
In step S300, the order reading unit 306 reads the order sheet 70 as a low-resolution monochrome binary image, and the positions of the verification mark 81 and the check boxes 74, 76, 79, 86, 87 on the image based on the reference mark 82. Then, the verification mark 81 and the processing conditions selected by the filled check boxes (see FIG. 1) 74m, 76m, 79m, 86m, and 87m are optically recognized.

  In step S302, the checksum corresponding to the verification mark 81 recognized in step S300 is compared with the checksum set in step S201, and the image file written in the order sheet 70 is stored in the removable memory 3. It is determined whether the image files match. If they match, the process proceeds to step S304. If they do not match, a screen is displayed on the LCD 14 that warns that the image file written in the order sheet 70 is different from the image file stored in the removable memory 3 (step 14). S306).

In step S304, it is determined whether or not two or more image files are selected in the image selection area 71. If only one image file has been selected, the process proceeds to step S308. If two or more image files have been selected, a screen for warning that effect is displayed on the LCD 14 (step S310).
Next, the range of the free drawing area 72 is recognized based on the reference mark 82 recognized in step S300 (step S308). By specifying the range of the free drawing area 72 on the image using the reference mark 82, the position of the free drawing area 72 can be accurately determined even when the order sheet 70 is not placed at a predetermined position on the document table. Can be specified.

Next, the order reading unit 306 reads the free drawing area 72 and the margin area 83 (see FIG. 27) in the vicinity thereof with high resolution (step S312).
Next, a region of an object such as a handwritten character is extracted from the image representing the free drawing region 72 (step S314). If the image representing the free drawing area 72 is directly combined with the image selected in the image selection area 71 without performing step S314, the image representing the entire area including the margin of the free drawing area 72 is selected in the image selection area 71. A composite image can be created.

In step S316, the object such as the handwritten character in the area extracted in step S314 and the image to be combined selected in the image selection area 71 are combined according to the layout selected in the layout selection area 77.
Next, the second output unit 308 repeats printing of the composite image until the composite image is printed by the number of prints selected in the area 75 for selecting the number of prints (steps S318 and 320).

FIG. 34 is a flowchart showing details of a process (step S314) for extracting a handwritten character region from an image representing the free drawing region 72 and superimposing the extracted region on the image selected in the image selection region 71. is there.
In step S400, a threshold value for separating the blank area 83 where the ground color of the order sheet 70 appears and the handwritten character is determined. Specifically, first, a luminance histogram of the margin area 83 is created. In this luminance histogram, as shown in FIG. 35, the distribution is concentrated on the luminance values corresponding to the ground color of the order sheet 70. Therefore, next, a threshold value for extracting the object region from the image representing the free drawing region 72 is set in the vicinity of the range where the distribution is concentrated. Thereby, it is possible to set an appropriate value according to the ground color of the printing paper used for the order sheet 70.

  In step S402, based on the specified threshold value, an area of handwritten characters is extracted from the image representing the free drawing area 72, and the alpha channel value of the area is selected by the check box 87 of the superposition synthesis condition selection area 85. And set the alpha channel value for all other areas to be completely transparent. The alpha channel is a channel that represents the transparency of the layer of the image for each pixel.

  In step S403, noise included in the region extracted as handwritten characters is removed. Specifically, the transparency of the island-shaped region composed of a predetermined number or less of the extracted regions is set to be completely transparent. Here, FIG. 36B is a schematic diagram showing the superposition synthesis process when the transparency of the area corresponding to noise is not changed in the alpha channel, that is, when noise removal is not performed, and FIG. FIG. 10 is a schematic diagram showing a superposition and synthesis process when the transparency of a region corresponding to noise in the alpha channel is made completely transparent, that is, when noise is removed.

  Next, if white bordering is selected as the superposition synthesis condition, the opaque region of the alpha channel is expanded (step S404). As a result, in step S316, the ground color of the order sheet 70 around the handwritten character is superimposed and synthesized on the image selected in the image selection area 71, so that the handwritten character is trimmed to form a synthesized image. (See FIG. 36 (d)). The processing in step S314 has been described in detail above.

  According to the MFP 1 according to the ninth embodiment of the present invention described above, the user can easily recognize the image processing conditions such as accessible image data, selectable layout, number of prints, and boundary processing conditions. . Further, the user can easily select an image to be combined from accessible image data, select an image processing condition, and input a handwritten message to be combined with the image to be combined. Therefore, even if the hardware providing the HMI is a simple system, the user can easily display a desired image and a handwritten message on the system.

Further, since the order sheet 70 has the reference mark 82, the position of the free drawing area 72 in which a handwritten message or the like is written can be relatively recognized on the image representing the order sheet 70. The region 72 can be recognized accurately.
Furthermore, since superimposition and synthesis can be selected as the image processing condition, for example, a printed matter with a design in which a message is handwritten directly on a photograph can be created.

Furthermore, since the blank area 83 is read to recognize the ground color of the order sheet 70, the handwritten character area can be accurately extracted from the image representing the free drawing area 72.
Furthermore, by reading the order sheet 70 at a low resolution and reading the free drawing area 72 and the margin area 83 in the vicinity thereof at a high resolution, the reading time of the order sheet 70 can be shortened without degrading the image quality of the composite image. it can.
Further, the image processing system of the present invention may be configured by a single printer including a paper position detection optical sensor provided in the paper transport path. That is, a check box filled with an order sheet may be recognized by such a paper position detection optical sensor.

Further, instead of laying out the thumbnail image 73 in the image selection area 71, an identifier or a file name may be laid out. In this case, it is desirable that the thumbnail image 73 and an identifier corresponding to the thumbnail image 73 can be displayed on the LCD 14.
(Tenth embodiment)
In the multifunction machine 1 according to the tenth embodiment, an order sheet 70 that can select two image files in the image selection area 71 is used.

FIG. 37 is a schematic diagram showing screen transitions according to the tenth embodiment of the present invention.
When the menu screen 100 is displayed and the user selects “print order sheet” with the cross button 12 and presses the enter button 10, a screen 2021 for selecting a layout is displayed on the LCD 14. On the screen 2021, an icon 203 schematically representing the layout is displayed. When the user selects any one icon with the cross button 12 and presses the enter button 10 in a state where the screen 2021 is displayed, the layout indicated by the icon is selected, and the layout in which the first operation unit 300 is selected. A print request for the order sheet 70 corresponding to the request is accepted (step S10).

FIG. 38 is a schematic diagram showing an example of an order sheet 70 according to the tenth embodiment of the present invention.
In the image selection area 71, check boxes 74a and 74b are printed for each thumbnail image 73. The user can select two image files by painting any one of the check boxes 74a and painting any one of the check boxes 74b.

In the free drawing area 72, a rectangular frame indicating areas 89a and 89b in which an image represented by the image file selected in the image selection area 71 is laid out is written. The user can draw handwritten characters in the free drawing area 72 outside the areas 89a and 89b.
In the image processing system according to the tenth embodiment of the present invention described above, since the order sheet 70 according to the layout selected by the user is output, when the user describes a handwritten message or the like in the free drawing area 72, The result of the synthesis with the image to be synthesized can be easily imaged. Further, two images to be combined can be selected simply by painting the check boxes 74a and 74b of the order sheet 70.

(Eleventh Example)
An order sheet receiving terminal as an eleventh embodiment of the image processing system of the present invention is an apparatus that reads an order sheet and receives a print order.

FIG. 39 is a schematic diagram showing a printing system using an order sheet receiving terminal according to the eleventh embodiment of the present invention. The printing system 6 includes an order sheet reception terminal 4, a printer 212 connected to the order sheet reception terminal 4, a PC 210, and a printer 211 connected to the PC 210.
The order sheet reception terminal 4 is installed, for example, in a store that provides a digital image print service, a convenience store, or the like. The order sheet reception terminal 4 includes an input unit 213, an operation unit 214, an order reading unit 306, and an output unit 215. The operation means 214 has substantially the same function as the second operation means of the ninth embodiment. The output means 215 has substantially the same function as the second output means of the ninth embodiment. The input unit 213 is an interface for inputting data stored in the removable memory 3.

  The order sheet accepting terminal 4 accepts a predetermined button operation by the user as a request for reading the order sheet 70 by the operating means 214, and outputs the composite image to a display device (not shown) provided in the order sheet accepting terminal 4 by the output means 215. Display a preview of the print result. The composite image is generated based on the image input from the removable memory 3 by the input unit 213 and printed by the printer 212 connected to the order sheet receiving terminal 4.

In the image processing system according to the eleventh embodiment of the present invention described above, a user can easily print a high-quality composite image in which handwritten characters are laid out even if the user does not have a printer capable of high-quality printing. Available at:
(Twelfth embodiment)
In the image processing system according to the twelfth embodiment, the setting of the number of prints is accepted by a key operation.

FIG. 40 is a schematic diagram showing screen transition of the LCD 14 in the twelfth embodiment of the present invention, and FIG. 41 is a flowchart showing processing for printing a composite image by the image processing system in the twelfth embodiment of the present invention. .
In step S330 of the process of printing the composite image, the multifunction device 1 determines that the request is a preview request when it recognizes that the check box 84 for selecting the preview of the order sheet 70 is filled, and proceeds to step S332 to determine that it is not a preview request. Then, it progresses to step S318. In step S <b> 332, the multifunction device 1 displays the test mode screen 220 on the LCD 14. On the test mode screen 220, a composite image 228 of the image represented by the handwritten character described in the free drawing area 72 and the image file selected in the image selection area 71 is displayed. In addition, a “print” button 222 and a number setting box 224 are displayed on the test mode screen 220. On the test mode screen 220, the desired number of prints can be set in the number setting box 224 by operating the cross button 12 up and down. When the cross button 12 is operated left and right, the “print” button 222 or the “return” button 226 is selected. When the enter button 10 is pressed while the “print” button 222 is selected, a print request for the set number of prints is accepted, and the process proceeds to step S318 (step S334). In steps S318 and S320, the second output unit 308 repeats printing of the composite image until the composite image is printed for the set number of prints.

In step S332, the composite image 228 is displayed on the test mode screen 220. However, the composite image 228 may be printed and displayed by the second output unit.
In the image processing system according to the twelfth embodiment of the present invention described above, the user sets the desired number of prints after displaying the composite image on the screen or printing in response to the preview request set in the order sheet 70. There is no need to read the order sheet again just to set the number of prints. That is, when setting a desired number of printed sheets, the user does not need to read an order sheet that takes a long time, and the number of printed sheets can be set by a simple button operation, so the work time can be shortened.

(Thirteenth embodiment)
In the image processing system according to the thirteenth embodiment, the image of the free drawing area 72 obtained when the order sheet 70 is read at a low resolution and the thumbnail image of the image file selected in the image selection area 71 are combined and displayed on the screen. Thereafter, when a user's print request is received, the image of the free drawing area 72 obtained when the order sheet 70 is read at high resolution and the main image of the image file selected in the image selection area 71 are combined and printed.

FIG. 42 is a schematic diagram showing screen transition of the LCD 14 in the thirteenth embodiment of the present invention, and FIG. 43 is a flowchart showing processing for printing a composite image by the image processing system in the thirteenth embodiment of the present invention. .
In step S340, the multi function device 1 uses the image of the free drawing area 72 read at low resolution in step S300 and the thumbnail image of the image file selected in the image selection area 71 as the image processing conditions set in the order sheet 70. The synthesized image 238 synthesized based on the result is displayed on the test mode screen 230 of the LCD 14. When the “print” switch 232 displayed on the test mode screen 230 is selected by operating the cross button 12 and the enter button 10 is pressed, a scan request is accepted (step S342), and the process proceeds to step S312. In steps S312, S314, S316, S318, and S320, as described in the ninth embodiment, the free drawing area 72 is read with high resolution, and the main image and the free drawing area of the image file selected in the image selection area 71 are read. 72 high-resolution images are combined, and the set number of sheets are printed. The test mode screen 230 also includes a “return” switch 236. When the user selects the “return” switch 236 using the cross button 12 and presses the enter button 10, printing is not performed (step S342), and the menu screen 1000 is displayed. indicate.

  In the image processing system according to the thirteenth embodiment of the present invention described above, the image of the free drawing area 72 and the thumbnail image of the image file selected in the image selection area 71 obtained when the order sheet 70 is read at a low resolution. Are combined based on the image processing conditions set in the order sheet 70 and displayed on the test mode screen 230. For this reason, the user can make a print request after confirming an approximate print result. Therefore, the image processing system according to the thirteenth embodiment of the present invention can save printing paper and ink consumed in test printing. Further, in the image processing system according to the thirteenth embodiment of the present invention, the composite image 238 on the test mode screen 230 is displayed based on the image and thumbnail image read at a low resolution, so that it takes time to confirm the print result. It can be shortened.

(14th embodiment)
In the image processing system according to the fourteenth embodiment, it is possible to select an image to be combined in the order sheet 70, set the layout, the number of printed sheets, and the boundary processing conditions as image processing conditions. After reading 70, a handwritten message or the like is separately read and combined with the selected image.

FIG. 44 is a schematic diagram showing an order sheet 70 according to the fourteenth embodiment of the present invention. The order sheet 70 includes an image selection area 71, an area 75 for selecting the number of copies, a layout selection area 77, and a superimposition / combination condition selection area 85.
FIG. 45 is a schematic diagram showing screen transition of the LCD 14 according to the fourteenth embodiment of the present invention, and FIG. 46 is a flowchart showing processing for printing a composite image by the image processing system according to the fourteenth embodiment of the present invention. FIG. 47 is a schematic diagram showing the user document 260.

  When the user places the order sheet 70 on a document table (not shown), selects “print composite image” with the cross button 12 and presses the enter button 10 on the menu screen 1000, the second operation unit 302 A scan request is accepted and processing for printing a composite image is started. In step S300 of the process of printing the composite image, the multifunction device 1 reads the order sheet 70 as a low-resolution monochrome binary image, recognizes the image to be combined and the image processing conditions, and performs various processes in steps S302 and S304. When the error is checked, a document set standby screen 240 is displayed on the LCD 14. Next, when the user places the user document 260 on a document table (not shown) and presses the enter button 10, it is determined that the setting of the user document 260 is completed (step S350), and the process proceeds to step S352. Here, the rectangular user document 260 may be a rectangular document placed at a predetermined position on the document table, or a document of an arbitrary shape placed at an arbitrary position on the document table. Next, the multifunction device 1 displays a screen 242 indicating that a composite image is being printed on the LCD 14. In addition, the multi function device 1 reads an image of the entire document table as a low-resolution monochrome binary image, and specifies a composition target area of the document table from the read image (step S352). At this time, the entire user document 260 may be the synthesis target area, or an area excluding the area corresponding to the mount of the user original 260 may be the synthesis target area. Thereafter, the process of reading the synthesis target area as a target area such as a handwritten character with high resolution, generating a synthesized image, and printing is the same as in the first embodiment.

  In the image processing system according to the fourteenth embodiment of the present invention described above, the objects to be synthesized can be diversified.

In the plurality of embodiments described above, an example in which the result of combining the image of the free drawing area 72 and the image selected in the image selection area 71 has been described has been described. Data representing an image obtained by combining the images selected in the image selection area 71 may be simply output to a removable memory, a communication line, or the like.
In addition, the image processing system of the present invention may be configured by a PC, a printer connected to the PC, and an image scanner, instead of the MFP 1 alone. In this case, an interface such as a USB (Universal Serial Bus) interface for connecting the PC and the image scanner, a USB interface for connecting the PC and the printer, and the like are described in the claims “Printer and Imager”. Corresponds to “the interface to which is connected”.

The schematic diagram which shows the order sheet which concerns on 7th Example of this invention. 1 is a front view of a multifunction machine according to a first embodiment of the present invention. 1 is a block diagram of a multifunction machine according to a first embodiment of the present invention. 1 is a functional block diagram of a multifunction machine according to a first embodiment of the present invention. The schematic diagram which shows the order sheet template which concerns on the 1st Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on the 1st Example of this invention. (A) is a schematic diagram which shows the synthetic | combination template concerning the 1st Example of this invention. (B) is a schematic diagram showing a synthesis result. The flowchart which concerns on the 1st Example of this invention. The schematic diagram which shows the screen transition which concerns on 1st Example of this invention. The flowchart which concerns on 2nd Example of this invention. The functional block diagram which concerns on the 2nd Example of this invention. The schematic diagram which shows the order sheet template which concerns on 3rd Example of this invention. The schematic diagram which shows the order sheet which concerns on 3rd Example of this invention. The schematic diagram which shows the order sheet which concerns on 4th Example of this invention. The schematic diagram which shows the order sheet template which concerns on 4th Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on 5th Example of this invention. The schematic diagram which shows the order sheet template which concerns on 5th Example of this invention. The schematic diagram which shows the synthetic | combination template concerning 5th Example of this invention. The flowchart which concerns on 5th Example of this invention. The schematic diagram which shows the screen transition which concerns on 5th Example of this invention. The schematic diagram which shows the order sheet | seat which concerns on 6th Example of this invention. It is a flowchart which concerns on 6th Example of this invention. The schematic diagram which shows the screen transition which concerns on 6th Example of this invention. The schematic diagram which shows the order sheet which concerns on 7th Example of this invention. The schematic diagram which shows the order sheet which concerns on 8th Example of this invention. It is a functional block diagram concerning the 9th example of the present invention. It is a schematic diagram which shows the order sheet which concerns on 9th Example of this invention. It is a schematic diagram which shows the directory structure based on 9th Example of this invention. It is a flowchart which concerns on 9th Example of this invention. It is a schematic diagram which shows the screen transition based on 9th Example of this invention. It is a schematic diagram which shows the order sheet which concerns on 9th Example of this invention. It is a flowchart which concerns on 9th Example of this invention. It is a flowchart which concerns on 9th Example of this invention. It is a flowchart which concerns on 9th Example of this invention. It is a schematic diagram which shows the density histogram which concerns on 9th Example of this invention. It is a schematic diagram which shows the superimposition synthesis process which concerns on 9th Example of this invention. It is a schematic diagram which shows the screen transition which concerns on 10th Example of this invention. It is a schematic diagram which shows the order sheet which concerns on 10th Example of this invention. It is a schematic diagram which shows the image processing system by 11th Example of invention. It is a schematic diagram which shows the screen transition based on 12th Example of this invention. It is a flowchart which concerns on 12th Example of this invention. It is a schematic diagram which shows the screen transition based on 13th Example of this invention. It is a flowchart which concerns on 13th Example of this invention. It is a schematic diagram which shows the order sheet | seat which concerns on 14th Example of this invention. It is a schematic diagram which shows the screen transition based on 14th Example of this invention. It is a flowchart which concerns on 14th Example of this invention. It is a schematic diagram which shows the user original document concerning 14th Example of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Multifunctional device, 20 Image pick-up part, 30 Printing part, 50 Control part, 60 Image selection instruction | indication reception module (Image selection instruction | indication reception means), 61 Composition instruction | indication reception module (Order sheet request | requirement reception means, Composition condition instruction | indication reception means), 62 Print control module (print control means), 64 Reading control module (reading control means), 66 Composition module (composition means, composition condition recognition means, area extraction means), 70 Order sheet, 81 Verification mark (identification notation), 82, 107 reference mark, 85 superimposition composition condition selection area, 88 m handwriting (composition condition instruction), 113 order sheet template, 110 area frame (area notation), 111 sample (composition condition notation), 116 object

Claims (18)

First receiving means for receiving an order sheet request;
Print control means for causing a printing unit to print a region notation indicating a free drawing region in response to the order sheet request;
Second receiving means for receiving a scan request;
Reading control means for causing the imaging unit to read the paper on which the object is recorded in the free drawing area in response to the scan request;
Combining means for combining the image of the free drawing area read by the imaging unit in response to the scan request with another image;
An image processing system comprising: Image selection instruction receiving means for receiving an instruction to select any one or more accessible images;
The image processing system according to claim 1, wherein the other image is the selected image. The print control unit causes the printing unit to print an image notation representing an accessible image on the paper,
Image selection instruction recognition means for recognizing the image represented by the image notation instructed by the image selection instruction recorded on the paper based on the image read by the imaging unit;
The image processing system according to claim 1, wherein the other image is an image represented by the image notation designated by the image selection instruction. The image selection instruction recognition means recognizes the plurality of images represented by the plurality of image notations instructed by the image selection instruction;
The image processing system according to claim 3, wherein the synthesizing unit synthesizes the image of the object and the plurality of other images.   The image processing system according to claim 3, wherein the reading control unit causes the imaging unit to read the image selection instruction at a resolution lower than that of the free drawing area. The print control means causes the printing unit to print a plurality of synthesis condition notations representing different synthesis conditions for synthesizing the image of the free drawing area and the other image,
A synthesis condition recognizing unit for recognizing the synthesis condition represented by the synthesis condition notation instructed in the synthesis condition instruction recorded on the paper based on an image read by the imaging unit;
The synthesizing unit synthesizes the image of the free drawing area read by the imaging unit and the other image in accordance with the synthesis condition represented by the synthesis condition notation instructed by the synthesis condition instruction. The image processing system according to any one of claims 1 to 5.   The reading control unit causes the imaging unit to read the combination condition instruction at a first resolution, and causes the imaging unit to read the free rendering area at a second resolution higher than the first resolution. 6. The image processing system according to 6. Further comprising synthesis condition instruction accepting means for accepting an instruction of a synthesis condition for synthesizing the image of the object and the other image;
The print control unit causes the printing unit to print the area notation indicating the free drawing area in a mode according to the instructed synthesis condition;
The image processing system according to claim 1, wherein the synthesizing unit synthesizes the image of the object and the other image according to the instructed synthesis condition.   The image processing system according to claim 6, wherein the synthesis condition includes a superposition synthesis condition.   The image processing system according to claim 9, wherein the superposition and synthesis condition includes a boundary processing condition between two images to be superposed and synthesized.   The image processing system according to claim 9, wherein the superposition and synthesis condition includes transparency of two images to be superposed and synthesized. The printing control unit causes the printing unit to print a reference mark on the paper;
The image processing system according to claim 1, wherein the reading control unit recognizes the free drawing area based on the reference mark. An area extracting means for extracting the area of the object recorded in the free drawing area from the image of the free drawing area read by the imaging unit;
The image processing system according to claim 1, wherein the image of the free drawing area is an image of the area of the object. An area extracting means for extracting the area of the object recorded in the free drawing area from the image of the free drawing area read by the imaging unit;
The print control unit causes the printing unit to print the image selected by the image selection instruction accepting unit so thin that the region extraction unit can extract the region of the object, and to print the free drawing region on the printing unit,
The image processing system according to claim 2, wherein the image of the free drawing area is an image of the area of the object.   The area extracting means recognizes the ground color of the paper based on a blank area image outside the free drawing area read by the imaging unit, and recognizes the area of the object based on the ground color of the paper. The image processing system according to claim 13 or 14, characterized in that:   The image processing system according to claim 1, further comprising the printing unit and the imaging unit.   The image processing system according to claim 1, further comprising an interface for connecting the printing unit and the imaging unit. A first reception stage for receiving an order sheet request;
A print control step for causing the printing unit to print a region notation indicating a free drawing region in response to the order sheet request;
A second reception stage for receiving a scan request;
A reading control step for causing the imaging unit to read the paper on which the object is recorded in the free drawing area in response to the scanning request;
Combining the image of the free drawing area read by the imaging unit in response to the scan request with another image;
An image processing method comprising:

Images