JP4281577B2 - Image processing system - Google Patents

Description

The present invention has been created in view of the above problems, and an object of the present invention is to provide an easy-to-handle image processing system that synthesizes and displays a message or the like on image data stored in advance.

  2. Description of the Related Art Conventionally, printing systems that read and print image data stored in a removable memory or the like without connecting to a personal computer or the like are known. In such a printing system, if an attempt is made to accept selection of image data to be printed, setting of image processing conditions such as the number of copies to be printed, layout, etc., from a menu displayed on a small screen, the menu hierarchy becomes deep and the operation is complicated. There is a problem of becoming. On the other hand, if the menu is displayed on a large screen, there is a problem that the manufacturing cost increases.

In Patent Document 1, a list of thumbnail images of image files stored in a removable memory or the like and a mark sheet printed with selectable printing conditions are printed, and the marks written on the mark sheet are optically recognized. An image processing system that accepts various print condition setting operations is disclosed.
However, when trying to create a greeting card or the like with the image processing system disclosed in Patent Document 1, the following problems arise. In general, a greeting card is filled with not only an image recorded by a digital camera or the like but also a message of the sender. However, it is troublesome to hand-write a message for each card on which only an image is printed by the image processing system disclosed in Patent Document 1. In addition, the dedicated glossy paper for high quality printing has a problem that it is difficult to fix handwriting unless it is a specific writing instrument, and it is difficult to write a message after printing an image.

JP 2002-51283 A

  The present invention was created in view of the above problems, and an object of the present invention is to provide an easy-to-handle image processing system and image processing method for composing and displaying a message or the like on image data stored in advance. And

  In order to achieve the above object, an image processing system according to the present invention includes a first operation unit that receives an order sheet request, an image selection area that displays accessible image data when the order sheet request is received, A first output unit that prints an order sheet having a free drawing area; a second operation unit that receives a composite display request; and when the composite display request is received, the order sheet is read, and any one of the image data is read Order reading means for optically recognizing a first selection instruction written on the order sheet to be instructed and outputting an image of the free drawing area, an image represented by image data instructed by the first selection instruction, Second output means for combining and displaying the image of the free drawing area. According to the image processing system of the present invention, an order sheet having an image selection area in which accessible image data is written is printed. Therefore, the user can easily know accessible image data. Further, since the first selection instruction written in the image selection area of the order sheet is optically recognized, the user can easily set the image data to be combined in the image processing system. Further, an order sheet having a free drawing area is printed, and an image represented by image data that can access a free drawing area handwritten message or the like by reading a handwritten message or the like written in the free drawing area by an order reading unit; Composite display is possible. In other words, according to the image processing system of the present invention, even if hardware that provides an HMI (Human Machine Interface) is simple, an operation for combining and displaying preliminarily stored image data and a message or the like is facilitated. be able to.

  Furthermore, the image processing system according to the present invention further includes third operation means for accepting an operation for selecting a layout, and the first output means is selected by the third operation means when the order sheet request is accepted. The order sheet having the free drawing area according to a layout is printed, and the second output means has a layout selected by the third operation means, and the image data instructed by the first selection instruction is The displayed image and the image of the free drawing area are combined and displayed. According to the image processing system of the present invention, an order sheet having a free drawing area in a mode according to the selected layout is printed, so that the user can select a mode (position, size, shape, A handwritten message or the like can be drawn on an order sheet having a free drawing area such as the number of areas. Therefore, when the user draws a handwritten message or the like in the free drawing area, the user can easily imagine the result of the combined display with the image instructed by the first selection instruction.

  Furthermore, in the image processing system according to the present invention, the order sheet further includes a layout selection area that indicates a plurality of layouts, and the order reading unit indicates the order sheet that indicates one of the plurality of layouts. The second output instruction is optically recognized, and the second output means has the layout indicated by the second selection instruction and the image represented by the image data indicated by the first selection instruction and the free drawing Combine and display the image of the area. According to the image processing system of the present invention, since the order sheet further includes a layout selection area in which a plurality of layouts are written, the user can set a layout in addition to inputting an instruction for a composite image, a handwritten message, and the like. This can be done by filling in an order sheet. Therefore, it is possible to easily set image processing conditions.

  Furthermore, in the image processing system according to the present invention, the order sheet has a superimposition / combination condition selection area indicating a plurality of superposition / combination conditions, and the order reading unit instructs one of the plurality of superposition / combination conditions Optically recognizing a third selection instruction written on the order sheet, and the second output means is image data instructed by the first selection instruction under a superposition and synthesis condition instructed by the third selection instruction. And the image of the free drawing area are combined and displayed. According to the image processing system of the present invention, since the order sheet has a superimposition / combination condition selection area in which a plurality of superposition / combination conditions are written, the user can easily know the superimposition / combination conditions that can be easily selected. In addition, since the image processing system according to the present invention optically recognizes the third selection instruction written on the order sheet that instructs one of a plurality of superposition and synthesis conditions, the user can perform the superposition and synthesis conditions with a simple operation. Can be selected.

  Furthermore, in the image processing system according to the present invention, the order reading unit optically recognizes the first selection instruction that instructs any two or more of the image data, and the second output unit includes the first output unit. The image represented by the plurality of image data instructed by the selection instruction and the image of the free drawing area are combined and displayed. The image processing system according to the present invention optically recognizes a first selection instruction that indicates any two or more of image data. For this reason, it is possible to select a plurality of image data as image data to be displayed, and it is possible to diversify the layout of the combined display of the plurality of image data and the image data in the free drawing area.

  Furthermore, in the image processing system according to the present invention, the order sheet has a reference mark, and the order reading unit recognizes the position of the free drawing area based on the reference mark and reads the free drawing area. According to the image processing system of the present invention, the order sheet has a reference mark, and the position of the free drawing area is recognized based on the reference mark. Therefore, the position of the free drawing area can be relatively recognized on the image representing the order sheet, and the actual free drawing area can be accurately recognized.

  Further, in the image processing system according to the present invention, the second output means recognizes the area of the object described in the free drawing area based on the image of the free drawing area and is instructed by the first selection instruction. The image represented by the image data and the image of the object described in the free drawing area are superimposed and displayed. The image processing system according to the present invention superimposes and displays an image represented by instructed image data and an image of an object described in a free drawing area. For example, a printed material with a design in which a message is handwritten directly on a photograph. Can be created. Note that the object is not limited to the handwriting of handwritten characters, but may be a magazine cut out or the like pasted in a free drawing area, or a word processor character printed in a free drawing area.

  Furthermore, in the image processing system according to the present invention, the order reading unit reads a blank area outside the free drawing area to recognize a ground color of the order sheet, and based on the ground color of the order sheet, the free drawing area Recognize the area of the object described in. Since the image processing system according to the present invention reads the blank area outside the free drawing area and recognizes the ground color of the order sheet, the area of the object can be accurately extracted from the image of the free drawing area.

  Further, in the image processing system according to the present invention, the order reading means reads the order sheet at a low resolution to optically recognize the first selection instruction, and outputs the image of the free drawing area. Read free drawing area with high resolution. According to the image processing system of the present invention, an object can be read at a high resolution while limiting a reading range with a high resolution that takes a long time to read, and thus a composite image can be displayed at high speed and with high quality.

  In order to achieve the above object, an image processing system according to the present invention includes an operation unit that receives a composite display request, an image selection area that displays accessible image data when the composite display request is received, and free drawing. An order reading means for reading an order sheet having a region, optically recognizing a first selection instruction written on the order sheet indicating any of the image data, and outputting an image of the free drawing region; An output unit configured to combine and display the image represented by the image data instructed by the first selection instruction and the image of the free drawing area; In the image processing system according to the present invention, the first selection instruction written on the order sheet indicating any of the image data is optically recognized, and an instruction is given by the user by reading the image of the free drawing area. An image and a handwritten message can be combined and displayed. In other words, according to the image processing system of the present invention, even if the hardware that provides the HMI is simple, an operation for combining and displaying preliminarily stored image data and messages can be facilitated.

  To achieve the above object, an image processing method according to the present invention is an image processing method by an image processing system for reading and printing an image, and prints an order sheet on which accessible image data is written. A first input stage, a first input stage for optically recognizing an image selection instruction written on the order sheet indicating one of the image data, and reading an object in association with the image selection instruction. A second input stage for outputting an image of the object, and a second output stage for combining and displaying the image represented by the image data instructed by the image selection instruction and the image of the read object. According to the image processing method of the present invention, the user can easily know accessible image data by causing the image processing system to print an order sheet on which accessible image data is written. Further, the user can easily set the image data to be displayed in the image processing system by causing the image processing system to optically recognize the image selection instruction written on the order sheet. Further, the user combines the image of the object with the image represented by the accessible image data by causing the image processing system to read the object such as a piece of paper on which handwritten characters are written in association with the image selection instruction. Can be displayed. That is, according to the image processing method according to the present invention, even if the hardware that provides the HMI is simple, the user can easily operate the image represented by the accessible image data and the image of the target object with a simple operation. Can be combined and displayed.

  Furthermore, the image processing method according to the present invention prints the order sheet on which at least a part of selectable image processing conditions is written in the first output stage, and writes the order sheet on the order sheet in the first input stage. A processing condition selection instruction for instructing any one of the image processing conditions is optically recognized, and in the second output stage, the combined display is performed using the image processing conditions specified by the processing condition selection instruction. According to the image processing method of the present invention, the user can easily set the image processing condition in the image processing system by causing the image processing system to optically recognize the processing condition selection instruction written on the order sheet.

  Furthermore, in the image processing method according to the present invention, in the first output stage, the order sheet in which a synthesis condition is expressed as a part of the selectable image processing conditions is printed, and in the second output stage, the processing is performed. The composite display is performed using the composite condition specified by the condition selection instruction. According to the image processing method of the present invention, the user can easily set the synthesis condition in the image processing system by causing the image processing system to optically recognize the processing condition selection instruction written on the order sheet.

  Furthermore, in the image processing method according to the present invention, the synthesis condition includes a boundary process condition between two images to be superimposed and synthesized. According to the image processing method of the present invention, the user easily sets the boundary processing conditions of two images in the image processing system by causing the image processing system to optically recognize the processing condition selection instruction written on the order sheet. be able to.

  Furthermore, in the image processing method according to the present invention, the synthesis condition includes transparency of two images to be superimposed and synthesized. According to the image processing method of the present invention, the user can easily set the transparency of two images in the image processing system by causing the image processing system to optically recognize the processing condition selection instruction written on the order sheet. it can.

  Furthermore, in the image processing method according to the present invention, after the second output stage, a third input stage for receiving a key operation for setting at least a part of the image processing conditions, the image data instructed by the image selection instruction, and the And a third output step of combining and displaying the read object using the image processing condition instructed by the processing condition selection instruction and the image processing condition set by the key operation. According to the image processing method of the present invention, the user displays a composite image on the image processing system on a trial basis, and then sets a part of the image processing condition by key operation, whereby the optically set image processing condition is set. And the image processing apparatus can be combined and displayed based on the image processing conditions set by key operation. For example, after a desired composite display result is obtained in the second output stage, the user sets a part of image processing conditions such as the number of prints with a key operation, so that the desired number of prints can be printed without waste. Obtainable.

  Furthermore, in the image processing method according to the present invention, the order sheet has a free drawing area where handwritten characters or figures as the object are written, and in the second input stage, the free drawing area is read. In the second output stage, the area of the object described in the free drawing area is recognized based on the image of the free drawing area, and the image represented by the image data instructed by the image selection instruction and the free drawing area Are superimposed and displayed on the image of the object described in (1). According to the image processing method of the present invention, since the order sheet has a free drawing area, a process for setting a reading range for reading the object, and a process for extracting the area of the object from the read image Can be simplified. Therefore, according to the image processing method of the present invention, the composition process can be speeded up.

  Further, in the image processing method according to the present invention, in the first input step, the order sheet is read at a low resolution to optically recognize the image selection instruction and the range of the free drawing area, and the second input step. The free drawing area is read at a high resolution. According to the image processing method of the present invention, it is possible to read an object with a high resolution while limiting a reading range with a high resolution that takes a long time to read, and therefore, a composite image can be displayed at high speed and with high quality.

  In order to achieve the above object, an image processing system according to the present invention includes a first output unit that prints an order sheet on which accessible image data is represented, and an indication on the order sheet that indicates one of the image data. First input means for optically recognizing the selected image selection instruction, second input means for reading an object in association with the image selection instruction, an image represented by the image data instructed by the image selection instruction, and the reading Second output means for combining and displaying the image of the target object. According to the present invention, the user can easily know accessible image data by causing the image processing system to print an order sheet on which accessible image data is written. Further, the user can easily set the image data to be displayed in the image processing system by causing the image processing system to optically recognize the image selection instruction written on the order sheet. Further, the user combines the image of the object with the image represented by the accessible image data by causing the image processing system to read the object such as a piece of paper on which handwritten characters are written in association with the image selection instruction. Can be displayed. That is, according to the image processing system according to the present invention, even if the hardware that provides the HMI is simple, the user can easily operate the image represented by the accessible image data and the image of the object with a simple operation. Can be combined and displayed.

Hereinafter, embodiments of the present invention will be described based on a plurality of examples.
(First Example)
FIG. 2 is a front view showing an external appearance of the multifunction machine 1 as the first embodiment of the image processing system of the present invention. FIG. 3 is a block diagram showing the multifunction machine 1 according to the first embodiment of the present invention. The multifunction device 1 has a function of reading a document and outputting image data to a personal computer (PC), a function of copying the document, a function of printing data output from the PC, and image data input from the removable memory 3. Has a function of printing. Further, the multifunction device 1 can accept the print condition setting operation by printing the order sheet and optically recognizing the print condition written on the order sheet.

As shown in FIG. 3, the scanner unit 20 of the multifunction device 1 includes an image sensor 21, an optical system 22, a first main scanning drive unit 23, a first sub-scanning driving unit 24, an AFE (Analog Front End) unit 25, a digital unit. An image processing unit 26 and the like are provided.
The image sensor 21 driven by the first main scanning drive unit 23 includes RGB three-channel light receiving elements, and is mounted on a carriage 27 that moves in parallel with a document table (not shown). The image sensor 21 outputs an electrical signal correlated with the density of the optical image on the scanning line formed on the light receiving surface by the optical system 22 including a lens and a mirror (not shown).

  The first sub-scanning drive unit 24 includes a slide shaft that is installed perpendicular to the longitudinal axis of the scan line and that holds the carriage 27 slidably, a carriage motor, a drive belt, and a drive circuit. When the carriage motor pulls the carriage 27 with the drive belt, the image sensor 21 and the document move relative to each other in the direction perpendicular to the scanning line, so that a two-dimensional image can be scanned.

The AFE unit 25 includes an analog signal processing unit, an A / D converter, and the like.
The digital image processing unit 26 performs processing such as shading correction on the output signal output from the AFE unit 25 to create a digital image.
The printer unit 30 of the multifunction device 1 includes a recording head 31, a head driving unit 32, a second main scanning driving unit 33, a second sub scanning driving unit 34, and the like for forming an image on a sheet by an ink jet method. The printer unit 30 may be configured to support other printing methods such as a laser method.

The recording head 31 is provided on a carriage 37 on which an ink cartridge (not shown) is mounted, and includes a nozzle, a piezo element, an ink passage, and the like.
The second main scanning drive unit 33 includes a carriage motor, a drive belt, a drive circuit for driving the carriage motor, etc. (not shown). As the carriage motor pulls the carriage 37 with the drive belt, the recording head 31 reciprocates in the main scanning direction.

The second sub-scanning drive unit 34 includes a paper conveyance roller, a paper feed motor, a drive circuit for driving the paper feed motor, and the like (not shown). When the paper feed motor rotates the paper transport roller, the print paper is transported in a direction perpendicular to the main scanning direction.
The card read / write unit 41 includes a card slot (not shown) for inserting the removable memory 3, a memory controller, and the like. The image data stored in the image file stored in the removable memory 3 corresponds to the accessible image data described in the claims. Note that the image data to be printed by the multifunction device 1 may be stored in the internal memory of the multifunction device 1, or a portable electronic device such as a digital camera connected to the multifunction device 1 or a mobile phone with a camera function. May be stored in a storage device such as a hard disk device connected to the multifunction device 1, or may be stored in a file server accessible from the multifunction device 1 via a communication line. It may be.

The operation unit 42 includes an LCD 14 for displaying a menu, and various buttons such as a determination button 10 and a cross button 12 for operating the menu.
The control unit 50 includes a CPU 51, a ROM 52, and a RAM 53. The CPU 51 executes programs stored in the ROM 52 to control each unit of the multifunction machine 1. The ROM 52 is a memory that stores various programs and data, and the RAM 53 is a memory that temporarily stores various programs and data. These various programs and data may be downloaded and input from a predetermined server via a network, or may be read from a computer-readable storage medium such as the removable memory 3 and input.

FIG. 4 is a functional block diagram of the multifunction device 1.
The third operation means 66 includes an operation unit 42, a control unit 50, and the like, and accepts a predetermined button operation for selecting a layout between an image selected in an image selection area 71 described later and an image representing a free drawing area 72. .
The first operation means 61 includes a control unit 50, an operation unit 42, and the like, and accepts a predetermined button operation as an order sheet request.

  The first output means 62 includes a control unit 50, a card read / write unit 41, a printer unit 30, and the like. When the order sheet request is received by the first operation means 61, the first output means 62 reads the image data stored in the removable memory 3 and the template stored in the ROM 52 and prints an order sheet described later. The first output means 62 corresponds to the first output means described in claims 1 and 19 and the output means described in claim 10.

The second operation means 63 includes a control unit 50, an operation unit 42, and the like, and accepts a predetermined button operation as a composite image print request. The print request for the composite image corresponds to the composite display request described in the claims.
The order reading unit 64 includes the control unit 50, the scanner unit 20, and the like. When a print request for the composite image is received by the second operation unit 63, the order reading unit 70 is read and a verification mark 81, a reference mark 82, which will be described later, The filled check boxes 74m, 76m, 79m, 86m, and 87m are optically recognized, and an image of the free drawing area 72 is output.

  The second output unit 65 includes the control unit 50, the printer unit 30, and the like, and prints a composite image of the image selected in the image selection area 71 and the image representing the free drawing area 72. In the preview described later, the second output means 65 displays the composite image on the LCD 14 without printing. Printing or displaying the synthesized image on the LCD 14 corresponds to synthesizing and displaying the image data recited in the claims.

  FIG. 5 is a schematic diagram showing an example of an order sheet 70 printed by the multifunction machine 1 in a state where the removable memory 3 having the directory structure shown in FIG. 6 is connected. The layout of the order sheet 70 is defined by a template stored in the ROM 52. FIG. 1 is a schematic diagram showing an example of an order sheet 70 in which necessary items are entered by a user. The arrangement of each element written on the order sheet 70 is set with reference to the reference mark 82.

The reference mark 82 is laid out in the upper left corner of the order sheet 70. When the order reading unit 64 recognizes the position of the reference mark 82, the position of each element written on the order sheet 70 can be relatively recognized.
In the image selection area 71, image files (for example, tree.jpg, face.jpg, flower.jpg, sea.jpg, maple.jpg, sunrise.jpg, mountain.jpg) stored in the DCIM folder 90 of the removable memory 3 are displayed. jpg, person.jpg) are laid out and thumbnail images 73 and check boxes 74 are laid out. By painting the check box 74, the main image of the image file corresponding to the thumbnail image 73m (for example, the sunrise.jpg thumbnail image) laid out immediately above the check box 74m can be selected as a compositing target. The handwriting that fills the check box 74m corresponds to the first selection instruction described in the claims. The image file stored in the DCIM folder 90 of the removable memory 3 may be expressed as a main image or may be expressed by printing a file name or an internal identifier.

  The verification mark 81 is laid out in the upper right corner of the order sheet 70. The verification mark 81 is the same between the removable memory 3 connected to the multifunction device 1 when an order sheet request is accepted and the removable memory 3 connected to the multifunction device 1 when a composite image print request is accepted. This represents a checksum for verifying sex. Specifically, for example, the checksum corresponds to the total number of all image files stored in the DCIM folder 90. The verification mark 81 may be an optically easily recognized mark such as a bar code representing a number for verifying the identity.

  The free drawing area 72 is a blank area for drawing a handwritten character (for example, “Kagasho”) or pasting a magazine cutout, and is surrounded by a rectangular frame. Characters and figures handwritten in the free drawing area 72, printed matter pasted in the free drawing area 72, and characters and figures printed in the free drawing area correspond to the objects described in the claims.

  In the area 75 for selecting the number of printed sheets, a check box 76 corresponding to each digit of the number of printed sheets from 0 to 99 and a check box 84 for selecting a preview are laid out. The tens digit of the number of printed sheets is selected by filling the check box 76 laid out in the left column, and the first digit of the number of printed sheets is filled in by filling the check box 76 laid out in the right column. Can be selected. The number of printed sheets corresponds to one of the image processing conditions described in the claims.

  In the layout selection area 77, an image 78 and a check box 79 schematically showing the layout are laid out. By filling the check box 79, a layout corresponding to the image 78m laid out immediately above the check box 79m can be selected. The handwriting (79m) in which the check box 79 is filled corresponds to the second selection instruction and the image selection instruction described in the claims.

  A check box 86 and a check box 87 are displayed in the superimposition synthesis condition selection area 85. By filling the check box 86, it is possible to select a boundary processing condition as to whether or not to perform white bordering when a handwritten character is superimposed and synthesized on the image selected in the image selection area 71. Further, by filling the check box 87, the transparency (for example, 0%) of the layer representing the handwritten character can be selected. The handwriting (86m and 87m) in which the check boxes 86 and 87 are filled corresponds to the third selection instruction and the processing condition selection instruction described in the claims. Further, the layout and the superposition synthesis conditions correspond to the synthesis conditions described in the claims. Note that the width of the white border may be set as the boundary processing condition, or another transparency may be selected as the superposition synthesis condition.

FIG. 7 is a flowchart showing a process of printing a composite image by the multifunction machine 1 according to the first embodiment of the present invention. FIG. 8 is a schematic diagram showing screen transition of the LCD 14 in the processing.
When the removable memory 3 is connected to the multifunction device 1 and the user selects “print order sheet” with the cross button 12 and presses the enter button 10 on the menu screen 100, the template of the order sheet 70 is selected on the LCD 14. A screen 102 is displayed. When the user selects a template (for example, a New Year's card) with the cross button 12 and presses the enter button 10 on the screen 102, the first operation means 61 receives a print request for the order sheet 70. When the first operation means 61 accepts the print request for the order sheet 70, the process proceeds to step S102 (step S100).

In step S <b> 102, a screen 104 indicating that the order sheet 70 is being printed is displayed on the LCD 14, and the first output unit 62 prints the order sheet 70.
In step S <b> 104, the user fills the check boxes 74, 76, 79, 86, and 87 of the printed order sheet 70 according to the image processing condition to be set, and draws handwritten characters in the free drawing area 72.

  Next, when the user places the order sheet 70 at a predetermined position on the document table (not shown), selects “print composite image” with the cross button 12 on the menu screen 100 and presses the enter button 10, the second operation means 63 accepts a composite image print request. When the second operation means 63 receives the composite image print request, the process proceeds to step S108 (step S106).

In step S108, a screen 106 indicating that the composite image is being printed is displayed on the LCD 14, and the second output means 65 prints the composite image. When printing of the composite image is completed, the menu screen 100 is displayed on the LCD 14.
FIG. 9 is a flowchart showing details of the process for printing the order sheet 70 (step S102). The process of printing the order sheet 70 in step S102 corresponds to the first output stage described in the claims.

  When the print request for the order sheet 70 is received by the first operation unit 61, the first output unit 62 assigns an identifier to the image file stored in the DCIM folder 90 of the removable memory 3 (step S200). At this time, a serial number as an identifier is assigned to each image file in the ASCII code order of the file name of the image file.

Next, a checksum is set (step S201). The checksum is calculated according to the content of data stored in the DCIM folder 90 of the removable memory 3 and stored in a predetermined area of the RAM 53.
Next, the template selected in step S100 is read from the ROM 52 into the RAM 53 (step S202), and the first output means 62 assigns the thumbnail image of the image file and the verification mark 81 to the layout frame defined by the template and orders them. The sheet 70 is printed (step S203).

FIG. 10 is a flowchart showing details of the process (step S108) for printing the composite image.
In step S300, the order reading unit 64 reads the order sheet 70 as a low-resolution monochrome binary image, and the positions of the verification mark 81 and the check boxes 74, 76, 79, 86, 87 on the image based on the reference mark 82. Then, the verification mark 81 and the processing conditions selected by the filled check boxes (see FIG. 1) 74m, 76m, 79m, 86m, and 87m are optically recognized.

  In step S302, the checksum corresponding to the verification mark 81 recognized in step S300 is compared with the checksum set in step S201, and the image file written in the order sheet 70 is stored in the removable memory 3. It is determined whether the image files match. If they match, the process proceeds to step S304. If they do not match, a screen is displayed on the LCD 14 that warns that the image file written in the order sheet 70 is different from the image file stored in the removable memory 3 (step 14). S306).

In step S304, it is determined whether or not two or more image files are selected in the image selection area 71. If only one image file has been selected, the process proceeds to step S308. If two or more image files have been selected, a screen for warning that effect is displayed on the LCD 14 (step S310).
Next, the range of the free drawing area 72 is recognized based on the reference mark 82 recognized in step S300 (step S308). By specifying the range of the free drawing area 72 on the image using the reference mark 82, the position of the free drawing area 72 can be accurately determined even when the order sheet 70 is not placed at a predetermined position on the document table. Can be specified.

Next, the order reading unit 64 reads the free drawing area 72 and the margin area 83 (see FIG. 5) in the vicinity thereof with high resolution (step S312).
Next, a region of an object such as a handwritten character is extracted from the image representing the free drawing region 72 (step S314). If the image representing the free drawing area 72 is directly combined with the image selected in the image selection area 71 without performing step S314, the image representing the entire area including the margin of the free drawing area 72 is selected in the image selection area 71. An image (see FIG. 13A) synthesized with the selected image can be created.

In step S316, the object such as the handwritten character in the area extracted in step S314 and the image to be combined selected in the image selection area 71 are combined according to the layout selected in the layout selection area 77.
Next, printing of the composite image is repeated by the second output means 65 until the composite image is printed by the number of prints selected in the area 75 for selecting the number of prints (steps S318 and 320).

FIG. 12 is a flowchart showing details of a process (step S314) for extracting a handwritten character area from an image representing the free drawing area 72 and superimposing the extracted area on the image selected in the image selection area 71. is there.
In step S400, a threshold value for separating the blank area 83 where the ground color of the order sheet 70 appears and the handwritten character is determined. Specifically, first, a luminance histogram of the margin area 83 is created. In this luminance histogram, as shown in FIG. 11, the distribution is concentrated on the luminance value corresponding to the ground color of the order sheet 70. Therefore, next, a threshold value for extracting the object region from the image representing the free drawing region 72 is set in the vicinity of the range where the distribution is concentrated. Thereby, it is possible to set an appropriate value according to the ground color of the printing paper used for the order sheet 70.

  In step S402, based on the specified threshold value, an area of handwritten characters is extracted from the image representing the free drawing area 72, and the alpha channel value of the area is selected by the check box 87 of the superposition synthesis condition selection area 85. And set the alpha channel value for all other areas to be completely transparent. The alpha channel is a channel that represents the transparency of the layer of the image for each pixel.

  In step S403, noise included in the region extracted as handwritten characters is removed. Specifically, the transparency of the island-shaped region composed of a predetermined number or less of the extracted regions is set to be completely transparent. Here, FIG. 13B is a schematic diagram showing the superposition synthesis process when the transparency of the area corresponding to noise is not changed in the alpha channel, that is, when noise removal is not performed, and FIG. FIG. 10 is a schematic diagram showing a superposition and synthesis process when the transparency of a region corresponding to noise in the alpha channel is made completely transparent, that is, when noise is removed.

  Next, if white bordering is selected as the superposition synthesis condition, the opaque region of the alpha channel is expanded (step S404). As a result, in step S316, the ground color of the order sheet 70 around the handwritten character is superimposed and synthesized on the image selected in the image selection area 71, so that the handwritten character is trimmed to form a synthesized image. (See FIG. 13D). The processing in step S314 has been described in detail above.

  According to the MFP 1 according to the first embodiment of the present invention described above, the user can easily recognize image processing conditions such as accessible image data, selectable layout, number of prints, boundary processing conditions, and the like. . Further, the user can easily select an image to be combined from accessible image data, select an image processing condition, and input a handwritten message to be combined with the image to be combined. Therefore, even if the hardware providing the HMI is a simple system, the user can easily display a desired image and a handwritten message on the system.

Further, since the order sheet 70 has the reference mark 82, the position of the free drawing area 72 in which a handwritten message or the like is written can be relatively recognized on the image representing the order sheet 70. The region 72 can be recognized accurately.
Furthermore, since superimposition and synthesis can be selected as the image processing condition, for example, a printed matter with a design in which a message is handwritten directly on a photograph can be created.

Furthermore, since the blank area 83 is read to recognize the ground color of the order sheet 70, the handwritten character area can be accurately extracted from the image representing the free drawing area 72.
Furthermore, by reading the order sheet 70 at a low resolution and reading the free drawing area 72 and the margin area 83 in the vicinity thereof at a high resolution, the reading time of the order sheet 70 can be shortened without degrading the image quality of the composite image. it can.

Note that the image processing system according to the present invention may be configured by a PC and a printer and a scanner connected to the PC, instead of the multifunction device 1 alone.
Further, the image processing system of the present invention may be configured by a single printer including a paper position detection optical sensor provided in the paper transport path. That is, a check box filled with an order sheet may be recognized by such a paper position detection optical sensor.

Further, instead of laying out the thumbnail image 73 in the image selection area 71, an identifier or a file name may be laid out. In this case, it is desirable that the thumbnail image 73 and an identifier corresponding to the thumbnail image 73 can be displayed on the LCD 14.
(Second embodiment)
In the multi function device 1 according to the second embodiment, an order sheet 70 capable of selecting two image files in the image selection area 71 is used. In the second embodiment, parts that are substantially the same as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

FIG. 14 is a schematic diagram showing screen transition according to the second embodiment of the present invention.
When the user selects “print order sheet” with the cross button 12 and presses the decision button 10 while the menu screen 100 is displayed, a screen 202 for selecting a layout is displayed on the LCD 14. An icon 203 schematically representing the layout is displayed on the screen 202. When the user selects one of the icons with the cross button 12 and presses the enter button 10 while the screen 202 is displayed, the layout indicated by the icon is selected and the first operation means 61 is selected. A print request for the order sheet 70 corresponding to the request is accepted (step S100).

FIG. 15 is a schematic diagram showing an example of an order sheet 70 according to the second embodiment of the present invention.
In the image selection area 71, check boxes 74a and 74b are printed for each thumbnail image 73. The user can select two image files by painting any one of the check boxes 74a and painting any one of the check boxes 74b.

In the free drawing area 72, a rectangular frame indicating areas 89a and 89b in which an image represented by the image file selected in the image selection area 71 is laid out is written. The user can draw handwritten characters in the free drawing area 72 outside the areas 89a and 89b.
In the image processing system according to the second embodiment of the present invention described above, since the order sheet 70 according to the layout selected by the user is output, when the user writes a handwritten message or the like in the free drawing area 72, The result of the synthesis with the image to be synthesized can be easily imaged. Further, two images to be combined can be selected simply by painting the check boxes 74a and 74b of the order sheet 70.

(Third embodiment)
An order sheet receiving terminal as a third embodiment of the image processing system of the present invention is an apparatus that reads an order sheet and receives a print order. In the third embodiment, parts substantially the same as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

FIG. 16 is a schematic diagram showing a printing system using an order sheet receiving terminal according to the third embodiment of the present invention. The printing system 6 includes an order sheet reception terminal 4, a printer 212 connected to the order sheet reception terminal 4, a PC 210, and a printer 211 connected to the PC 210.
The order sheet reception terminal 4 is installed, for example, in a store that provides a digital image print service, a convenience store, or the like. The order sheet reception terminal 4 includes an input unit 213, an operation unit 214, an order reading unit 64, and an output unit 215. The operation means 214 has substantially the same function as the second operation means of the first embodiment. The output means 215 has substantially the same function as the second output means of the first embodiment. The input unit 213 is an interface for inputting data stored in the removable memory 3.

  The order sheet accepting terminal 4 accepts a predetermined button operation by the user as a request for reading the order sheet 70 by the operating means 214, and outputs the composite image to a display device (not shown) provided in the order sheet accepting terminal 4 by the output means 215. Display a preview of the print result. The composite image is generated based on the image input from the removable memory 3 by the input unit 213 and printed by the printer 212 connected to the order sheet receiving terminal 4.

In the image processing system according to the third embodiment of the present invention described above, the user can easily print a high-quality composite image in which handwritten characters and the like are laid out without having a printer capable of high-quality printing. Available.
(Fourth embodiment)
In the image processing system according to the fourth embodiment, the setting of the number of prints is accepted by a key operation. In the fourth embodiment, parts substantially the same as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

FIG. 17 is a schematic diagram showing screen transition of the LCD 14 in the fourth embodiment of the present invention, and FIG. 18 is a flowchart showing processing for printing a composite image by the image processing system in the fourth embodiment of the present invention.
In step S330 of the process of printing the composite image, the multifunction device 1 determines that the request is a preview request when it recognizes that the check box 84 for selecting the preview of the order sheet 70 is filled, and proceeds to step S332 to determine that it is not a preview request. Then, it progresses to step S318. In step S <b> 332, the multifunction device 1 displays the test mode screen 220 on the LCD 14. On the test mode screen 220, a composite image 228 of the image represented by the handwritten character described in the free drawing area 72 and the image file selected in the image selection area 71 is displayed. In addition, a “print” button 222 and a number setting box 224 are displayed on the test mode screen 220. On the test mode screen 220, the desired number of prints can be set in the number setting box 224 by operating the cross button 12 up and down. When the cross button 12 is operated left and right, the “print” button 222 or the “return” button 226 is selected. When the enter button 10 is pressed while the “print” button 222 is selected, a print request for the set number of prints is accepted, and the process proceeds to step S318 (step S334). In steps S318 and S320, the second output unit 65 repeats printing of the composite image until the composite image is printed for the set number of prints.

In step S332, the composite image 228 is displayed on the test mode screen 220. However, the composite image 228 may be printed and displayed by the second output unit.
In the image processing system according to the fourth embodiment of the present invention described above, when the user sets the desired number of prints after displaying the composite image on the screen or printing in response to the preview request set in the order sheet 70, There is no need to read the order sheet again just to set the number of prints. That is, when setting a desired number of printed sheets, the user does not need to read an order sheet that takes a long time, and the number of printed sheets can be set by a simple button operation, so the work time can be shortened.

(Fifth embodiment)
In the image processing system according to the fifth embodiment, the image of the free drawing area 72 obtained when the order sheet 70 is read at a low resolution and the thumbnail image of the image file selected in the image selection area 71 are combined and displayed on the screen. When the user's print request is received, the image of the free drawing area 72 obtained when the order sheet 70 is read at high resolution and the main image of the image file selected in the image selection area 71 are combined and printed. In the fifth embodiment, parts substantially the same as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

FIG. 19 is a schematic diagram showing screen transition of the LCD 14 in the fifth embodiment of the present invention, and FIG. 20 is a flowchart showing processing for printing a composite image by the image processing system in the fifth embodiment of the present invention.
In step S340, the multi function device 1 uses the image of the free drawing area 72 read at low resolution in step S300 and the thumbnail image of the image file selected in the image selection area 71 as the image processing conditions set in the order sheet 70. The synthesized image 238 synthesized based on the result is displayed on the test mode screen 230 of the LCD 14. When the “print” switch 232 displayed on the test mode screen 230 is selected by operating the cross button 12 and the enter button 10 is pressed, a print request is accepted (step S342), and the process proceeds to step S312. In steps S312, S314, S316, S318, and S320, as described in the first embodiment, the free drawing area 72 is read at a high resolution, and the main image and the free drawing area of the image file selected in the image selection area 71 are read. 72 high-resolution images are combined, and the set number of sheets are printed. The test mode screen 230 also includes a “return” switch 236. When the user selects the “return” switch 236 using the cross button 12 and presses the enter button 10, printing is not performed (step S342), and the menu screen 100 is displayed. indicate.

  In the image processing system according to the fifth embodiment of the present invention described above, the image of the free drawing area 72 obtained when the order sheet 70 is read at a low resolution and the thumbnail image of the image file selected in the image selection area 71 are displayed. Then, the images are synthesized based on the image processing conditions set in the order sheet 70 and displayed on the test mode screen 230. For this reason, the user can make a print request after confirming an approximate print result. Therefore, the image processing system according to the fifth embodiment of the present invention can save printing paper and ink consumed in test printing. Further, in the image processing system according to the fifth embodiment of the present invention, the composite image 238 on the test mode screen 230 is displayed based on the low resolution read image and the thumbnail image, so the time required for confirming the print result is shortened. can do.

  In the plurality of embodiments described above, an example in which the result of combining the image of the free drawing area 72 and the image selected in the image selection area 71 has been described has been described. Data representing an image obtained by combining the images selected in the image selection area 71 may be simply output to a removable memory, a communication line, or the like.

(Sixth embodiment)
In the image processing system according to the sixth embodiment, it is possible to select an image to be combined in the order sheet 70, and to set the layout, the number of printed sheets, and the boundary processing conditions as image processing conditions. After reading, a handwritten message or the like is separately read and combined with the selected image. In the sixth embodiment, parts substantially the same as those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

FIG. 21 is a schematic diagram showing an order sheet 70 according to the sixth embodiment of the present invention. The order sheet 70 includes an image selection area 71, an area 75 for selecting the number of copies, a layout selection area 77, and a superimposition / combination condition selection area 85.
FIG. 22 is a schematic diagram showing screen transition of the LCD 14 according to the sixth embodiment of the present invention, and FIG. 23 is a flowchart showing processing for printing a composite image in the image processing system according to the sixth embodiment of the present invention. 24 is a schematic diagram showing the user document 260.

  When the user places the order sheet 70 on a document table (not shown), selects “print a composite image” with the cross button 12 on the menu screen 100 and presses the enter button 10, the second operation unit 63 A print request for the composite image is received, and processing for printing the composite image is started. In step S300 of the process of printing the composite image, the multifunction device 1 reads the order sheet 70 as a low-resolution monochrome binary image, recognizes the image to be combined and the image processing conditions, and performs various processes in steps S302 and S304. When the error is checked, a document set standby screen 240 is displayed on the LCD 14. Next, when the user places the user document 260 on a document table (not shown) and presses the enter button 10, it is determined that the setting of the user document 260 is completed (step S350), and the process proceeds to step S352. Here, the rectangular user document 260 may be a rectangular document placed at a predetermined position on the document table, or a document of an arbitrary shape placed at an arbitrary position on the document table. Next, the multifunction device 1 displays a screen 242 indicating that a composite image is being printed on the LCD 14. In addition, the multi function device 1 reads an image of the entire document table as a low-resolution monochrome binary image, and specifies a composition target area of the document table from the read image (step S352). At this time, the entire user document 260 may be the synthesis target area, or an area excluding the area corresponding to the mount of the user original 260 may be the synthesis target area. Thereafter, the process of reading the synthesis target area as a target area such as a handwritten character with high resolution, generating a synthesized image, and printing is the same as in the first embodiment.

  In the image processing system according to the sixth embodiment of the present invention described above, the objects to be synthesized can be diversified.

It is a schematic diagram which shows the order sheet which concerns on the 1st Example of this invention. 1 is a front view showing an image processing system according to a first embodiment of the present invention. It is a block diagram which shows the hardware constitutions of the image processing system by the 1st Example of this invention. It is a functional block diagram concerning the 1st example of the present invention. It is a schematic diagram which shows the order sheet which concerns on the 1st Example of this invention. It is a schematic diagram which shows the directory structure based on 1st Example of this invention. 3 is a flowchart according to the first embodiment of the present invention. It is a schematic diagram which shows the screen transition which concerns on 1st Example of this invention. 3 is a flowchart according to the first embodiment of the present invention. 3 is a flowchart according to the first embodiment of the present invention. It is a schematic diagram which shows the density histogram which concerns on the 1st Example of this invention. 3 is a flowchart according to the first embodiment of the present invention. It is a schematic diagram which shows the superimposition synthetic | combination process which concerns on 1st Example of this invention. It is a schematic diagram which shows the screen transition which concerns on 2nd Example of this invention. It is a schematic diagram which shows the order sheet which concerns on the 2nd Example of this invention. It is a schematic diagram which shows the image processing system by 3rd Example of invention. It is a schematic diagram which shows the screen transition which concerns on 4th Example of this invention. It is a flowchart which concerns on 4th Example of this invention. It is a schematic diagram which shows the screen transition which concerns on 5th Example of this invention. It is a flowchart which concerns on 5th Example of this invention. It is a schematic diagram which shows the order sheet which concerns on 6th Example of this invention. It is a schematic diagram which shows the screen transition which concerns on 6th Example of this invention. It is a flowchart which concerns on 6th Example of this invention. It is a schematic diagram which shows the user original document concerning 6th Example of this invention.

Explanation of symbols

61 First operation means, 62 First output means, 63 Second operation means, 64 Order reading means, 65 Second output means, 66 Third operation means, 70 Order sheet, 71 Image selection area, 72 Free drawing area, 74 m Filled check box (first selection instruction), 77 Layout selection area, 79m Filled check box (second selection instruction, image selection instruction), 82 Reference mark, 83 Margin area, 85 Superimposition composition condition selection area, 86m Filled check box (third selection instruction, processing condition selection instruction), 87 m Filled check box (third selection instruction), 220 Test mode screen, 222 “Print” switch, 224 Number setting box

Claims (9)

A first operating means for receiving an order sheet request;
When the order sheet request is received, a first output means for printing an order sheet having an image selection area in which a plurality of accessible image data is written, and one free drawing area;
A second operating means for accepting the composite output request;
When the composite output request is received, the order sheet is read, the first selection instruction written on the order sheet indicating any of the image data is optically recognized, and the image of the free drawing area is extracted. Order reading means,
Second output means for combining and outputting the image represented by the image data instructed by the first selection instruction and the image of the free drawing area;
An image processing system comprising: A third operation means for receiving an operation for selecting a layout;
When the first output means receives the order sheet request, the first output means prints the order sheet having the free drawing area according to the layout selected by the third operation means,
The second output means synthesizes and outputs the image represented by the image data instructed by the first selection instruction and the image of the free drawing area in the layout selected by the third operation means. The image processing system according to claim 1. The order sheet further includes a layout selection area indicating a plurality of layouts,
The order reading means optically recognizes a second selection instruction written on the order sheet indicating any of the plurality of layouts;
The second output means synthesizes and outputs the image represented by the image data instructed by the first selection instruction and the image of the free drawing area in the layout instructed by the second selection instruction. The image processing system according to claim 1. The order sheet has a superimposition synthesis condition selection area that describes a plurality of superposition synthesis conditions,
The order reading means optically recognizes a third selection instruction written on the order sheet that indicates any of the plurality of superposition and synthesis conditions;
The second output means synthesizes and outputs the image represented by the image data instructed by the first selection instruction and the image of the free drawing area under the superposition synthesis condition instructed by the third selection instruction. The image processing system according to claim 1, wherein: The order reading means optically recognizes the first selection instruction indicating any one of the image data;
The said 2nd output means synthesize | combines and outputs the image which the some image data instruct | indicated by said 1st selection instruction | indication and the image of the said free drawing area | region are output . The image processing system according to one item. The order sheet has a reference mark,
6. The image processing system according to claim 1, wherein the order reading unit recognizes a position of the free drawing area based on the reference mark and reads the free drawing area. The second output means recognizes the area of the object described in the free drawing area based on the image of the free drawing area, and the image represented by the image data instructed by the first selection instruction and the free drawing The image processing system according to any one of claims 1 to 6, wherein the image of the object described in the region is superimposed and synthesized and output . The order reading means reads a blank area outside the free drawing area to recognize a ground color of the order sheet, and recognizes an area of the object described in the free drawing area based on the ground color of the order sheet. The image processing system according to claim 7. The order reading means reads the order sheet at a low resolution to optically recognize the first selection instruction, and reads the free drawing area at a high resolution to extract an image of the free drawing area. The image processing system according to any one of claims 1 to 8, wherein the image processing system is characterized in that:

Images