JP2009135578A - Image processing method, image processing device, image forming apparatus and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce user's burden when printing a taken image of a subject in an actual size, and to shorten a period of time up to printing. <P>SOLUTION: The image processing method includes: a first step of photographing a reference object representing reference length with a subject; a second step of extracting the reference object included in the image on the basis of image data representing the image taken in the first step; and a third step of performing expansion or reduction processing of the image such that the reference length represented by the reference object extracted in the second step coincides with actual length associated with the reference length. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

 The present invention relates to an image processing method, an image processing apparatus, an image forming apparatus, and an image processing program.

Conventionally, when printing an image taken with a digital camera, the digital camera is connected to a PC (Personal Computer) with a USB (Universal Serial Bus) cable or the like, or a memory card storing image data from the digital camera is used. Generally, the image data is transferred to the PC by taking out and setting the memory card in the PC, and the image is printed by the printer via the PC. In recent years, it has become common to directly connect a digital camera to a printer with a USB cable or the like, and directly transmit image data from the digital camera to the printer to print an image (see, for example, Patent Document 1 below). ).
JP 2007-27970 A

  Incidentally, the actual size of the subject photographed by the digital camera is naturally different from the size of the subject printed as an image. Therefore, conventionally, when an image of a subject photographed with a digital camera is printed in an actual size, the user has to adjust the enlargement or reduction ratio of the image by operating a PC or a printer. However, it is extremely difficult and time-consuming work for the user to adjust the enlargement ratio and reduction ratio manually to accurately adjust the subject image to the actual size.

    The present invention has been made in view of the above-described circumstances, and an object of the present invention is to reduce the burden on the user when printing a photographed subject image at an actual size and to shorten the time until printing.

    In order to achieve the above object, the present invention provides, as a first solution means for an image processing method, a first step of photographing a reference object representing a reference length together with a subject, and an image photographed in the first step. A second step of extracting the reference object included in the image on the basis of the image data representing the image, and a reference length represented by the reference object extracted in the second step is an actual size associated with the reference length And a third step of performing enlargement or reduction processing of the image so as to match the length.

    Further, as a second solving means relating to the image processing method, in the first solving means, the third step includes a dot number counting step of counting the number of dots existing within the range of the reference length; An image resolution calculation step of calculating the resolution of the image based on the correspondence between the reference length and the actual size length and the counting result of the number of dots, and the enlargement of the image based on the print resolution and the resolution of the image A magnification calculating step for calculating a rate or a reduction rate, and an image enlargement / reduction step for performing enlargement or reduction processing of the image using the enlargement rate or the reduction rate.

    Further, as a third solving means related to the image processing method, in the first or second solving means, a fourth step of printing the image after the enlargement or reduction processing in the third step on a paper of a predetermined size. It is characterized by having.

  Further, as a fourth solving means according to the image processing method, in the third solving means, in the fourth step, when the image after the enlargement or reduction process is larger than the size of the paper, the size is larger. It is determined whether or not the image fits on the large size paper, and if it is determined that the image fits, the image is printed on the large size paper or it is determined that the image fits and is received from the user. The image is printed on the large size paper when the permission is given.

  Further, as a fifth solving means according to the image processing method, in the fourth solving means, in the fourth step, the large size paper is a maximum size paper, and the image is the maximum size. If it is determined that the image does not fit on the sheet, printing of the image is stopped.

  Further, as a sixth solving means relating to the image processing method, in the third or fourth solving means, in the fourth step, printing is performed after performing the erasing process of the reference object in the image. Features.

 On the other hand, the first aspect of the present invention relates to an image processing apparatus, an external interface for acquiring image data representing an image obtained by photographing a reference object representing a reference length together with a subject, and the image. Based on image data representing the image, storage means for storing image data, a first process for extracting the reference object included in the image, and a reference length represented by the reference object extracted in the first process Comprises a second processing for performing a process of enlarging or reducing the image so as to coincide with the actual size length associated with the reference length.

 Further, as a second solving means according to the image processing apparatus, in the first solving means, the arithmetic processing means is a dot for counting the number of dots existing in the reference length range in the second processing. A number counting process, an image resolution calculating process for calculating a resolution of the image based on a correspondence relationship between the reference length and the actual size length, and a counting result of the dot number, a printing resolution, and a resolution of the image. A magnification calculation process for calculating an enlargement ratio or a reduction ratio of the image based on the image and an image enlargement / reduction process for performing the enlargement or reduction process of the image using the enlargement ratio or the reduction ratio are executed. And

 Furthermore, the present invention provides, as a first solving means related to an image forming apparatus, an image processing apparatus having any of the above-described solving means, and the enlargement or reduction under the control of the arithmetic processing means in the image processing apparatus. Image forming means for printing the processed image on a sheet of a predetermined size.

 Further, as a second solving means relating to the image forming apparatus, in the first solving means, the arithmetic processing means may be configured such that when the image after the enlargement or reduction processing is larger than the size of the paper, the paper having a larger size is used. Whether or not the image fits on the large size paper, and if it is determined that the image fits, the image is printed on the large size paper or is determined to fit and is received from the user. The image forming unit is controlled so as to print the image on the large size paper when the permission is given.

 Further, as a third solving means according to the image forming apparatus, in the second solving means, the arithmetic processing means is characterized in that the large size paper is a maximum size paper and the image is the maximum size paper. If it is determined that the image does not fit in, the printing of the image is stopped.

 Further, as a fourth solving means according to the image forming apparatus, in the first or second solving means, the arithmetic processing means performs the printing after performing the erasing process of the reference object in the image. The image forming means is controlled.

 Furthermore, the present invention provides, as a solution to the image processing program, image data representing an image obtained by photographing a reference object representing a reference length together with a subject, acquired via an external interface, on a computer provided in the image processing apparatus. Based on this, the first process for extracting the reference object included in the image and the reference length represented by the reference object extracted in the first process match the actual length associated with the reference length. And a second process for enlarging or reducing the image.

  According to the present invention, the user only needs to shoot a reference object representing the reference length together with the subject, and then the image processing apparatus automatically enlarges the image to match the actual size length associated with the reference length. Alternatively, since the reduction process is performed, it is possible to reduce the burden on the user when printing the photographed subject image at the actual size, and to shorten the time until printing.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a functional block diagram of an image forming apparatus 100 according to the present embodiment. An image forming apparatus 100 according to the present embodiment is a multifunction peripheral having functions of, for example, a copier and a printer, and includes a CPU (Central Processing Unit) 10, a ROM (Read Only Memory) 11, a RAM (Random Access Memory) 12, and various types. A sensor group 13, a paper transport unit 14, a document reading unit 15, an image data storage unit 16, an image forming unit 17, an operation display unit 18, and a USB interface 19 are provided. Reference numeral 200 denotes a digital camera connected to the image forming apparatus 100 via a USB (Universal Serial Bus) cable.

  The CPU (arithmetic processing means) 10 executes an image processing program stored in the ROM 11 to detect detection signals input from various sensor groups 13 and image data stored in the image data storage unit 16 (this image data). Includes image data of a document read by the document reading unit 15 and image data acquired from the digital camera 200 via the USB interface 19), and an image forming apparatus based on an operation signal input from the operation display unit 18. 100 overall operations are controlled.

  Further, as a characteristic operation in the present embodiment, the CPU 10 represents an image obtained by photographing a reference object representing a reference length together with a subject obtained from the digital camera 200 via the USB interface 19 based on the image processing program. Based on the image data, the first process for extracting the reference object included in the image, and the reference length represented by the reference object extracted in the first process match the actual length associated with the reference length. As described above, the second process for enlarging or reducing the image is executed. Details of the characteristic operation (actual size printing process) of the CPU 10 will be described later.

 The ROM 11 is a non-volatile memory that stores an image processing program executed by the CPU 10 and other data. The RAM 12 is a working memory used as a temporary data storage destination when the CPU 10 executes an image processing program and performs various arithmetic processes. The various sensor groups 13 are various sensors necessary for an image forming operation such as a paper out detection sensor, a paper position detection sensor, a temperature sensor, and the like, and output various information detected by each to the CPU 10 as detection signals. The paper transport unit 14 includes a transport roller for transporting paper stored in a paper tray (not shown) to the image forming unit 17 and a motor for driving the transport roller, and a paper after image forming processing to a paper discharge tray (not shown). It is composed of a conveying roller for conveying, a motor for driving the conveying roller, and the like.

 The document reading unit 15 irradiates a document set on a document table (not shown) with illumination light in a scanning manner, receives the reflected light by a CCD (Charge Coupled Device) sensor, and converts it into an analog voltage signal. Image data of the read original is generated by digitally converting the analog voltage signal. The image data storage unit (storage unit) 16 is, for example, a flash memory, and stores image data generated by the document reading unit 15 and image data acquired from the digital camera 200 via the USB interface 19.

The image forming unit (image forming unit) 17 transfers the toner image onto the paper conveyed from the paper conveying unit 14 based on the image data stored in the image data storage unit 16 under the control of the CPU 10. A toner image fixing process (printing process) is performed. The operation display unit 18 is configured by, for example, a touch panel, displays a screen for notifying various operation keys and various information under the control of the CPU 10, and operates operation input information of various operation keys displayed on the touch panel. It outputs to CPU10 as a signal. The USB interface (external interface) 19 is an interface for performing data communication between the image forming apparatus 100 (specifically, the CPU 10) and the external digital camera 200 via a USB cable.
Of the above-described components, the CPU 10, the image data storage unit 16, and the USB interface 19 constitute an image processing apparatus according to the present invention.

 Next, the operation of the image forming apparatus 100 according to the present embodiment configured as described above will be described with reference to the flowchart of FIG. Since the image forming operation (copying / printing operation) of the image forming apparatus 100 is the same as the conventional one, the description thereof will be omitted, and the characteristic operation (actual size printing process) of the image forming apparatus 100 will be described below. To do.

 Further, as a premise that the image forming apparatus 100 performs the actual size printing process, the user uses the digital camera 200 to photograph a reference object representing the reference length together with the subject (corresponding to the first step). Assume that image data representing the captured image is stored in the internal memory. FIG. 3 is an example of an image obtained by photographing a reference object representing a reference length together with a subject. In FIG. 3, reference numeral 300 is a subject, and reference numeral 400 is a reference object. In the present embodiment, a scale having a reference length of 1 mm per scale is used as the reference object 400. Since such a reference object 400 needs to be extracted from image data by pattern matching processing in an actual size printing process described later, the ROM 11 of the image forming apparatus 100 stores the shape of the reference object 400 necessary for the pattern matching processing. Information such as the scale arrangement is stored in advance. Further, the ROM 11 of the image forming apparatus 100 stores an actual size length (that is, 1 mm) associated with the reference length of the reference object 400.

 In the present embodiment, as shown in FIG. 3, it is assumed that an image has been shot with a size of 1600 vertical (dots) × 1200 horizontal (dots). The digital camera 200 storing such image data representing the image is connected to the image forming apparatus 100 via a USB cable, and the image data acquired from the digital camera 200 via the USB interface 19 is stored in the image data storage unit 16. Remembered.

Based on the above premise, the actual size printing process of the image forming apparatus 100 will be described below with reference to the flowchart of FIG.
First, the CPU 10 reads out the image data from the image data storage unit 16 and performs a pattern matching process based on the image data and information such as the shape of the reference object 400 and the scale arrangement stored in the ROM 11. The reference object 400 included in the image (see FIG. 3) is extracted (step S1: equivalent to the second step and the first process).

 Subsequently, the CPU 10 counts the number of dots existing within the reference length range represented by the reference object 400 extracted in step S1 (step S2: equivalent to a dot number counting step and a dot number counting process). In the present embodiment, for example, as shown in FIG. 4, it is assumed that the number of dots existing within the reference length range is five. Then, the CPU 10 calculates the resolution of the image based on the correspondence relationship between the reference length and the actual size length and the result of counting the number of dots in step S2 (step S3: equivalent to an image resolution calculation step and an image resolution calculation process). ). Specifically, the CPU 10 reads the actual size length (that is, 1 mm) associated with the reference length stored in the ROM 11 and grasps that the number of dots per 1 mm is 5 from the result of counting the number of dots. This is converted into the number of dots per inch, that is, in units of dpi (dot per inch). Thereby, the CPU 10 calculates 127 dpi as the image resolution.

 Then, the CPU 10 calculates the enlargement ratio or reduction ratio of the image based on the print resolution in the image forming unit 17 and the image resolution calculated in step S3 (step S4: equivalent to a magnification calculation process and a magnification calculation process). Specifically, the CPU 10 calculates the enlargement ratio or the reduction ratio by an arithmetic expression of print resolution / image resolution × 100%. For example, if the print resolution in the image forming unit 17 is 300 dpi, the solution of the above equation is 236%, and the enlargement ratio is calculated. For example, if the print resolution in the image forming unit 17 is 72 dpi, the solution of the above equation is 57%, and the reduction ratio is calculated.

Then, the CPU 10 performs an image enlargement or reduction process using the enlargement ratio or reduction ratio calculated in step S4 (step S5: equivalent to an image enlargement / reduction process and an image enlargement / reduction process). Specifically, for example, when the enlargement ratio of 236% is calculated in step S4, the CPU 10 has an image size of 1600 × 236% in the vertical direction, so that 1600 × 236% = 3776 dots and 1200 × 236% in the horizontal direction: 2832 dots. For example, when the reduction ratio 57% is calculated in step S4, the image reduction process is performed so that the vertical length is 1600 × 57% = 912 dots and the horizontal length is 1200 × 57% = 684 dots. Do. By performing the enlargement process or the reduction process of the image in this manner, the reference length represented by the reference object 400 in the image after printing matches the actual length (1 mm) associated with the reference length, and the subject after printing. The size of 300 matches the actual size.
Steps S2 to S5 described above correspond to the third step and the second processing in the present invention.

 Subsequently, the CPU 10 determines whether or not the image subjected to the enlargement process or the reduction process in step S5 falls within the paper size currently designated for printing (step S5). For example, if the image has been enlarged to 3776 × 2832 dots in the above step S5, the actual size of the printed image is 3776 dots / 300 dpi × 2.54 cm = 21.9 cm, and 2832 dots / 300 dpi × 2.54 cm = If the paper size currently designated for printing is “A4 (21 × 29.7 cm)”, it is determined that this image does not fit within the paper.

 If it is determined in step S6 that the paper size is within the paper size currently designated for printing (“Yes”), the CPU 10 determines the image forming unit based on the image data representing the image after the enlargement process or the reduction process. 17 is controlled to print an image on a sheet currently designated for printing, and the actual size printing process is terminated (step S7). Thus, the size of the subject 300 included in the printed image matches the actual size.

On the other hand, if it is determined in step S6 that it does not fit within the paper size currently designated for printing (“No”), the CPU 10 determines whether or not the paper size currently designated for printing is the maximum size. Is determined (step S8). If it is determined in this step S8 that the paper size is the maximum size (“Yes”), it is considered that printing of the image is impossible, so the CPU 10 stops printing the image after the enlargement process or the reduction process. This completes the actual size printing process (step S9). On the other hand, if it is determined in step S8 that the paper size is not the maximum size (“No”), the CPU 10 changes the designation of the paper size for printing to a paper size larger by one rank, and returns to step S6 ( Step S10). That is, the paper size capable of printing the image (subject 300) in the actual size is searched for by the processes in steps S6, S8, and S10.
In addition, said step S6-S10 is corresponded to the 4th process in this invention.

 As described above, according to the present embodiment, the user only needs to photograph the reference object 400 representing the reference length together with the subject 300, and the image forming apparatus 100 thereafter uses the image data representing the photographed image. In addition, since the actual size printing process is automatically performed, it is possible to reduce the burden on the user and shorten the time until printing.

In addition, this invention is not limited to the said embodiment, The following modifications can be considered.
(1) In the above embodiment, when the image is printed in step S7, the reference object 400 is printed while being included in the image. On the other hand, printing may be performed after the reference object 400 is erased from the image. Thereby, the appearance of the image after printing can be improved.

(2) In the above embodiment, the processing in steps S6, S8, and S10 is automatically printed on a sheet of a size that can accommodate the enlarged or reduced image, but the user does not want to change the sheet size. Cases are also conceivable. In order to cope with such a case, in step S6 after changing the paper size in step S10, when it is determined that the image fits in the changed paper size and there is permission from the user, after the change You may make it print an image on the paper of this. Specifically, when it is determined that the image fits on the changed paper size, a screen for asking permission of the user is displayed on the operation display unit 18, and the user performs an operation corresponding to the print permission. What is necessary is just to give CPU10 the function to perform printing.

(3) In the above-described embodiment, the case where a ruler with one scale as a reference length is used as the reference object 400 to be photographed with the subject 300. However, the reference object is not limited to this, and the reference associated with the actual size length is used. Others may be used as long as they represent the length.

(4) In the above embodiment, a multifunction peripheral is exemplified as the image forming apparatus 100. However, the present invention is not limited to any image forming apparatus provided with a printing function (image forming unit 17) such as a printer. It can also be applied to. In the above-described embodiment, the configuration in which image data is acquired from the digital camera 200 via the USB interface 19 has been described. However, the image forming apparatus 100 is provided with a memory card insertion slot, and the image data is stored from the digital camera 200. A configuration may be adopted in which image data is acquired by taking out the inserted memory card and inserting it into the slot.

(5) In the above-described embodiment, the image forming apparatus 100 including the image processing apparatus (the CPU 10, the image data storage unit 16, and the USB interface 19) has been described as an example. An image that has been enlarged or reduced so as to be printable in size may be printed using a printer connected to the PC.

1 is a functional block diagram of an image forming apparatus 100 according to an embodiment of the present invention. 4 is a flowchart illustrating an operation of the image forming apparatus 100 according to an embodiment of the present invention. FIG. 6 is a first explanatory diagram regarding the operation of the image forming apparatus 100 according to an embodiment of the present invention. FIG. 10 is a second explanatory diagram relating to the operation of the image forming apparatus 100 according to an embodiment of the present invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Image forming apparatus, 10 ... CPU (Central Processing Unit), 11 ... ROM (Read Only Memory), 12 ... RAM (Random Access Memory), 13 ... Various sensor groups, 14 ... Paper conveyance part, 15 ... Image reading part , 16 ... Image data storage unit, 17 ... Image forming unit, 18 ... Operation display unit, 19 ... USB interface, 200 ... Digital camera, 300 ... Subject, 400 ... Reference object

Claims (13)

A first step of photographing a reference object representing a reference length together with a subject;
A second step of extracting the reference object included in the image based on the image data representing the image taken in the first step;
A third step of enlarging or reducing the image so that the reference length represented by the reference object extracted in the second step matches the actual length associated with the reference length;
An image processing method comprising: The third step includes
A dot number counting step of counting the number of dots existing within the range of the reference length;
An image resolution calculation step of calculating the resolution of the image based on the correspondence between the reference length and the actual size length, and the counting result of the number of dots;
A magnification calculating step for calculating an enlargement ratio or a reduction ratio of the image based on a print resolution and a resolution of the image;
An image enlarging / reducing process for enlarging or reducing the image using the enlargement rate or reduction rate;
The image processing method according to claim 1, further comprising:   3. The image processing method according to claim 1, further comprising a fourth step of printing the image after the enlargement or reduction processing in the third step on a sheet of a predetermined size.  In the fourth step, when the image after the enlargement or reduction process is larger than the size of the paper, it is determined whether or not the image fits on a paper of a larger size, and the image is fit. The image is printed on the large-size paper, or the image is printed on the large-size paper when it is determined that the image fits and permission is received from the user. The image processing method according to claim 3.  In the fourth step, printing of the image is stopped when it is determined that the large size paper is the maximum size paper and the image does not fit on the maximum size paper. The image processing method according to claim 4.   5. The image processing method according to claim 3, wherein, in the fourth step, printing is performed after erasing processing of the reference object in the image. An external interface for acquiring image data representing an image obtained by photographing a reference object representing a reference length together with a subject from the outside;
Storage means for storing image data representing the image;
Based on the image data representing the image, the first process for extracting the reference object included in the image and the reference length represented by the reference object extracted in the first process are associated with the reference length. A second processing for performing an enlargement or reduction process of the image so as to coincide with the actual size length;
An image processing apparatus comprising: In the second process, the arithmetic processing means
A dot number counting process for counting the number of dots existing within the range of the reference length;
An image resolution calculation process for calculating the resolution of the image based on the correspondence between the reference length and the actual size length, and the counting result of the number of dots;
A magnification calculation process for calculating an enlargement ratio or a reduction ratio of the image based on a print resolution and a resolution of the image;
Performing image enlargement / reduction processing for performing enlargement or reduction processing of the image using the enlargement rate or reduction rate,
The image processing apparatus according to claim 7. An image processing device according to claim 7 or 8,
Under the control of the arithmetic processing means in the image processing apparatus, image forming means for printing the image after the enlargement or reduction processing on a sheet of a predetermined size;
An image forming apparatus comprising:  When the image after the enlargement or reduction process is larger than the size of the paper, the arithmetic processing unit determines whether the image fits on a paper of a larger size, and determines that the image fits. The image is printed on the large size paper, or the image is formed so that the image is printed on the large size paper when it is determined that the image fits and the user gives permission. 10. The image forming apparatus according to claim 9, wherein the image forming apparatus is controlled.  The arithmetic processing unit stops printing of the image when it is determined that the large size paper is the maximum size paper and the image does not fit on the maximum size paper. Item 15. The image forming apparatus according to Item 10.   The image forming apparatus according to claim 9, wherein the arithmetic processing unit controls the image forming unit to perform printing after performing the erasure processing of the reference object in the image. In the computer equipped with the image processing device,
A first process of extracting the reference object included in the image based on image data representing an image obtained by photographing the reference object representing the reference length together with the subject, acquired via the external interface;
A second process for enlarging or reducing the image so that a reference length represented by the reference object extracted in the first process matches an actual length associated with the reference length;
An image processing program for executing

Images