JP2006203667A - Image processing device, image processing method and image processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily synthesize an attaching image to a draft image. <P>SOLUTION: A scanner 11 acquires image data of the draft image in which a code image (two dimensional code 72) coded by memory position information showing the memory position of the attaching image data showing an attached image attached to the draft image, and additional position information showing a position to add the attaching image to the draft image are prepared. A CPU 40 acquires the memory position information and the attaching position information coded by the code image prepared in the draft image based on the acquired image data. A network I/F 60 acquires the attaching image data from the memory position shown by the memory position information. The CPU 40 synthesizes the attaching image shown by the attaching image data to the draft image shown by the image data in the attaching position shown by the attaching position information. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing apparatus, an image processing method, and an image processing program for combining an additional image with a document image.

  Conventionally, a digital multifunction machine having a plurality of functions such as a copy function and a printer function is known. This type of digital multifunction peripheral generally has a function of printing an image indicated by image data obtained by reading a document image with a scanner provided in the apparatus main body on a recording sheet.

By the way, in an information processing apparatus such as a digital multifunction machine as described above, various functions can be realized by reading a document image provided with a barcode or a two-dimensional code with a scanner. As a technique, in Patent Document 1, a barcode for specifying the article is provided in a magazine article, the barcode is read by a scanner provided in the information processing apparatus, and information obtained thereby is searched. A technique for transmitting information to a server and searching for information such as an image related to an article in a magazine using the search server is disclosed.
Japanese Patent Laid-Open No. 2003-216631

  However, the technique disclosed in Patent Document 1 can search for an image specified by a barcode, but does not consider combining the image with a predetermined document image. There was a problem that it could not be done.

  SUMMARY An advantage of some aspects of the invention is that it provides an image processing apparatus, an image processing method, and an image processing program capable of easily combining an additional image with a document image. To do.

  In order to achieve the above object, the image processing apparatus according to claim 1 adds storage position information indicating a storage position of additional image data indicating an additional image to be added to a document image and the additional image to the document image. A document image data acquisition unit that acquires image data of the document image provided with a code image in which additional position information indicating a position to be encoded is provided, and based on the image data acquired by the document image data acquisition unit, Position information acquisition means for acquiring the storage position information and the additional position information encoded by the code image provided in the document image, and storage indicated by the storage position information acquired by the position information acquisition means Additional image data acquisition means for acquiring the additional image data from a position, and a document image indicated by the image data To have and a synthesizing means for synthesizing the adding position indicated by the adding position information acquired by the position information acquiring unit an additional image represented by the additional image data.

  According to the first aspect of the present invention, the document image data acquisition unit adds the storage position information indicating the storage position of the additional image data indicating the additional image to be added to the document image and the additional image to the document image. Image data of the original image provided with a code image obtained by encoding additional position information indicating the position to be acquired is acquired. The acquisition of the image data by the document image data acquisition means includes acquisition from an external device via a network in addition to acquisition by a scanner and acquisition by imaging.

  Here, in the present invention, the storage position information encoded by the code image provided in the document image based on the image data acquired by the document image data acquisition unit by the position information acquisition unit, and The additional position information is acquired, and the additional image data acquisition means acquires the additional image data from the storage position indicated by the storage position information acquired by the position information acquisition means. An additional image indicated by the additional image data is combined with an additional position indicated by the additional position information acquired by the position information acquisition unit with respect to the original image shown.

  Thus, according to the first aspect of the present invention, the storage position information indicating the storage position of the additional image data indicating the additional image to be added to the document image and the addition indicating the position at which the additional image is added to the document image. The storage position information encoded by the code image provided in the document image based on the acquired image data, obtained image data of the document image provided with a code image in which position information is encoded The additional image data is acquired from the storage position indicated by the acquired storage position information, and the additional image indicated by the additional image data is added to the original image indicated by the image data. Since it is combined with the additional position indicated by the additional position information, the additional image can be easily combined with the original image. .

  According to the first aspect of the present invention, as in the second aspect of the present invention, the code image is a two-dimensional code, and the two-dimensional code of the two-dimensional code is based on the image data acquired by the document image data acquiring unit. It is preferable that the image forming apparatus further includes a detecting unit that detects a rotation angle, and the combining unit rotates the additional image with respect to the document image by rotating the additional image to the additional position by the rotation angle.

  According to a first aspect of the present invention, as in the third aspect of the present invention, the code image is a two-dimensional code, and the two-dimensional code is obtained based on the image data acquired by the document image data acquiring unit. Detection means for detecting a rotation angle is further provided, and the combining means rotates the document image by the rotation angle in the direction opposite to the rotation direction of the two-dimensional code, and combines the additional image with the additional position. May be.

  Further, according to the present invention, as in the invention described in claim 4, the code image further includes size information indicating a size of an area where the additional image is added to the document image. When the size of the additional image indicated by the acquired additional image data is different from the size indicated by the size information, the image processing apparatus further comprises image size changing means for enlarging or reducing the additional image so as to match the size. The synthesizing unit may synthesize the additional image whose size has been changed by the image size changing unit with the document image.

  On the other hand, in order to achieve the above object, the image processing method according to claim 5 includes storage position information indicating a storage position of additional image data indicating an additional image to be added to the document image and the addition to the document image. Image data of the document image provided with a code image obtained by encoding additional position information indicating a position to add an image is acquired, and based on the acquired image data, the code image provided in the document image The encoded storage position information and the additional position information are acquired, the additional image data is acquired from the storage position indicated by the acquired storage position information, and the document image indicated by the image data is The additional image indicated by the additional image data is combined with the additional position indicated by the additional position information obtained.

  Therefore, since the image processing method according to the fifth aspect operates in the same manner as the first aspect, the additional image can be easily combined with the original image, similarly to the first aspect.

  On the other hand, in order to achieve the above object, the image processing program according to claim 6 stores storage position information indicating a storage position of additional image data indicating an additional image to be added to the original image and the addition to the original image. A document image data acquisition step for acquiring image data of the document image provided with a code image obtained by encoding additional position information indicating a position to add an image, and provided on the document image based on the acquired image data. A position information acquisition step for acquiring the storage position information and the additional position information encoded by the code image; and additional image data for acquiring the additional image data from the storage position indicated by the acquired storage position information. An acquisition step and an attachment indicated by the additional image data with respect to the document image indicated by the image data; It includes a synthesizing step of synthesizing the adding position indicated by the adding position information acquired image.

  Accordingly, since the image processing program according to the sixth aspect operates in the same manner as the first aspect, it is possible to easily synthesize the additional image with the original image as in the first aspect.

  As described above, according to the present invention, the storage position information indicating the storage position of the additional image data indicating the additional image to be added to the original image, and the additional position indicating the position at which the additional image is added to the original image. Acquiring image data of the document image provided with a code image obtained by encoding information, and based on the acquired image data, the storage position information encoded by the code image provided in the document image; The additional position information is acquired, the additional image data is acquired from the storage position indicated by the acquired storage position information, and the additional image indicated by the additional image data is added to the document image indicated by the image data. Since the image is combined with the additional position indicated by the additional position information, the additional image can be easily combined with the original image., Has an excellent effect.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Here, a case where the present invention is applied to an image forming apparatus configured as a digital multifunction peripheral will be described.

  FIG. 1 shows a schematic configuration of an image forming apparatus 10 according to the present embodiment.

  As shown in the figure, the image forming apparatus 10 conveys a document placed at a predetermined reading position, and reads the document image by a built-in CCD (Charge Coupled Device) line sensor to show the document image. A scanner 11 that acquires image data, an apparatus main body 12 that performs image forming processing using various image data such as image data acquired by the scanner 11 and image data acquired from an external apparatus, and operation menus and messages are displayed. And a touch panel display (hereinafter referred to as “display”) 14 having a transmissive touch panel integrally provided on the surface thereof.

  Note that in the image forming apparatus 10 according to the present embodiment, a pressure-sensitive touch panel is used as the touch panel, and image formation is performed when the user touches the display surface of the display 14 with a fingertip (touch operation). Various operations can be instructed to the apparatus 10.

  Further, an image forming engine unit 15 (not shown in FIG. 1; see FIG. 2) that prints an image on a recording sheet by an electrophotographic method is provided inside the apparatus main body 12. The image forming engine unit 15 can form a full color image using toners of four colors of yellow (Y), magenta (M), cyan (C), and black (K).

  On the other hand, the image forming apparatus 10 according to the present embodiment is connected to a network 20. The network 20 is connected to the Internet (not shown), and the image forming apparatus 10 can communicate with an external WWW (World Wide Web) server via the network 20.

  Next, with reference to FIG. 2, the main configuration of the electrical system of the image forming apparatus 10 will be described.

  The image forming apparatus 10 stores in advance a CPU (central processing unit) 40 that controls the operation of the entire apparatus, a scanner driver 50 that controls reading of an optical image by the scanner 11, and various programs including a control program. The ROM 42, a RAM 48 for temporarily storing various data, an HDD (Hard Disk Drive) 56 for storing various data acquired by each device such as the scanner 11, and the operation of the image forming engine unit 15 are controlled. Network interface (I / F) that transmits / receives communication data to / from an image forming engine control unit 54 to be connected to a connector 59 connected to the network 20 and to an external device connected to the network 20 via the connector 59 ) Controls display of various information on the unit 60 and the display 14 And spray drivers 44, and includes an operation input detection unit 46 for detecting a touch operation on the display 14.

  The CPU 40, RAM 48, ROM 42, HDD 56, display driver 44, scanner driver 50, image forming engine control unit 54, network I / F unit 60, and operation input detection unit 46 are connected to each other via a system bus BUS. . Therefore, the CPU 40 accesses the RAM 48, ROM 42, and HDD 56, controls the operation of the scanner 11 via the scanner driver 50, controls the operation of the image forming engine unit 15 via the image forming engine control unit 54, and the network I / F. Transmission / reception of communication data with an external device via the unit 60 and display of various types of information on the display 14 via the display driver 44 can be performed. Further, the CPU 40 can always grasp an operation instruction by a user's touch operation on the display 14 via the operation input detection unit 46.

  By the way, in this embodiment, as shown in FIG. 3A, a two-dimensional code 72 (in this embodiment, a QR code (Quick Response code) (registered trademark) is added to a document 70 read from the scanner 11 together with a document image. )) Is provided. The two-dimensional code 72 is a graphic pattern obtained by encoding information such as characters and numbers. In the present embodiment, the storage position of additional image data indicating an additional image to be added to a document image is indicated. The storage position information shown and the additional position information showing the position where the additional image is added are coded as a two-dimensional code 72.

  FIG. 4 shows the data structure of the storage position information and additional position information according to the present embodiment. As shown in the figure, in the storage position information, information indicating a position where an additional image to be added is stored and an electronic file name of the additional image data is set. In the present embodiment, the location where the additional image is stored is an external WWW server connected via the network 20, and the URL (Uniform Resource Locator) address of the WWW server is set. . In addition, information indicating the size of the area to be combined with the position where the additional image is combined with the original image is set as the additional position information. In FIG. 3A, the area where the additional image indicated by the additional position information shown in FIG. 4 is synthesized is shown as an area surrounded by a broken line.

  In the image forming apparatus 10 according to the present embodiment, when a document 70 provided with a two-dimensional code 72 is placed at a predetermined reading position and a user performs a predetermined operation instructing start of reading, an image to be described later Read / print processing is performed, the additional image data is downloaded from the storage position indicated by the storage position information encoded in the two-dimensional code 72, and the image indicated by the additional image data is indicated by the additional position information with respect to the original image. A composite image synthesized at the added position is generated and printed.

  Next, the operation of the image forming apparatus 10 when executing the image reading / printing process will be described with reference to FIG. FIG. 5 is a flowchart showing the flow of processing of the image reading / printing processing program executed by the CPU 40 when executing the image reading / printing processing. The program is stored in a predetermined area of the ROM 42. Stored in advance.

  In step 100 of the figure, the scanner 11 is controlled to transport the document 70 (see also FIG. 3A) in the direction of arrow A in FIG. 3A, read by the CCD line sensor, and recorded on the document 70. The image data of the original document image is acquired.

  In the next step 102, a portion provided with the two-dimensional code 72 is extracted from the document image indicated by the image data.

  As shown in FIG. 3A, the two-dimensional code 72 includes three cut-out symbols 74 and a data area 76 with respect to an area of a predetermined size.

  FIG. 6 shows an enlarged view in which the cutout symbol 74 is enlarged. As shown in FIG. 6, the cut-out symbol 74 has a ratio of black area to white area of 1 (black): 1 (white): 3 (black): 1 (white): It is 1 (black).

  Therefore, in the present embodiment, the document image indicated by the image data is scanned, the position where the ratio of the black area to the white area is the ratio described above is specified as the position of the cut-out symbol 74, and within the area of a predetermined size. A portion including three cutout symbols 74 is extracted as a region of the two-dimensional code 72. Note that the size of the area of the predetermined size is preferably set as appropriate according to the type, version, number of cells, etc. of the two-dimensional code 72 to be used.

  In the next step 104, it is determined whether or not the two-dimensional code 72 exists in the document image indicated by the image data by determining whether or not the two-dimensional code 72 can be extracted by the processing in step 102, and If the determination is affirmative, the process proceeds to step 106, and if the determination is negative, the process proceeds to step 105. In step 105, since the two-dimensional code is not included, the image forming engine unit 15 is controlled based on the image data to print the document image, and the image reading / printing processing program is terminated.

  On the other hand, in step 106, the portion of the two-dimensional code 72 is extracted from the original image, and the image of the two-dimensional code 72 is rotated as shown in FIG. The angle is corrected so that the virtual line connecting the centers of the two cut-out symbols 74 at the upper left and upper right is parallel to the scanning direction by the CCD line sensor when reading by the scanner 11. The corrected angle is stored in the RAM 48 as corrected angle information.

  In the next step 108, the extracted image of the two-dimensional code 72 is decoded (decoded) to obtain storage position information and additional position information.

  In the next step 110, additional image data is acquired from the storage position indicated by the acquired storage position information. Here, in this embodiment, as shown in FIG. 4, the URL storing the additional image data and the digitized file name of the additional image data are set as the storage location information. For this reason, the WWW server of the URL is accessed via the network I / F unit 60, the network 20, and the like, and an electronic file of additional image data is downloaded. FIG. 8 shows an example of an additional image indicated by the additional image data.

  In the next step 112, the size of the additional image indicated by the downloaded additional image data is compared with the size of the synthesis area indicated by the decoded additional position information (see FIG. 4). The enlargement process or the reduction process is performed so that the size matches the size of the synthesis area.

  In the next step 114, the two-dimensional code 72 in the image data indicating the original image is masked to make the two-dimensional code 72 invisible. Then, the additional image data is rotated so that the additional image having the size of the composite area is rotated by the angle indicated by the correction angle information in the direction in which the two-dimensional code 72 is rotated. Composite image data indicating an image obtained by combining the additional image indicated by the subsequent additional image data with the composite position indicated by the additional position information (see FIG. 4) of the original image indicated by the image data is generated. As a result, as shown in FIG. 3B, the additional image indicated by the additional image data can be combined with the original image in a state where the direction of the two-dimensional code 72 is matched.

  In the next step 116, the image forming engine unit 15 is controlled to print a composite image based on the composite image data. Thereby, when the original document 70 is conveyed by the scanner 11 in the direction of arrow A in FIG. 3A and read by the CCD line sensor, the reading is performed on the recording paper in the order of reading (arrows in FIG. 3B). (B direction) A composite image indicated by the composite image data is formed, and the process ends.

  As described above, in the image forming apparatus 10 according to the present embodiment, the document image data acquisition unit (here, the scanner 11) stores the storage position of the additional image data indicating the additional image to be added to the document image. Image data of the original image provided with code information (two-dimensional code 72) obtained by encoding position information and additional position information indicating the position where the additional image is added to the original image is acquired, and position information acquisition means ( Here, the CPU 40) acquires the storage position information and the additional position information encoded by the code image provided in the document image based on the image data acquired by the document image data acquisition unit. Then, the additional image data acquisition unit (here, the network I / F unit 60) is configured to acquire the position information acquisition unit. The additional image data is acquired from the storage position indicated by the stored position information, and the synthesizing means (here, the CPU 40) adds the additional image indicated by the additional image data to the position of the original image indicated by the image data. Since the image is combined with the additional position indicated by the additional position information acquired by the information acquisition means, the additional image can be easily combined with the document image.

  Further, the code image is a two-dimensional code, and further includes a detecting unit that detects a rotation angle of the two-dimensional code based on the image data acquired by the document image data acquiring unit, the synthesizing unit including the document Since the additional image is combined with the image by rotating the additional image to the additional position by the rotation angle, the direction of the image indicated by the additional image can be combined with the original image by matching the direction of the two-dimensional code. it can.

  Further, the code image further includes size information indicating the size of the area where the additional image is added to the document image, and the image size changing means (here, the CPU 40) is acquired by the additional image data acquiring means. When the size of the additional image indicated by the additional image data is different from the size indicated by the size information, the additional image is enlarged or reduced to match the size, and the synthesizing unit Since the additional image whose size has been changed by the image size changing unit is combined, the additional image can be combined with the size indicated by the size information regardless of the size of the additional image.

(Modification)
Next, a modification of the above embodiment will be described.

  In the above embodiment, in step 114 of the image reading / printing processing program, the additional image is rotated in accordance with the rotation angle of the two-dimensional code 72 with respect to the original image. However, in this modification, the two-dimensional code 72 for the original image is rotated. The original image itself is rotated according to the rotation angle.

  That is, in this modification, in step 100 of the image reading / printing processing program, when the original 70 shown in FIG. 3A is conveyed in the direction indicated by the arrow A and the original image is read by the scanner 11, By utilizing the fact that the vertical direction of the original image can be determined from the corrected angle of the two-dimensional code 72 in step 106, in step 114, the original image is moved in the direction opposite to the direction in which the two-dimensional code 72 is rotated by the correction angle information. A rotation process is performed on the image data indicating the original image so that the image is rotated by the indicated angle. As a result, as shown in FIG. 3A, even when the original image is read from the lower end side with respect to the conveyance direction of the scanner 11, the orientation of the image when the composite image is printed is illustrated. As indicated by an arrow C in 3 (C), the print can be corrected so as to be printed from the upper end side. Therefore, even when a deviation (so-called skew) of the angle of the original 70 occurs with respect to the conveyance direction when the original 70 is read by the scanner 11, the deviation of the angle can be corrected.

  As described above, according to the present modification, the code image is set as a two-dimensional code, and the detection unit that detects the rotation angle of the two-dimensional code based on the image data acquired by the document image data acquisition unit is further provided. And the synthesizing unit rotates the document image by the rotation angle in the direction opposite to the rotation direction of the two-dimensional code, and synthesizes the additional image at the additional position. Regardless of the orientation of the original image, the direction of the synthesized image can be corrected to a certain direction.

  In the present embodiment, the case where the image data of the document image is acquired by the scanner 11 has been described. However, the present invention is not limited to this, and for example, the image processing apparatus includes an imaging device. The document image provided with the two-dimensional code 72 may be captured by the imaging device to acquire image data. Examples of the image processing apparatus provided with such an imaging apparatus include a camera, a camera-equipped mobile phone, a personal digital assistant (PDA (Personal Digital Assistant)), and the like. Further, the image data of the document image provided with the two-dimensional code 72 may be acquired via the network 20. Also in this case, the same effects as in the present embodiment can be obtained.

  In the present embodiment, the case where the image data of the additional image is downloaded from the WWW server has been described. However, the present invention is not limited to this. For example, the image data of the additional image is acquired from the HDD 56. Alternatively, the image data of the additional image may be acquired from an external storage device connected to the network 20. In these cases, the same effects as in the present embodiment can be obtained.

  Furthermore, in the present embodiment, the case where a QR code (registered trademark) is used as the two-dimensional code 72 has been described. However, the present invention is not limited to this, and for example, the FD 417 ( PDF417) (registered trademark), data matrix (DataMatrix) (registered trademark), Maxi Code (registered trademark), Veri Code (Veri Code), or the like may be used. Further, as a bar code, a code 39 (CODE 39), a code 93 (CODE 93), a code 128 (CODE 128), or the like may be used. Also in this case, the same effects as in the present embodiment can be obtained.

  In addition, the configuration (see FIGS. 1 and 2) of the image forming apparatus 10 described in the present embodiment is an example, and it is needless to say that the configuration can be appropriately changed without departing from the gist of the present invention.

  Further, the flow of processing of the image reading / printing processing program described in this embodiment (see FIG. 5) is also an example, and it goes without saying that it can be changed as appropriate without departing from the gist of the present invention.

1 is a configuration diagram of an image forming apparatus according to an embodiment. 1 is a block diagram illustrating a configuration of a main part of an electric system of an image forming apparatus according to an embodiment. (A) is a schematic diagram showing an example of a document on which a document image according to the embodiment is recorded, and (B) is a diagram in which a document according to the embodiment is read and an additional image is synthesized and printed. FIG. 4B is a schematic diagram illustrating an example of a recording sheet, and FIG. 5B is a schematic diagram illustrating an example of a recording sheet that is printed by reading a document according to a modification and synthesizing additional images. It is a schematic diagram which shows the data structure of the memory | storage position information and additional position information which concern on embodiment. It is a flowchart which shows the flow of a process of the image reading / printing processing program which concerns on embodiment. It is the enlarged view to which the cut-out symbol of the two-dimensional code which concerns on embodiment was expanded. It is a top view which shows an example of the two-dimensional code which concerns on embodiment. It is a top view which shows an example of the additional image which concerns on embodiment.

Explanation of symbols

10 Image forming apparatus 11 Scanner 40 CPU
60 Network I / F section

Claims (6)

The code image in which the storage position information indicating the storage position of the additional image data indicating the additional image to be added to the original image and the additional position information indicating the position of adding the additional image to the original image is encoded is provided. Original image data acquisition means for acquiring image data of an original image;
Position information acquisition means for acquiring the storage position information and the additional position information encoded by the code image provided in the document image based on the image data acquired by the document image data acquisition means;
Additional image data acquisition means for acquiring the additional image data from the storage position indicated by the storage position information acquired by the position information acquisition means;
Synthesizing means for synthesizing the additional image indicated by the additional image data with the additional position indicated by the additional position information acquired by the position information acquiring means with respect to the document image indicated by the image data;
An image processing apparatus. The code image is a two-dimensional code,
Detection means for detecting a rotation angle of the two-dimensional code based on the image data acquired by the document image data acquisition means;
The image processing apparatus according to claim 1, wherein the synthesizing unit synthesizes the additional image by rotating the additional image to the additional position by the rotation angle. The code image is a two-dimensional code,
Detection means for detecting a rotation angle of the two-dimensional code based on the image data acquired by the document image data acquisition means;
The image processing apparatus according to claim 1, wherein the synthesizing unit rotates the document image by the rotation angle in a direction opposite to a rotation direction of the two-dimensional code to synthesize the additional image at the additional position. The code image further includes size information indicating a size of an area where the additional image is added to the document image,
When the size of the additional image indicated by the additional image data acquired by the additional image data acquisition unit is different from the size indicated by the size information, an image for enlarging or reducing the additional image to match the size Further comprising a resizing means,
The image processing apparatus according to claim 1, wherein the synthesizing unit synthesizes the additional image whose size has been changed by the image size changing unit with respect to the document image. The code image in which the storage position information indicating the storage position of the additional image data indicating the additional image to be added to the original image and the additional position information indicating the position of adding the additional image to the original image is encoded is provided. Obtain image data of the original image,
Based on the acquired image data, the storage position information and the additional position information encoded by the code image provided in the document image are acquired,
Acquiring the additional image data from the storage position indicated by the acquired storage position information;
Combining the original image indicated by the image data with the additional position indicated by the additional position information obtained by acquiring the additional image indicated by the additional image data;
Image processing method. The code image in which the storage position information indicating the storage position of the additional image data indicating the additional image to be added to the original image and the additional position information indicating the position of adding the additional image to the original image is encoded is provided. An original image data acquisition step for acquiring original image data;
A position information acquisition step for acquiring the storage position information and the additional position information encoded by the code image provided in the document image based on the acquired image data;
An additional image data acquisition step of acquiring the additional image data from the storage position indicated by the acquired storage position information;
A synthesis step of synthesizing the additional image indicated by the additional image data to the additional position indicated by the additional position information obtained with respect to the document image indicated by the image data;
An image processing program for causing a computer to execute.

Images