JP5434273B2 - Image processing apparatus and image processing program - Google Patents

Description

  The present invention relates to an image processing apparatus and an image processing program.

  A technique for extracting handwritten handwriting information has been developed. When an image obtained by combining information images representing position information is printed and written on an electronic pen that reads the information image, the handwriting information is extracted.

  As a technology related to this, for example, in Patent Document 1, when image data is printed out, appropriate data processing corresponding to the attribute of each image included in the image data is realized, and the quality of the output image is improved. The rasterizer generates an RGB bitmap image based on the object data input from the printer driver and stores it in the image memory. At this time, the rasterizer generates the attribute information indicating the attribute of the input object data. The image processing unit converts the RGB bitmap image stored in the image memory into binary bitmap data for each color of YMCK that can be processed by the image forming unit. At this time, based on the attribute information held in the attribute map memory , For example, such as switching the dither matrix for binarization, is possible to switch the contents of the conversion process is disclosed.

  Further, for example, in Patent Document 2, it is determined whether each pixel is a part of a character image or a part of a photographic image according to the characteristics of each pixel data of the image data, and each pixel is determined according to the determination. The problem is to obtain a good image by setting the output resolution. When the pixel of interest in the image data is in a character image, obtain the thickness information of the character, and the thinner the thickness, Set higher resolution, lower resolution for thicker images, set information to lower resolution if it is in a photographic image, and set it first when the density of pixel data after image processing is low It is disclosed that the resolution is corrected so as to be lowered and the corrected resolution setting information is output.

  Further, for example, in Patent Document 3, it is an object to suppress modification of a code image by a document image, and the client rasterizes RGB vector data corresponding to the document image and R′G′B ′ raster data obtained by color conversion. The R′G′B ′ raster data with tag obtained by adding the tag based on the code image data is output to the printer, and the printer performs color conversion processing on the received R′G′B ′ raster data with tag. YMC raster data with Tag is created, and then the printer refers to Tag of YMC raster data with Tag, obtains code image data obtained based on the contents of Tag, and then YMC raster data and code image It is disclosed that K data based on data is synthesized and output to an exposure unit.

  Further, for example, in Patent Document 4, when handwriting information written on paper is written using an electronic pen that can be time-series data with paper position information, information from the electronic pen is written. The received information processing apparatus has an object to make it possible for a third party to easily identify a difference in entry conditions. In the information processing apparatus, paper identification information, electronic pen identification information, and time-series position information When handwriting information consisting of, information on the time when these pieces of information are received, and attribute information that divides the area of the paper are given, information processing is performed by combining these pieces of information, and features are distinguished and displayed according to the results of the information processing. It is disclosed.

  Further, for example, Patent Document 5 has an object to provide a form receiving system for performing a process quickly and easily even with a handwritten form using an electronic pen. The public document invoice written in handwriting is reproduced by pasting the image data of handwritten characters into the format data of the public document public invoice, and the reproduced public document public invoice and the image data are converted into text data. It is disclosed that a handwritten public document public invoice can be received as electronic data by displaying the converted public document public invoice side by side on the screen.

  In addition, for example, Patent Document 6 has an object of proposing a system for efficiently managing highly reliable sign data, and sign data entered with an electronic pen on a slip which is an electronic processing paper is provided. A slip management method for managing a slip ID for uniquely identifying a slip, a slip form ID for uniquely identifying a slip form configured in a format determined for a predetermined purpose, Entry data entered for each slip, at least one entry field data including a dot pattern recognizable by the electronic pen, and at least one signature data including handwriting data entered by the electronic pen for the entry field of the slip Are recorded in a database in association with each other.

  Further, for example, Patent Document 7 provides an application processing system that can verify the authenticity of the contents of entry based on information entered by the user in the electronic pen form and perform processing quickly. As an issue, in the application processing system, the user fills in the application form using the electronic pen, and the electronic pen obtains the check information and text entry information entered by the user. The server identifies the item identification information of the items constituting the application form entered by the user by referring to the coordinate information, and further the server obtains the coordinate information based on the item identification information. By referencing, the content of the corresponding item is specified, the entry error is detected by the user based on the content of the item and the entry information, and the information on the detected entry error is obtained by the user. Be presented have been disclosed.

  Further, for example, in Patent Document 8, an information processing system includes a device that enables on-demand printing of a position-coded base. In this device, a current graphic object is stored in advance in the system. Selected from a set of stored graphic objects, each of these pre-stored graphic objects defining graphic information, and corresponding to a rule object that at least one processing measure relates to graphic information In this device, the current graphic object is assigned position data from the position data bank, and this assigned position data is combined with the graphic information to form a position-coded base. Applies to The device also provides assignment data in the system, which associates the assigned position data with the graphic object so that the position data read by the digital pen device from the base is the appropriate rule. It is disclosed that an object can be processed in the system.

JP 2000-148973 A JP 2000-261659 A JP 2008-187304 A JP 2003-308169 A JP 2003-308479 A JP 2005-122552 A JP 2006-079254 A JP-T-2006-504181

By the way, in the above-described background art, when an information image is combined with an image, the information image may not be read in a region where the image and the information image overlap.
It is an object of the present invention to provide an image processing apparatus and an image processing program that can solve such problems.

The gist of the present invention for achieving the object lies in the inventions of the following items.
According to the first aspect of the present invention, an area designating unit for designating an area in an image and an area designated by the area designating unit are changed based on an attribute set in the area in accordance with an operation of the operator. an area changing means, as a target the designated area or the designated area other than regions by the region designation means, and a color conversion unit that performs color conversion, at least including the color conversion region by the color conversion means the image in the area, and a information image combining means for combining the information image representing the position information, the color conversion means, and characterized by applying the color conversion that represents the black color in the synthesis of other colors An image processing apparatus.

The invention of claim 2 further comprises setting means for setting an attribute in the area, and the area changing means changes the area based on the attribute of the area set by the setting means. This is an image processing apparatus.
According to a third aspect of the present invention, the area changing means enlarges the area when the attribute set in the area indicates an entry area, and the information image synthesizing means is enlarged by the area changing means. The image processing apparatus according to claim 1, wherein the information image is combined with a region.
According to a fourth aspect of the present invention, the area changing means enlarges or reduces the area when the attribute set in the area indicates an area that is not the entry area, and the information image composition means adds the area to the area. The information image is not combined with the area enlarged or reduced by the area changing unit when the set attribute indicates an area that is not the entry area. It is an image processing apparatus of description.

Invention, the color conversion means according to claim 5, as a target the modified region or a region other than the modified region by the area changing means performs color conversion, the information image synthesizing means, the area change 2. The image processing apparatus according to claim 1, wherein an information image is synthesized with an image in an area including at least the area subjected to color conversion by the color conversion means based on the area changed by the means. It is.

The invention according to claim 6 is the image processing apparatus according to claim 5 , wherein the area changing unit enlarges the area so as to include at least the area specified by the area specifying unit.

The invention of claim 7, wherein the area changing means is an image processing apparatus according to claim 5, characterized in that to reduce the area designated by said area designating means.

The invention of claim 8, wherein the information image synthesizing means according to any one of claims 5 to 7, characterized in that combining the information image within the changed area by the area changing means This is an image processing apparatus.

The invention of claim 9, wherein the information image synthesizing means, any one of the seven claim 5, characterized in that combining the information image in the region other than the changed regions by the region changing means The image processing apparatus described in the above.

According to a tenth aspect of the present invention, the computer designates an area in the image according to the operation of the operator, and the area designated by the area designation means is based on the attribute set in the area. An area changing unit that changes the color, a color conversion unit that performs color conversion on an area specified by the area specifying unit or an area other than the specified area, and an area that has been color converted by the color converting unit. It functions as an information image synthesis unit that synthesizes an information image representing position information with respect to an image in at least an included area, and the color conversion unit performs color conversion that expresses black by combining other colors. This is a featured image processing program.

According to the image processing apparatus of the first aspect, when an information image is combined with an image, it is possible to prevent the information image from being read even in a region where the image and the information image overlap. . Even if color conversion is performed, the influence on human readability can be reduced.

According to the second, third , and fourth image processing apparatuses, when an information image is combined with an image, the information image can be prevented from being read even in a region where the image and the information image overlap. can do. Even if color conversion is performed, the influence on human readability can be reduced.

According to the image processing device of claim 5 , when a region where the information image is to be combined or a region where the information image is not to be combined is designated, at the boundary between the region where the information image is combined and the region where the information image is not combined. It is possible to suppress a situation in which writing information to be extracted cannot be extracted or writing information that should not be extracted is extracted.

According to the image processing device of the sixth , seventh , eighth , and ninth aspects, an area where there is no possibility of writing is suppressed from being reduced in human readability, and the area where there is a possibility of writing is determined. On the other hand, the situation where an information image is not synthesized can be suppressed.

According to the image processing program of the tenth aspect , when an information image is combined with an image, it is possible to prevent the information image from being read even in a region where the image and the information image overlap. . Even if color conversion is performed, the influence on human readability can be reduced.

It is a conceptual module block diagram about the structural example of this Embodiment. It is a flowchart which shows the process example by this Embodiment. It is explanatory drawing which shows the more specific module structural example of the color conversion module of this Embodiment. It is a flowchart which shows the process example by a color conversion module. It is explanatory drawing which shows the document image which is an example of a target image. It is explanatory drawing which shows the example of an information image. It is explanatory drawing which shows the structural example of the pen with a scanner. It is explanatory drawing which shows the example which synthesize | combined the information image with the document image. In this Embodiment, it is explanatory drawing which shows the process example which synthesize | combines an information image with a document image. In this Embodiment, it is explanatory drawing which shows the process example which synthesize | combines an information image with a document image. In this Embodiment, it is explanatory drawing which shows the process example which synthesize | combines an information image with a document image. It is a block diagram which shows the hardware structural example of the computer which implement | achieves this Embodiment.

Hereinafter, an example of a preferred embodiment for realizing the present invention will be described with reference to the drawings.
FIG. 1 shows a conceptual module configuration diagram of a configuration example of the present embodiment.
The module generally refers to components such as software (computer program) and hardware that can be logically separated. Therefore, the module in the present embodiment indicates not only a module in a computer program but also a module in a hardware configuration. Therefore, the present embodiment also serves as an explanation of a computer program, a system, and a method. However, for the sake of explanation, the words “store”, “store”, and equivalents thereof are used. However, when the embodiment is a computer program, these words are stored in a storage device or stored in memory. It is the control to be stored in the device. In addition, the modules correspond almost one-to-one with the functions. However, in mounting, one module may be composed of one program, or a plurality of modules may be composed of one program. A plurality of programs may be used. The plurality of modules may be executed by one computer, or one module may be executed by a plurality of computers in a distributed or parallel environment. Note that one module may include other modules. Hereinafter, “connection” is used not only for physical connection but also for logical connection (data exchange, instruction, reference relationship between data, etc.).
In addition, the system or device is configured by connecting a plurality of computers, hardware, devices, and the like by communication means such as a network (including one-to-one correspondence communication connection), etc., and one computer, hardware, device. The case where it implement | achieves by etc. is included. “Apparatus” and “system” are used as synonymous terms.
An information image is an image code systematically created to represent electronic data representing position information in a machine-readable manner, and will be described later with reference to FIG. 6 as a specific example.

The image processing apparatus according to the present embodiment synthesizes an information image with an image. As shown in FIG. 1, a target image receiving module 110, an area specifying module 120, an area changing module 130, and a superimposed image generating module. 140, a color conversion module 150, a superimposed image synthesis module 160, and an image output module 170.
The target image receiving module 110 is connected to the area specifying module 120. The target image receiving module 110 receives the target image and passes the image to the area specifying module 120. Accepting an image means, for example, reading an image with a scanner, a camera, etc., receiving an image from an external device via a communication line by fax, etc., and taking an image with an imaging device such as a CCD (Charge-Coupled Device). And reading out images stored in a hard disk (including those connected to the computer in addition to those built in the computer). The image may be a binary image or a multi-value image (including a color image). One image may be received or a plurality of images may be received. Further, as the content of the image, handwritten writing by the user is assumed, and for example, an application form or the like is applicable. As a more suitable target image, there is an area for handwritten writing (hereinafter also referred to as an entry area), and an area on which what should be read by a human being (for example, an area for explaining an entry field) (Hereinafter also referred to as an explanation partial area). In other words, it is an area where the readability is reduced if the information image is combined with the area where what is to be read is printed. In addition, in the area where what is to be read is printed, a figure, a photograph, or the like may be printed in addition to characters. In addition to character interpretation, it also includes those that reduce the visibility and appearance of photographs and the like by combining information images. In other words, the legibility here includes appreciation.

The area specifying module 120 is connected to the target image receiving module 110 and the area changing module 130. A target image is received from the target image receiving module 110, and an area in the target image and an attribute of the area are designated according to the operation of the operator. Then, the target image, the designated area, and its attributes are passed to the area change module 130.
The area to be specified exemplifies a rectangle, but may be a shape other than the rectangle (for example, an area surrounded by a free curve). The area to be passed to the area changing module 130 corresponds to, for example, the coordinates of the upper left corner and the lower right corner for a rectangle, and the coordinates of each pixel on the line for a free curve.
As the operation of the operator, for example, the target image may be displayed on the display of the image processing apparatus, and the area may be designated along the entry frame using a user interface such as a mouse. An area may be drawn using a marker pen or the like, and an area surrounded by the marker pen in the image may be recognized as a designated area.

The designated area includes an entry partial area or an explanation partial area. Designating the entry partial area designates an area where the information image is to be synthesized, and designation of the explanation partial area designates an area where the information image is not synthesized (the information image is synthesized in other areas). ).
The area attributes include “writing information acquisition”, “writing information acquisition priority”, “original image readability priority”, “writing information non-acquisition A”, and “writing information non-acquisition B”. Note that the attribute to be specified may be set in advance as any attribute, or may be determined according to the operation of the operator.

(1) “Acquisition of writing information” is a case where an entry partial area is designated and the area and the area where the information image is combined are matched.
(2) “Writing information acquisition priority” is a case where an entry partial area is designated, and the writing information written in the area can be reliably acquired. That is, the information image is synthesized in an area that is larger than the designated area.

(3) “Document image readability priority” is a case where an explanation partial area is designated, and the area is matched with an area where the information image is not combined. Therefore, the information image is synthesized outside the area.
(4) “Writing information non-acquisition A” is a case where an explanation partial area is designated, and priority is given to not acquiring writing information in that area. In other words, the information image is prevented from being combined with an area larger than the designated area. Therefore, the information image is synthesized in a region other than the enlarged region, and the region for synthesizing the information image itself is smaller than that in the case where the document image legibility is prioritized.
(5) “Writing information non-acquisition B” is a case where an explanation partial area is designated, and priority is given to acquiring writing information in other areas. That is, the information image is prevented from being combined with an area smaller than the designated area. Therefore, the information image is synthesized in the area other than the reduced area, and the area for synthesizing the information image itself becomes larger than that in the case where the document image legibility is prioritized.

  The area change module 130 is connected to the area designation module 120, the superimposed image generation module 140, and the color conversion module 150. The area designated by the area designation module 120 is changed. Then, the target image, the changed area, and the attribute of the area are passed to the superimposed image generation module 140 and the color conversion module 150. The area change includes enlargement and reduction. It should be noted that the attribute of the area to be transferred to the superimposed image generation module 140 and the color conversion module 150 may be either the entry partial area or the explanation partial area in addition to the attributes described above.

When “writing information acquisition priority” or “writing information non-acquisition A” is designated as the attribute of the area, the area is enlarged. Enlarging an area means enlarging the area to include at least the designated area.
For example, the enlargement may be the same enlargement ratio with respect to the vertical and horizontal directions, or may be different in the vertical and horizontal directions. The center of enlargement does not need to be the center of the region, and may be an enlargement with a position different from the center of the region as the center of enlargement. For example, when the enlargement center is set to the right side from the center of the region, the left side is enlarged more than the right side. Furthermore, in the case of a rectangular region, the widths that expand vertically and horizontally may be different.

When “writing information non-obtained B” is designated as the attribute of the area, the area is reduced. To reduce the area means to reduce the area so as not to include at least a part of the designated area.
For example, the reduction may be the same reduction ratio in the vertical and horizontal directions, or may be different in the vertical and horizontal directions. The center of enlargement does not need to be the center of the region, and reduction using a position different from the center of the region as the center of reduction may be used. For example, when the center of reduction is set to the right side from the center of the region, the left side is reduced more greatly than the right side. Further, in the case of a rectangular region, the widths to be reduced vertically and horizontally may be different.
The values relating to the enlargement / reduction (parameters, for example, enlargement rate, reduction rate, width to be enlarged, width to be reduced, etc.) are not only predetermined values but also the code system of the information image and the type of pen for reading the information image It may be determined based on the above. Here, when determining the value related to enlargement / reduction based on the type of pen, it is based on the positional relationship between the pen tip of the pen with a scanner for acquiring writing information and the image reading module provided in the pen. It becomes. The structure of the scanner pen will be described later.

The superimposed image generation module 140 is connected to the region change module 130 and the superimposed image synthesis module 160. Based on the area changed by the area changing module 130 and the attribute of the area, an information image to be combined with the target image is generated. Then, the generated information image is transferred to the superimposed image synthesis module 160.
If the attribute is an entry partial area, an information image is generated so as to be superimposed on the changed area.
If the attribute is an explanatory partial area, an information image is generated so that the composition can be superimposed on an area other than the changed area.

  The color conversion module 150 is connected to the area change module 130 and the superimposed image composition module 160. Color conversion is performed for an area changed by the area change module 130 or an area other than the changed area. Specifically, as the color conversion processing, for example, color conversion is performed in which black is expressed by combining other colors (that is, colors other than black). More specifically, for example, K in the YMCK (Yellow, Magenta, Cyan, blackK) color space is expressed by another YMC. That is, it means that black that easily absorbs infrared rays is combined and expressed with a color other than black that hardly absorbs infrared rays. Then, the target image that has undergone color conversion is passed to the superimposed image synthesis module 160.

  Further, based on the region attributes received from the region change module 130, whether the region to be subjected to color conversion is a region that has been changed by the region change module 130 or a region other than the changed region. decide. That is, when the attributes are “writing information acquisition” and “writing information acquisition priority”, color conversion is performed on the image in the region, and the attributes are “document image readability priority”, “writing information non-acquisition A”, In the case of “writing information non-acquisition B”, color conversion is performed on an image in a region other than the region. As a result, in the above-described example of the YMCK color space, the area where the information image is synthesized is not used, and K is used instead of K, and the area where the information image is not synthesized is represented by that color. Such color conversion is not performed. However, normal color conversion (for example, color conversion adapted to the device output by the image output module 170) may be performed regardless of the area. The processing performed by the color conversion module 150 will be described later with reference to FIGS.

  The superimposed image synthesis module 160 is connected to the superimposed image generation module 140, the color conversion module 150, and the image output module 170. The information image generated by the superimposed image generation module 140 is combined with an image in an area including at least the area subjected to color conversion by the color conversion module 150. Further, based on the area changed by the area changing module 130, an information image may be synthesized with an image in an area including at least the area color-converted by the color conversion module 150. Then, an image obtained by combining the information images is transferred to the image output module 170.

  The image output module 170 is connected to the superimposed image composition module 160. An image obtained by combining the information image with the target image received by the target image receiving module 110 by the superimposed image combining module 160 is received, and the image is output. To output an image is, for example, printing on a printing device such as a printer, displaying on a display device such as a display, transmitting an image on an image transmission device such as a fax, or image to an image storage device such as an image database. , And storing in a storage medium such as a memory card. In addition, paper, a film for OHP (OverHead Projector), etc. are included as a medium printed with a printing apparatus. Note that the image output by the image output module 170 is a color image because it includes an image that has been color-converted by the color conversion module 150. However, the image to be output may be only one that is determined to be black for humans. This is because, as described above, even if it is determined to be black for human beings, K is expressed by YMC composition.

FIG. 2 is a flowchart showing an example of processing according to this embodiment.
In step S202, the target image receiving module 110 receives the target image.
FIG. 5 is an explanatory diagram illustrating a document image 500 that is an example of a target image. The document image 500 includes an explanation partial area 510 and an entry partial area 520. The entry partial area 520 is an area in which handwritten characters are entered, and the explanation partial area 510 is an area in which the explanation is written.

  In step S204, the area specifying module 120 specifies an area in the target image and an attribute of the area in accordance with an operation by the operator. In the document image 500 shown in the example of FIG. 5, the designated partial area is the explanation partial area 510 or the entry partial area 520. The entry partial area 520 is designated as an area is intended to at least synthesize an information image in the entry partial area 520, and the attribute is “writing information acquisition” or “writing information acquisition priority” Is specified. The explanation partial area 510 is designated as an area, which means that at least a part in the explanation partial area 510 is intended not to synthesize an information image, and attributes include “original image readability priority”, “ "Writing information not acquired A" or "Writing information not acquired B" is designated.

Here, the information image will be described with reference to FIG. FIG. 6 is an explanatory diagram illustrating an example of an information image.
In this example, a glyph code (for example, JP-A-6-103390, JP-A-6-75795) developed by the Palo Alto Research Institute of Xerox Corporation in the United States is used as an information image. It is a two-dimensional code pattern image used as a certain code symbol.

  In this example, the unit area 600 is a square area of 8 symbols × 8 symbols. The value of each symbol is represented by a hatched pattern as shown in FIGS. 6 (b) and 6 (c). In this example, symbol value 0 is a downward slanting line (pattern 0 in the example of FIG. 6B) that forms an angle of 45 degrees counterclockwise with respect to the vertical line, and symbol value 1 is relative to the vertical line. It is represented by a diagonal line that goes upward 45 degrees clockwise (pattern 1 in the example of FIG. 6C).

  Among these, the position code image 602 is a square image of 6 symbols × 6 symbols in the upper left corner of the unit area 600, and the identification code image 604 is the remaining area obtained by subtracting the 6 × 6 symbols square from the unit area 600. This is an image of an inverted L-shaped area.

  In this example, columns and rows of the synchronization code 606 are provided in the vertical and horizontal directions along the outer periphery of the unit region 600. In this example, the synchronization code 606 is a series of diagonal symbols that rise to the right (“1”), and the symbol size and arrangement pitch are the same as the symbol size and pitch in the unit region 600. The synchronization code 606 is provided at equal intervals in the vertical and horizontal directions, and each unit area 600 is provided in a square area surrounded by the synchronization code 606. The synchronization code 606 indicates a break of each unit area 600. That is, when a device that reads a two-dimensional code pattern image detects a row and a column in which right-up symbols are continuous, the inside of a mesh of a lattice formed by the row and the column is recognized as a unit region 600. The 6 × 6 symbol at the upper left corner of the unit area 600 can be recognized as the position code image 602.

  The synchronization code 606 may not be the one illustrated in FIG. 6 as long as the location of the unit region 600 or the position code image 602 can be specified. For example, the synchronization code 606 may be a symbol in which symbols having a specific shape different from the hatched symbols are arranged at the four corners of the unit region 600. In the example of FIG. 6, a row and a column having a width corresponding to one symbol are used for the synchronization code 606. However, if the mark constituting the synchronization code 606 is sufficiently small, the unit area 600 can be divided into 2 without a gap. The marks may be arranged in a dimensional arrangement, and the mark is arranged in the margin of the adjacent unit region 600.

  In the example of FIG. 6, one position code image 602 stores a total of 36 symbols, that is, 36-bit data. Of the 36 bits, 18 bits can be used for encoding the x coordinate and 18 bits can be used for encoding the y coordinate. If all 18 bits are used for position encoding, 2 ^ 18 (about 260,000) positions can be encoded. When each hatched pattern is composed of 8 pixels × 8 pixels as shown in the examples of FIGS. 6B and 6C, when printing at 600 dpi (dot per inch), 1 of 600 dpi is used. Since the vertical and horizontal lengths of the dots are 0.0423 mm, the vertical and horizontal lengths of the two-dimensional code (including the synchronization code 606) in FIG. 6 are about 3 mm (= 8 pixels × 9 symbols × 0 per symbol). 0.0423 mm). When 260,000 positions are encoded at intervals of 3 mm, a length of about 786 m can be encoded. If the reading accuracy is good, all 18 bits can be used for position coding. However, if a reading error becomes a problem, it is preferable to include redundant bits for error detection and error correction. Increasing the proportion of redundant bits in 18 bits increases error detection and error correction capability, but the range of positions that can be expressed decreases.

  In the example of FIG. 6, the identification code image 604 is arranged in a rectangular area of 2 bits × 8 bits and a rectangular area of 2 bits × 6 bits, and can store identification information of a total of 28 bits. When 28 bits are used as identification information, approximately 270 million (2 ^ 28) identification information can be expressed, but some of the 28 bits are used for error detection and error correction. Redundant bits may be used to cope with reading errors. The identification information is, for example, a sheet identification number that uniquely identifies a sheet. When the identification information is a sheet identification number, the identification code images 604 in the unit area 600 printed on one sheet are the same. Of course, since the position information represented by the position code image 602 in the unit area 600 is information indicating the position in the sheet, the position code image 602 in each unit area 600 is different.

  In the above example, 1-bit data is represented by one symbol by using two oblique line patterns having angles different from each other by 90 degrees as a symbol, but this is only an example. For example, if a pattern of vertical lines and horizontal lines is added to a symbol, 2-bit information can be expressed by one symbol. As described above, it is also possible to increase the number of bits that one symbol can represent by increasing the angle types of the oblique line pattern of one symbol. An information image other than the glyph code may be used.

There is a pen with a scanner (scanner type pen) for reading such an information image. FIG. 7 is an explanatory diagram showing a structure example of a pen 710 with a scanner that can read an information image. An information image is printed on the code print medium 701.
The pen 710 with a scanner has a core 711, an image reading module 712, and a control / transmission module 713. In accordance with the operation of the operator of the pen 710 with a scanner, characters or the like are written on the code print medium 701 by the core 711. Then, the image reading module 712 performs relatively high-speed continuous imaging at, for example, about several tens to hundreds of tens of frames per second, scans every frame, and then outputs the read image to the control / transmission module 713. In the image reading by the image reading module 712, only a color that absorbs infrared rays (for example, black) may be read. The information image is printed with a color that absorbs infrared rays. The control / transmission module 713 transmits the image read by the image reading module 712 to the information processing apparatus. The information processing apparatus (which may be built in the control / transmission module 713) that has received the read image detects the synchronization code 606 from the read image. In the case of the code pattern image as in the example of FIG. 6, a row and a column in which a right-up oblique line pattern continuously appears are detected as a row and a column of the synchronization code 606. As the synchronization code, various conventionally proposed codes other than those illustrated in FIG. 6 can be used, and detection can be performed by a conventional detection method corresponding to the type of the synchronization code.

  A position code image 602 and an identification code image 604 are extracted from the read image. The code reader reproduces the position information and the identification information by performing a code recognition process on the position code image 602 and the identification code image 604. The code recognition process performed here is roughly the reverse of the information image generation process. To explain the identification code image 604 as a representative, the information processing apparatus first recognizes each hatched symbol from the identification code image 604 to obtain the value of each symbol, and determines the value of each symbol in each identification code image 604. An identification code matrix arranged in accordance with the symbol arrangement position is obtained. Then, a serial identification code is obtained for the identification code matrix, and the identification information is decoded by performing a decoding process corresponding to the encoding method on the identification code. With respect to the position code image 602, the position information can be decoded by the same process. The extraction and recognition processes described above are performed for each frame to obtain position information and identification information.

  The position information and the identification information obtained from the read image of each frame in this way are provided to and used by application software that uses these information. For example, in the case of an application that captures, as electronic information, a handwriting written by an operator using a pen 710 with a scanner on a sheet on which an information image is printed, the original image of the sheet is acquired by identifying the sheet from the identification information. Then, processing such as obtaining the trajectory of the operator's writing from the position information acquired from each frame that is continuously read and recording an image indicating the trajectory superimposed on the original image is performed.

  For example, when an information image is synthesized only in a designated area, information written at the end of the entry area may not be acquired. As shown in the example of FIG. 7, the pen 710 with a scanner for acquiring writing information does not directly obtain the coordinates of the pen tip, but is an area slightly shifted from the pen tip (depending on the structure of the pen 710 with a scanner). This is because the position information is acquired from the information image, and the coordinates of the pen tip are estimated from the positional relationship between the pen tip and the image reading module 712 and the like. In other words, depending on how the pen is held, there is a case where there is no information image in the portion imaged by the image reading module 712 even if writing is performed with the pen 710 with a scanner in the area of the entry portion. In particular, it is likely to occur at the boundary between a region where the information image is combined and a region where the information image is not combined. Since position information cannot be acquired from the captured image, the coordinates of the pen tip cannot be estimated. Alternatively, there may be cases where writing is performed outside the area of the entry portion. Conversely, writing information that should not be extracted may be extracted. This is because the information image may be present in the part imaged by the image reading module 512, depending on how the pen is held, even though the information image is written in an unsynthesized area.

  Here, the case where step S204 and step S206 are not performed will be described. FIG. 8 is an explanatory diagram illustrating an example in which an information image is combined with the document image 500. The document image 500 has an explanation partial area 510, an entry partial area 520, and an overlapping area 810. Since the overlapping area 810 and the document image 500 are the same, the information image is combined on one side. Although the information image needs to be synthesized in the entry partial area 520, the information image is also synthesized in the explanation partial area 510, which is an area where the possibility of writing is low. As a result, the legibility of the explanation partial area 510 is lowered.

In step S206, the area change module 130 changes the area specified in step S204 based on the attribute.
FIG. 9 is an explanatory diagram showing an example of processing for combining an information image with a document image 500 in the present embodiment. This is a case where a designated area 920b surrounding the entry partial area 520 is designated according to the operation of the operator for the document image 500 (FIG. 9A) including the explanation partial area 510 and the entry partial area 520. It is assumed that the attribute of the designation area 920b has priority to obtain writing information (FIG. 9B). In this case, the area change module 130 performs enlargement including at least the designated area 920b, and changes the designated area 920b to the overlapping area 920c (FIG. 9C).

  FIG. 10 is an explanatory diagram showing a processing example of combining an information image with a document image 500 in the present embodiment. For the document image 500 including the explanation partial area 510 (FIG. 10A, that is, in the case where free description is permitted except for the explanation partial area 510), the explanation partial area 510 according to the operation of the operator. Is designated (the non-designated area 1010b is an area excluding the designated area 1020b), and the attribute of the designated area 1020b is writing information non-acquisition A (FIG. 10B). )). In this case, the area changing module 130 performs enlargement including at least the designated area 1020b, and converts the designated area 1020b into the non-overlapping area 1020c (the overlapping area 1010c, which is the area where the information image is synthesized, is an area excluding the non-overlapping area 1020c. (Fig. 10 (c)). Also, when the attribute of the designated area 1020b is the writing information non-acquisition B (FIG. 10 (b)), the area changing module 130 reduces the designated area 1020b and changes the designated area 1020b to the non-overlapping area 1020d (information image). The overlapping area 1010d, which is the area to be combined, is an area excluding the non-overlapping area 1020d) (FIG. 10D).

  FIG. 11 is an explanatory diagram showing a processing example of combining an information image with a document image 500 in the present embodiment. A difference from the example of FIG. 10 is that the document image 500 includes an entry partial area 520 in addition to the explanation partial area 510. That is, an example is shown in which the information image may be combined not only with the entry portion area 520 but also with other portions.

In step S208, the superimposed image generation module 140 generates an information image to be superimposed on the target image based on the region and attribute changed in step S206. That is, for example, a superimposed image including an information image is generated from the identification information and position information indicating each position in the area.
In step S210, the color conversion module 150 performs color conversion in the target image based on the region and attribute changed in step S206. This process will be described later with reference to FIGS.
In step S212, the superimposed image synthesis module 160 synthesizes the superimposed image generated in step S208 with the target image and the target image color-converted in step S210.
In step S214, the image output module 170 outputs an image obtained by combining the superimposed image with the target image in step S212.

FIG. 3 is an explanatory diagram showing a more specific module configuration example of the color conversion module 150 of the present embodiment.
The color conversion module 150 includes a distribution module 151, a color conversion A module 152, and a color conversion B module 153.
The distribution module 151 is connected to the color conversion A module 152 and the color conversion B module 153. The region information 301 (region, attribute of the region) and the target image 302 are received from the region change module 130, and the target image 302 is divided into a region for performing color conversion A and a region for performing color conversion B. Then, the area for performing color conversion A is transferred to the color conversion A module 152, and the area for performing color conversion B is transferred to the color conversion B module 153. That is, according to the area information 301, the area in the target image 302 is divided and determined to be passed to the color conversion A module 152 or the color conversion B module 153.

The color conversion A module 152 is connected to the distribution module 151. An image in the area is received from the distribution module 151, and color conversion is performed in which K in the YMCK color space is expressed by another YMC as in the above-described example. Then, the image of the area expressed by YMC 303 is passed to the superimposed image synthesis module 160.
The color conversion B module 153 is connected to the distribution module 151. An image in the area is received from the distribution module 151, and normal color conversion processing is performed as in the above-described example. Then, the image of the area expressed by YMCK 304 is passed to the superimposed image synthesis module 160. Note that the color conversion B module 153 does not have to perform color conversion processing.
Further, the color conversion by the color conversion A module 152 may be further performed in the same manner as the color conversion by the color conversion B module 153. However, color conversion that includes K as an output is not included.

FIG. 4 is a flowchart illustrating an example of processing performed by the color conversion module 150.
In step S <b> 402, the distribution module 151 receives the region information 301 and the target image 302 from the region change module 130.
In step S <b> 404, the distribution module 151 distributes the image of the area in the target image 302 to the color conversion A module 152 or the color conversion B module 153 according to the area information 301.
In step S406, the color conversion A module 152 performs color conversion in which the area in the target image to be combined with the information image is expressed in YMC.
In step S408, the color conversion B module 153 performs color conversion that expresses a region in the target image that is not combined with the information image in YMCK.

  A hardware configuration example of the image processing apparatus according to the present embodiment will be described with reference to FIG. The configuration illustrated in FIG. 12 is configured by, for example, a personal computer (PC), and illustrates a hardware configuration example including a data reading unit 1217 such as a scanner and a data output unit 1218 such as a printer.

  A CPU (Central Processing Unit) 1201 includes various modules described in the above-described embodiments, that is, an area designation module 120, an area change module 130, a superimposed image generation module 140, a color conversion module 150, a superimposed image composition module 160, and the like. It is a control part which performs the process according to the computer program which described the execution sequence of each module.

  A ROM (Read Only Memory) 1202 stores programs used by the CPU 1201, calculation parameters, and the like. A RAM (Random Access Memory) 1203 stores programs used in the execution of the CPU 1201, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus 1204 including a CPU bus.

  The host bus 1204 is connected to an external bus 1206 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 1205.

  A keyboard 1208 and a pointing device 1209 such as a mouse are input devices operated by an operator. The display 1210 includes a liquid crystal display device or a CRT (Cathode Ray Tube), and displays various types of information as text or image information.

  An HDD (Hard Disk Drive) 1211 incorporates a hard disk, drives the hard disk, and records or reproduces a program executed by the CPU 1201 and information. The received target image is stored in the hard disk. Further, various computer programs such as various other data processing programs are stored.

  The drive 1212 reads data or a program recorded in a removable recording medium 1213 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and the data or program is read out to the interface 1207 and the external bus 1206. , The bridge 1205, and the RAM 1203 connected via the host bus 1204. The removable recording medium 1213 can also be used as a data recording area similar to a hard disk.

  The connection port 1214 is a port for connecting the external connection device 1215 and has a connection unit such as USB, IEEE1394. The connection port 1214 is connected to the CPU 1201 and the like via the interface 1207, the external bus 1206, the bridge 1205, the host bus 1204, and the like. The communication unit 1216 is connected to a network and executes data communication processing with the outside. The data reading unit 1217 is a scanner, for example, and executes document reading processing. The data output unit 1218 is a printer, for example, and executes document data output processing.

Note that the hardware configuration of the image processing apparatus illustrated in FIG. 12 illustrates one configuration example, and the present embodiment is not limited to the configuration illustrated in FIG. 12, and the modules described in the present embodiment are executed. Any configuration is possible. For example, some modules may be configured with dedicated hardware (for example, Application Specific Integrated Circuit (ASIC), etc.), and some modules are in an external system and connected via a communication line In addition, a plurality of systems shown in FIG. 12 may be connected to each other via communication lines so as to cooperate with each other. Further, it may be incorporated in a copying machine, a fax machine, a scanner, a printer, a multifunction machine (an image processing apparatus having any two or more functions of a scanner, a printer, a copying machine, a fax machine, etc.).
The technology described in the background art may be adopted as the processing content of each module described above.

  In the above-described embodiment, the case where the area is changed by the area changing module 130 has been described. However, the area changing module 130 may be omitted. That is, the area specifying module 120 passes the target image, the specified area, and its attributes to the superimposed image generation module 140 and the color conversion module 150. The superimposed image generation module 140 generates an information image to be combined with the target image based on the designated area and the attribute of the area. Then, the color conversion module 150 performs color conversion on an area specified by the area specifying module 120 or an area other than the specified area. Based on the attribute of the area received from the area specifying module 120, it is determined whether the area to be subjected to color conversion is an area specified by the area specifying module 120 or an area other than the specified area. decide.

The program described above may be provided by being stored in a recording medium, or the program may be provided by communication means. In that case, for example, the above-described program may be regarded as an invention of a “computer-readable recording medium recording the program”.
The “computer-readable recording medium on which a program is recorded” refers to a computer-readable recording medium on which a program is recorded, which is used for program installation, execution, program distribution, and the like.
The recording medium is, for example, a digital versatile disc (DVD), which is a standard established by the DVD Forum, such as “DVD-R, DVD-RW, DVD-RAM,” and DVD + RW. Standard “DVD + R, DVD + RW, etc.”, compact disc (CD), read-only memory (CD-ROM), CD recordable (CD-R), CD rewritable (CD-RW), Blu-ray disc ( Blu-ray Disc (registered trademark), magneto-optical disk (MO), flexible disk (FD), magnetic tape, hard disk, read-only memory (ROM), electrically erasable and rewritable read-only memory (EEPROM), flash Includes memory, random access memory (RAM), etc. .
The program or a part of the program may be recorded on the recording medium for storage or distribution. Also, by communication, for example, a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a wired network used for the Internet, an intranet, an extranet, etc., or wireless communication It may be transmitted using a transmission medium such as a network or a combination of these, or may be carried on a carrier wave.
Furthermore, the program may be a part of another program, or may be recorded on a recording medium together with a separate program. Moreover, it may be divided and recorded on a plurality of recording media. Further, it may be recorded in any manner as long as it can be restored, such as compression or encryption.

DESCRIPTION OF SYMBOLS 110 ... Object image reception module 120 ... Area specification module 130 ... Area change module 140 ... Superimposed image generation module 150 ... Color conversion module 151 ... Distribution module 152 ... Color conversion A module 153 ... Color conversion B module 160 ... Superimposed image composition module 170 Image output module 701 Code printing medium 710 Pen 711 Core 712 Image reading module 713 Control / transmission module

Claims (10)

An area specifying means for specifying an area in the image in accordance with an operation of the operator;
Area changing means for changing the area specified by the area specifying means based on the attribute set in the area;
Color conversion means for performing color conversion on an area designated by the area designation means or an area other than the designated area; and
The image color-converted at least including the area of the region by the color conversion means, comprising an information image combining means for combining the information image representing the position information,
The image processing apparatus according to claim 1, wherein the color conversion means performs color conversion that expresses black by combining other colors .   Setting means for setting attributes in the area,
  Have
  The area changing means changes the area based on the attribute of the area set by the setting means.
  The image processing apparatus according to claim 1.   The area changing means enlarges the area when the attribute set in the area indicates an entry area,
  The information image synthesizing means includes
  Combining the information image with the region enlarged by the region changing means;
  The image processing apparatus according to claim 1.   The area changing means enlarges or reduces the area when the attribute set in the area indicates an area that is not the entry area,
  The information image synthesizing means does not synthesize the information image for the area enlarged or reduced by the area changing means when the attribute set in the area indicates an area that is not the entry area;
  The image processing apparatus according to any one of claims 1 to 3. The color conversion means performs color conversion on an area changed by the area changing means or an area other than the changed area,
The information image synthesizing unit synthesizes an information image with respect to an image in a region including at least the region color-converted by the color conversion unit based on the region changed by the region changing unit. The image processing apparatus according to claim 1 . The image processing apparatus according to claim 5 , wherein the area changing unit enlarges the area so as to include at least the area specified by the area specifying unit. The image processing apparatus according to claim 5 , wherein the area changing unit reduces the area specified by the area specifying unit. The information image synthesizing unit, the image processing apparatus according to any one of the seven claim 5, characterized in that combining the information image within the changed area by the area changing means. The information image synthesizing unit, the image processing apparatus according to any one of the seven claim 5, characterized in that combining the information image in the region other than the changed regions by the region changing means. Computer
An area specifying means for specifying an area in the image in accordance with an operation of the operator;
Area changing means for changing the area specified by the area specifying means based on the attribute set in the area;
Color conversion means for performing color conversion on an area designated by the area designation means or an area other than the designated area; and
Functioning as an information image synthesizing unit that synthesizes an information image representing position information with respect to an image in a region including at least the region subjected to color conversion by the color converting unit ;
An image processing program characterized in that the color conversion means performs color conversion to express black by combining other colors .

Images