JP5140773B2 - Image processing program, portable terminal, and image processing method - Google Patents

Description

  The present invention is a technique that is effective when applied to a technique for imaging a document using a camera function of a compact digital camera or a mobile phone.

  Compact digital cameras and digital cameras mounted on mobile phones and smartphones are capable of high-accuracy shooting with millions of pixels and more, not only for shooting landscapes and people, but also for paper documents and memos. It is increasingly used for photographing business cards and business cards.

  A typical smartphone, Apple's iPhone (a registered trademark of Apple Inc., licensed by Apple Inc.), reads the surface image of a paper medium photographed with an installed camera and It recognizes the edge of a paper medium, corrects the trapezoidal edge to a square shape (trapezoid correction) because it is shooting from an oblique direction, and reads the paper medium with a close-up document scanner. There are several types of applications called scanner applications that finish images.

  On the other hand, Japanese Patent Application Laid-Open No. 2010-130181 (Patent Document 1) discloses a technique for correcting an image of a document captured by a camera as described above. In Patent Document 1, as described in claim 7 and paragraph 0047, a red line RL as a marker is provided along both sides of a keyboard of a personal computer (main body PCB), and a screen side edge of a captured image is provided. A technique for correcting a trapezoid using a tilt angle as a correction parameter is shown.

JP 2010-130181 A

  Since Patent Document 1 performs keystone correction based on the marker of the red line RL photographed in an oblique direction provided on both sides of a personal computer (main body PCB), there is an advantage that keystone correction can be automated. If the document placed in front of the personal computer (main body PCB) is not placed at an accurate position with respect to the personal computer (main body PCB), there is a problem that accurate keystone correction cannot be performed. In other words, if the document (DCM) is slightly tilted, the document (DCM) reproduced as an image will be deformed even if trapezoidal correction is performed on the tilted captured image. There was a high possibility that it would be uncomfortable.

  Furthermore, even if the conventional technology for recognizing the edge portion of the document and correcting the keystone is used together, it is necessary to perform a complicated correction calculation, and the document is placed on a desk having a color similar to the paper color. If it is placed, or the corners are crushed or bent by the staples of the stapler, the recognition rate of the edge portion becomes low and accurate document reproduction is often impossible.

  The present invention has been made in view of the above points, and image correction is possible without being affected by the placement of the document or the position of the camera, and even when the paper color or the corners are crushed. It is an object to provide an imaging technique with high document reproducibility.

  The present invention employs the following means in order to solve the above problems.

  More specifically, the image processing system of the present invention includes an imaging object having a positioning symbol formed by a symbol code composed of multi-valued graphics at at least two predetermined positions, and the imaging object. Image data that is in the first range by detecting the positioning symbol from the imaging unit for imaging and the original image data captured by the imaging unit, recognizing the predetermined area calculated based on the positioning symbol as the first range An image processing system comprising: an image acquisition unit that cuts out only the image and acquires it as cut-out image data; and an image data storage unit that stores the cut-out image acquired by the image acquisition unit.

  According to the present invention, since a positioning symbol (symbol code) is provided on a document or memo itself as an imaging object, it is not affected by how the document is placed or the position of the camera, and the color or corner of the paper. Even if there is crushing of the image, it is possible to correct the image and obtain a highly reproducible document image. In other words, the symbol code consisting of a multi-valued figure is a symbol code having an appearing part and a non-appearing part. If there are two or more positioning symbols, the outer shape can be recognized, and if there are three positioning symbols, the coordinates of the image can be obtained. However, it is preferable to provide a vertex detection cell as a countermeasure against distortion during imaging. If there are four positioning symbols, it is preferable to provide a direction determining symbol because the outer shape can be understood even if it is distorted during imaging, but the direction cannot be known.

  In the image processing system of the present invention, the imaging object includes a direction recognition symbol for recognizing the direction of the first range at a predetermined position of the first range, and the first range or the first range. The image acquisition unit or the image data storage unit stores character information for collation in advance, and the image acquisition unit includes the direction recognition symbol. The direction of the first range is recognized based on the direction, the second range is detected based on the recognized direction information, the image drawn in the second range is compared with the character information, and the image is a character. When this is recognized, the character may be stored as related information of the image data read from the first range.

  According to the present invention, the character data described in the second range as the related information can be recognized and stored as the character information for the image data read from the first range. It can be used as a data index, and the searchability of image data can be improved. The predetermined position of the first range is, for example, one of the upper part of the first range and the positioning symbol. The related information is, for example, a date.

  In the present invention, the collation character information may be at least one of English characters and numbers. By limiting the recognition of characters described in the second range to alphanumeric characters, the recognition rate can be increased and the processing speed can be increased.

  In the image processing system of the present invention, the imaging unit may read the imaging target and deliver the captured image to the image acquisition unit when detecting at least three positioning symbols from the read image. . The image pickup means can detect the coordinates of the image by detecting at least three positioning symbols, and an automatic shutter can be realized by transferring the picked-up image data to the image processing means. As a result, it is possible to acquire image data at an optimal timing without unnecessary user operations.

In the image processing system of the present invention, the first range on the imaging object has a rectangular shape, and the positioning symbols are respectively arranged at the four vertices of the rectangle. The reference distance between the positioning symbols stored in advance is read, and it is verified whether or not the distance between the positioning symbols in the captured image matches the reference distance between the positioning symbols stored in advance. If they do not match, the captured images may be corrected so that the distance between the positioning symbols in the captured image matches the reference distance between the positioning symbols.

  According to the present invention, a positioning symbol is provided on an object to be imaged such as a document or a memo, and the edge of the paper is recognized in order to perform image correction (trapezoid correction) processing based on the positioning symbol. Compared to the case, it is possible to reliably recognize the acquisition range of the image data without being influenced by how to place the imaging object (direction, position, and location).

  In the image processing system of the present invention, the surface of the imaging object is subjected to a printing process in which prohibited symbols provided in shapes different from other positions appear at predetermined positions when electronically copied. The imaging unit that captured the imaging object may not execute the process of transferring the captured image to the image acquisition unit when the prohibited symbol is recognized in the captured image.

  According to the present invention, even if an imaging object that has been electronically copied (copied) is to be imaged by the imaging means, image processing by the image acquisition means is not performed, so that unauthorized electronic copying (copying) is prevented. Can do.

  Moreover, this invention can be specified as an imaging target object used with the image processing system of this invention. That is, the present invention is an imaging object of the above-described image processing system, and has positioning symbols formed by symbol codes composed of multi-valued graphics at at least two predetermined positions.

  According to the object to be imaged of the present invention, by setting positioning symbols having a special shape in at least two places (for example, upper left and lower right), it is clearly seen as a figure such as a handwritten character described in the first range. While distinguishing, it becomes easy to determine the range. As the positioning symbol, the same symbol as that used in the QR code (trademark registration No. 4075066) may be used.

  In the imaging object of the present invention, the symbol code including the multi-valued figure has a appearing portion and a non-appearing portion, and the non-appearing portion is obtained from the imaging means. A copy that has a background portion and a latent image portion that have different patterns that cannot be visualized in the captured image, electronically copies the read object, and prints the copy, and the background portion and the latent image portion appear. The object may be reproduced in a visualized state.

  According to the present invention, in the figure of the positioning symbol, the image is not visualized by the image pickup means, but is copied by providing a background portion and a latent image portion that appear visually by electronic copying (copying by a copying machine). Unauthorized use of the imaging object can be prevented. In other words, when the object to be copied was imaged using electronic copying (copying by a copying machine), the positioning symbol figure itself was different because the background portion and latent image portion of the positioning symbol appeared. It will be recognized by the imaging means as having a shape. For this reason, the image pickup unit cannot specify the positioning symbol and cannot transfer it to the image acquisition unit.

In addition, the present invention includes a background portion and a latent image portion having different patterns that are not visualized in a captured image obtained from the imaging means at a predetermined location excluding an area where a positioning symbol is formed, and the reading target When an object is electronically copied and the copy is printed, the prohibited symbol in which the background portion and the latent image portion appear can be reproduced in a visualized state. By providing a background and latent image that are not visualized by the imaging means at a predetermined location but appear visually by electronic copying (copying by a copying machine), illegal use of the copied imaging object is prevented. it can. That is, when the imaging unit detects a background part and a latent image part that appear visually, that is, a prohibited symbol, unauthorized use can be prevented by not passing the captured image data to the image acquisition unit.

  Further, according to the present invention, a positioning symbol formed by a symbol code consisting of a multi-valued figure is disposed at at least two predetermined positions, and is placed on a sheet as an imaging object. A sheet, an imaging unit for imaging the imaging object, and a predetermined symbol calculated based on the positioning symbol by detecting the positioning symbol from the original image data on the surface of the paper imaged by the imaging unit through the transparent sheet. Image acquisition means for recognizing a region as a first range, cutting out only image data in the first range and acquiring it as cut-out image data, and image data for storing the cut-out image acquired by the image acquisition means The image processing system may include a storage unit.

  Further, the present invention images two or more seal pieces made of a positioning symbol formed by a symbol code made of a multi-valued graphic that is affixed on a paper as an image pickup object, and the image pickup object. And detecting a positioning symbol of the sticker piece from the original image data on the surface of the paper imaged by the imaging unit, recognizing a predetermined area calculated based on the positioning symbol as a first range, As an image processing system comprising an image acquisition unit that cuts out only image data in a range and acquires it as cut-out image data, and an image data storage unit that stores the cut-out image acquired by the image acquisition unit Also good. By arranging the positioning symbol on the transparent sheet or configuring the positioning symbol with a seal piece, it is possible to correct the image even when the document or memo as the imaging target does not have the positioning symbol.

  The present invention can also be specified as an image processing method. That is, according to the present invention, the surface of an imaging object having a positioning symbol formed by a symbol code consisting of multi-valued graphics at at least two predetermined positions is imaged by an imaging means, and the original image data In the image processing system in which the image acquisition unit processes and registers in the image data storage unit, the imaging unit images the imaging object so that positioning symbols at predetermined positions in the two locations are included, and The image acquisition means detects the positioning symbol from the captured original image data, recognizes a predetermined area calculated based on the positioning symbol as a first range, and only image data in the first range. Cutting out and obtaining as cut image data; and storing the cut image data in the image data storage means That is an image processing method comprising the steps.

  The present invention can also be specified as an image processing program. That is, according to the present invention, the surface of an imaging object having a positioning symbol formed by a symbol code consisting of multi-valued graphics at at least two predetermined positions is imaged by an imaging means, and the original image data An image processing program that can be executed by an image processing system that processes the image by the image acquisition means and registers the image data storage means, wherein the imaging means includes positioning symbols at at least two predetermined positions. A step of imaging an imaging target; and a step of detecting the positioning symbol from the captured original image data and recognizing a predetermined area calculated based on the positioning symbol as a first range; Cutting out only image data in the first range and obtaining it as cut-out image data; and An executable image processing program in the clipped images image processing system comprising the step of storing the data to.

Further, the present invention is an imaging object used in an image processing system that is imaged by an imaging means, processes the image data by an image acquisition means, and saves the data in the data storage means, and the imaging range of the imaging object A positioning symbol formed by a symbol code composed of multi-valued graphics provided at at least two predetermined positions for confirmation, and the image provided at a predetermined position with reference to the positioning symbol; The imaging target may be used in an image processing system including a first range for causing the obtaining unit to cut out image data.

  Furthermore, in the imaging target of the present invention, the imaging target includes a direction recognition symbol for recognizing the direction of the first range at a predetermined position of the first range, and the first range or the first range. A character is provided that is provided as a separate area from the range, whose direction is recognized by the positional relationship with the direction recognition symbol, and for collation with collation character information stored in advance in the image data storage means. A second range may be provided.

  Furthermore, the present invention provides an imaging object having a positioning symbol formed by a symbol code consisting of multi-valued graphics at at least two predetermined positions, an imaging means for imaging the imaging object, and imaging In the transmitting means for transmitting the original image data captured by the means via the network and the image processing server for receiving the original image data via the network, the positioning symbol is detected from the original image data captured by the imaging means. An image acquisition unit that recognizes a predetermined area calculated based on the positioning symbol as a first range, cuts out only image data in the first range and acquires it as cut-out image data, and the image acquisition unit acquires Image processing via a network composed of image data storage means for storing the cut out image data It can also be identified as a stem.

  According to the present invention, it is possible to provide an imaging technique that is capable of image correction and high document reproducibility even if the document is not affected by the placement of the document and the position of the camera, and even if the color of the paper or the corner portion is crushed. can do.

The figure which shows the memo paper as an imaging target object in embodiment (1) The figure which shows the memo paper as an imaging target object in embodiment (2) The figure which shows the memo paper as an imaging target object in embodiment (3) Configuration diagram of a camera-equipped smartphone used in the embodiment Explanatory diagram when the embodiment is used on a network Flow chart showing an example of processing of the embodiment The figure which shows the imaging | photography state in embodiment, and the transparent plate on which the positioning mark was printed The figure which shows the memo paper as an imaging target object in embodiment (4) The figure which shows the seal | sticker which printed the positioning mark used for embodiment Flow chart showing another example of processing of the embodiment

(Embodiment 1)
The present invention will be described with reference to the drawings. FIG. 1 shows the configuration of the surface of a memo paper (imaging object) (DOC) in this embodiment. As shown in the figure, this memo paper (DOC) is composed of a binding margin (US) provided at the top and a paper body. A horizontal perforation (ML) in the figure may be provided above the paper body along the binding margin (US) so that the memo paper body can be cut off.

On the surface of the memo paper main body, positioning symbols (M1 to M4) are printed near the four corners. Of the four positioning symbols, the upper left (M1), lower left (M2), and lower right (M3) positioning symbols correspond to the symbol codes made up of multi-valued figures of the present invention, and have a rectangular shape. A solid quadrilateral (appearing portion) surrounded by a blank background area (non-appearing portion) is arranged inside the thick line diagram (appearing portion). This thick line shape is preferably printed with a thicker line than a general-purpose writing instrument (pencil, ballpoint pen, sign pen) so that it can be clearly distinguished from the handwriting of the writing instrument described in the first range described later. . The positioning symbol may be a color code.

  A direction determination symbol (M4) having a shape different from that of the positioning symbol is printed on the upper right of the paper body. The direction determination symbol (M4) corresponds to the symbol code composed of the multi-valued graphic of the present invention, and is different from the positioning symbols of the upper left (M1), lower left (M2) and lower right (M3). Shape. In this way, by changing the shape of only one of the four symbols to a different shape, the positive direction of the memo paper (DOC) can be detected when assessed by the camera (CAM). Yes.

  A region surrounded by the four positioning symbols (M1 to M4) is configured as a first range (AR1) so that a user can draw handwritten characters, figures, symbols, pictures, and the like. The first range (AR1) is read as original image data.

  In this example, the first range (AR1) is recognized as a portion surrounded by four positioning symbols (M1 to M4), but four positioning symbols are not necessarily arranged. As shown in FIG. 3, it may be arranged only in the upper left (M6) and lower right (M7). That is, a rectangular area having a diagonal line connecting the upper left positioning marker (M6) and the lower right positioning marker (M7) may be recognized as the first range (AR1).

  In the above description, among the four positioning symbols (M1 to M4), the shape of the upper right symbol is changed to be a direction determination symbol, but this direction determination symbol is not only the positioning symbol (M1 to M4). In addition, it may be printed on another part as indicated by M5 in FIGS.

  Further, the second range (AR2) may be recognized from the relative positional relationship between the positioning symbol (M1) and the positioning symbol (M2). Instead of the relative positional relationship between the positioning symbols, the second range (AR2) may be recognized from the relative positional relationship between the positioning symbol and the direction determination symbol. In the example shown in FIG. 3, the second range (AR2) may be recognized based on the binding margin (US).

  In FIG. 1, a second range (AR2) is provided in the immediate left region of the direction determining symbol (M4) in the first range (AR1). The second range (AR2) has the same height as the direction determination symbol, and the left end side of the direction determination symbol (M4) matches the right end side of the second range. If the direction determination symbol (M4) can be detected from the original image data captured by (CAM), the second range can also be detected.

  Although details are not shown in FIG. 1 in the second range, as shown in FIG. 3, a filling guide made of straight pieces constituting 7 segments is printed in a light color. That is, by tracing the entry guide portion constituting 7 segments with a writing instrument, numbers from 0 to 9 can be described in each segment as shown on the electronic bulletin board.

Thus, by providing a 7-segment entry guide, the recognition rate of the entered numbers can be increased. In addition, although the example of providing a 7-segment entry guide makes it easy to recognize the entered numbers, this is not restrictive, and each character's frame is printed in a light color and entered in this frame. It may be possible to recognize characters such as numbers and English characters. In other words, the characters (alphanumeric characters) entered in the second range (AR2) are read by the camera (CAM) and compared with the character pattern (character information for verification) stored in the memory (MEM). It can be performed.

  As shown in FIG. 2, a prohibition symbol (AS1) is provided immediately below the direction determination symbol (M4) of the paper memo (DOC). The prohibition symbol is subjected to printing that cannot be visually recognized, for example, tint block printing, and appears as a visible prohibition symbol when electronically copied by a copying apparatus or the like. The prohibited symbol only needs to be at a predetermined position in the first range (AR1), and may be arranged at a position immediately above the lower left positioning symbol (M2), for example, as shown in FIG.

  Further, by making the tint block print appear (visualize), it may be positively recognized as a prohibited symbol by a program. When the CPU recognizes that the prohibited symbol exists on the memo paper (DOC) in this way, the central processing unit (CPU) stops the image processing based on the program and displays “This paper is on the display (DISP)”. “It is not regular paper” may be displayed.

  Next, the hardware configuration of the camera-equipped smartphone (MP) used in this embodiment will be described with reference to FIG. The smartphone (MP) is, for example, Apple's iPhone (a registered trademark licensed from Aiphone).

  A home button (BTN) is provided on the main body, and icons and menus displayed on the display (DISP) are returned to the home screen or function as a shutter of the camera (CAM).

  The inside of the smartphone (MP) includes a central memory (MM), a memory unit (MEM) connected via a bus (BUS), a communication interface (TIF), a camera (CAM) Buttons (BTN), a touch panel display in which a touch panel (TPN) and a display (DISP) are integrated, and a speaker (SPK).

  As shown in FIG. 5, the communication interface (TIF) can be connected to a general-purpose network (NW) via a base station (BS) through a wireless telephone line. The communication interface (TIF) can communicate with a wireless LAN access point (AP), and can be connected to a network via any communication means.

  The memory unit (MEM) is provided with an operating system (OS), an image processing application program (APL), and a user data area (UDT) for holding original image data and character information.

  In the present embodiment, the above-described imaging of memo paper (DOC) and its image processing are performed by the CPU (CPU) and the central processing unit (CPU) via the bus (BUS) and the main memory (MM). ) Is read and executed sequentially. This process will be described based on the process flow of FIG.

First, when the image processing application program (APL) is selected and activated by the user's touch operation on the touch panel (TPN) (step 601), the function of the camera (CAM) is activated, and the memo paper (image object) DOC) is photographed, and the central processing unit (CPU) reads the photographed image based on the program to determine the presence or absence of the prohibited symbol described with reference to FIG. 2 (step 603). The determination of the prohibited symbol is performed by reading the image data of the reference prohibited symbol recorded in the memory unit and comparing it with the original image data from the camera (CAM).

  If a prohibited symbol is detected, the process returns to step 602 without performing the subsequent processing. At this time, as described above, a message such as “This sheet is not a regular sheet” may be displayed on the display (DISP) to notify the user that a prohibited symbol has been detected.

  When the prohibition symbol is not detected, the central processing unit (CPU) searches for a positioning symbol from the original image data (step 604). This positioning symbol search is also performed by reading the reference positioning symbol image data recorded in the memory unit and comparing it with the original image data from the camera (CAM).

  When the positioning symbol is detected, the original image data at that stage is stored in the memory unit (MEM) (step 605). At this time, a shutter sound for notifying that the adoption of the original image data is determined may be output from a speaker (SPK). Even if the positioning symbol is not recognized in step 604, a shutter sound is generated by the user's button (BTN) operation (step 611), and the original image data at that time is stored in the memory unit (MEM) and the positioning symbol is also displayed. May continue (step 612). Also in this case, if the positioning symbol cannot be detected within a certain time, it may be selected whether to retain the original image data as it is or to return to step 602 and shoot again (step 613).

  When the original image data is held in step 605, the number of positioning symbols is counted (step 606). When only three positioning symbols are detected, the remaining one positioning position is detected from these three positions. A symbol is estimated and a fourth positioning symbol is additionally set in a pseudo manner (step 610).

  When all four positioning symbols (M1 to M4) are determined, four virtual lines connecting the outer edges of the four positioning symbols are set, and an image is cut out using a portion surrounded by the virtual lines as a first range. (Step 607).

  Next, trapezoidal correction is performed on the clipped image so that the position and distance of the four sides are matched with the reference position / distance stored in advance in the memory unit (step 608), and the corrected image is recorded on the memo paper (DOC). The reproduced image is stored in the memory unit (MEM) (step 609).

  In FIG. 6, the processing when the prohibited symbol is (AS1) and is arranged at a position immediately below the direction determination symbol (M4) of the paper memo (DOC) or at the position directly above the lower left positioning symbol (M2) has been described. . Here, as shown in FIG. 2, the prohibited symbol may be provided by non-appearing portion (white background portion) of the positioning symbol (for example, M3) by tint block printing. Further, the prohibition symbol may be provided by non-appearing portion (white background portion) of another positioning symbol (for example, M3) by tint block printing. In this way, when the positioning symbol (M3) and the prohibition symbol (AS3) are printed in a superimposed manner, when the memo paper (DOC) is electronically copied by a copying apparatus or the like, the positioning symbol (M3) of this copy is obtained. ) Has a different shape, the central processing unit (CPU) performs processing that is not recognized as a positioning symbol (M3) by a program in image processing after being read by the camera (CAM). Thereby, the processing of the original image data in the first range may not be performed.

As described above, when the prohibition symbol is provided by the copy-forgery-inhibited pattern printing on the non-appearing portion (white portion) of the positioning symbol, it is not necessary to recognize the prohibition symbol. Therefore, imaging and image processing can be performed by the processing flow shown in FIG. The process shown in FIG. 10 differs from the process flow shown in FIG. 6 in that a process (step 1004) for finding a positioning symbol is performed without performing the process (step 603) for determining the presence or absence of a prohibited symbol in FIG. Note that the last two digits of the code of each step in FIG. 10 correspond to the last two digits of the code of each step in FIG. 6, and the same processing is performed for steps having the same last two digits. Shall.

  In the above-described processing flow, the example in which the keystone correction is performed using all of the four positioning symbols has been described. However, the present invention is not limited to this, and as described in FIG. 3, the upper left positioning symbol (M6) and the right Keystone correction may be executed based on only the lower positioning symbol (M7). In this case, only two positioning symbols need be detected in step 606. Further, the positions of the remaining two positioning symbols may be estimated and pseudo positioning symbols may be set.

  In the above description, the case where all processes are performed by the smartphone (MP) has been described, but a part of the processes may be executed by the server (SV) connected via the network (NW).

  For example, after taking a memo paper (DOC) with a camera (CAM), the original image data is temporarily stored in the memory unit (MEM) and the server (SV) via the communication interface (TIF) and the network (NW). Send to.

  The server (SV) that receives the original image data detects the positioning symbol from the original image data based on an image processing program stored in the server, and uses a predetermined area calculated based on the positioning symbol as a first range. It is also possible to recognize and cut out only the image data in the first range and store it in the server (SV) as cut-out image data.

  The image data stored in the server (SV) may be accessible from the smartphone (MP) via the network (NW).

  In the above description, the example in which the positioning symbol and the direction determination symbol are directly printed on the memo paper (DOC) itself is described. However, the present invention is not limited to this, and the positioning symbol and the direction determination symbol are printed or printed on the transparent plastic sheet (PL). Even if the plastic sheet (PL) is put on the memo paper (DOC) and the plastic sheet is transmitted through the camera (CAM) and the surface of the memo paper (DOC) is imaged. Good.

  In addition, as shown in FIG. 9, it is provided as a seal (SL) made of a plastic film on which a positioning symbol and a direction determining symbol are printed, and an adhesive surface is provided on the back surface of the seal (SL), so that a general-purpose memo paper or report paper is provided. It may be affixed to.

  In the above description, the object to be imaged is described as memo paper (DOC). However, positioning symbols and orientation symbols such as A4 size report paper, blank paper, printed documents, business cards or business card size memo paper are set. Any size is possible as long as possible.

  The present invention can be used in the field of image processing for taking a document by non-close-up photography using a camera.

DOC Imaging object (memo paper)
AR1 First range AR2 Second range US Binding margins M1 to M4, M6, M7 Positioning symbol (M4 is a direction determining symbol)
M5 Direction determination symbol AS1 to AS3 Prohibited symbol MP Smartphone CAM Camera PL Plastic sheet SL Seal CPU Central processing unit MM Main memory BUS Bus MEM Memory unit OS Operating system APL Image processing program UDT User data area TIF Communication interface BTN Home button TPN Touch panel DISP Display panel SPK Speaker BS Base station AP Access point

Claims (10)

Imaging an imaging object having a positioning symbol formed by a symbol code composed of multi-valued graphics arranged at at least two predetermined positions with an imaging means, and processing the original image data with a CPU, An image processing program executable by the image processing system registered in the image data storage means,
The positioning symbols are at least two types of rectangular positioning symbols provided in at least two locations in the vicinity of the four corners of the rectangular paper body, and are represented by a symbol code consisting of multi-valued figures. Formed,
The positioning symbol has an appearing portion having a color value different from the ground color of the paper body, and a non-appearing portion having a ground color of the paper body,
The appearing portion of the first positioning symbol has two straight portions that are parallel to the two sides extending from the corner of the sheet body, and a corner portion where the ends of the two straight portions are in contact with each other. The non-appearing part of the first positioning symbol includes a frame-like appearing part, and is composed of a ground-colored region surrounded by the frame-like appearing part,
The appearing portion of the second positioning symbol has two straight portions that are parallel to the two sides extending from the corner of the sheet body, and a corner portion where the ends of the two straight portions are in contact with each other. At least a protruding portion having a straight line portion and a corner portion, and a rectangular protruding portion located inside the protruding portion having the straight line portion and the corner portion, wherein the non-protruding portion is the straight line portion. And a region between the protruding portion having a corner and the rectangular protruding portion,
The second positioning symbol includes four corners of the two straight portions, each end of the two straight portions not forming the corner, and the rectangular appearance portion. And two virtual straight lines connecting the corners farthest from the corners are constituted by virtual rectangles forming four sides ,
In the CPU,
Detecting the positioning symbol from original image data of the imaging object including positioning symbols at at least two predetermined positions imaged by the imaging means;
Recognizing a predetermined area calculated based on the positioning symbol as a first range;
Cutting out only image data in the first range and obtaining it as cut-out image data;
Storing the cut image data in the image data storage means;
An image processing program for executing In the step of detecting the positioning symbols, a plurality of positioning symbols having at least two types of shapes are detected from the original image data,
The CPU reads out the reference position of each positioning symbol stored in advance so as to match the positional relationship between the plurality of positioning symbols in order to recognize the direction of the first range of the imaging object, The image processing program according to claim 1, further comprising executing a step of recognizing a direction of the first range based on the position. The CPU recognizes a second range different from the first range, collates an image drawn in the second range with collation information stored in advance in the image data storage unit, and the collation information When the image data is recognized as corresponding to the image data, the image data read from the first range is stored as related information.
The image processing program according to claim 1 or 2. In the step of detecting the positioning symbols, a plurality of positioning symbols are detected from the original image data,
The CPU reads out a reference distance between the positioning symbols stored in advance, and collates whether or not the distances between the plurality of positioning symbols match the reference distance. Further executing a step of correcting the captured image so that the distance between the positioning symbols matches the reference distance.
The image processing program according to any one of claims 1 to 3. In the step of detecting positioning symbols, four positioning symbols are detected from the original image data,
In the obtaining step, only the image data in the first range is cut out, and is acquired as the cut-out image data including a rectangle whose apex is the vicinity of the four positioning symbols.
The image processing program according to any one of claims 1 to 4. In the step of detecting positioning symbols, five positioning symbols are detected from the original image data,
In the obtaining step, only the image data in the first range is cut out, a rectangle having a vertex in the vicinity of four positioning symbols among the five positioning symbols, and the other one positioning symbol is The image acquisition means acquires the cut-out image data, which is a direction determining symbol for defining the imaging direction of the imaging object.
The image processing program according to any one of claims 1 to 4. When the CPU detects a plurality of positioning symbols from the captured image of the imaging object, the CPU automatically acquires the cut-out image data.
The image processing program according to any one of claims 1 to 6. Causing the CPU to further execute a step of storing the cut-out image data in a server;
The image processing program according to any one of claims 1 to 7.   The portable terminal which is the said image processing system in which the image processing program of any one of Claims 1-8 was installed. Imaging an imaging object having a positioning symbol formed by a symbol code composed of multi-valued graphics arranged at at least two predetermined positions with an imaging means, and processing the original image data with a CPU, An image processing method executable by an image processing system registered in an image data storage means,
The positioning symbols are at least two types of rectangular positioning symbols provided in at least two locations in the vicinity of the four corners of the rectangular paper body, and are represented by a symbol code consisting of multi-valued figures. Formed,
The positioning symbol has an appearing portion having a color value different from the ground color of the paper body, and a non-appearing portion having a ground color of the paper body,
The appearing portion of the first positioning symbol has two straight portions that are parallel to the two sides extending from the corner of the sheet body, and a corner portion where the ends of the two straight portions are in contact with each other. The non-appearing part of the first positioning symbol includes a frame-like appearing part, and is composed of a ground-colored region surrounded by the frame-like appearing part,
The appearing portion of the second positioning symbol has two straight portions that are parallel to the two sides extending from the corner of the sheet body, and a corner portion where the ends of the two straight portions are in contact with each other. At least a protruding portion having a straight line portion and a corner portion, and a rectangular protruding portion located inside the protruding portion having the straight line portion and the corner portion, wherein the non-protruding portion is the straight line portion. And a region between the protruding portion having a corner and the rectangular protruding portion,
The second positioning symbol includes four corners of the two straight portions, each end of the two straight portions not forming the corner, and the rectangular appearance portion. And two virtual straight lines connecting the corners farthest from the corners are constituted by virtual rectangles forming four sides ,
The CPU is
Detecting the positioning symbol from original image data of the imaging object including positioning symbols at at least two predetermined positions imaged by the imaging means;
Recognizing a predetermined area calculated based on the positioning symbol as a first range;
Cutting out only image data in the first range and obtaining it as cut-out image data;
Storing the cut image data in the image data storage means;
An image processing method for executing.

Images