JP6286919B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program.

2. Description of the Related Art Conventionally, an apparatus that generates code information in which predetermined information is encoded in a regular array of pixel sets is known (see, for example, Patent Document 1).
The code information is imaged by an imaging device such as a mobile phone or a smartphone while being formed on a recording medium such as paper. The imaging apparatus obtains original predetermined information represented by the code information by performing a predetermined decoding process on the image information of the captured code information.

JP 2007-118316 A

By the way, when the code information is combined with another image and the outer shape is substantially circular, depending on the relative positional relationship of the imaging device with respect to the circular subject, the circular subject in the image obtained by imaging the circular subject The part corresponding to will be oval.
Also, if code information is added along the circumferential direction of the circle, the start position when reading predetermined information from the code information cannot be specified, and there is a possibility that the reading process cannot be performed properly. is there.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an image processing apparatus capable of appropriately performing predetermined information reading processing from code information added to a subject, An image processing method and program are provided.

In order to solve the above problems, an image processing apparatus according to the present invention provides:
In an annular portion forming a substantially annular, the plurality of code information is added Rutotomoni, acquisition means for acquiring a captured image of a subject in which a plurality of landmarks are formed, said in an image acquired by the acquisition unit The annular portion is obtained by performing projective transformation processing on an image acquired by the acquiring unit with reference to a specifying unit that specifies a plurality of landmarks and positions of the plurality of landmarks specified by the specifying unit and generating means for generating the converted image into a perfect circular shape based on said plurality of landmarks identified by the identification means, each from a predetermined of said plurality of code information in an image acquired by the acquisition unit comprising reading means for reading the information, the among the plurality of landmarks, between two marks each other which are formed continuously along the circumferential direction of the ring portion, contact the code information located The reading means reads a first mark of the plurality of marks as a start position of the code information reading process, and a second of the plurality of marks adjacent to the first mark. The code information reading process is performed by reading a mark as an end position of the code information reading process .

The image processing method according to the present invention includes:
An image processing method using the image processing apparatus, the annular portion having a substantially annular shape, a plurality of code information is added Rutotomoni, acquiring an image obtained by capturing an object in which a plurality of landmarks are formed , identifying a plurality of landmarks in the acquired image, based on the positions of the plurality of landmarks are identified, by performing projective transformation processing on the obtained image, the circular ring portion and generating an image converted into a perfect circular shape, based on the plurality of landmarks are identified, observed including the steps, the reading the predetermined information from each of a plurality of code information in the acquired image, Among the plurality of marks, the code information is located between two marks formed continuously along the circumferential direction of the annular portion, and each of the plurality of code information is predetermined. Read the information In the step of taking, the first mark of the plurality of marks is read as the start position of the code information reading process, and the second mark of the plurality of marks adjacent to the first mark is read. The code information reading process is performed by reading as an end position of the code information reading process .

The program according to the present invention is
The computer of the image processing apparatus acquires, in an annular portion forming a substantially annular, the plurality of code information is added Rutotomoni, obtaining means for obtaining an image of the captured subject more landmarks are formed, by the acquisition unit specifying means for specifying a plurality of landmarks in the image, the reference to the position of said plurality of landmarks specified by the specifying means, by performing the projection conversion processing on the image acquired by the acquisition unit , generating means for generating an image obtained by converting the circular ring portion into a perfect circular shape, based on the plurality of landmarks specified by the specifying means, said plurality of code information of which has been in an image acquired by the acquisition unit reading means for reading predetermined information from each, to function as, among the plurality of landmarks, between two marks each other which are formed continuously along the circumferential direction of the circular ring portion When the code information is located and predetermined information is read from each of the plurality of code information by the reading means, the first mark among the plurality of marks is started to read the code information. Reading the position of the code information, and reading the second mark of the plurality of marks adjacent to the first mark as the end position of the reading process of the code information. It is characterized by.

  According to the present invention, it is possible to appropriately perform a process of reading predetermined information from code information added to a subject.

It is a block diagram which shows schematic structure of the portable terminal of one Embodiment to which this invention is applied. It is a flowchart which shows an example of the operation | movement which concerns on the code reading process by the portable terminal of FIG. It is a figure for demonstrating the code reading process of FIG. It is a figure which shows typically an example of the image which concerns on the code reading process of FIG. It is a figure which shows typically an example of the image which concerns on the code reading process of FIG.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

FIG. 1 is a block diagram showing a schematic configuration of a mobile terminal 100 according to an embodiment to which the present invention is applied.
As shown in FIG. 1, the mobile terminal 100 includes a central control unit 1, a memory 2, an imaging unit 3, an imaging control unit 4, an image data generation unit 5, a code processing unit 6, and an operation processing unit 7. A display unit 8, a display control unit 9, a transmission / reception unit 10, a communication control unit 11, an operation input unit 12, and the like.
The central control unit 1, the memory 2, the imaging unit 3, the imaging control unit 4, the image data generation unit 5, the code processing unit 6, the operation processing unit 7, the display control unit 9, the transmission / reception unit 10, and the communication control unit 11 Are connected via a bus line 13.

  Note that the mobile terminal 100 includes, for example, an imaging device, a mobile station used in a mobile communication network such as a mobile phone or a PHS (Personal Handy-phone System), a PDA (Personal Data Assistants), and the like.

  The central control unit 1 controls each unit of the mobile terminal 100. Specifically, the central control unit 1 includes a CPU (Central Processing Unit; not shown) that controls each part of the mobile terminal 100, and performs various control operations according to various processing programs (not shown) for the mobile terminal 100. Do.

  The memory 2 is composed of, for example, a DRAM (Dynamic Random Access Memory) or the like. The memory 2 includes a buffer memory that temporarily stores data processed by the central control unit 1 and the code processing unit 6, a working memory such as the central control unit 1, and various types of functions related to the function of the mobile terminal 100. A program memory (not shown) in which programs and data are stored is provided.

The imaging unit 3 images a circular subject (for example, an imprint Si; see FIG. 3A).
Here, the circular subject includes a substantially circular imprint Si of the seal S stamped on the recording medium P. Specifically, the imprint Si is obtained by adding an annular portion Sr having a substantially annular outer shape around the stamp image Sp for forming the imprint Si.
A plurality of code information Sc obtained by encoding predetermined information into a regular array of pixel sets is added to the annular portion Sr. That is, the annular portion Sr has a plurality of arc portions Sa,... Of approximately equal length divided equally by a predetermined number (for example, four), and the outer periphery and inner periphery of the annular portion Sr. Adjacent arc portions Sa are separated from each other by a notch (mark) Sm formed in such a shape that the opposing portions are recessed inward. For example, it is assumed that the four cutout portions Sm,... Are added on the stamp face of the seal S so as to be on the upper side, the lower side, the left side, and the right side with respect to the stamp image Sp in the reference state.
The same code information Sc is added to each arc portion Sa along the extending direction of the arc (the circumferential direction of the annular portion Sr). That is, the code information Sc is embedded in the seal impression Si in a multiple manner.
Here, the code information Sc is obtained by encoding original predetermined information (for example, URL) according to a predetermined encoding format (for example, Reed-Solomon code, Golay code, etc.). For example, in the code information Sc, a set of white pixels having a pixel value “1” and a set of black pixels having a pixel value “0” are regularly arranged with a predetermined number of dimensions.

  In this way, each of the plurality of cutout portions Sm,... Constitutes a mark formed by changing the shape of a part of the annular portion Sr, and these cutout portions Sm,... Are adjacent to the annular portion Sr. The code information Sc is formed with a substantially equal interval.

The imaging unit 3 includes a lens unit 3a and an electronic imaging unit 3b.
The lens unit 3a includes a plurality of lenses such as a zoom lens and a focus lens.
The electronic imaging unit 3b is composed of, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS), and converts an optical image that has passed through various lenses of the lens unit 3a into a two-dimensional image signal. To do.
In addition, although illustration is abbreviate | omitted, the imaging part 3 may be provided with the aperture_diaphragm | restriction which adjusts the quantity of the light which passes the lens part 3a.

The imaging control unit 4 controls the imaging of the subject by the imaging unit 3. That is, the imaging control unit 4 includes a timing generator, a driver, and the like, although not illustrated. Then, the imaging control unit 4 scans and drives the electronic imaging unit 3b with a timing generator and a driver, converts the optical image into a two-dimensional image signal with the electronic imaging unit 3b at a predetermined period, and the electronic imaging unit 3b. The frame image is read out from the imaging area for each screen and is output to the image data generation unit 5.
In addition, the imaging control unit 4 performs adjustment control of imaging conditions of the subject such as AF (automatic focusing process), AE (automatic exposure process), AWB (automatic white balance), and the like.

  The image data generation unit 5 appropriately adjusts the gain for each color component of RGB with respect to the analog value signal of the frame image transferred from the electronic image pickup unit 3b, and then samples and holds it by a sample hold circuit (not shown). The digital signal is converted into digital data by a / D converter (not shown), color processing including pixel interpolation processing and γ correction processing is performed by a color process circuit (not shown), and then a digital luminance signal Y and color difference signal Cb , Cr (YUV data).

  Then, the image data generation unit 5 sequentially outputs the generated YUV data of each frame image to the memory 2 and stores it in the memory 2.

The code processing unit 6 includes an image acquisition unit 6a, a binarization unit 6b, a landmark specifying unit 6c, a projective conversion unit 6d, an information reading unit 6e, and a control processing unit 6f.
Each unit of the code processing unit 6 is configured by, for example, a predetermined logic circuit, but the configuration is an example and is not limited thereto.

The image acquisition unit 6a sequentially acquires a captured image Ia (see FIG. 4A) in which a circular impression Si is captured.
That is, the image acquisition unit (image acquisition unit) 6a acquires an image in which a circular imprint (circular subject) Si formed by adding a plurality of code information Sc is captured from a predetermined direction. Specifically, the image acquisition unit 6a reproduces image data (for example, luminance data) of a predetermined resolution of the captured image Ia generated by the image data generation unit 5 by imaging the circular impression Si by the imaging unit 3. Is obtained from the memory 2.
Here, the circular imprint Si imprinted on the recording medium P is picked up as a substantially circular image when picked up by the image pickup unit 3 arranged so that the lens unit 3a is opposed, but the circular imprint. Depending on the relative positional relationship of the lens unit 3a with respect to Si, an elliptical image is obtained.
In the following description, an image is taken in a state where the lens portion 3a is arranged obliquely with respect to the circular imprint Si so as to have a predetermined angle, and the annular portion Sr has an elliptical shape in the captured image Ia. And

The binarization unit 6b generates a binarized image Ib (see FIG. 4B) of the captured image Ia.
In other words, the binarization unit 6b performs binarization processing that binarizes the image data of the captured image Ia acquired by the image acquisition unit 6a with a predetermined threshold value, thereby generating an image of the binarized image Ib. Generate data.
Note that the above binarization process is a known technique, and thus detailed description thereof is omitted here.

The mark specifying unit 6c specifies a plurality of notches Sm,... In the captured image Ia.
That is, the mark specifying unit (specifying unit) 6c includes a plurality of notch portions (marks) Sm formed at predetermined intervals in the annular portion Sr of the imprint Si in the captured image Ia acquired by the image acquiring unit 6a. Specify….
Specifically, the mark specifying unit 6c specifies an elliptical contour portion R corresponding to the outer periphery of the annular portion Sr of the imprint Si in the binarized image Ib generated by the binarizing unit 6b (see FIG. 4 (b)), the coordinate portion where the white pixel exists is specified by scanning the contour portion R from the predetermined reference position (for example, the left end) in the circumferential direction (specifically, for example, clockwise). To do. In other words, the mark specifying unit 6c specifies a coordinate position where a plurality of black pixels having a pixel value “0” arranged along the circumferential direction of the contour portion R are separated by white pixels having a pixel value “1”. . And the mark specific | specification part 6c each specifies the coordinate position where the white pixel of the outline part R specified by the binarized image Ib exists as the notch part Sm currently formed in the annular part Sr of the circular imprint Si. (See FIG. 5A).

  In addition, although the template matching using an elliptical template is mentioned as a method of specifying the outline part R of the seal impression Si, it is an example and is not limited to this, and can be arbitrarily changed as appropriate.

The projective conversion unit 6d performs a projective conversion process for generating a projective transformed image Ic (see FIG. 5B).
That is, the projective transformation unit (generation unit) 6d is a binarized image of the captured image Ia acquired by the image acquisition unit 6a with reference to the coordinate positions of the plurality of notches Sm,. A projective transformation process is performed on Ib to generate a projective transformed image Ic obtained by converting an annular portion Sr of the imprint Si having an elliptical shape into a perfect circle.
Specifically, the projective transformation unit 6d sets the positions corresponding to 0 o'clock (12 o'clock), 3 o'clock, 6 o'clock, and 9 o'clock on the dial of the watch as 0 ° (360 °), 90 °, and 180 ° of a perfect circle. And 270 °, and the coordinate conversion formula is such that the coordinate positions of the four notches Sm,... Specified by the mark specifying unit 6c are the coordinate positions of 0 °, 90 °, 180 ° and 270 ° of the perfect circle. Is calculated. That is, the projective transformation unit 6d calculates a coordinate transformation formula such that a square is formed by the coordinate positions of the four notches Sm,... After the projective transformation.
Then, the projective transformation unit 6d performs a projective transformation process on the binarized image Ib of the captured image Ia of the imprint Si taken in the direction in which the outer shape is an elliptical shape according to the calculated coordinate transformation formula, A projective transformed image Ic in which the outer shape of the Si ring portion Sr is transformed into a perfect circle is generated.
Note that the above-described projective transformation process is a known technique, and thus detailed description thereof is omitted here.

The information reading unit 6e performs a reading process of reading original predetermined information from the code information Sc of the seal imprint Si.
That is, the information reading unit (reading unit) 6e reads predetermined information from the code information Sc in the captured image Ia with reference to the coordinate positions of the plurality of notches Sm,... Specified by the mark specifying unit 6c. I do.
Specifically, the information reading unit 6e has coordinates in which the four cutouts Sm,... Exist in the projective transformed image Ic obtained by converting the ring portion Sr of the imprint Si generated by the projecting transformation unit 6d into a perfect circle shape. The position (positions of 0 °, 90 °, 180 ° and 270 ° of the perfect circle) is specified. Then, the information reading unit 6e scans along the circumferential direction of the annular portion Sr with the coordinate position of each identified notch Sm as the start position of the reading process in the projective transformed image Ic. The coordinate position where the set of white pixels of “” and the set of black pixels of pixel value “0” exist is specified. The information reading unit 6e performs a decoding process on the specified array of white pixels and black pixels according to the encoding method of the code information Sc, and performs the original predetermined process represented by the code information Sc. Information (for example, URL) is read.
That is, the information reading unit 6e performs the reading process a number of times (for example, four times) according to the number of code information Sc delimited by the cutout portion Sm of the projective transformed image Ic, and the code information Sc,. Read the original predetermined information. Here, since the same code information Sc is added to each arc portion Sa of the ring portion Sr of the seal imprint Si, the information reading unit 6e detects, for example, the original predetermined information at two or more locations. When a plurality of readings are read, the predetermined information may be determined to have been read properly.
Note that the above reading process is a known technique, and thus detailed description thereof is omitted here.

The control processing unit 6f controls execution of at least one of the projection conversion process and the reading process.
That is, the control processing unit (control unit) 6f forms an elliptical shape in the captured image Ia acquired by the image acquisition unit 6a based on the positions of the plurality of notches Sm,. Execution of at least one of a projection conversion process for converting the annular portion Sr of the seal impression Si into a perfect circle shape and a reading process for reading predetermined information from the code information Sc in the captured image Ia is controlled.

The operation processing unit 7 performs a predetermined operation according to the original predetermined information of the code information Sc read by the information reading unit 6e.
For example, when the URL is read as the predetermined information, the operation processing unit 7 controls the communication control unit 11 to access a specific page on the Internet defined by the acquired URL. Then, the operation processing unit 7 controls the display control 9, the transmission / reception unit 10, and the like in accordance with execution instructions for various kinds of preset processes (for example, reproduction of specific sounds and images). Let it run.

  The display unit 8 is composed of, for example, a liquid crystal display panel, and displays an image (for example, a live view image) captured by the imaging unit 3 based on a video signal from the display control unit 9 on a display screen.

The display control unit 9 performs control to read out display image data temporarily stored in the memory 2 and display it on the display unit 8.
Specifically, the display control unit 9 includes a VRAM (Video Random Access Memory), a VRAM controller, a digital video encoder, and the like. The digital video encoder reads the luminance signal Y and the color difference signals Cb and Cr read from the memory 2 and stored in the VRAM (not shown) under the control of the central control unit 1 through the VRAM controller. Are read out at a predetermined playback frame rate (for example, 30 fps), and a video signal is generated based on these data and output to the display unit 8.
For example, the display control unit 9 performs live updating on the display unit 8 while sequentially updating a plurality of frame images captured by the imaging unit 3 and the imaging control unit 4 and generated by the image data generation unit 5 at a predetermined display frame rate. Display the view.

The transmitter / receiver unit 10 performs a call with an external user of an external device connected via the communication network N.
Specifically, the transmission / reception unit 10 includes a microphone 10a, a speaker 10b, a data conversion unit 10c, and the like. The transmission / reception unit 10 performs A / D conversion processing on the user's transmission voice input from the microphone 10a by the data conversion unit 10c and outputs the transmission voice data to the central control unit 1. Under the control, voice data such as received voice data outputted and inputted from the communication control unit 11 is D / A converted by the data conversion unit 10c and outputted from the speaker 10b.

The communication control unit 11 transmits and receives data via the communication network N and the communication antenna 11a.
That is, the communication antenna 11a is connected to a predetermined communication method (for example, W-CDMA (Wideband Code Division Multiple Access) method, GSM (Global System)) used by the mobile terminal 100 for communication with a radio base station (not shown). for Mobile Communications (registered trademark) system, etc.). The communication control unit 11 transmits / receives data to / from the radio base station via the communication antenna 11a through a communication channel set in the communication method according to a communication protocol corresponding to a predetermined communication method. That is, the communication control unit 11 transmits / receives voice during a call with an external user of the external device to the external device of the communication partner based on the instruction signal output from the central control unit 1 and input, Send and receive e-mail data.
Note that the configuration of the communication control unit 11 is an example and is not limited thereto, and can be arbitrarily changed as appropriate. For example, although not shown, a wireless LAN module is mounted and an access point (Access Point) is provided. It is good also as a structure which can access the communication network N via this.

The communication network N is a communication network that connects the mobile terminal 100 to an external device via a wireless base station, a gateway server (not shown), or the like, for example.
The communication network N is a communication network constructed using, for example, a dedicated line or an existing general public line, and various line forms such as a LAN (Local Area Network) and a WAN (Wide Area Network) are applied. Is possible. The communication network N includes, for example, various communication network networks such as a telephone line network, ISDN line network, dedicated line, mobile communication network, communication satellite line, CATV line network, IP network, VoIP (Voice over Internet Protocol). ) Gateways, Internet service providers, etc. are included.

The operation input unit 12 is for inputting various instructions to the terminal body.
Specifically, the operation input unit 12 executes a shutter button related to a subject photographing instruction, up / down / left / right cursor buttons and a determination button related to a selection instruction of a mode, a function, etc., making / receiving a call, sending / receiving an e-mail, etc. Various buttons (not shown) such as communication-related buttons related to instructions and numeric buttons and symbol buttons related to text input instructions are provided.
When various buttons are operated by the user, the operation input unit 12 outputs an operation instruction corresponding to the operated button to the central control unit 1. The central control unit 1 causes each unit to execute a predetermined operation (for example, imaging of a subject, incoming / outgoing calls, transmission / reception of an e-mail, etc.) according to an operation instruction output from the operation input unit 12 and input.

  The operation input unit 12 may include a touch panel provided integrally with the display unit 8, and an operation instruction corresponding to the predetermined operation is given to the central control unit based on a predetermined operation of the touch panel by the user. 1 may be output.

<Imprint information generation processing>
Next, code reading processing by the portable terminal 100 will be described with reference to FIGS.
FIG. 2 is a flowchart showing an example of an operation related to the seal stamp information generation process.
It is assumed that a circular imprint Si imaged in the following code reading process is stamped at a predetermined position of a recording medium P such as a postcard (see FIG. 3A). Further, it is assumed that the same code information Sc is added to each arc portion Sa of the ring portion Sr of the seal impression Si.

As shown in FIG. 2, first, when an imaging instruction is input based on a predetermined operation of the operation input unit 12 by the user, the imaging control unit 4 causes the imaging unit 3 to image a circular impression Si, and generates image data. The unit 5 generates image data of the captured image Ia transferred from the electronic imaging unit 3b (step S1). At this time, the circular imprint Si is imaged in a state in which the lens unit 3a of the image pickup unit 3 is arranged obliquely with respect to the imprint Si (see FIG. 3B). ).
Then, the image data generation unit 5 outputs the generated YUV data of the captured image Ia to the memory 2 and stores it in the memory 2.

  Note that the display control unit 9 may cause the display unit 8 to display a guide display corresponding to the outline of the imprint Si in order to make it easier to capture the imprint Si in a more circular state.

  Next, the image acquisition unit 6a of the code processing unit 6 acquires image data (for example, luminance data) of a predetermined resolution of the captured image Ia generated by the image data generation unit 5 from the memory 2 (step S2; FIG. 4 (a)). Subsequently, the binarization unit 6b performs binarization processing that binarizes the image data of the captured image Ia acquired by the image acquisition unit 6a with a predetermined threshold value, so that the binarized image Ib Image data is generated (step S3).

  Next, the landmark specifying unit 6c uses, for example, various elliptical templates with different major and minor axes in the binarized image Ib generated by the binarizing unit 6b. An elliptical contour portion R corresponding to the outer periphery of the ring portion Sr of the imprint Si is specified by template matching (step S4; see FIG. 4B). Subsequently, the mark specifying unit 6c scans the specified contour portion R in the circumferential direction to specify the coordinate position where the white pixel having the pixel value “1” exists, and the white pixel of the specified contour portion R exists. The coordinate position is specified as a notch Sm formed in the ring portion Sr of the circular imprint Si (step S5; see FIG. 5A).

Thereafter, the control processing unit 6f causes the projective transformation unit 6d to execute a projective transformation process (step S6).
That is, the projective transformation unit 6d applies the binarized image Ib of the captured image Ia acquired by the image acquisition unit 6a with reference to the coordinate positions of the plurality of notches Sm, ... specified by the mark specifying unit 6c. A projective transformation process is performed to generate a projective transformed image Ic (see FIG. 5B) in which the ring-shaped portion Sr of the imprint Si having an elliptical shape is transformed into a perfect circle. Specifically, the projective transformation unit 6d is configured such that the coordinate positions of the four notches Sm,... Specified by the mark specifying unit 6c are coordinate positions of 0 °, 90 °, 180 °, and 270 ° of a perfect circle. A coordinate transformation formula is calculated, a projective transformation process is performed on the binarized image Ib according to the computed coordinate transformation formula, and the outer shape of the ring portion Sr of the impression Si is transformed into a perfect circle shape. Ic is generated.

Next, the control processing unit 6f causes the information reading unit 6e to execute a reading process (step S7).
That is, the information reading unit 6e specifies the coordinate positions of the four cutout portions Sm,... In the projective transformed image Ic obtained by converting the ring portion Sr of the imprint Si generated by the projective transformation unit 6d into a perfect circle shape. A reading process for reading predetermined information from each piece of code information Sc is performed with reference to the coordinate positions of the plurality of notches Sm,. Specifically, the information reading unit 6e scans along the circumferential direction of the annular portion Sr with the coordinate position of each identified notch Sm as the start position of the reading process in the projective transformed image Ic. A position where a set of white pixels having a value “1” and a set of black pixels having a pixel value “0” exists is specified. Then, the information reading unit 6e performs a decoding process according to the encoding method of the code information Sc on the specified array of white pixels and black pixels, and performs original predetermined information (for example, URL Etc.).

Subsequently, the information reading unit 6e determines whether or not the original predetermined information has been read a plurality of times from the code information Sc by the reading process (step S8).
Here, when it is determined that the original predetermined information has been read a plurality of times (step S8; YES), the information reading unit 6e determines that the predetermined information has been properly read, and the operation processing unit 7 Performs a predetermined operation (for example, reproduction of a specific sound or image by accessing the Internet) according to predetermined information (for example, URL) read by the information reading unit 6e (step S9).

  On the other hand, when it is determined in step S8 that the original predetermined information has not been read a plurality of times (step S8; NO), the CPU of the central control unit 1 skips the process of step S9 and executes the code The reading process is terminated.

As described above, according to the mobile terminal 100 of the present embodiment, the captured image Ia obtained by capturing the circular impression (circular subject) Si obtained by adding a plurality of code information Sc to the annular portion Sr from a predetermined oblique direction. Based on a plurality of notches (marks) Sm formed at predetermined intervals in the annular portion Sr specified in the binarized image Ib, an elliptical shape is formed in the binarized image Ib. Since execution control of at least one of the projection conversion process for converting the annular portion Sr into a perfect circle shape and the reading process for reading predetermined information from the code information Sc in the binarized image Ib is controlled. In addition, it is possible to appropriately perform the projective conversion process on the image obtained by capturing the circular impression Si and the process of reading predetermined information from the code information Sc.
That is, projective transformation processing is performed on the binarized image Ib of the captured image Ia with reference to the coordinate positions of the plurality of notches Sm,. Since the projection-converted image Ic converted into is generated, even if the projection conversion processing is performed on an image in which the annular portion Sr has an elliptical shape, a plurality of notches Sm formed in the annular portion Sr at a predetermined interval. ,... Can be appropriately performed. In addition, a reading process is performed on the basis of the coordinate positions of the plurality of cutout portions Sm,... In the projection-transformed image Ic obtained by converting the oval portion Sr having an elliptical shape of the seal imprint Si into a perfect circle shape. In the reading process of the original predetermined information from the plurality of code information Sc added to the annular portion Sr, a plurality of notches formed in the annular portion Sr at a predetermined interval By using Sm,..., The reading start position of each code information Sc can be specified, and the reading process can be appropriately performed.

  Further, since the plurality of notches Sm,... Are formed at substantially equal intervals between the adjacent code information Sc of the annular portion Sr, the projection based on the coordinate positions of the plurality of notches Sm,. Conversion processing and reading processing can be performed efficiently and appropriately. That is, since the regular polygon is formed by the plurality of notches Sm formed at substantially equal intervals in the annular portion Sr, the content of the projective transformation process is set to the processing content that returns to the regular polygon. And the projective transformation process can be performed efficiently. Further, it is possible to make the relative positional relationship with the adjacent code information Sc all equal for each of the plurality of cutout portions Sm,... And efficiently specify the reading start position of each code information Sc. It can be carried out.

  Further, since the plurality of cutout portions Sm,... Are formed by changing the shape of a part of the annular portion Sr, a circular imprint (circular subject) Si is captured in a captured image Ia captured from a predetermined direction. The plurality of notches Sm,... Can be easily identified in the elliptical contour portion R corresponding to the annular portion Sr of the imprint Si.

The present invention is not limited to the above-described embodiment, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, in the above-described embodiment, both the projection conversion process and the reading process are executed. However, this is an example, and the present invention is not limited to this, and it is not always necessary to execute both processes. That is, the mobile terminal 100 may have any configuration as long as it is configured to execute at least reading processing.

  In the above embodiment, as the reading process, the process of reading predetermined information from the code information Sc in the projective transformed image Ic obtained by converting the ring portion Sr of the imprint Si into a perfect circle shape is shown as an example. However, the present invention is not limited to this, and the processing content can be arbitrarily changed as long as the original predetermined information is read from the code information Sc with reference to the coordinate positions of the plurality of notches Sm,. That is, the information reading unit 6e uses the coordinate positions of the plurality of notches Sm,... Specified by the mark specifying unit 6c as a reference (for example, reading start position), and the code information Sc in the captured image Ia before projective conversion. It may be configured such that predetermined information is read from.

  Furthermore, in the above-described embodiment, the circular imprint Si is illustrated as the circular subject. However, the circular imprint Si is an example, and the present invention is not limited to this. It can be arbitrarily changed as appropriate. For example, the image may be a circular image formed on the recording medium P by a method other than stamping (for example, printing).

  Further, in the above embodiment, the same code information Sc is added to each arc portion Sa of the ring portion Sr of the imprint Si, but this is only an example and the present invention is not limited to this. Different code information Sc may be added. In this case, the amount of code information (original predetermined information) Sc embedded in the seal imprint information can be increased.

Moreover, in the said embodiment, as a mark, the notch part formed in the shape where the outer peripheral part of the circular ring part Sr and the opposing part of an inner periphery dent inward between several circular arc part Sa of the impression Si, ... Although the configuration in which Sm is arranged has been illustrated, this is an example and the present invention is not limited to this, and the shape of the mark can be arbitrarily changed as appropriate. For example, it may be a mark (notch) formed in a shape in which either one of the outer periphery and the inner periphery of the annular portion Sr (for example, the outer periphery) is recessed inward. Specifically, in the case of a mark formed in such a shape that the inner periphery of the annular part Sr is recessed inward (center side), the mark specifying part 6c defines a contour part corresponding to the inner periphery of the annular part Sr. After specifying, the position where the white pixel exists in the contour portion is specified as a mark.
For example, although not shown, a plurality of arc portions may be added with a predetermined interval, and a mark may be configured by a gap between the arc portions.

  Furthermore, in the above-described embodiment, the mobile terminal 100 is exemplified as the image processing apparatus. However, the image processing apparatus is an example, and the present invention is not limited thereto. Can be changed.

In addition, in the above-described embodiment, the functions as the acquisition unit, the identification unit, and the reading unit are controlled under the control of the central control unit 1 of the portable terminal 100, the image acquisition unit 6a, the landmark identification unit 6c, the information reading unit. Although the configuration realized by driving the unit 6e is not limited thereto, the configuration may be realized by executing a predetermined program or the like by the CPU of the central control unit 1.
That is, a program including an acquisition processing routine, a specific processing routine, and a reading processing routine is stored in a program memory that stores the program. Then, the CPU of the central control unit 1 may function as a means for acquiring an image obtained by imaging a subject in which code information is added to a substantially circular ring portion by an acquisition processing routine. Further, the CPU of the central control unit 1 may function as a means for specifying a mark formed on the annular portion in the acquired image by the specifying process routine. Further, the CPU of the central control unit 1 may function as a means for reading predetermined information from code information in the acquired image based on the specified mark by the reading processing routine.

  Similarly, the generation unit may be configured to be realized by executing a predetermined program or the like by the CPU of the central control unit 1.

  Furthermore, as a computer-readable medium storing a program for executing each of the above processes, a non-volatile memory such as a flash memory or a portable recording medium such as a CD-ROM is applied in addition to a ROM or a hard disk. Is also possible. A carrier wave is also used as a medium for providing program data via a predetermined communication line.

[Appendix]
Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
<Claim 1>
An acquisition means for acquiring an image obtained by imaging a subject in which code information is added to an annular portion having a substantially annular shape;
Specifying means for specifying a mark formed on the annular portion in the image acquired by the acquiring means;
Reading means for reading predetermined information from the code information in the image acquired by the acquiring means based on the mark specified by the specifying means;
An image processing apparatus comprising:
<Claim 2>
Generation means for performing projective transformation processing on the image acquired by the acquisition means on the basis of the position of the mark specified by the specifying means, and generating an image obtained by converting the annular portion into a perfect circle shape; The image processing apparatus according to claim 1, further comprising:
<Claim 3>
The image processing apparatus according to claim 1, wherein a plurality of the code information is added to the annular portion, and a plurality of the marks are formed at substantially equal intervals between adjacent code information.
<Claim 4>
The image processing apparatus according to claim 1, wherein the mark is formed by changing a shape of a part of the annular portion.
<Claim 5>
The annular portion has a plurality of arc portions equally divided by a predetermined number,
The image processing apparatus according to claim 1, wherein a plurality of the marks are formed by a gap between the plurality of arc portions.
<Claim 6>
The image processing apparatus according to claim 1, wherein the subject is an imprint in which code information is added to a substantially annular frame.
<Claim 7>
An image processing method using an image processing apparatus,
Obtaining an image obtained by imaging a subject in which code information is added to an annular portion having a substantially annular shape;
Identifying a landmark formed on the annular portion in the acquired image;
Reading predetermined information from the code information in the acquired image based on the identified landmark;
An image processing method comprising:
<Claim 8>
The computer of the image processing device
An acquisition means for acquiring an image obtained by imaging a subject in which code information is added to an annular portion having a substantially annular shape;
A specifying means for specifying a mark formed on the annular portion in the image acquired by the acquiring means;
Reading means for reading predetermined information from the code information in the image acquired by the acquiring means based on the mark specified by the specifying means;
A program characterized by functioning as

DESCRIPTION OF SYMBOLS 100 Portable terminal 1 Central control part 6 Code processing part 6a Image acquisition part 6c Marking identification part 6d Projection conversion part 6e Information reading part 6f Control processing part 7 Operation processing part

Claims (10)

In an annular portion forming a substantially annular, and a plurality of code information is added Rutotomoni, obtaining means for obtaining an image of the captured subject more landmarks are formed,
Specifying means for specifying the plurality of landmarks in the image acquired by the acquiring means;
By performing a projective transformation process on the image acquired by the acquisition unit on the basis of the positions of the plurality of landmarks specified by the specifying unit, an image in which the ring portion is converted into a perfect circle shape is generated. Generating means for
Reading means for reading predetermined information from each of the plurality of code information in the image acquired by the acquiring means based on the plurality of marks specified by the specifying means;
Equipped with a,
Among the plurality of marks, the code information is located between two marks formed continuously along the circumferential direction of the annular portion,
The reading unit reads a first mark of the plurality of marks as a start position of the code information reading process, and a second mark of the plurality of marks adjacent to the first mark. Is read as the end position of the code information reading process, to perform the code information reading process,
An image processing apparatus. The plurality of marks are formed at equal intervals along the circumferential direction of the annular portion in the annular portion.
The image processing apparatus according to claim 1. The plurality of landmarks are four landmarks,
The four marks are formed on the subject so that the four marks form a square in the image converted into the perfect circle shape by the projective transformation process.
The image processing apparatus according to claim 2. The plurality of landmarks are located on a contour portion of the annular portion corresponding to the annular portion of the subject in the acquired image.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus. Wherein the plurality of indicia, the image processing apparatus according to any one of claim 1 to 4, characterized in that is formed by changing the shape of a portion of the ring portion. The annular portion has a plurality of arc portions equally divided by a predetermined number,
Wherein the plurality of indicia, the image processing apparatus according to any one of claim 1 to 5, characterized by comprising made Rikatachi by the plurality of gaps of the arc portion each other. Each of the plurality of pieces of code information is one-dimensional code information in which a plurality of pixel sets are regularly arranged along a circumferential direction of the annular portion. The image processing apparatus according to item. The object is an image processing apparatus according to any one of claim 1 to 7, wherein the plurality of code information is imprint added to a substantially annular frame. An image processing method using an image processing apparatus,
In an annular portion forming a substantially annular, and obtaining a plurality of code information is added Rutotomoni, an image obtained by capturing an object in which a plurality of landmarks are formed,
Identifying the plurality of landmarks in the acquired image;
Generating an image obtained by converting the annular portion into a perfect circle by performing projective transformation processing on the acquired image with reference to the positions of the plurality of identified landmarks;
Reading predetermined information from each of the plurality of code information in the acquired image based on the plurality of identified landmarks;
Only including,
Among the plurality of marks, the code information is located between two marks formed continuously along the circumferential direction of the annular portion,
In the step of reading predetermined information from each of the plurality of code information, the first mark of the plurality of marks is read as a start position of the reading process of the code information, and adjacent to the first mark. The code information reading process is performed by reading a second mark of the plurality of marks as an end position of the code information reading process.
An image processing method. The computer of the image processing device
In an annular portion forming a substantially annular, the plurality of code information is added Rutotomoni, obtaining means for obtaining an image of the captured subject more landmarks are formed,
Specifying means for specifying the plurality of landmarks in the image acquired by the acquiring means;
By performing a projective transformation process on the image acquired by the acquisition unit on the basis of the positions of the plurality of landmarks specified by the specifying unit, an image in which the ring portion is converted into a perfect circle shape is generated. Generating means,
Reading means for reading predetermined information from each of the plurality of code information in the image acquired by the acquisition means based on the plurality of landmarks specified by the specifying means;
To function as,
Among the plurality of marks, the code information is located between two marks formed continuously along the circumferential direction of the annular portion,
When reading predetermined information from each of the plurality of code information by the reading unit, the first mark of the plurality of marks is read as a start position of the code information reading process, and the first mark The code information reading process is performed by reading a second mark of the plurality of marks adjacent to the code mark as an end position of the code information reading process.
A program characterized by that.

Images