JP2010231760A - Position detecting device, information processing system, position detecting program, information processing program, computer readable recording medium, position detecting method, and information processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a position detecting device for detecting a position designated on a photographic image of an object as well as the size of the object. <P>SOLUTION: The position detecting device 1 includes a first resolution adjuster 2a, a second resolution adjuster 2b, an edge gradient direction specifying section 3, a section for improving collation efficiency 4, a model pattern storing section 5, a collation section 6, a position specifying section 7, a position/size output section 8, and a collation condition managing section 9 for specifying the position designated on the photographic image of the object and the size of the object by using the image data of the captured image. The device collates a collation area with the model pattern for each of all the pixels at the position x(i, j), to determine a pixel condition that has maximum degree of matching. For example, when the degree of matching is maximum at the pixel position x(m, n), (m, n) is the position designated, and the size of the specified object is classified into a category from the condition for obtaining the maximum degree of matching. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention generally relates to a position detection apparatus having a function of specifying an instruction position on a captured image by a photographing target using image data of a captured image, and more specifically, imaging. Position detection apparatus, information processing apparatus, and position detection program improved so as to be able to detect not only the designated position of the target but also information related to the size of the imaging target so that more flexible response processing can be performed The present invention relates to an information processing program, a computer-readable recording medium, a position detection method, and an information processing method.

  As is well known, an image display device (hereinafter referred to as “liquid crystal display device”) having a liquid crystal display as an image display unit is widely used in various devices such as mobile phones and PDAs (Personal Digital Assistants). It is. In particular, PDAs have been equipped with a touch sensor for a long time, enabling touch input to input information by directly bringing a finger or the like into contact with a liquid crystal display. In addition, liquid crystal display devices including a touch sensor are expected to spread in mobile phones and other devices.

  As an example of a liquid crystal display device including such a touch sensor, there is a technique disclosed in Patent Document 1.

  The conventional liquid crystal display device mainly includes an edge detection circuit, a contact determination circuit, and a coordinate calculation circuit. The edge detection circuit detects an edge of the photographed image and obtains an edge image.

  Further, the contact determination circuit determines whether or not the object has touched the display screen using the edge image obtained by the edge detection circuit. The contact determination circuit checks the moving direction (time change of edge coordinates) for each edge, and determines that the object has touched the display screen when there is an edge moving in the opposite direction. This is based on the principle that the edges do not move in opposite directions unless the object is in contact. Specifically, the determination accuracy is improved by determining that the contact is made when the amount of movement in the reverse direction is equal to or greater than a predetermined threshold.

  Further, the coordinate calculation circuit calculates the center of gravity of the edge as the coordinate position of the object when it is determined that the object has touched. This makes it possible to improve the accuracy of position calculation by not calculating the coordinate position before the object comes into contact.

JP 2006-244446 A (published September 14, 2006)

  However, in the above conventional liquid crystal display device, it is possible to detect touch / non-touch and specify the coordinate position of the object, but the size of the object cannot be specified, and the type of the object to be touched Regardless, there is a problem that only uniform response processing based on the detected coordinate position can be performed.

  The present invention has been made in view of the above-described conventional problems, and its purpose is to detect not only the indicated position on the captured image of the imaging target but also information on the size of the imaging target. An object of the present invention is to provide a position detection device, an information processing device, a position detection program, an information processing program, a computer-readable recording medium, a position detection method, and an information processing method capable of performing more flexible response processing.

  The position detection apparatus according to the present invention is a position detection apparatus having a function of specifying an instruction position on the captured image by an imaging target using image data of a captured image, and the resolution of the image data A resolution adjustment unit for adjusting the gradient direction specifying unit for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data; The matching region, which is a region including a predetermined number of pixels, is matched with a predetermined model pattern, and the gradient direction included in the matching region matches the gradient direction included in the model pattern. From the number, the degree of coincidence calculating means for calculating the degree of matching indicating the degree of matching between the matching area and the model pattern, and the degree of coincidence calculated by the degree of coincidence calculating means are maximized. Two or more different conditions are managed for the position specifying means for specifying the indicated position on the captured image by the imaging target from the position of the pixel, and the necessity or degree of resolution adjustment in the resolution adjusting means, Collation condition management means that controls to perform collation under two or more conditions, an indication position identified by the position identification means according to a collation result under the two or more conditions, and an imaging target And a position / size output means for outputting information on the size.

  According to the present invention, by adjusting the resolution of the image data, for example, a model pattern having the same size (for example, 7 × 7) is used for each of the case where the resolution is not adjusted and the case where the resolution is 1/4, for example. By collating, information regarding the size of the imaging target can be identified depending on which collation condition (resolution) the degree of match is obtained and the position is identified. In this case, specifically, for example, the size is specified as “small” when the position is obtained without adjusting the resolution, and the size is specified as “large” when the position is obtained under the condition of resolution ¼. be able to.

  An apparatus according to another aspect of the present invention is a position detection device having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image. For each pixel, a gradient direction specifying means for specifying the gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels, and a matching region that includes a predetermined number of pixels around the pixel of interest Are compared with a predetermined model pattern, and from the number of pixels in which the gradient direction included in the verification region matches the gradient direction included in the model pattern, the verification region and the model pattern are Matching degree calculation means for calculating the degree of matching indicating the degree of matching and two or more different predetermined sizes corresponding to two or more different matching areas. A model pattern storage unit that stores a model pattern, a position specifying unit that specifies an instruction position on the captured image by the imaging target, from a position of a target pixel that maximizes the degree of matching calculated by the matching level calculation unit; Matching condition management means for managing two or more different conditions for the size of the model pattern used for matching in the matching degree calculating means, and controlling the matching so as to perform matching under each of the two or more conditions, and the two According to the collation result under each of the above conditions, the pointing position specified by the position specifying means and a position / size output means for outputting information related to the size of the imaging target are provided.

  According to the present invention, a plurality of model pattern sizes are prepared (for example, 7 × 7, 11 × 11, and 15 × 15), and a plurality of sizes (for example, 7 × 7) are prepared for image data having the same resolution. , 11 × 11, 15 × 15) using the model pattern, information regarding the size of the imaging target is specified depending on which matching condition (model pattern) the matching degree is obtained and the position is specified. be able to. In this case, specifically, for example, when the position is obtained under the condition of the model pattern size 7 × 7, the size is “small”, and when the position is obtained under the condition of the model pattern size 11 × 11, the size “ When the position is obtained under the condition of “medium” and model pattern size 15 × 15, the size can be specified as “large”.

  An apparatus according to yet another aspect of the present invention is a position detection device having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image. A resolution adjusting unit that adjusts the resolution of the pixel, a gradient direction specifying unit that specifies a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data, and a target pixel The matching area, which is an area including a predetermined number of pixels, is matched with a predetermined model pattern, and the gradient direction included in the matching area matches the gradient direction included in the model pattern. A matching degree calculating means for calculating a matching degree indicating a degree of matching between the matching area and the model pattern, and a matching area having two or more different sizes. Correspondingly, from the model pattern storage means for storing model patterns having two or more different sizes determined in advance, and the position of the pixel of interest where the degree of matching calculated by the degree of matching calculating means is maximized, There are two types of position specifying means for specifying the indicated position on the picked-up image, the necessity of resolution adjustment in the resolution adjusting means or the degree of resolution adjustment, and the size of the model pattern used for matching in the matching degree calculating means. The above-mentioned different combination conditions are managed, the matching condition management means for controlling to perform the matching under each of the two or more combination conditions, and the position identification according to the matching result under the two or more combination conditions. And a position / size output means for outputting information on the size of the object to be imaged. To.

  According to the present invention, by adjusting the resolution of the image data, for example, a plurality of model pattern sizes are prepared for each of the case of no resolution adjustment and the case of an image of 1/4 resolution (for example, 7 × 7, 11 × 11, 15 × 15) and a plurality of prepared model patterns (for example, 7 × 7, 11 × 11, and 15 × 15), so that the matching condition (resolution and Information on the size of the object to be imaged can be specified depending on whether the position is specified by obtaining the degree of match in the combination of model patterns). In this case, specifically, for example, when the position is obtained under the condition of the model pattern size 7 × 7 without adjusting the resolution, the position can be obtained under the condition of the size “small 1” and the model pattern size 11 × 11. When the position is obtained under the condition of the size “small 2” and the model pattern size 15 × 15, the position is set to the size “medium”, the resolution is 1/4, and the position is determined under the condition of the model pattern size 7 × 7. When the position is obtained under the condition of the size “Large 1” when obtained, and when the position is obtained under the condition of the size “Large 2” and the model pattern size 15 × 15 Can be specified as size "large 3".

  For example, when the position is obtained under the condition of the model pattern size of 7 × 7, 11 × 11, or 15 × 15 without adjusting the resolution, the size is “small”, and the model pattern size is 7 × 7 or 11 with a resolution of 1/4. When the position is obtained under the condition of × 11 or 15 × 15, the size may be “large”.

  According to a preferred embodiment of the present invention, the degree-of-match calculation means is based on the degree of match calculated for each model pattern having two or more different sizes stored in the model pattern storage means. A size determination means for determining the size is provided.

  According to this, a plurality of model pattern sizes are prepared (for example, 7 × 7, 11 × 11, 15 × 15), and a plurality of prepared sizes (for example, 7 × 7, 11) are obtained for image data having the same resolution. × 11, 15 × 15) model patterns are collated, the degree of matching is calculated for each model pattern size, and the size of the imaging target is determined based on the calculated degree of matching. The size can be determined in more detail than the number of types.

  Preferably, the size determination unit calculates a contribution rate for each model pattern using the degree of matching calculated for each model pattern, and determines the contribution rate for each model pattern with a predetermined threshold. Thus, the size of the imaging target is determined.

  According to this, a plurality of model pattern sizes are prepared (for example, 7 × 7, 11 × 11, 15 × 15), and the contribution rate is calculated by using the degree of matching calculated for each model pattern size. By determining the contributed ratio with a predetermined threshold value, it is possible to determine a size that is more detailed than the number of types of model pattern sizes. In this case, specifically, for example, the model pattern size is 7 × 7, the model pattern size is 11 × 11, and the model pattern size is 15 × 15. First, it can be classified into five or more sizes (for example, size 1, size 2, size 3, size 4, size 5).

  Preferably, the size determination means calculates a contribution rate for each model pattern using the degree of match calculated for each model pattern, and a contribution rate for each model pattern, a predetermined weighting factor, and The size of the imaging target is determined by calculating the information indicating the size using.

  According to this, a plurality of model pattern sizes are prepared (for example, 7 × 7, 11 × 11, 15 × 15), and the contribution rate is calculated by using the degree of matching calculated for each model pattern size. By calculating information indicating the size using the contributed contribution rate and a predetermined weighting factor, the size can be determined in more detail than the number of types of model pattern sizes. In this case, specifically, for example, the model pattern size is 7 × 7, the model pattern size is 11 × 11, and the model pattern size is 15 × 15. For example, it can be classified into 256 or more sizes (size 0, size 1,..., Size 255).

  Further, according to a preferred embodiment of the present invention, the collation area is divided into a plurality of divided areas having the same number of pixels, and the gradient direction information for each pixel included in the divided area is obtained for each divided area. , Comprising a collation efficiency improving means for improving the collation efficiency between the collation area and the model pattern by replacing with the gradient direction information included in the divided area, and the matching degree calculation means comprises the collation efficiency The number of coincidence between the gradient direction included in each divided region in the collation area and the gradient direction in the model pattern is obtained by collating the collation area where collation efficiency has been improved by the composing means and the model pattern. Is calculated as the degree of coincidence, and the collation condition management means preferably manages two or more different combination conditions including the necessity of the collation efficiency improvement.

  By providing a collation efficiency improvement unit, it is possible to specify information related to the size of the imaging target, while maintaining both position detection accuracy and memory saving.

  An apparatus according to another aspect of the present invention is an information processing apparatus that uses an image data of a captured image to specify an instruction position on the captured image by an object to be imaged, and executes processing according to the instruction position. And based on the information regarding the magnitude | size of the said imaging target specified using the one or two or more processing means which performs a different process according to the magnitude | size of the said imaging target, and the said image data And a process switching means for switching processing contents of the processing means.

  Preferably, a resolution adjustment unit that adjusts the resolution of the image data, and a gradient direction that specifies a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data The identification means, a collation area that includes a predetermined number of pixels around the target pixel, and a predetermined model pattern are collated, and the gradient direction included in the collation area is included in the model pattern. A matching degree calculating means for calculating a matching degree indicating a degree of matching between the matching area and the model pattern based on the number of pixels having a matching gradient direction, and a matching area having two or more different sizes. A model pattern storage means for storing model patterns having two or more predetermined different sizes, and the degree of match calculated by the degree of match calculation means. Position specifying means for specifying the indicated position on the captured image by the imaging target from the position of the target pixel that becomes large, necessity of resolution adjustment in the resolution adjusting means or the degree of resolution adjustment, and collation in the matching degree calculating means A matching condition management means for managing two or more different combination conditions for the size of the model pattern used at the time, and controlling to perform matching under each of the two or more combination conditions; The processing content of the processing means is switched based on information related to the size of the imaging target that is output according to the collation result under each of the two or more combination conditions.

  According to the present invention, different response processing can be performed according to the size of the imaging target.

  A position detection program according to another aspect of the present invention is a program that causes a computer to execute position detection having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image. A resolution adjustment step for adjusting the resolution of the image data, and a gradient direction for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data A specific step, a matching area that is a region including a predetermined number of pixels around the target pixel, and a predetermined model pattern are matched, and the gradient direction included in the matching area is included in the model pattern. The degree of coincidence is calculated by calculating the degree of matching indicating the degree of matching between the matching area and the model pattern from the number of pixels that match the gradient direction. The position specifying step for specifying the indicated position on the captured image by the imaging target from the position of the target pixel that maximizes the matching degree calculated in the matching degree calculating step and the resolution adjustment in the resolution adjusting step. For the degree of resolution or the degree of resolution adjustment, two or more different conditions are managed, and a collation condition management step for controlling to perform collation under the two or more conditions, and a collation result under the two or more conditions. Accordingly, it is characterized by comprising an indicated position specified in the position specifying step and a position / size output step for outputting information related to the size of the imaging target.

  A position detection program according to another aspect of the present invention is a program that causes a computer to execute position detection having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image. A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data, and a predetermined number of pixels around the target pixel The matching area, which is an area including the pattern area, is matched with a predetermined model pattern, and the matching is calculated based on the number of pixels in which the gradient direction included in the matching area matches the gradient direction included in the model pattern. The matching degree calculation step for calculating the matching degree indicating the degree of matching between the region and the model pattern, and the matching degree calculated in the matching degree calculation step are the highest. Two or more different conditions are managed with respect to the size of the model pattern used at the time of matching in the position specifying step for specifying the designated position on the captured image by the imaging target from the position of the target pixel and the matching degree calculating step A matching condition management step for controlling to perform matching under each of the two or more conditions, and an indication position specified in the position specifying step according to a matching result in the two or more conditions. And a position / size output step for outputting information relating to the size of the imaging target.

  A position detection program according to still another aspect of the present invention causes a computer to execute position detection having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image. A resolution adjustment step for adjusting the resolution of the image data, and a gradient for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data A direction specifying step, a matching area that is a region including a predetermined number of pixels around the target pixel, and a predetermined model pattern are matched, and a gradient direction included in the matching area and the model pattern are Match that calculates the degree of matching that indicates the degree of matching between the matching area and the model pattern from the number of pixels that match the gradient direction included A position specifying step for specifying the indicated position on the captured image by the imaging target from the position of the target pixel that maximizes the degree of matching calculated in the matching degree calculating step; and resolution adjustment in the resolution adjusting step. Two or more different combination conditions are managed for the necessity or resolution adjustment degree and the size of the model pattern used for matching in the matching degree calculation step, and control is performed so that matching is performed under each of the two or more combination conditions. Position / size output that outputs information on the designated position specified in the position specifying step and the size of the imaging target in accordance with the matching condition management step to be performed and the matching result in each of the two or more combination conditions. And a step.

  Preferably, the degree of matching calculation step determines the size of the imaging target based on the degree of matching calculated for each model pattern having two or more different sizes managed in the matching condition management step. A determination step.

  According to this, a plurality of model pattern sizes are prepared (for example, 7 × 7, 11 × 11, 15 × 15), and a plurality of prepared sizes (for example, 7 × 7, 11) are obtained for image data having the same resolution. × 11, 15 × 15) model patterns are collated, the degree of matching is calculated for each model pattern size, and the size of the imaging target is determined based on the calculated degree of matching. The size can be determined in more detail than the number of types.

  Preferably, the size determination step calculates a contribution rate for each model pattern using the degree of match calculated for each model pattern, and determines the contribution rate for each model pattern with a predetermined threshold. Thus, the size of the imaging target is determined.

  According to this, a plurality of model pattern sizes are prepared (for example, 7 × 7, 11 × 11, 15 × 15), and the contribution rate is calculated by using the degree of matching calculated for each model pattern size. By determining the contributed ratio with a predetermined threshold value, it is possible to determine a size that is more detailed than the number of types of model pattern sizes. In this case, specifically, for example, the model pattern size is 7 × 7, the model pattern size is 11 × 11, and the model pattern size is 15 × 15. First, it can be classified into five or more sizes (for example, size 1, size 2, size 3, size 4, size 5).

  Preferably, in the size determination step, a contribution rate for each model pattern is calculated using the degree of matching calculated for each model pattern, a contribution rate for each model pattern, a predetermined weighting factor, and The size of the imaging target is determined by calculating the information indicating the size using.

  According to this, a plurality of model pattern sizes are prepared (for example, 7 × 7, 11 × 11, 15 × 15), and the contribution rate is calculated by using the degree of matching calculated for each model pattern size. By calculating information indicating the size using the contributed contribution rate and a predetermined weighting factor, the size can be determined in more detail than the number of types of model pattern sizes. In this case, specifically, for example, the model pattern size is 7 × 7, the model pattern size is 11 × 11, and the model pattern size is 15 × 15. For example, it can be classified into 256 or more sizes (size 0, size 1,..., Size 255).

  In this case, preferably, the collation area is divided into a plurality of divided areas having the same number of pixels, and information on the gradient direction of each pixel included in the divided area is included in the divided area. The matching efficiency calculation step is provided to improve the efficiency of matching between the matching region and the model pattern by replacing the information with the gradient direction information, and the matching degree calculation step improves the efficiency of matching by the matching efficiency. The matching area is matched with the model pattern, and the number of matches between the gradient direction included in each divided area in the matching area and the gradient direction in the model pattern is calculated as the matching degree. The collation condition management step is characterized by managing two or more different combination conditions including the necessity of the collation efficiency improvement.

  An information processing program according to another aspect of the present invention uses an image data of a captured image to specify an instruction position on the captured image by an imaging target, and causes a computer to execute a process according to the instruction position. An information processing program that relates to one or two or more processing steps that execute different processes depending on the size of the imaging target, and the size of the imaging target that is specified using the image data And a process switching step for switching the processing contents of the processing step based on the information.

  Preferably, in the present invention, a resolution adjustment step for adjusting the resolution of the image data, and for each pixel on the image data, the gradient direction for each pixel is specified from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels. A gradient direction specifying step, a matching region that is a region including a predetermined number of pixels around the target pixel, and a predetermined model pattern are collated, the gradient direction included in the matching region, and the model A matching degree calculation step for calculating a matching degree indicating the degree of matching between the matching area and the model pattern from the number of pixels matching the gradient direction included in the pattern, and a matching area having two or more different sizes Corresponding to the model pattern storage step of storing model patterns having two or more predetermined different sizes, and A position specifying step for specifying an indicated position on the captured image by the imaging target from the position of the target pixel having the maximum matching degree calculated in the matching degree calculating step, and whether or not resolution adjustment is necessary or resolution adjustment in the resolution adjusting step Matching condition management step for managing two or more different combination conditions for the degree and the size of the model pattern used at the matching in the matching degree calculation step, and controlling to perform matching under each of the two or more combination conditions And the processing switching step switches the processing content of the processing step based on information on the size of the imaging target that is output in accordance with the collation result under each of the two or more combination conditions. It is characterized by.

  The present invention also relates to a computer-readable recording medium on which the program is recorded.

  A method according to another aspect of the present invention is a position detection method that causes a computer to execute position detection having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image. A resolution adjustment step for adjusting the resolution of the image data, and a gradient direction for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data A specific step, a matching area that is a region including a predetermined number of pixels around the target pixel, and a predetermined model pattern are matched, and the gradient direction included in the matching area is included in the model pattern. A degree-of-match calculation step of calculating a degree of match indicating the degree of matching between the matching region and the model pattern, from the number of pixels that match the gradient direction to be determined; The position specifying step for specifying the indicated position on the captured image by the imaging target from the position of the target pixel having the maximum matching degree calculated in the matching degree calculating step, and the necessity or resolution of resolution adjustment in the resolution adjusting step Regarding the degree of adjustment, according to a matching condition management step for managing two or more different conditions and controlling to perform matching under each of the two or more conditions, and a matching result under the two or more conditions, It is characterized by comprising an indicated position specified in the position specifying step and a position / size output step for outputting information relating to the size of the imaging target.

  According to still another aspect of the present invention, there is provided a position detection method for causing a computer to perform position detection having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image. A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data, and a predetermined pixel around the target pixel A matching region that includes a number and a predetermined model pattern are collated, and the gradient direction included in the matching region and the number of pixels in which the gradient direction included in the model pattern matches, In correspondence with a matching degree calculation step for calculating a matching degree indicating the degree of matching between the matching area and the model pattern, and a matching area having two or more different sizes From the model pattern storage step for storing model patterns having two or more predetermined different sizes and the position of the pixel of interest where the degree of matching calculated in the degree of matching calculation step is maximum, the captured image by the imaging target Two or more different conditions are managed for the size of the model pattern used at the time of matching in the position specifying step for specifying the above indicated position and the matching degree calculating step, and matching is performed under each of the two or more conditions. The position / size for outputting the information related to the size of the imaging target and the indicated position specified in the position specifying step in accordance with the matching condition management step to be controlled and the matching results in the two or more conditions. And an output step.

  A method according to still another aspect of the present invention is a position detection method having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image. A resolution adjusting step for adjusting the resolution of the pixel, a gradient direction specifying step for specifying the gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data, and the pixel of interest The matching area, which is an area including a predetermined number of pixels, is matched with a predetermined model pattern, and the gradient direction included in the matching area matches the gradient direction included in the model pattern. A matching degree calculating step for calculating a matching degree indicating a matching degree between the matching region and the model pattern from the number of pixels to be processed, and having two or more different sizes Corresponding to the collation area, from the model pattern storing step for storing model patterns having two or more predetermined different sizes, and from the position of the pixel of interest where the matching degree calculated in the matching degree calculating step is maximum , A position specifying step for specifying an indicated position on the captured image by the imaging target, whether or not resolution adjustment is necessary or the resolution adjustment level in the resolution adjustment step, and the size of the model pattern used for matching in the match level calculation step In accordance with a matching condition management step for managing two or more different combination conditions and controlling to perform matching in each of the two or more combination conditions, and a matching result in each of the two or more combination conditions, Outputs information on the indicated position specified in the position specifying step and the size of the imaging target. Characterized in that it comprises a position, size output step.

  Preferably, the degree of matching calculation step determines the size of the imaging target based on the degree of matching calculated for each model pattern having two or more different sizes managed in the matching condition management step. A determination step.

  Preferably, the size determination step calculates a contribution rate for each model pattern using the degree of match calculated for each model pattern, and determines the contribution rate for each model pattern with a predetermined threshold. Thus, the size of the imaging target is determined.

  Preferably, the size determination step calculates a contribution rate for each model pattern using the degree of match calculated for each model pattern, and calculates a contribution rate for each model pattern and a predetermined weighting factor. The size of the object to be imaged is determined by calculating information indicating the size.

  The method according to still another aspect of the present invention uses the image data of the captured image to specify the indicated position on the captured image by the imaging target, and causes the computer to execute processing according to the indicated position. Information regarding the size of the imaging target specified by using one or more processing steps for performing different processing depending on the size of the imaging target, and the image data. And a process switching step for switching the processing contents of the above-described processing steps.

  It is possible to detect not only the designated position on the captured image of the imaging target but also information related to the size of the imaging target, and it is possible to perform more flexible response processing.

It is a block diagram which shows one Embodiment of the position detection apparatus and information processing apparatus in this invention. (A) is a schematic diagram which shows the mode of imaging of the captured image of the belly of the finger when the surroundings are dark. (B) is a schematic diagram showing the characteristics of a captured image of the belly of the finger when the surroundings are dark. (C) is a schematic diagram showing how a captured image of the belly of a finger is captured when the surroundings are bright. (D) is a schematic diagram showing the characteristics of the captured image of the belly of the finger when the surroundings are bright. (E) is a schematic diagram showing a state of capturing a captured image of the pen tip when the surroundings are dark. (F) is a schematic diagram showing the characteristics of the picked-up image of the pen tip when the surroundings are dark. (G) is a schematic diagram showing how a picked-up image of the pen tip is picked up when the surroundings are bright. (H) is a schematic diagram showing characteristics of a picked-up image of a pen tip when the surroundings are bright. It is a flowchart which shows operation | movement of the said position detection apparatus. (A) is a schematic diagram showing the characteristics of the gradient direction of image data when the surrounding is dark. (B) is a schematic diagram showing a state after performing collation efficiency improvement for FIG. (A) is a schematic diagram showing an example of a small-sized (7 × 7) model pattern. FIG. 5B is a schematic diagram illustrating an example of a medium size (11 × 11) model pattern. (C) is a schematic diagram showing an example of a large (15 × 15) model pattern. (A) is an example of the combination condition table of each process which a collation condition management part manages. (B) is another example of a combination condition table for each process managed by the collation condition management unit. It is a flowchart which shows operation | movement of the said information processing apparatus. (A) is an outline figure showing an example of a response processing result when operating with a pen. (B) is a schematic diagram showing an example of a response processing result when operated with a finger. It is a block diagram of the position detection apparatus and information processing apparatus which concern on the other Example of this invention. It is a figure explaining the flowchart of the process of the position detection apparatus which concerns on the other Example of this invention, and information processing apparatus. It is a block diagram which shows the structure of the magnitude | size determination part in the position detection apparatus (information processing apparatus) which concerns on the other Example of this invention. It is a figure explaining the flowchart of a process of the magnitude | size determination part in the position detection apparatus (information processing apparatus) which concerns on the other Example of this invention. It is a figure explaining the flowchart of the process of the magnitude | size determination part in the position detection apparatus (information processing apparatus) which concerns on the further another Example of this invention. (A) It is an example of the combination condition table of each process which a collation condition management part manages. (B) It is another example of the combination condition table of each process which a collation condition management part manages. 14 is a flowchart illustrating an operation of a size determination unit in the position detection apparatus according to the fifth embodiment.

  Embodiments of the present invention will be described below with reference to the drawings.

[1. Configuration of position detection device (information processing device)]

  FIG. 1 is a block diagram showing an embodiment of a position detection device and an information processing device according to the present invention.

  First, based on FIG.1 and FIG.2 (a)-(h), the structure of the position detection apparatus 1 (information processing apparatus 20) which is one Embodiment of this invention and the example of a captured image are demonstrated. Hereinafter, for convenience, the position detection device 1 will be described. However, if the information processing device (information processing device 20) requires the function of the position detection device 1 according to an embodiment of the present invention, a general information processing device will be described. Is applicable.

  First, the outline of the configuration of the position detection device 1 and the imaging principle of the position detection device 1 will be described. The position detection device 1 has a display function, and includes a liquid crystal display (display) composed of a plurality of pixels and a backlight for irradiating light to the liquid crystal display in the same manner as a normal liquid crystal display. It is.

  However, the liquid crystal display in the position detection device 1 includes a photosensor (imaging sensor) in each pixel, and images an external object or the like (imaging target) that has approached the display screen of the liquid crystal display by the photosensor. It differs from a normal liquid crystal display in that it can be captured as image data (image data captured by an image sensor).

  Note that the liquid crystal display may have a built-in photosensor in each of a predetermined number of pixels among the plurality of pixels. However, from the viewpoint of resolution of an image captured by the photosensor, It is preferable to be built in the pixel.

  The liquid crystal display of the position detection device 1 is wired so that a plurality of scanning lines and a plurality of signal lines intersect like a normal liquid crystal display, and a pixel is disposed at each intersection, a thin film transistor, and A display portion including pixels having various capacitors, a driving circuit for driving a scanning line, and a driving circuit for driving a signal line are provided.

  In addition, the liquid crystal display of the position detection device 1 has a configuration in which, for example, a photodiode (imaging sensor) is incorporated as an imaging sensor in each pixel. A capacitor is connected to the photodiode, and the charge amount of the capacitor is changed in accordance with a change in the amount of light incident on the photodiode from the display screen. An image is captured (captured) by generating image data by detecting the voltage across the capacitor. This is the imaging principle of the position detection device 1 using the liquid crystal display.

  Note that the imaging sensor is not limited to a photodiode, and any sensor may be used as long as it can be built in each pixel such as a liquid crystal display using the photoelectric effect as an operating principle.

  With the above configuration, the position detection device 1 includes a display function for displaying an original image of the liquid crystal display, and an imaging function for capturing an image (imaging target) of an external object that has come close to the display screen. Yes. Therefore, it is possible to adopt a configuration that allows touch input on the display screen of the display.

  Here, based on FIGS. 2A to 2H, “finger belly” and “pen tip” are examples of imaging objects to be imaged by the photodiodes incorporated in each pixel of the liquid crystal display of the position detection device 1. The outline of the characteristics of each captured image (or image data) will be described.

  FIG. 2 (a) is a schematic diagram showing a captured image of the finger belly when the surrounding is dark, and FIG. 2 (b) shows the characteristics of the captured image of the finger belly when the surrounding is dark. FIG. As shown in FIG. 2A, consider a case where the user touches the index finger's belly on the display screen of the liquid crystal display in a dark room.

  In this case, the captured image 21 in FIG. 2B is an image obtained by reflecting the backlight to the imaging target (finger's belly) and is an image in which the white circular shape is blurred. The gradient direction in each pixel shows a tendency toward the vicinity of the center of the area surrounded by the edge portion from the edge portion in the captured image. (Here, the gradient direction is positive from the dark part to the bright part.)

  Next, FIG. 2 (c) is a schematic diagram showing the state of the captured image of the finger belly when the periphery is bright, and FIG. 2 (d) is the captured image of the finger belly when the periphery is bright. It is a schematic diagram which shows the characteristic. As shown in FIG. 2C, consider the case where the user touches the index finger's belly on the display screen of the liquid crystal display in a bright room.

  In this case, the captured image 22 in FIG. 2D is an image obtained by external light entering the display screen of the liquid crystal display (when touched, the reflected light from the backlight is also mixed), and the index finger is used. It consists of the shadow of the finger caused by the external light being blocked, and the portion where the white circle formed by the reflection of the light from the backlight on the belly of the finger in contact with the display screen of the liquid crystal display is blurred. Among these, the gradient direction in the white circular portion shows the same tendency as when the belly of the finger is contacted in the dark room described above, but the shadow surrounding it is dark and the surrounding is bright with external light, The gradient direction in each pixel shows a tendency opposite to the gradient direction in the white circular portion.

  FIG. 2 (e) is a schematic diagram showing how a picked-up image of the pen tip is taken when the surroundings are dark, and FIG. 2 (f) is a summary showing the characteristics of the picked-up image of the pen tip when the surroundings are dark. FIG. As shown in FIG. 2E, consider a case where the user touches the pen tip on the display screen of the liquid crystal display in a dark room.

  In this case, the captured image 23 in FIG. 2F is an image obtained by reflecting the backlight to the imaging target (pen tip), and is an image in which a small white circular shape is blurred. The gradient direction in each pixel shows a tendency toward the vicinity of the center of the area surrounded by the edge portion from the edge portion in the captured image.

  Next, FIG. 2 (g) is a schematic diagram showing a picked-up image of the pen tip when the surrounding is bright, and FIG. 2 (h) is a feature of the pen tip picked-up image when the surrounding is bright. FIG. As shown in FIG. 2G, a case is considered where the user touches the pen tip on the display screen of the liquid crystal display in a bright room.

  In this case, the captured image 24 in FIG. 2 (h) is an image obtained by external light entering the display screen of the liquid crystal display (when touched, the reflected light from the backlight is also mixed) and is a pen. It consists of a pen shadow caused by blocking external light and a small white circular shape formed by reflection of light from the backlight on the pen tip in contact with the display screen of the liquid crystal display. Among these, the gradient direction in the small white circular portion shows the same tendency as when the pen tip is contacted in the dark room described above, but the shadow surrounding it is dark and the surrounding is bright with external light. The gradient direction in each pixel shows a tendency opposite to the gradient direction in the small white circular portion.

  The distribution in each gradient direction as described above is, for example, when the surface is soft like a finger and the contact surface becomes circular by touching the surface, or even when the surface is hard like a pen with a round tip When the surface is circular, the tendency is either from the edge part in the captured image to the vicinity of the center of the region surrounded by the edge part, or from the vicinity of the center to the edge part radially. Show. Moreover, even if the contact surface has other shapes, it goes from the edge part in the captured image to the area surrounded by the edge part, or from the area surrounded by the edge part to the outside of the area. One of the trends. Further, these tendencies do not change greatly depending on the situation of the imaging target. Therefore, the gradient direction is an amount suitable for pattern matching.

  Next, based on FIG. 1, the detail of a structure of the position detection apparatus 1 in this Embodiment is demonstrated.

  As shown in FIG. 1, the position detection device 1 has a function of specifying an instruction position on a captured image by an imaging target and information on the size of the imaging target using image data of the captured image. The first resolution adjusting unit 2a, the second resolution adjusting unit 2b, the edge gradient direction specifying unit 3, the matching efficiency improving unit 4, the model pattern storage unit 5, the checking unit 6, the position specifying unit 7, the position / size The output unit 8 and the matching condition management unit 9 are provided.

  The first resolution adjustment unit 2a adjusts the resolution of the image data of the captured image. The resolution adjustment function may be freely adjustable to M / N times (M and N are both positive integers) or may be fixed to 1/2 times. In the case of fixed at 1/2 times, for example, an average value of 2 × 2 4 pixels may be set as a pixel value of a corresponding region of the image after being reduced to 1/2 times. In addition, since the matching condition management unit 9 described later switches the matching condition, it is preferable that the resolution adjustment function can be switched on / off.

  The second resolution adjustment unit 2b adjusts the resolution of the image data of the captured image. The resolution adjustment function may be freely adjustable to M / N times or may be fixed to 1/2 times. In the case of fixed at 1/2 times, for example, an average value of 2 × 2 4 pixels may be set as a pixel value of a corresponding region of the image after being reduced to 1/2 times. In addition, since the matching condition management unit 9 described later switches the matching condition, it is preferable that the resolution adjustment function can be switched on / off.

  Here, the first resolution adjustment unit 2a and the second resolution adjustment unit 2b may be one resolution adjustment processing unit that can be freely adjusted to M / N times, and resolution adjustment fixed to 1/2 times. Three or more parts may be arranged. When a plurality of resolution adjustment units fixed at 1/2 times are arranged, there is an effect that the circuit cost can be reduced as compared with a case where the resolution can be freely adjusted to M / N times. Further, for the same reason, one resolution adjusting unit of 1 / L (L is a positive multiple of 2) times may be arranged.

  The edge gradient direction specifying unit 3 specifies the edge gradient direction for each pixel on the image data. Specifically, for example, the edge gradient direction can be specified as follows.

  First, for each pixel on the image data, the vertical gradient amount and the horizontal gradient amount of the pixel value of the target pixel are calculated from the pixel value of the target pixel and the pixel values of a plurality of adjacent pixels. Specifically, an edge extraction operator such as a Sobel operator or a Prewit operator may be used.

For example, the Sobel operator will be described. The local vertical gradient Sy and the horizontal gradient Sx at the pixel position x (i, j) of each pixel are obtained by the following equation (1).

  Here, xij represents the pixel value at the pixel position x (i, j), i represents the position of the pixel along the horizontal direction, and j represents the position of the pixel along the vertical direction. Here, i and j are positive integers.

Here, the expression (1) is a 3 × 3 Sobel operator (matrix operators Sx and Sy) of the following expressions (2) and (3), and the pixel position x (i, j) is the pixel of interest 3 × 3. This is equivalent to applying to 3 pixels.

Based on the vertical gradient Sy and the horizontal gradient Sx, the gradient magnitude ABS (S) and gradient direction ANG (S) at the pixel position x (i, j) are given as follows. In the following description, the vertical gradient amount and the horizontal gradient amount obtained by applying the vertical gradient Sy and the horizontal gradient Sx as operators to the respective pixels are respectively referred to as the vertical gradient amount Sy and the horizontal direction for convenience. It may be described as a gradient amount Sx.

  Next, an edge pixel that is a pixel of the edge portion of the captured image is extracted (specified) from the calculation result of the calculated vertical gradient amount Sy and horizontal gradient amount Sx of each pixel.

  Here, the edge pixel is a pixel in a portion (edge) where the brightness changes abruptly among the pixels constituting the image data. More specifically, the edge pixel is a pixel in which each of the vertical gradient amount Sy and the horizontal gradient amount Sx, or the gradient magnitude ABS (S) is equal to or greater than a predetermined threshold.

  The purpose of extracting the edge pixels is to specify the gradient direction for a plurality of extracted edge pixels, and to specify the pixels other than the edge pixels as if they are non-uniform directions. .

  Here, since the gradient direction ANG (S) is a continuous amount that changes in the range of 0 rad to 2π rad, in the present embodiment, for example, a quantized value in eight directions is used for pattern matching as a gradient direction. It is assumed to be a characteristic amount (hereinafter sometimes referred to as “feature amount”). In order to perform pattern matching with higher accuracy, it may be quantized into 16 directions. Note that direction quantization means that a direction in which the gradient direction ANG (S) is within a predetermined range is treated as a uniform gradient direction in a specific direction.

  The matching efficiency improvement unit 4 performs matching between a matching region that includes a predetermined number of pixels around the target pixel and a predetermined model pattern (hereinafter, referred to as “pattern matching”). In this case, it is intended to improve the efficiency of matching between the matching area and the model pattern.

  The model pattern storage unit 5 stores model patterns. The model pattern storage unit 5 is, for example, a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, a compact disk-ROM / MO / MD / digital video disk / compact disk-R, or the like. A disk system including the above optical disk, a card system such as an IC card (including a memory card) / optical card, or a semiconductor memory system such as a mask ROM / EPROM / EEPROM / flash ROM can be used.

  For example, the matching unit 6 performs matching between the matching area and the model pattern, and the number of pixels in which the gradient direction included in the matching area matches the gradient direction included in the model pattern (hereinafter referred to as “number of matching pixels”). The degree of matching indicating the degree of matching between the collation area and the model pattern is calculated. The matching is performed by matching the matching area with the model pattern for each of all the pixels at the pixel position x (i, j). Then, the pixel having the highest matching degree is found. The pattern matching method is as described in JP-A-2008-250949, 2008-250950, and 2008-250951.

  The position specifying unit 7 specifies the indicated position on the captured image by the imaging target from the position of the pixel (hereinafter referred to as “peak pixel”) having the highest degree of matching calculated by the matching unit 6. Specifically, for example, the designated position can be specified as follows.

  First, in a search area including a predetermined number of pixels around the target pixel (hereinafter, sometimes referred to as a “first area”), a peak that is a pixel having a maximum matching degree calculated by the matching unit 6. Search for a pixel.

  Next, the search is performed in a small area (hereinafter sometimes referred to as “second area”) that has a predetermined number of pixels smaller than the number of pixels in the search area and is completely included in the search area. When it is determined that there is a peak pixel found in (1), the designated position on the captured image by the imaging target is calculated.

  The indicated position is calculated by using the degree of matching for each pixel in the peak pixel area, which is the area including the predetermined number of pixels centered on the found peak pixel. To do.

  The position / size output unit 8 outputs information related to the size of the imaging target specified based on the indicated position specified by the position specifying unit 7 and the matching condition managed by the matching condition management unit 9 described later. is there.

  The collation condition management unit 9 manages conditions regarding the necessity of resolution adjustment in the first resolution adjustment unit 2a and the second resolution adjustment unit 2b, or the degree of resolution adjustment (for example, 1/2 reduction). The collation condition management unit 9 manages conditions regarding the necessity of collation efficiency improvement in the collation efficiency improvement unit 4. The matching condition management unit 9 manages conditions for the size (for example, 7 × 7, 11 × 11, or 15 × 15) of the model pattern used in the matching unit 6. The collation condition management unit 9 manages / controls collation conditions to identify information on the size of the imaging target output by the position / size output unit 8.

  Next, based on FIG. 1, the detail of a structure of the information processing apparatus 20 in this Embodiment is demonstrated.

  As illustrated in FIG. 1, the information processing apparatus 20 has a function of specifying an instruction position on a captured image by an imaging target and information on the size of the imaging target using image data of the captured image. In addition, it has a function of performing different processing depending on the size of the imaging target, and includes a processing switching unit 10, a small indicator processing unit 11, and a large indicator processing unit 12.

  The process switching unit 10 uses either the small indicator processing unit 11 or the large indicator processing unit 12 described later based on the information regarding the size of the imaging target output from the position / size output unit 8. This is to switch whether to execute the process.

  Here, a case will be described in which either the small indicator processing unit 11 or the large indicator processing unit 12 is selectively switched, but three or more processing units for the indicator size are arranged and selected. In addition, one processing unit that switches processing conditions for two or more indicator sizes may be arranged, and the processing switching unit 10 may switch processing conditions by parameter adjustment or the like. Good.

  The small indicator processing unit 11 performs processing executed when the size of the imaging target is small. Specifically, for example, as shown in FIG. 8A, a process of drawing a line may be performed assuming a pen as an imaging target with a small indicator.

The large indicator processing unit 12 performs a process that is executed when the size of the imaging target is large. Specifically, for example, as shown in FIG. 8B, assuming that a finger is an imaging object of the size of the object, a process such as erasing the drawn content (such as an eraser) is performed. do it.
[2. Overview of operation of position detection device (information processing device)]

  Next, based on FIG.1 and FIG.3, the outline | summary of operation | movement of the position detection apparatus 1 which is one Embodiment of this invention is demonstrated.

  In addition, [2. The configuration other than that described in [Overview of operation of position detection device (information processing device)] is described in [1. Configuration of Position Detection Device (Information Processing Device)]. For convenience of explanation, [1. Members having the same functions as those shown in the drawings of the configuration of the position detection device (information processing device)] are given the same reference numerals, and descriptions thereof are omitted. In addition, although an item is provided suitably below, in this case, the same description after the above-mentioned writing is omitted.

  FIG. 3 is a flowchart showing the operation of the position detection apparatus 1. In step S101 (hereinafter referred to as “S101”), it is determined whether or not the first resolution adjustment unit 2a performs resolution adjustment based on the current collation condition managed by the collation condition management unit 9 in FIG. If the resolution adjustment is necessary (YES), the process proceeds to S102. If the resolution adjustment is not necessary (NO), the first resolution adjustment is not performed and the process proceeds to S103.

  Here, it is one of the features of the present invention that the collation condition management unit 9 manages whether or not the first resolution adjustment is necessary. As described above, by managing whether or not the first resolution adjustment is necessary, the collation condition management unit 9 can output information on the size of the imaging target.

  In S102, the first resolution adjustment unit 2a adjusts the resolution based on the current collation condition managed by the collation condition management unit 9, and proceeds to S103. Specifically, for example, in the case of image data of 320 × 240 pixels, bilinear reduction is performed such as 160 × 120 pixels (lower resolution ratio 1/2). Here, bilinear reduction is, for example, by taking an average value of pixel values of 2 × 2 pixels and replacing 2 × 2 pixel data with 1 × 1 pixel data having the average value as a whole. It means to perform 1/4 information compression.

  In S103, based on the current collation conditions managed by the collation condition management unit 9, it is determined whether or not the second resolution adjustment unit 2b adjusts the resolution. If resolution adjustment is necessary (YES), the process proceeds to S104. If adjustment is not required (NO), the second resolution adjustment is not performed, and the process proceeds to S105.

  Here, it is one of the features of the present invention that the collation condition management unit 9 manages whether or not the second resolution adjustment is necessary. As described above, by managing whether or not the second resolution adjustment is necessary in the collation condition management unit 9, it is possible to output information on the size of the imaging target.

  In S104, the second resolution adjustment unit 2b adjusts the resolution based on the current collation condition managed by the collation condition management unit 9, and proceeds to S105. Specifically, for example, when image data of 320 × 240 pixels is input and a reduction process with a reduction ratio of 1/2 is executed in S102, 160 × 120 pixels to 80 × 60 pixels (reduction in resolution) Bilinear reduction as in the case of rate 1/2).

  In S105, the edge gradient direction specifying unit 3 calculates the vertical gradient amount Sy and the horizontal gradient amount Sx for each pixel on the image data, and then specifies either the gradient direction or non-directional for each pixel. Then, the process proceeds to S106.

  In S106, based on the current collation conditions managed by the collation condition management unit 9, the collation efficiency improvement unit 4 determines whether or not collation efficiency is increased. If the collation efficiency improvement is necessary (YES), the process proceeds to S107. If the collation efficiency improvement is not required (NO), the collation efficiency is not improved and the process proceeds to S108.

  Here, it is one of the features of the present invention that the collation condition management unit 9 manages whether or not the collation efficiency is necessary. As described above, the collation condition management unit 9 manages whether or not the collation efficiency is necessary, so that information regarding the size of the imaging target can be output.

  In S107, the collation efficiency improvement unit 4 divides the collation area into a plurality of divided areas having the same number of pixels, and divides the gradient direction and non-directional information for each pixel included in the divided area for each divided area. By replacing the information with the gradient direction and the non-direction information included in the region, the collation region and the model pattern are efficiently collated, and the process proceeds to S108. In this case, the collation unit 6 performs collation between the collation area that has been collated efficiently by the collation efficiency improving unit 4 and the model pattern, and the gradient direction included in each divided area in the collation area and the model The number of matches with the gradient direction in the pattern is calculated as the degree of match. Specifically, with regard to collation efficiency, for example, collation efficiency can be improved as follows.

  First, as shown in FIG. 4A, the distribution characteristic in the gradient direction of each pixel of the image data when the surrounding is dark has a substantially circular non-directional pixel region at the center, and the surrounding area is taken around. A large number of pixels having a gradient direction are distributed in a direction toward the non-directional region so as to surround.

  Next, FIG. 4B is a schematic diagram showing a state after the collation efficiency is improved for the image data of FIG.

  As shown in FIG. 4A, a 14 × 14 pixel region (collation region) is divided into a plurality of 2 × 2 pixel regions (divided regions) and 2 × 2 pixel regions are divided into 2 × 2 pixels. By replacing the gradient direction and non-direction information for each pixel included in the 2-pixel area with the gradient direction and non-direction information included in the 2 × 2-pixel area, the 14 × 14-pixel area and the model pattern ( An example of the model pattern will be described in detail later).

  For example, among the plurality of 2 × 2 pixel regions obtained by dividing the 14 × 14 pixel region illustrated in FIG. 4A, the second 2 × 2 pixel region from the top and the first 2 × 2 pixel region from the left include the upper left The pixel is “no direction”, the upper right pixel is “right downward (gradient direction)”, the lower left pixel is “rightward (gradient direction)”, and the lower right pixel is “right downward (gradient direction)”. . In this 2 × 2 pixel region, information regarding the existence position in each gradient direction is omitted. The second block from the top in FIG. 4B and the first block from the left (hereinafter referred to as “pixel” for convenience). Yes.) Other blocks can be generated in the same manner. As a result, the 14 × 14 pixel region shown in FIG. 4A is divided into a total of 7 × 7 = 49 2 × 2 pixel regions.

  In S108, the collation unit 6 collates the collation area with the model pattern stored in the model pattern storage unit 5, calculates the number of matching pixels, calculates the degree of match, and proceeds to S109.

  Here, a specific example of the model pattern will be described with reference to FIG.

  5A is a schematic diagram illustrating an example of a small-sized (7 × 7) model pattern, and FIG. 5B is a schematic diagram illustrating an example of a medium-sized (11 × 11) model pattern. (C) is a schematic diagram showing an example of a large (15 × 15) model pattern.

  As shown in FIG. 5, a plurality of sizes of model patterns in which edge gradient directions are arranged in a donut shape are prepared. Here, the model pattern of each size has the edge gradient direction arranged in a donut shape as shown in FIGS. 2 (b), 2 (d), 2 (f), and 2 (h). In addition, the edge gradient direction from the dark side to the bright side is extracted as a feature amount from the outside toward the center of the circular shape in the peripheral portion (edge pixel) of the circular contact surface with which the imaging target is in contact. Follow the trend. This tendency is also apparent from the schematic diagram showing the characteristics of the gradient direction of the image data when the surroundings are dark, as shown in FIG.

  A plurality of sizes are prepared for dealing with cases where the area of the contact surface is different, such as when the imaging target is a pen or a finger. It is one of the features of the present invention that the matching condition management unit 9 manages which size is used when these matching patterns are used by the matching unit 6. As described above, by managing the size of the model pattern in the matching condition management unit 9, it is possible to output information related to the size of the imaging target.

  In S109, the position specifying unit 7 specifies the indicated position on the picked-up image by the imaging target from the position of the peak pixel where the degree of matching calculated by the matching unit 6 in S108 is maximized, and the process proceeds to S110.

  In S110, the position / size output unit 8 outputs information on the size of the imaging target specified based on the indication position specified by the position specifying unit 7 in S109 and the matching condition managed by the matching condition management unit 9. Then, a series of processing is completed.

  Here, the series of position / size specifying processes described with reference to the flowchart of FIG. 3 specifies the position / size for one combination condition among a plurality of combination conditions (matching conditions) managed by the matching condition management unit 9. The case where a process is performed is demonstrated. Actually, a series of position / size specifying processes described in the flowchart of FIG. 3 are executed for each of a plurality of combination conditions (matching conditions) managed by the matching condition management unit 9. At this time, in S109, the designated position on the picked-up image by the imaging target specified by the position specifying unit 7 is stored in the specified position storage unit (not shown), and at that time, the matching condition management unit 9 manages it. Based on the combination condition (matching condition) to be performed, information related to the size of the imaging target is stored in the imaging target size storage unit (not shown), and the position / size output processing of S110 is not executed each time. For all of the combination conditions (collation conditions) managed by the collation condition management unit 9, the position / size output process of S110 may be executed when the position / size specifying process is completed.

  Next, a combination condition of each process managed by the matching condition management unit 9 will be described with reference to FIG.

  6A is an example of a combination condition table for each process managed by the collation condition management unit, and FIG. 6B is another example of a combination condition table for each process managed by the collation condition management unit. is there.

  In FIG. 6A, the combination of processing conditions in the first resolution adjustment unit 2a, the second resolution adjustment unit 2b, the collation efficiency improvement unit 4, and the collation unit 6 and the size of the pointing object (imaging target) are 5 The combination conditions of the street (condition A, condition B, condition C1, condition C2, condition C3) are managed. In this way, by specifying and combining the processing conditions of each processing unit one by one, it is possible to specify the size of the indicator from the relationship between the resolution at the time of matching and the model pattern size. That is, for each of the respective pixels at the pixel position x (i, j), the matching area is compared with the model pattern for each condition, and the degree of matching is calculated. Then, the pixel having the highest matching degree and its condition are found. For example, if the degree of coincidence is the maximum at the pixel position x (m, n), (m, n) is the designated position. If the condition for obtaining the maximum matching degree is, for example, the condition C1 in FIG. 6A, it is determined that the size of the pointing object is 1.

  In FIG. 6B, the combination of processing conditions in the first resolution adjustment unit 2a, the second resolution adjustment unit 2b, the collation efficiency improvement unit 4, and the collation unit 6 and the size of the indication (imaging target) are 2 The combination condition of the street (condition A, condition C) is managed. In this way, not only one processing condition is specified for each processing unit, but a plurality of model pattern sizes may be incorporated into one combination condition as in condition C. Even in this case, it is possible to specify the size of the indicator from the relationship between the resolution at the time of matching and the model pattern size. However, by allowing a plurality of processing conditions in one combination condition element As for the size of the indicator, it is a big tie specification. That is, in FIG. 6 (a), the indicator sizes of 1, 2, and 3 correspond to the conditions C1, C2, and C3, respectively, whereas in FIG. 6 (b), the condition C Will correspond with one of the large size of the indicator.

  Here, two examples of the combination condition table for each process managed by the matching condition management unit 9 are shown. However, the contents of the condition table are not limited to the above-described contents, but the resolution and model pattern size at the time of matching. Various combinations can be set based on the relationship.

  From the viewpoint of high-speed processing, it is preferable to reduce the resolution as much as possible. However, in order to obtain necessary edge information, for example, in the case of image data of 320 × 240 pixels (150 dpi), 80 × 60. It is preferable to set the pixel (lower resolution ratio 1/4) as the limit of lower resolution. Further, from the viewpoint of high-precision processing, it is preferable that the resolution is not reduced at all or even if the resolution is reduced, it is limited to 160 × 120 pixels (reduction ratio 1/2).

  Next, based on FIG.1 and FIG.7, the outline | summary of operation | movement of the information processing apparatus 20 which is one Embodiment of this invention is demonstrated.

  FIG. 7 is a flowchart showing the operation of the information processing apparatus 20. In S201, the process switching unit 10 determines whether or not the indicator is small based on the information regarding the size of the imaging target output in S110 of FIG. 3. If the indicator is small (YES), the process proceeds to S202. If the indicator is not small (NO), the process proceeds to S203.

  In S202, the small indicator processing unit 11 performs a process executed when the size of the imaging target is small, and ends the process.

  In S203, the processing unit 12 for the large-sized object performs a process that is executed when the size of the imaging target is large (not small), and ends the process.

  Referring to FIG. 8, the small indicator processing unit 11 performs a process that is executed when the size of the imaging target is small. Specifically, for example, as shown in FIG. 8A, a process of drawing a line may be performed assuming a pen as an imaging target with a small indicator.

  The large indicator processing unit 12 performs a process that is executed when the size of the imaging target is large. Specifically, for example, as shown in FIG. 8B, assuming that a finger is an imaging object of the size of the object, a process such as erasing the drawn content (such as an eraser) is performed. do it.

  Here, the liquid crystal display device 30 is a liquid crystal display device including an image sensor used by the position detection device 1 (information processing device 20) for imaging.

  Here, the line drawing and the drawing content erasing (eraser) processing have been described as an example of the processing to be switched based on the size of the imaging target. However, the processing content is not limited to the above-described processing. As long as two or more different processes are switched based on the size of the object, any process may be used. For example, a thin pen (small indicator) draws a line with a width of 1 dot, a thick pen or little finger (inside the indicator) draws a line with a width of 3 dots, and a forefinger or middle finger (large indicator) has a width of 5 dots The line may be drawn.

  [Configuration of Position Detection Device (Information Processing Device) According to Embodiment 3]

  FIG. 9 is a block diagram of the position detection apparatus and the information processing apparatus according to the third embodiment. Based on FIG. 9, the detail of a structure of the position detection apparatus 1a in a present Example is demonstrated. 9, the processing unit having the same name as that in FIG. 1 and the processing unit having the same reference numerals have the same functions as those in FIG. 1, and therefore description thereof will not be repeated.

  As illustrated in FIG. 9, the position detection device 1 a has a function of specifying an instruction position on a captured image by an imaging target and information on the size of the imaging target using image data of the captured image. The first resolution adjusting unit 2a, the second resolution adjusting unit 2b, the edge gradient direction specifying unit 3, the matching efficiency improving unit 4, the model pattern storage unit 5, the matching unit 6a, the position specifying unit 7, the position / size The output unit 8, the matching condition management unit 9 a, and the size determination unit 13 are provided. By providing the size determination unit 13, it is possible to detect information related to the size of the imaging target in more detail than in the apparatus of FIG. 1.

  For example, the matching unit 6a performs matching between the matching area and the model pattern, and the number of pixels in which the gradient direction included in the matching area matches the gradient direction included in the model pattern (hereinafter, “the number of matching pixels”). The degree of matching indicating the degree of matching between the collation area and the model pattern is calculated.

  Here, the collation unit 6a outputs the matching degree calculated for each size to the size determination unit 13 when collating with a plurality of model patterns of different sizes. Different from 6. A method of outputting the degree of matching for each model pattern size of a plurality of different sizes to the size determining unit may be, for example, storing a plurality of degrees of matching in a RAM (Random Access Memory) and outputting them together. Alternatively, for example, every time the degree of match is calculated using a plurality of model patterns of different sizes, it may be output sequentially. In any output form, when the size determination unit 13 performs the size determination, it is only necessary to refer to the degree of match for each of a plurality of different model pattern sizes.

  The collation condition management unit 9a manages conditions regarding the necessity of resolution adjustment in the first resolution adjustment unit 2a and the second resolution adjustment unit 2b, or the degree of resolution adjustment (for example, 1/2 reduction). The collation condition management unit 9a manages conditions regarding whether or not the collation efficiency improvement unit 4 requires collation efficiency. The collation condition management unit 9a manages conditions for the size of the model pattern (for example, 7 × 7, 11 × 11, or 15 × 15) used in the collation unit 6a. Further, the collation condition management unit 9a manages / controls the collation conditions to specify information on the size of the imaging target output by the position / size output unit 8.

  Here, the matching condition management unit 9a not only manages and controls the condition of the size of the model pattern (for example, 7 × 7, 11 × 11, or 15 × 15) used at the time of matching, but the matching unit 6a 1 is different from the matching condition management unit 9 in the apparatus of FIG. 1 in that the information regarding the size of the imaging target output from the size determination unit 13 is managed when matching is performed using a plurality of model patterns of different sizes. .

  [Outline of Operation of Position Detection Device (Information Processing Device) According to this Embodiment]

  Next, based on FIG.9 and FIG.10, the outline | summary of operation | movement of the position detection apparatus 1a which concerns on a present Example is demonstrated. Since the configuration other than that described here is the same as that described in [Configuration of Position Detection Device (Information Processing Device) According to Embodiment 3], description thereof will not be repeated. For convenience of explanation, members having the same functions as those shown in FIG. 9 are denoted by the same reference numerals, and description thereof is omitted. In addition, although an item is provided suitably below, in this case, the same description after the above-mentioned writing is omitted. Also, in FIG. 10, the processing steps having the same names as those in FIG. 3 and the processing steps having the same reference numerals have the same processing contents as those in FIG.

  FIG. 10 is a flowchart showing the operation of the position detection apparatus 1a. This will be described with reference to FIG.

  In S <b> 108 a, the collation unit 6 a collates the collation area with the model pattern stored in the model pattern storage unit 5, and a plurality of model patterns having different sizes are stored in the model pattern storage unit 5. The degree of coincidence is calculated by calculating the number of matching pixels for each model pattern size, and the process proceeds to S111.

  In S111, the size determination unit 13 determines the size of the object based on the degree of matching for each model pattern size calculated by the matching unit 6a in S108a, and the process proceeds to S109. Detailed processing contents of the size determination processing step will be described later.

  Here, the series of position / size specifying processes described with reference to the flowchart of FIG. 10 specifies the position / size for one combination condition among a plurality of combination conditions (matching conditions) managed by the matching condition management unit 9a. The case where a process is performed is demonstrated. Actually, a series of position / size specifying processes described in the flowchart of FIG. 10 are executed for each of a plurality of combination conditions (matching conditions) managed by the matching condition management unit 9a. At this time, in S109, the indicated position on the captured image specified by the imaging target specified by the position specifying unit 7 is stored in the specified position storage unit (not shown), and the matching condition management unit 9a manages the specified position at that time. Based on the combination condition (matching condition) to be performed, information related to the size of the imaging target is stored in the imaging target size storage unit (not shown), and the position / size output processing of S110 is not executed each time. For all of the combination conditions (collation conditions) managed by the collation condition management unit 9a, the position / size output process of S110 may be executed when the position / size specifying process is completed.

  Further, it is preferable that the collation processing step S108a described in the flowchart of FIG. 10 proceeds to the size determination processing S111 after the degree of coincidence is calculated for the model patterns having a plurality of sizes managed by the collation condition management unit 9a. This is because in the size determination process S111, the degree of match for each of the model patterns having a plurality of sizes is referred to.

  [Configuration of Size Determination Unit in Position Detection Device (Information Processing Device) According to Third Embodiment]

  FIG. 11 is a block diagram illustrating the configuration of the size determination unit in the position detection apparatus (information processing apparatus) according to the third embodiment. Based on FIG. 11, the detail of the structure of the magnitude | size determination part 13 of the position detection apparatus 1a in this Embodiment is demonstrated. This will be described with reference to FIG.

  As shown in FIG. 11, the size determination unit 13 has a function of outputting information related to the size of the object based on the degree of match for each model pattern size calculated by the matching unit 6a. A contribution rate calculation unit 131 and a contribution rate evaluation unit 132 are provided.

The contribution rate calculation unit 131 calculates the contribution rate for each model pattern size according to the following equation (6) using the degree of match for each model pattern size calculated by the matching unit 6a.

  Here, i represents a number representing the model pattern size, Ci represents a contribution ratio of the model pattern size i, and Si represents a matching degree of the model pattern size i.

  Here, as a specific example, a case where there are three model pattern sizes of 7 × 7, 11 × 11, and 15 × 15 will be described. (I = 7, 11, 15)

At this time, contribution rates C7, C11, and C15 for each model pattern size are as follows.

  The contribution rate evaluation unit 132 evaluates the contribution rate for each model pattern size calculated by the contribution rate calculation unit 131 and outputs information related to the size of the object. Details of the method for evaluating the contribution rate will be described later.

  [Outline of Size Determination Processing Operation in Position Detection Device (Information Processing Device) According to Embodiment 3]

  Next, based on FIG.11 and FIG.12, the outline | summary of operation | movement of the magnitude | size determination process part 13 which concerns on a present Example is demonstrated. The configuration other than that described here is the same as the configuration of the size determination unit described above.

  FIG. 12 is a flowchart showing the operation of the size determination unit 13. In the following description, a case where there are three model pattern sizes of 7 × 7, 11 × 11, and 15 × 15 will be described.

  In S <b> 1111, the contribution rate calculation unit 131 calculates the contribution rate for each model pattern size using the degree of matching for each model pattern size, and proceeds to S <b> 1112.

  In S1112, the contribution rate evaluation unit 132 determines whether or not the contribution rate C7 of the 7 × 7 model is less than a predetermined threshold value Ta. If the contribution rate evaluation unit 132 is less than the threshold value Ta, the process proceeds to S1114. move on.

  In S1113, “1” is output as the size-related information, and the size determination process ends.

  In S1114, the contribution rate evaluation unit 132 determines whether or not the contribution rate C11 of the 11 × 11 model is less than a predetermined threshold Tb. If the contribution rate C11 is less than the threshold Tb, the process proceeds to S1116. move on.

  In S1115, “3” is output as the size-related information, and the size determination process ends.

  In S1116, the contribution rate evaluation unit 132 determines whether or not the contribution rate C15 of the 15 × 15 model is less than the predetermined threshold value Tc. If the contribution rate C15 is less than the threshold value Tc, the process proceeds to S1118. move on.

  In S1117, “5” is output as the size information, and the size determination process ends.

  In S1118, the contribution rate evaluation unit 132 determines whether the contribution rate C15 of the 15 × 15 model is less than the contribution rate C7 of the 7 × 7 model. If the contribution rate C15 is less than the contribution rate C7, the process proceeds to S1120. If the contribution rate C15 is greater than or equal to the contribution rate C7, the process proceeds to S1119.

  In S1119, “4” is output as the size-related information, and the size determination process ends.

  In S1120, “2” is output as the size-related information, and the size determination process ends.

  Here, the predetermined threshold values Ta, Tb, and Tc are set to 60%, 70%, and 80%, for example, so that it is determined that the size is close to the model size with a large contribution rate.

  [Outline of Size Determination Processing Operation in Position Detection Device (Information Processing Device) According to Embodiment 4]

  Next, based on FIG.11 and FIG.13, the outline | summary of operation | movement of the magnitude | size determination process part 13 which concerns on Example 4 of this invention is demonstrated. The configuration other than that described here is the same as the configuration of the size determination unit in the third embodiment.

  FIG. 13 is a flowchart showing the operation of the size determination unit 13. In the following description, a case where there are three model pattern sizes of 7 × 7, 11 × 11, and 15 × 15 will be described.

  In S1111, the contribution rate calculation unit 131 calculates the contribution rate for each model pattern size using the degree of match for each model pattern size, and proceeds to S1121.

In S1121, the contribution rate evaluation unit 132 uses the contribution rate C7 of the 7 × 7 model, the contribution rate C11 of the 11 × 11 model, the contribution rate C15 of the 15 × 15 model, and the predetermined weighting factors W7, W11, and W15. Then, the size-related information Size is calculated according to the following equation (7), and the process proceeds to S1122.

  Here, the weighting factors W7, W11, and W15 are weights set in association with the model sizes 7 × 7, 11 × 11, and 15 × 15, respectively. For example, W7 = 0, W11 = 127, and W15 = 255. Thus, the Size value can be calculated to be a value from 0 to 255.

  In S1122, the “Size value” is output as the size information, and the size determination process ends.

  Next, a combination condition of each process managed by the matching condition management unit 9a will be described with reference to FIG. 14A is an example of a combination condition table for each process managed by the collation condition management unit, and FIG. 14B is another example of a combination condition table for each process managed by the collation condition management unit. is there. Descriptions other than the model pattern and the size of the pointer in FIGS. 14A and 14B have been described with reference to FIGS.

  In FIG. 14A, three model patterns (7 × 7, 11 × 11, 15 × 15) and five patterns within one condition (condition C) with respect to the size of the model pattern and the indicator (imaging target). Are managed (large 1, large 2, large 3, large 4, large 5). In this way, by managing the processing conditions having a plurality of model patterns and a size of an indicator that is greater than or equal to the model pattern within one condition, the size of the indicator can be determined from the degree of matching for each model pattern size. It becomes possible to specify in more detail. However, FIG. 14A is based on the size determination processing step described with reference to FIG.

  In FIG. 14B, three model patterns (7 × 7, 11 × 11, 15 × 15) and 256 patterns within one condition (Condition C) for the size of the model pattern and the indicator (imaging target). Are managed (large 0, ..., large 127, ..., large 255). In this way, by managing the processing conditions having a plurality of model patterns and a size of an indicator that is greater than or equal to the model pattern within one condition, the size of the indicator can be determined from the degree of matching for each model pattern size. Further details can be specified. However, FIG. 14B is based on the size determination processing step described with reference to FIG.

  [Overview of Size Determination Processing Operation in Position Detection Device (Information Processing Device) According to Embodiment 5]

  Next, based on FIG.11 and FIG.15, the outline | summary of operation | movement of the magnitude | size determination process part 13 which concerns on Example 5 of this invention is demonstrated. The configuration other than that described here is the same as the configuration of the size determination unit in the fourth embodiment.

  FIG. 15 is a flowchart showing the operation of the size determination unit 13. In the following description, a case where there are three model pattern sizes of 7 × 7, 11 × 11, and 15 × 15 will be described.

  In S1111, the contribution rate calculation unit 131 calculates the contribution rate for each model pattern size using the degree of matching for each model pattern size, and proceeds to S1131.

ここで、オフセットＢ７、Ｂ１１、Ｂ１５、ゲインＧ７、Ｇ１１、Ｇ１５は、モデルサイズ７×７、１１×１１、１５×１５にそれぞれ対応づけて設定されるオフセットとゲインであり、例えば、Ｂ７＝０、Ｂ１１＝０．２、Ｂ１５＝０．２、Ｇ７＝０、Ｇ１１＝４、Ｇ１５＝２０とすることで、Ｓｉｚｅ値を０から２５５以上の値になるように算出することができる。このとき、２５６以上の値が算出された場合は、２５５を上限とするように処理しても良い。 In S1131, the contribution rate evaluation unit 132 performs the contribution rate C7 of the 7 × 7 model, the contribution rate C11 of the 11 × 11 model, the contribution rate C15 of the 15 × 15 model, a predetermined offset B7, B11, and B15, By using the gains G7, G11, and G15, the size-related information Size is calculated according to the following equation (8), and the process proceeds to S1122.

Here, the offsets B7, B11, B15 and gains G7, G11, G15 are offsets and gains set in association with the model sizes 7 × 7, 11 × 11, and 15 × 15, for example, B7 = 0. By setting B11 = 0.2, B15 = 0.2, G7 = 0, G11 = 4, and G15 = 20, the Size value can be calculated from 0 to a value of 255 or more. At this time, if a value of 256 or more is calculated, processing may be performed so that the upper limit is 255.

  In S1122, the “Size value” is output as the size information, and the size determination process ends.

  It should be understood that the embodiments disclosed herein are illustrative and non-restrictive in every respect. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  INDUSTRIAL APPLICABILITY The present invention is a technique that can detect not only the indicated position on the captured image of the imaging target but also information regarding the size of the imaging target, and is important for supporting the feature functions of the liquid crystal device incorporating the optical sensor. One of the technologies. The position detection apparatus and the information processing apparatus of the present invention can be applied to an apparatus that performs operations and instructions by touching a display of a display device such as a liquid crystal display such as a mobile phone or a PDA. . Specifically, as a display device, for example, it can be used for an active matrix liquid crystal display device, and an electrophoretic display, a twist ball display, a reflective display using a fine prism film, a digital mirror device, etc. In addition to displays using light modulation elements, organic EL light-emitting elements, inorganic EL light-emitting elements, displays using variable-light-emitting elements such as LEDs (Light Emitting Diodes), and field emission displays (FED) It can also be used for plasma displays.

DESCRIPTION OF SYMBOLS 1, 1a Position detection apparatus 2a 1st resolution adjustment part 2b 2nd resolution adjustment part 3 Edge gradient direction specific | specification part 4 Collation efficiency improvement part 5 Model pattern storage part 6, 6a Collation part 7 Position specification part 8 Position and magnitude | size output part 9, 9a Collation condition management unit 10 Process switching unit 11 Processing unit for pointing object small 12 Processing unit for large pointing object 13 Size determination unit 20 Information processing device 21 Captured image 22 Captured image 23 Captured image 24 Captured image 30 Liquid crystal display device

Claims (26)

A position detection device having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image,
Resolution adjusting means for adjusting the resolution of the image data;
Gradient direction specifying means for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating means for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of pixels that match
Position specifying means for specifying the indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated by the match level calculating means;
Collation condition management means for managing two or more different conditions for the necessity of resolution adjustment or the degree of resolution adjustment in the resolution adjustment means, and controlling to perform collation under each of the two or more conditions;
In accordance with a collation result in each of the two or more conditions, the pointing position specified by the position specifying means and a position / size output means for outputting information on the size of the imaging target are provided. Position detector. A position detection device having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image,
Gradient direction specifying means for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating means for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of pixels that match
Model pattern storage means for storing model patterns having two or more predetermined different sizes corresponding to collation areas having two or more different sizes;
Position specifying means for specifying the indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated by the match level calculating means;
Matching condition management means for managing two or more different conditions for the size of the model pattern used for matching in the matching degree calculating means, and controlling to perform matching under each of the two or more conditions;
In accordance with a collation result in each of the two or more conditions, the pointing position specified by the position specifying means and a position / size output means for outputting information on the size of the imaging target are provided. Position detector. A position detection device having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image,
Resolution adjusting means for adjusting the resolution of the image data;
Gradient direction specifying means for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating means for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of pixels that match
Model pattern storage means for storing model patterns having two or more predetermined different sizes corresponding to collation areas having two or more different sizes;
Position specifying means for specifying the indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated by the match level calculating means;
Two or more different combination conditions are managed for the necessity of resolution adjustment in the resolution adjustment means or the degree of resolution adjustment, and the size of the model pattern used for matching in the match degree calculation means, and each of the two or more combinations Collation condition management means for controlling to perform collation according to conditions,
In accordance with a collation result in each of the two or more combination conditions, the pointing position specified by the position specifying unit and a position / size output unit that outputs information on the size of the imaging target are provided. A position detection device.   A size determination unit that determines the size of the imaging target based on the match level calculated for each model pattern having two or more different sizes stored in the model pattern storage unit by the match level calculation unit; The position detection apparatus according to claim 2, further comprising a position detection device.   The size determination means calculates the contribution rate for each model pattern using the degree of match calculated for each model pattern, and determines the contribution rate for each model pattern with a predetermined threshold, thereby obtaining an imaging target. The position detection device according to claim 4, wherein the size of the position detection device is determined.   The size determination means calculates a contribution rate for each model pattern using the degree of match calculated for each model pattern, and uses the contribution rate for each model pattern and a predetermined weighting factor to calculate the size. The position detection apparatus according to claim 4, wherein the size of the imaging target is determined by calculating information indicating the position. The collation area is divided into a plurality of divided areas having the same number of pixels, and for each divided area, the gradient direction information for each pixel included in the divided area is converted into the gradient direction information included in the divided area. By replacing, comprising a matching efficiency improvement means for improving the efficiency of matching between the matching area and the model pattern,
The matching degree calculation means
The collation area that has been collated efficiently by the collation efficiency means and the model pattern are collated, and the gradient directions included in the respective divided areas in the collation area, the gradient direction in the model pattern, The number of matches is calculated as the degree of match,
4. The position detection apparatus according to claim 1, wherein the collation condition management unit manages two or more different combination conditions including whether or not the collation efficiency is necessary. An information processing apparatus that uses an image data of a captured image to identify an instruction position on the captured image by an imaging target and executes processing according to the instruction position,
One or two or more processing means for performing different processing depending on the size of the imaging target;
An information processing apparatus comprising: a process switching unit that switches processing contents of the processing unit based on information relating to a size of the imaging target specified using the image data. Resolution adjusting means for adjusting the resolution of the image data;
Gradient direction specifying means for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating means for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of pixels that match
Model pattern storage means for storing model patterns having two or more predetermined different sizes corresponding to collation areas having two or more different sizes;
Position specifying means for specifying the indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated by the match level calculating means;
Two or more different combination conditions are managed for the necessity of resolution adjustment in the resolution adjustment means or the degree of resolution adjustment, and the size of the model pattern used for matching in the match degree calculation means, and each of the two or more combinations A matching condition management means for performing control so as to perform matching according to conditions,
The processing switching unit switches processing contents of the processing unit based on information on the size of the imaging target that is output in accordance with a collation result under each of the two or more combination conditions. The information processing apparatus according to claim 8. A program that causes a computer to perform position detection having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image,
A resolution adjustment step of adjusting the resolution of the image data;
A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating step for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of matching pixels;
A position specifying step for specifying an indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated in the match level calculating step;
A matching condition management step for managing two or more different conditions for the necessity of resolution adjustment or the degree of resolution adjustment in the resolution adjusting step, and controlling to perform matching under each of the two or more conditions;
In accordance with a collation result under each of the two or more conditions, the pointing position specified in the position specifying step and a position / size output step for outputting information on the size of the imaging target are provided. Position detection program. A program that causes a computer to perform position detection having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image,
A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating step for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of matching pixels;
A position specifying step for specifying an indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated in the match level calculating step;
A matching condition management step for managing two or more different conditions for the size of the model pattern used in matching in the matching degree calculation step, and controlling to perform matching under each of the two or more conditions;
In accordance with a collation result under each of the two or more conditions, the pointing position specified in the position specifying step and a position / size output step for outputting information on the size of the imaging target are provided. Position detection program. A program that causes a computer to perform position detection having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image,
A resolution adjustment step of adjusting the resolution of the image data;
A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating step for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of matching pixels;
A position specifying step for specifying an indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated in the match level calculating step;
Two or more different combination conditions are managed for the necessity of resolution adjustment or the degree of resolution adjustment in the resolution adjustment step and the size of the model pattern used at the time of matching in the match degree calculation step, and each of the two or more combinations A matching condition management step for controlling to perform matching according to conditions,
The pointing position specified in the position specifying step and a position / size output step for outputting information related to the size of the imaging target according to the collation result in each of the two or more combination conditions. A position detection program.   A size determination step for determining the size of the imaging target based on the match level calculated for each model pattern having two or more different sizes managed in the matching condition management step in the match level calculation step The position detection program according to claim 11 or 12, further comprising:   The size determination step calculates a contribution rate for each model pattern using the degree of matching calculated for each model pattern, and determines a contribution rate for each model pattern with a predetermined threshold, thereby obtaining an imaging target. The position detection program according to claim 13, wherein the position is determined.   The size determination step calculates a contribution rate for each model pattern using the degree of match calculated for each model pattern, and uses the contribution rate for each model pattern and a predetermined weighting factor to calculate the size. The position detection program according to claim 13, wherein the size of the object to be imaged is determined by calculating information indicating the position. The collation area is divided into a plurality of divided areas having the same number of pixels, and for each divided area, the gradient direction information for each pixel included in the divided area is converted into the gradient direction information included in the divided area. By providing a matching efficiency improvement step for improving the efficiency of matching between the matching area and the model pattern by replacing,
The matching degree calculating step includes:
The collation area in which the collation efficiency is improved by the collation efficiency and the model pattern are collated, and the gradient direction included in each divided region in the collation area and the gradient direction in the model pattern Calculate the number of matches as the degree of match,
The position detection program according to claim 10, 11 or 12, wherein the collation condition management step manages two or more different combination conditions including whether or not the collation efficiency is necessary. An information processing program that uses an image data of a captured image to identify an instruction position on the captured image by an imaging target and causes a computer to execute a process according to the instruction position,
One or more processing steps for performing different processing depending on the size of the imaging target;
An information processing program comprising: a process switching step of switching processing contents of the processing step based on information relating to the size of the imaging target specified using the image data. A resolution adjustment step of adjusting the resolution of the image data;
A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating step for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of matching pixels;
A model pattern storing step for storing model patterns having two or more different predetermined sizes in correspondence with two or more matching areas having different sizes;
A position specifying step for specifying an indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated in the match level calculating step;
Two or more different combination conditions are managed for the necessity of resolution adjustment or the degree of resolution adjustment in the resolution adjustment step and the size of the model pattern used at the time of matching in the match degree calculation step, and each of the two or more combinations A matching condition management step for performing control so that matching is performed under conditions,
The process switching step is characterized in that the process content of the process step is switched based on information on the size of the imaging target that is output according to a collation result under each of the two or more combination conditions. The information processing program according to claim 17.   The computer-readable recording medium which recorded the program of any one of Claim 10 to 18. A position detection method for causing a computer to perform position detection having a function of specifying an instruction position on the captured image by an imaging target using image data of a captured image.
A resolution adjustment step of adjusting the resolution of the image data;
A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating step for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of matching pixels;
A position specifying step for specifying an indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated in the match level calculating step;
A matching condition management step for managing two or more different conditions for the necessity of resolution adjustment or the degree of resolution adjustment in the resolution adjusting step, and controlling to perform matching under each of the two or more conditions;
In accordance with a collation result under each of the two or more conditions, the pointing position specified in the position specifying step and a position / size output step for outputting information on the size of the imaging target are provided. Position detection method. A position detection method for causing a computer to perform position detection having a function of specifying an instruction position on the captured image by an imaging target using image data of a captured image.
A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating step for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of matching pixels;
A model pattern storing step for storing model patterns having two or more different predetermined sizes in correspondence with two or more matching areas having different sizes;
A position specifying step for specifying an indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated in the match level calculating step;
A matching condition management step for managing two or more different conditions for the size of the model pattern used in matching in the matching degree calculation step, and controlling to perform matching under each of the two or more conditions;
In accordance with a collation result under each of the two or more conditions, the pointing position specified in the position specifying step and a position / size output step for outputting information on the size of the imaging target are provided. Position detection method. A position detection method having a function of specifying an indicated position on the captured image by an imaging target using image data of a captured image,
A resolution adjustment step of adjusting the resolution of the image data;
A gradient direction specifying step for specifying a gradient direction for each pixel from the pixel value of the pixel and the pixel values of a plurality of adjacent pixels for each pixel on the image data;
A collation region that is a region including a predetermined number of pixels around the target pixel and a predetermined model pattern are collated, a gradient direction included in the collation region, and a gradient direction included in the model pattern A degree of coincidence calculating step for calculating a degree of coincidence indicating the degree of matching between the matching region and the model pattern from the number of matching pixels;
A model pattern storing step for storing model patterns having two or more different predetermined sizes in correspondence with two or more matching areas having different sizes;
A position specifying step for specifying an indicated position on the captured image by the imaging target from the position of the target pixel having the maximum degree of match calculated in the match level calculating step;
Two or more different combination conditions are managed for the necessity of resolution adjustment or the degree of resolution adjustment in the resolution adjustment step and the size of the model pattern used at the time of matching in the match degree calculation step, and each of the two or more combinations A matching condition management step for controlling to perform matching according to conditions,
The pointing position specified in the position specifying step and a position / size output step for outputting information related to the size of the imaging target according to the collation result in each of the two or more combination conditions. Position detection method.   A size determination step for determining the size of the imaging target based on the match level calculated for each model pattern having two or more different sizes managed in the matching condition management step in the match level calculation step The position detection program according to claim 21 or 22, further comprising:   The size determination step calculates a contribution rate for each model pattern using the degree of matching calculated for each model pattern, and determines a contribution rate for each model pattern with a predetermined threshold, thereby obtaining an imaging target. The position detection program according to claim 23, wherein the size of the position is determined.   The size determination step calculates a contribution rate for each model pattern using the degree of match calculated for each model pattern, and uses the contribution rate for each model pattern and a predetermined weighting factor to calculate the size. The position detection program according to claim 23, wherein the size of the imaging target is determined by calculating information indicating An information processing method that uses an image data of a captured image to identify an indicated position on the captured image by an imaging target and causes a computer to execute a process according to the indicated position,
One or more processing steps for performing different processing depending on the size of the imaging target;
An information processing method comprising: a process switching step of switching processing contents of the processing step based on information relating to the size of the imaging target specified using the image data.

Images