JP2008205774A - System, method and program for guiding photographing work - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To photograph an image easy to conduct a recognition by a recognition application without requiring the labor of a cameraman. <P>SOLUTION: An index for judging the propriety of the recognition is obtained by analyzing the image. A recognition-propriety discriminating means 122 refers to a recognition-propriety discriminating-parameter storage section 132 on the basis of the analyzed index, and judges a recognition propriety. A camera parameter is set when the recognition is enabled. A changing camera parameter for enabling the recognition is computed when the recognition is unable. A screen display means 124 superposes an induction display to image data and outputs the data on the basis of the changing camera parameter. The cameraman conducts a working according to the guiding display, and can obtain the image easy to conduct the recognition only by photographing an object. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a photographing operation guidance system, a photographing manipulation guidance method, and a photographing manipulation guidance program, and particularly relates to a photographing manipulation guidance system, a photographing manipulation guidance method, and a photographing manipulation guidance program for photographing an easily recognizable image.

  Until now, camera-equipped mobile terminals such as camera-equipped mobile phones have been used for shooting landscapes and people. In recent years, high-performance and high-performance information processing capabilities have been remarkable in mobile terminals with cameras. These terminals can be used for image recognition processing such as OCR (Optical Character Recognition) and barcode reading (hereinafter referred to as recognition applications). Also being used.

  The requirements of input images required for image recognition processing by these recognition applications are generally not conscious of the photographer, and the photographer can use the terminal based on intuition, experience, etc. The shooting conditions (camera parameters) such as the position of the camera are adjusted, and an input image that satisfies the requirements required by the recognition application to be used is shot.

  In order to obtain the desired image, there is an approach to improve the mechanical structure of the camera provided in the terminal and control the camera parameters at the time of shooting to the desired one, but under the constraint of miniaturization of the terminal, The approach of complicating mechanical structures is often avoided.

  Under such circumstances, a method for guiding a photographing operation based on the size of a predetermined area in a photographed image has been proposed in order to cause a photographer to photograph an image satisfying the requirements as an input image for character recognition.

  For example, Patent Document 1 describes a technique for displaying the size of a character to be input to a photographer when inputting an image to be character-recognized. Further, in Patent Document 2, a guide display function that supports a photographing operation is realized by determining a target region for OCR from the size of a connected component of characters and displaying guide information.

On the other hand, the in-focus state is attracting attention as a requirement of the input image. For example, in Patent Document 3, differential image data is created from a photographed image “focused by the photographer's operation”, and its high-frequency component There is described an apparatus that includes means for allocating and displaying a predetermined color in accordance with a pixel value that indicates the in-focus state by a difference in color. Further, Patent Document 4 includes a display unit that visually or audibly displays a focus state of “focus adjustment by a photographer's operation”. For example, the focus state is indicated by a bar graph, a level meter, a numerical value, and a graphic. , The blinking pitch of the LED, and a method of indicating by sound.

JP 11-110536 A (paragraphs 0014 to 0015, FIG. 2 etc.) JP 2004-213215 A JP 2002-196225 A JP 2006-166451 A

  The first problem is that the captured image does not necessarily satisfy the recognizable requirement even if the captured image satisfies the size of the region and the in-focus state.

  For example, in the case of the in-focus state that is determined by the high-frequency component amount of the image described in Patent Documents 3 and 4, the in-focus state is determined even if the high-frequency component continues to increase but the high-frequency component increases. As a result, high-frequency noise may be added to the image. As a result, the image quality is disturbed due to the influence of high frequency noise, which may cause recognition failure. Further, the input image may not be recognized due to insufficient image resolution, insufficient contrast, alignment, or other factors.

  The second problem is that the photographer does not know a specific photographing operation for photographing an image that satisfies the requirements that can be recognized by the recognition application.

Since the photographer does not know how much the camera terminal should be moved to by just checking the focus state display according to the difference in color described in Patent Documents 3 and 4 and the focus state by a bar graph or sound. As a rule of thumb, you have to move your device up, down, left and right. In addition, Patent Document 2 only presents the determination result when it cannot be recognized as guide information, and does not present a guidance display for guiding a specific photographing operation to the photographer.
[Object of invention]
The present invention has been made in view of the above problems, and guides a photographing operation that allows a photographer to easily grasp an operation for photographing an image that satisfies the recognition processing requirements of a recognition application. To provide a system.

  Another object of the present invention is to provide a photographing operation guidance system that simplifies an operation for photographing an image that satisfies requirements.

  In order to solve the above problems, the invention disclosed in the present application is a photographing operation guidance system, which performs image processing on image data and outputs a predetermined index, and recognizes the index, camera parameter, and image data A recognizable parameter storage means for storing the recognizability indicating whether it is possible or not, and the camera parameter corresponding to the index and the recognizability are read from the recognizable parameter storage means, and the recognition is performed. A recognition enable / disable determining unit that outputs a camera parameter to be able to perform, and a display unit that performs guidance display for guiding an operation based on the output camera parameter.

  Further, the invention disclosed in the present application to solve the above-described problem is a program, an analysis process for performing image processing on image data and outputting a predetermined index to the information processing apparatus, the index and the camera parameter, Recognition / rejectability parameter storage processing for storing the recognition availability indicating whether or not the image data can be recognized in association with each other, and reading the camera parameter corresponding to the index and the recognition availability from the recognition availability parameter storage means, and the recognition is not possible In this case, a recognition possibility determination process for outputting a camera parameter for recognizing and a display process for performing a guidance display for guiding an operation based on the output camera parameter are executed.

  The first effect is that the photographer can easily grasp the photographing operation for photographing an image that satisfies the requirement without being aware of the requirement of the input image in the recognition application.

  The reason is to determine whether the image data is recognizable based on the index obtained by analyzing the captured image data and the camera parameter. If the image data cannot be recognized, the camera parameter for obtaining easy-to-recognize image data is determined. This is because the photographing operation for calculating and realizing the camera parameters is displayed on the terminal screen.

  The second effect is that an operation by a photographer for photographing an image satisfying the requirements is facilitated. The reason is that when the camera parameters can be reset by controlling the internal mechanism, a recognizable image can be captured without requiring an operation by the photographer.

[First Embodiment]
Next, the configuration of the first embodiment for carrying out the present invention will be described in detail with reference to FIG.

  The first embodiment for carrying out the present invention uses the amount of blur obtained by analyzing the in-focus state of image data as an index for determining whether or not an image can be recognized.

  Referring to FIG. 1, the first embodiment for implementing the present invention includes an imaging device 110, a data processing device 120, a data storage device 130, and a display device 140.

  The imaging device 110 outputs image data by photographing a target.

  The data storage device 130 includes a camera parameter storage unit 131 and a recognition possibility determination parameter storage unit 132. The data storage device 130 is realized by, for example, a semiconductor memory or a magnetic storage device. The semiconductor memory may be configured in advance as described above, or the camera parameter storage unit 131 and the recognition possibility determination parameter storage unit 132 may be configured in the semiconductor memory when a read program or the like operates. good.

  The camera parameter storage unit 131 stores camera parameters when image data is captured by the imaging device 110. The camera parameters include the distance to the subject, the attitude of the imaging device, the F value, the resolution of image data, the zoom value, and the like.

  The recognition possibility determination parameter storage unit 132 stores the index obtained by analyzing the image data, the camera parameter, and the recognition possibility indicating whether or not the recognition is possible. In this embodiment, the blur amount obtained as a result of analyzing the in-focus state is used as an index. FIG. 4 is a diagram illustrating an example of correspondence between the blur amount, the camera parameter, and the recognition possibility stored in the recognition possibility determination parameter storage unit 132. In this figure, in order to facilitate understanding, the amount of blur and the distance to the subject, which is a part of the camera parameters, are shown associated with each other. More specifically, the vertical axis indicates the amount of blur and the horizontal axis indicates the distance to the subject that is a part of the camera parameter, and the relationship between the two is shown in a predetermined graph shape. In addition, a recognizable range is stored as a predetermined shape (rectangular shape in the example of FIG. 4) in the relationship between the amount of blur and the distance between the subject. The above-described storage mode is an example and is not limited to such a method.

  The data processing device 120 is a device that processes input image data and generates display data for output to a display device. Specifically, it is realized by a semiconductor integrated circuit or the like.

  The data processing device 120 includes an in-focus state analysis unit 121, a recognition possibility determination unit 122, and a screen display unit 123. It may be realized as a semiconductor integrated circuit configured in advance as described above, or may be configured to operate as having the above-mentioned means by interpreting and executing a program read by the semiconductor integrated circuit.

  The in-focus state analyzing unit 121 receives the image data, analyzes the image data to obtain an index for determining whether or not the image can be recognized, and outputs the analysis result. In this embodiment, the blur amount is used as an index for determining whether or not an image can be recognized. Therefore, the focusing state analysis unit 121 in the present embodiment specifically analyzes the focusing state of the image data and outputs the amount of blur. The analysis of the in-focus state is performed, for example, by obtaining the smoothness of the edge, the proportion of intermediate colors, and the like. An example of a focused state analysis processing method will be described later.

  The recognizability determining means 122 receives an index for determining whether or not an image can be recognized, reads a camera parameter from the camera parameter storage unit 131, and determines whether or not recognition is associated with the index and the camera parameter. read out. When the recognition failure is read out, the recognition enable / disable determining unit 122 outputs a camera parameter to be changed to enable recognition (hereinafter referred to as a changed camera parameter). In this embodiment, since the blur amount is used as an index, the recognition possibility determining unit 122 receives the blur amount as an input, reads the recognition possibility determination parameter storage unit 132 together with the read camera parameter, and determines whether or not the associated recognition is possible. read out. When the recognition failure determination unit 122 reads that recognition is not possible, the camera parameter for enabling recognition, for example, an F value, a distance to the subject, and the like are calculated and output as a changed camera parameter.

  The recognizability determining means 122 has, for example, a difference between the index associated with the camera parameter that can be recognized and the input index as the changed camera parameter, and the difference between the camera parameters before and after the change. The smallest camera parameter can be output. The camera parameter output method as described above is an example, and is not limited to the above method.

  Further, the recognizability judging means 122 changes the camera parameters related to the internal mechanism (aperture value, F value, etc.) and stores them in the camera parameter storage unit 131, and other camera parameters not related to the internal mechanism ( The distance from the subject, the attitude of the imaging device, etc.) may be output as the changed camera parameters. In this way, the change of the camera parameter relating to the internal mechanism is automated, so that the operation by the photographer can be reduced.

  When it is possible to directly determine whether or not recognition is possible from the index as in the present embodiment, reading of camera parameters from the camera parameter storage unit 131 may be omitted. In this way, since the reading process can be omitted, the process can be performed at high speed and light weight.

  The screen display means 123 receives image data and changed camera parameters as input, and outputs display data by superimposing a predetermined message or figure for guiding an operation for realizing the change of the camera parameters on the image data. It is. For example, when the change of the camera parameter by the changed camera parameter extends the distance from the subject, the screen display unit 123 embeds a character string such as “please get away more” in the display data, Generate display data. Alternatively, the screen display unit 123 may generate display data by superimposing a frame-like figure indicating a smaller area than a predetermined area in the image data near the center point of the area. When the change of the camera parameter by the changed camera parameter is to change the attitude of the imaging device, the screen display means 123 may embed a character string such as “Please turn downward” in the display data, An arrow-shaped figure indicating the downward direction may be embedded in the display data. Although not shown, the character string embedded by the screen display unit 123 may be stored in advance in the data storage device in association with the changed camera parameter element.

  The display device 140 receives display data and displays the input display data. Specifically, the display device 140 is realized by a liquid crystal display or the like.

  Next, operations of the first embodiment for carrying out the present invention will be described with reference to the drawings.

  The imaging device 110 performs imaging based on the camera parameters stored in the camera parameter storage unit 131. Then, the imaging apparatus 110 transmits the captured image data to the in-focus state analyzing unit 121 (Step A1).

  The in-focus state analyzing unit 121 analyzes the in-focus state of the image data (step A2).

  For example, the in-focus state analyzing unit 121 can analyze the smoothness of the edge and output the amount of blur. In the out-of-focus state, the edge becomes smooth, and this smooth length is taken as the amount of blur (FIG. 5). As another example, the in-focus state analyzing unit 121 can output the proportion of the intermediate color as a blur amount (FIG. 6). When the object to be photographed is a binary image (monochrome image), if it is in focus, it is divided into two types: white pixels and black pixels, but in the out-of-focus state, the smoothed pixel values are white and black. (The hatched portion in FIG. 6B). Therefore, the ratio of the intermediate color to the target area can be set as the blur amount.

  Note that the analysis target area by the in-focus state analysis unit 121 may be determined in advance as a rectangular area near the center of the image, or may be an area obtained by extracting a recognition target area from the image data.

  When the in-focus state analysis ends, the in-focus state analysis unit 121 inputs a blur amount value obtained as a result of the analysis to the recognition possibility determination unit 122.

  Next, the recognition enable / disable determining unit 122 receives the analysis result of the in-focus state, refers to the recognition enable / disable determination parameter storage unit 132, and confirms whether the analysis result can be recognized (step A3).

  The recognition enable / disable determining unit 122 reads from the recognition enable / disable determining parameter storage unit 132 the recognition enable / disable associated with the input blur amount and the camera parameter stored in the camera parameter storage unit 131. When the recognition is impossible, the recognition possibility determination unit 122 determines whether or not the recognition is possible by changing the camera parameter that can be changed by controlling the internal mechanism (step A4). For example, the F value is a camera parameter that is changed by controlling an aperture that is an internal mechanism, and the blur amount can be controlled by changing the F value. The recognizability determining means 122 searches the recognizable F values in ascending or descending order while confirming whether or not the recognition is associated with the blur amount changed by changing the F value and the camera parameter. When a recognizable F value is searched, the recognition possibility determination unit 122 determines that the camera parameter can be reset (Yes in step A4), and stores it in the camera parameter storage unit 131. Camera parameters are set (step A5), and shooting is performed under the reset conditions.

  When it is determined that parameter setting is not possible (No in step A4), the recognition possibility determination unit 122 outputs a changed camera parameter for capturing recognizable image data. For example, the recognizability determining unit 122 determines a recognizable target blur amount, and among the changed camera parameters for satisfying the determined target blur amount, the difference between the current camera parameter and the changed camera parameter is minimized. Can be output as a changed camera parameter.

  The recognition possibility determination unit 122 may determine the target blur amount that can be recognized by selecting from the records stored in the recognition possibility determination parameter storage unit 132. In this case, the recognition enable / disable determining unit may select one that minimizes the difference between the analyzed blur amount and the target blur amount. In this way, since the difference between the camera parameters before and after the change becomes small, the operation by the photographer can be suppressed finely.

  The processing method by the recognition possibility determination unit 122 as described above is an example, and is not limited to the above method.

  Next, when receiving the changed camera parameter from the recognition enable / disable determining unit 122, the screen display unit 123 generates display data for guiding an operation in order to satisfy the changed camera parameter (step A6).

  When the shooting distance is input as the changed camera parameter, the screen display unit 123 enlarges / reduces the display data for guiding the operation, a predetermined area in the image data, and the outline of the area, for example. It can be created by superimposing on the figure. In this case, the image display unit 123 calculates the size of the changed area when a predetermined area in the image data is imaged at the changed imaging distance based on the input imaging distance. For example, in the case of a camera that doubles the angle of view when the distance is doubled (FIG. 8), the size of the predetermined area in the image data is halved (FIG. 9) when the shooting distance is doubled. Then, the size of the changed area is calculated as a half size of the predetermined area in the current image data. The image display unit 123 creates display data by superimposing a frame-like figure that displays the size of the calculated area on the image data, and transmits the display data to the display device 140. As another example, the image display unit 123 may generate display data by superimposing a predetermined message previously associated with the change parameter on the image data.

  The display device 140 displays the input display data on a screen such as a liquid crystal display (step A7).

  Next, the effect of the first embodiment for carrying out the present invention will be described.

  In the first embodiment of the present invention, the photographer can take an image that satisfies the requirement without being aware of the requirement of the input image in the recognition application. In the first embodiment of the present invention, the recognition possibility determination process is performed based on the result of analyzing the in-focus state of a photographed image. When the recognition is impossible, a recognizable in-focus state image is photographed. This is because guidance display for resetting or resetting the camera parameters is performed.

  In the first embodiment of the present invention, an operation by a photographer for photographing an image that satisfies the requirements is facilitated. The reason is that even if it is impossible to reset the camera parameters by controlling the internal mechanism, a guidance display for guiding to the camera parameters for taking a recognizable image is performed. Since the guidance display is displayed on a display device such as a screen, the user can know the specific camera operation method (how much and in what direction the camera should be moved) while viewing the display, It is easy for the photographer to realize photographing conditions for photographing an image that satisfies the requirements of the input image in the recognition application.

Further, according to the first embodiment of the present invention, an operation by a photographer for photographing an image that satisfies the requirements is facilitated. The reason is that when the camera parameters can be reset by the control of the internal mechanism, a recognizable image can be captured without requiring an operation by the photographer.
[Example]
Next, a first embodiment of the present invention will be described with reference to the drawings. This example corresponds to the first embodiment for carrying out the present invention.

  In this embodiment, a camera-equipped cellular phone is used as an imaging device, a small computer built in the camera-equipped cellular phone is used as a data processing device, and a RAM built in the camera-equipped cellular phone is used as a data storage device as an output device. The camera-equipped mobile phone display is provided.

  The small computer has a central processing unit that functions as an in-focus state analyzing unit 121, a recognition enable / disable determining unit 122, and a screen display unit 123, and a camera parameter and a recognition enable / disable determining parameter are stored in the RAM. ing.

  As shown in FIG. 3, for example, the resolution is “1280 × 1024”, the F value is “4.0”, and the zoom level is “2” as shown in FIG. Further, as shown in FIG. 4, the recognizable / unrecognizable parameter storage unit shows a recognizable range with respect to the recognizable relationship between the amount indicating the focus state (hereinafter referred to as a blur amount) and the shooting distance. Parameters are predetermined.

  Now, it is assumed that an image is captured with parameters determined by the camera parameter storage unit and input to the in-focus state analysis unit 121.

  The in-focus state analyzing unit 121 analyzes the in-focus state of the image by the central processing unit. The in-focus state analysis includes a method in which the smoothness of the edge is used as a blur amount and a method in which the proportion of the intermediate color is used as a blur amount. After the in-focus state analysis is completed, the in-focus state analyzing unit 121 supplies the blur amount value to the recognition possibility determining unit 122.

  The recognition enable / disable determining unit 122 compares the input blur amount with the recognition enable / disable determining parameter. If it is determined that recognition is impossible, it is determined whether parameter setting is possible, and then parameter setting is performed if possible. Since the parameter for improving the blur amount is the F value, the F value parameter is changed from, for example, F4.0 to F5.6. If the parameter setting is not possible, the recognizable / criminalizing means 122 calculates a recognizable target blur amount and outputs the ideal shooting distance to the screen display means 123 as a changed camera parameter.

  For example, it is assumed that the amount of blur output by the in-focus state analyzing unit 121 is 100. In this case, when the recognition possibility determination unit 122 reads out the shooting distance associated with the blur amount 100 and the recognition possibility from the recognition possibility determination parameter storage unit 132, the blur amount 100 is arranged in A of FIG. The shooting distance is 5 cm and it is determined that recognition is impossible. In order to move the mapping position to the recognizable range, it is necessary to reduce the blur amount to the target blur amount of 50 (B in FIG. 7). Since the ideal shooting distance is 10 cm from the target blur amount, it is sufficient to shoot at a distance of 5 cm from the current position. The recognition enable / disable determining unit 122 outputs information indicating an ideal shooting distance of 10 cm as the changed camera parameter.

  The screen display means 123 calculates how large the target area currently displayed should be displayed based on the output ideal shooting distance. For example, in the case of a camera that doubles the angle of view when the distance is doubled (FIG. 8), when the shooting distance is doubled, the object to be photographed is halved (FIG. 9). As a result, the target area is set to half the current target area. The size of the target area calculated in this way is created and transmitted to the display device 140.

  The display device 140 displays the target area generated by the screen display unit 123.

  Hereinafter, an example of a target generated by the screen display unit 123 will be described in detail with reference to FIGS. 10 and 11. The screen display unit 123 is set in advance so that these displays can be performed.

  In FIG. 10, a rectangle is displayed on the display screen 1 as a guide display, and indicates that the rectangular area is enlarged according to the ideal shooting distance (FIG. 10A). When the rectangular area is small, the words "Please pull the camera" may be displayed, and when the rectangular area becomes large, the words "Please shoot with the camera close" may be displayed (Fig. 10 (b)). .

  In FIG. 11, the outline of the object to be imaged is displayed on the display screen 2 as a guide display, indicating that the outline is enlarged or reduced in accordance with the ideal shooting distance (FIG. 11 (a)). When the contour becomes smaller, the words “Please pull the camera to shoot” and when the contour becomes larger, the words “Please shoot with the camera closer” may be displayed (FIG. 11B). ). Here, the contour of the object to be photographed is described in the conventional method of contour extraction by quadratic differentiation or “New Image Analysis Handbook” (supervised by Mikio Takagi and Yoshihisa Shimoda, Japan, 2004, pages 253 to 254). It can be extracted by using a contour extraction process using snake.

Such guidance display allows the photographer to know how much and in what direction the camera should be moved while looking at the screen.
[Second Embodiment]
Next, a second embodiment of the present invention will be described with reference to the drawings.

  In the first embodiment, the blur amount obtained by analyzing the in-focus state of the image data is used as an index for determining whether or not the image can be recognized. The second embodiment is different from the first embodiment in that a resolution state value obtained by analyzing a resolution state of image data is used as an index for determining whether or not an image can be recognized. Different. That is, the second embodiment is characterized in that the cause of recognition addition due to a decrease in resolution is grasped, and camera parameter setting is performed to prevent the decrease in resolution.

  FIG. 12 is a diagram illustrating the configuration of the second embodiment. Referring to FIG. 12, in the second embodiment of the present invention, a recognition possibility determination parameter storage unit 133 is provided instead of the point recognition possibility determination parameter storage unit 132 provided with a resolution analysis unit 124 instead of the in-focus state analysis unit 121. And a point different from the first embodiment in that a recognition availability determination unit 125 is provided instead of the recognition availability determination unit 122. Constituent elements similar to those in the first embodiment are denoted by the same reference numerals and description thereof is omitted.

  The resolution analysis unit 124 receives the image data, analyzes the resolution state from the image data and outputs a resolution state value in order to obtain an index for determining whether or not the image can be recognized. The analysis of the resolution state can be performed, for example, by measuring the size of the target object in the image data as the resolution state value or reading the model number information of the two-dimensional barcode. An example of the resolution state analysis processing method will be described later.

  The recognition enable / disable determination parameter storage unit 133 is different from the recognition enable / disable determination parameter storage unit 132 in that a resolution state value is used as an index obtained by analyzing image data. That is, the recognition possibility determination parameter storage unit 133 stores the resolution state value, the camera parameter, and the recognition possibility indicating whether recognition is possible in association with each other. FIG. 15 is a diagram illustrating an example of correspondence between resolution state values, camera parameters, and recognition availability, which is stored in the recognition possibility determination parameter storage unit 133. In this figure, for easy understanding, the correspondence between the resolution state value and the camera resolution which is a part of the camera parameter is shown in the shape of a graph. Specifically, the vertical axis represents the camera resolution and the horizontal axis represents the resolution state value, and the relationship between the two is shown in a predetermined graph shape. Further, in the relationship between the camera resolution and the resolution state value, a recognizable range is stored as a predetermined area (a triangular area that is a lower part of a predetermined straight line in the example of FIG. 15). The above-described storage mode is an example and is not limited to such a method.

  The recognition availability determination unit 125 is different from the recognition availability determination unit 122 in that the resolution state value is used as an index for determining whether or not an image can be recognized. The recognition possibility determination unit 125 reads the camera parameter from the camera parameter storage unit 131, reads the input resolution state value and the recognition possibility associated with the camera parameter, and can recognize if the recognition is impossible. This is a means for calculating a changed camera parameter and setting it in the camera parameter storage unit 131.

  Next, the operation of the present embodiment will be described in detail with reference to the flowcharts of FIGS. In addition, the same code | symbol is attached | subjected to the operation | movement similar to 1st Embodiment, and description is abbreviate | omitted.

  The resolution state analysis unit 124 analyzes the resolution state of the image data (step B2).

  When the analysis of the resolution state is finished, the resolution state analysis unit 124 transmits the resolution state value to the recognition availability determination unit 125 as an analysis result.

  The resolution state analysis unit 124 can analyze the resolution state by, for example, a method of measuring the size of the target object in the image data and setting the size as the resolution state value. As a method of measuring the size of the target object in the image data, the basic processing and the layout analysis described in “New Image Analysis Handbook” (supervised by Mikio Takagi and Yoshihisa Shimoda, Japan, 2004, pages 1823-1824) Can be used. The projection direction is performed in two types, the vertical direction and the horizontal direction, and the interval between the projection amounts is set as the resolution state value.

  When a two-dimensional barcode is captured in the image data, the resolution state analyzing unit 124 may analyze the resolution state in the two-dimensional barcode by reading the model number information of the two-dimensional barcode, for example. good. This model number information describes how many modules each side of a two-dimensional barcode is composed of (JIS X 0510 two-dimensional code symbol-QR code-basic specification, 2004, page 5, 7. Chapter 3). The resolution state analysis means 124 calculates how many pixels each module is composed of from the number of modules and the length of one side (number of pixels) on the image of the two-dimensional barcode, and uses the value as the resolution state value. Can be used. For example, assuming that the length of one side of the photographed two-dimensional barcode is 300 pixels, the resolution state analyzing unit 124 reads from the model number information that one side is composed of 54 modules, Since the number of pixels is 300 ÷ 54 = 5.56, the resolution state value is set to 5.56 (FIG. 14).

  The above-described analysis method of the resolution state of the image data is an example, and is not limited to the above method.

  Next, the recognition possibility determination unit 125 receives the resolution state value, compares it with the recognition possibility determination parameter stored in the recognition permission determination parameter storage unit, and confirms whether the analysis result is recognizable (step B3). ). The recognition possibility determination unit 125 reads, for example, the recognition possibility associated with the camera parameter read from the camera parameter storage unit 131 and the received resolution state value, and determines whether the recognition is possible.

  If it can be recognized, the subsequent processing is not performed (Yes in step B3). If it is not recognizable (No in step B3), the recognizability determining unit 125 obtains a camera parameter that can be recognized from the recognizability determining parameter storage unit 134, and after determining whether the camera parameter can be reset ( Step B4), the camera parameter storage unit 131 is reset (step B5), the image is taken again, and the changed camera parameter is output to the screen display means 123. .

  The recognizability determining means 125 can set a recognizable camera parameter by changing the imaging resolution of the camera (camera resolution shown in FIG. 15), for example. That is, when shooting at a higher resolution than that at the time of shooting is possible, camera parameters for increasing the resolution at the time of shooting are set in the camera parameter storage unit 131. For example, when the camera resolution is 1280 × 1024, the resolution state value is 5.56, and the zoom level is 2, this point is arranged at point A in FIG. Here, when the camera resolution is 1616 × 1212, the point A moves to the point B and is arranged in the recognizable area. Since the camera can be recognized by changing the camera resolution to 1616 × 1212, the recognition possibility determination unit 125 sets the changed camera parameter for setting the camera resolution to 1616 × 1212 in the camera parameter storage unit 131, and the imaging device 110 sets the set camera. Re-shoot with parameters.

  As another example, the recognition possibility determination unit 125 can set a recognizable camera parameter by using, for example, a zoom function of the camera. In other words, by raising the zoom stage at the time of shooting, the object to be shot is enlarged to increase the resolution. For example, when the camera resolution is 1280 × 1024, the resolution state value is 5.56, and the zoom level is 2, this point is arranged at point A in FIG. Here, when the zoom stage is doubled to 4, the resolution state value is doubled and 5.56 × 2 = 11.12 (point C). By doubling the zoom stage, point A moves to point C and is placed in the recognizable area. Since it becomes possible to recognize by changing the zoom level to 2 × 4, the recognition possibility determination unit 125 sets the changed camera parameter for setting the zoom level to 4 in the camera parameter storage unit 131, and the imaging apparatus 110 sets it. Reshoot with the specified camera parameters.

  Further, the recognition possibility determination unit 125 may use both the change of the imaging resolution of the camera and the use of the zoom function of the camera.

  When the content of the camera parameter storage unit 131 is set, the screen display unit 123 may transmit that fact to the display device 140. In this case, the screen display unit 123 may generate image data in which the reset camera parameters are embedded and transmit the image data to the display device 140, and the display device 140 may display the contents on the display device. In this way, the photographer can understand that the camera parameters have been reset. Further, notification / non-notification of the resetting may be switched.

  Next, the effect of the second embodiment for carrying out the present invention will be described.

  In the second embodiment for carrying out the present invention, since a means for analyzing the resolution state is added, it is possible to determine whether or not recognition is possible due to insufficient resolution. If the recognition is impossible, the camera parameters for photographing the ideal resolution state are reset, so that an image that is easy to recognize can be photographed.

As the second embodiment, the configuration in which the in-focus state analysis unit 121 of the first embodiment includes the resolution analysis unit 124 has been described. However, as another embodiment, the composite state analysis unit 121 and the resolution analysis unit are included. 124 may be provided. According to such a configuration, an operation for satisfying the requirement of a detailed input image can be guided.
[Third Embodiment]
Next, a third embodiment of the present invention will be described with reference to the drawings.

  FIG. 16 is a block diagram illustrating the configuration of the third embodiment. Referring to FIG. 16, the third embodiment of the present invention further includes an image quality state analysis unit 126, an image quality adjustment unit 127, and a recognition enable / disable determining unit 128, and recognizes instead of the recognition enable / disable determination parameter storage unit 132. This is different from the first embodiment in that an availability determination parameter storage unit 134 is provided. The third embodiment is characterized in that, by having these, an unrecognizable factor due to image quality degradation is grasped, and image processing and parameter setting are performed to prevent image quality degradation.

  The image quality state analyzing unit 126 receives the image data, analyzes the image quality state from the image data, and outputs an image quality state value as an analysis result in order to obtain an index for determining whether or not the image can be recognized. In the analysis of the image quality state, for example, the contrast of the image can be analyzed and the contrast value can be used as the image quality state value. A method of analyzing the image quality state will be described later.

  The recognition possibility determination parameter storage unit 134 stores, in addition to the contents stored in the recognition possibility determination parameter storage unit 132, the image quality state value and the recognition possibility in association with each other.

  The recognition possibility determination unit 128 receives the image quality state value as input, reads out the recognition possibility associated with the image quality state value from the recognition permission determination parameter storage unit 134, determines whether or not recognition is possible, and does not recognize it. In this case, a target image quality state value is read and output so as to be recognizable.

  The image quality state adjustment unit 127 is a unit that receives a target image quality state value as input, determines whether adjustment to the target image quality state value is possible, and performs predetermined image processing if adjustment is possible. . If adjustment is impossible, a predetermined character string is output to the screen display means.

  Next, the operation of the present embodiment will be described in detail with reference to the flowcharts of FIGS. 16 and 17.

  The imaging device 110 transmits the image data captured based on the camera parameters held in the camera parameter storage unit 131 to the image quality state analysis unit 126 (step C1). The image quality state analyzing unit 126 analyzes the image quality state of the image data (step C2). The analysis result of the image quality state is transmitted to the recognition possibility determination unit 128.

  The analysis content of the image quality state of the captured image by the image quality state analysis unit 126 includes, for example, image contrast. When the contrast is defined as the maximum luminance value and the minimum luminance value in the image, the maximum luminance value 245 and the minimum luminance value 5 in the histogram of luminance values in the image in FIG. The larger the contrast value, the clearer the image, and the easier it is to recognize. According to such an example, the image quality state analyzing unit 126 uses the contrast value as the analysis result.

  Next, the recognition possibility determination means 122 receives the analysis result of the image quality state, compares it with the recognition permission determination parameter stored in the recognition permission determination parameter storage unit, and confirms whether the analysis result can be recognized (step C3). ). If it can be recognized, no further processing is performed. When the recognition is impossible, the recognition availability determination unit 128 reads the recognizable image quality state value and the recognition availability from the recognition availability determination parameter storage unit, and outputs them to the image quality adjustment unit 127. Thereafter, the image quality adjustment unit 127 determines whether the image quality can be adjusted based on the received image quality state value and the recognition possibility (step C4). If the image quality adjustment is possible, the image quality adjustment unit 127 performs image processing based on the received image quality state value (step C6). If the image quality adjustment is impossible, the image quality adjustment unit 127 displays a predetermined word on the display device 140 (step C5).

  To explain using an example in which a contrast value is used as the image quality state value, for example, the recognizable / unrecognizable determination parameter storage unit stores 200 as a recognizable contrast value and 100 as a nonrecognizable contrast value. Are stored in association with each other. That is, in this case, the recognizable contrast value is 200 or more and the unrecognizable contrast is 100 or less.

  In the example in which the recognition possibility determination parameter storage unit stores the above-described information, for example, the image quality state analysis is performed by the image quality state analysis unit 126, and the contrast value is analyzed as 150. An example will be described. In this case, the recognition enable / disable determining unit reads the recognition enable / disable associated with the contrast value 150. The contrast value 150 is a contrast value between the recognizable contrast value and the unrecognizable contrast, and the recognition possibility associated with the contrast value is neither a recognizable contrast nor a non-recognizable contrast. The recognition possibility determination unit 128 outputs the result to the image quality adjustment unit 127. Further, if the recognition possibility is not the recognizable contrast, the recognition possibility determination unit 128 may output a recognizable contrast value as the target image quality state value together with the recognition possibility.

  The image quality adjusting unit 127 receives the result and determines that the adjustment is possible because the contrast is not unrecognizable. After the determination, the image quality adjusting unit 127 performs image processing relating to contrast and outputs image data with adjusted image quality. As a method for adjusting the contrast, for example, the method described on pages 1171 to 1176 of “New Edition Image Analysis Handbook” (supervised by Mikio Takagi and Yoshihisa Shimoda, Japan, 2004) can be used. The image quality adjusting unit 127 may refer to the recognizable contrast value stored in the recognizable determination parameter unit when determining the value for adjusting the contrast. Further, the target image quality state value received from the recognition availability determination unit 128 may be referred to.

  When the contrast value is analyzed as 50 by the image quality state analyzing unit, the recognition possibility determining unit 128 outputs the contrast value as the unrecognizable contrast to the image quality adjusting unit 126. In this case, the image quality adjustment unit 127 determines that adjustment is impossible because the received contrast value is unrecognizable contrast. The image quality adjusting means 127 may output a predetermined character string such as “Please turn on the light” and “Please shoot in a bright place” to the screen display means 123 together with the above determination (displayed in FIG. 19). Example of the embodiment). If the contrast value analyzed by the image quality state analyzing unit 126 is 200 or more, the image quality adjusting unit 126 is notified as a recognizable contrast, and the image quality adjusting unit 126 does not adjust the image quality.

  Next, the in-focus state analyzing unit 121 receives the image data after the image quality adjustment, and analyzes the in-focus state (step A2). Thereafter, the in-focus state analyzing unit 121 transmits the analysis result to the recognition possibility determining unit 122.

  Subsequent operations are the same as those in the first embodiment.

  Next, the effect of the third embodiment for carrying out the present invention will be described.

  In the third embodiment for carrying out the present invention, means for analyzing the image quality state and means for adjusting the image quality are added, and the image quality state is analyzed before analyzing the in-focus state. adjust. For this reason, it is possible to determine whether the captured image data satisfies the image quality requirement in the recognition application. Specifically, it is possible to determine whether or not recognition is possible due to image quality degradation.

  The third embodiment for carrying out the present invention adjusts the image quality when the captured image data cannot be recognized and can be adjusted to a recognizable image quality. Therefore, in a predetermined case, it is possible to generate image data that is easy to recognize for the recognition application process without changing the shooting conditions and the like.

  Further, in the third embodiment for carrying out the present invention, an operation by a photographer for photographing an image satisfying the requirements becomes easy. The reason is that even if the camera parameters cannot be reset by controlling the internal mechanism, guidance display is performed to guide the camera parameters to a recognizable in-focus state. Since the guidance display is displayed by a display device such as a screen, the photographer can know the specific camera operation method (how much the camera should be moved in which direction, etc.) while viewing the display. It is easy for the photographer to realize photographing conditions for photographing an image that satisfies the requirements of the input image in the recognition application.

In addition, each component in each embodiment of the present invention can be realized by a computer and a program as well as its function in hardware. The program is provided by being recorded on a computer-readable recording medium such as a magnetic disk or a semiconductor memory, and is read by the computer at the time of starting up the computer, etc. It functions as a component in the form.
[Industrial applicability]
INDUSTRIAL APPLICABILITY According to the present invention, the present invention can be applied to uses such as a shooting operation guiding device for shooting with an optimum image quality and a program for realizing a shooting operation guiding device on a computer. It can also be applied to applications such as an image quality adjustment function installed in digital cameras and digital video cameras equipped with face recognition and fingerprint authentication.

The block diagram which shows the structure of the 1st Embodiment of this invention. The flowchart which shows operation | movement of the 1st Embodiment of this invention. Explanatory diagram showing examples of camera parameters Explanatory diagram showing the recognizable range from the relationship between blur amount and shooting distance A one-dimensional illustration of the relationship between the amount of blur in the in-focus state and the out-of-focus state A diagram illustrating the relationship between the amount of blur in the in-focus state and the out-of-focus state on a two-dimensional plane Diagram explaining the measured blur amount, target blur amount, and each shooting distance Explanatory drawing showing examples of shooting distance and angle of view Explanatory drawing showing the shooting distance and the size of the shooting target Explanatory drawing which shows the example which displayed the guidance display on the display screen as a rectangle Explanatory drawing which shows the example which displayed the guidance display on the display screen as the outline of the photographing object The block diagram which shows the structure of the 2nd Embodiment of this invention. The flowchart which shows the operation | movement of the 2nd Embodiment of this invention. Explanatory drawing which shows the example of calculation of the resolution state value of a two-dimensional barcode Explanatory diagram showing the effect of changing the resolution state and zoom level The block diagram which shows the structure of the 3rd Embodiment of this invention. The flowchart which shows the operation | movement of the 4th Embodiment of this invention. Explanatory drawing showing an example of contrast Explanatory drawing which shows the example which displayed the guidance display on the display screen as words

Explanation of symbols

DESCRIPTION OF SYMBOLS 110 Image pick-up device 120 Data processing device 121 Focus state analysis means 122 Recognizability judgment means 123 Screen display means 124 Resolution analysis means 125 Recognizability judgment means 126 Image quality state analysis means 127 Image quality adjustment means 128 Recognizability judgment means 130 Data storage device 131 Camera parameter storage unit 132 Recognition enable / disable determination parameter storage unit 133 Recognition enable / disable determination parameter storage unit 134 Recognition enable / disable determination parameter storage unit 140 Display device

Claims (8)

Analysis means for performing image processing on the image data and outputting a predetermined index;
Recognizability parameter storage means for storing the index, camera parameter, and recognizability indicating whether or not image data can be recognized;
Recognizability determining means for reading out the camera parameter corresponding to the index and the recognition enable / disable from the recognition enable / disable parameter storage means, and outputting a camera parameter for recognizing when the recognition is impossible
Display means for performing guidance display for guiding operations based on the output camera parameters;
An imaging operation guidance system comprising:
The analysis unit is a focus state analysis unit that analyzes a focus state of image data and outputs a blur amount,
The recognizability parameter storage means associates and stores a blur amount, a distance to a subject, and a recognition possibility indicating whether image data can be recognized;
The photographing operation guiding system according to claim 1.
The analysis unit is a resolution state analysis unit that analyzes a resolution state of image data and outputs a resolution state value,
The recognition possibility parameter storage means stores a resolution state value, a camera resolution, and a recognition possibility indicating whether or not image data can be recognized in association with each other.
The photographing operation guiding system according to claim 1.
The recognizability parameter storage means further stores an image quality state value indicating the image quality state of the image data and a recognition availability indicating whether the image data can be recognized,
A second recognition enable / disable determining unit that receives an image quality state value as input, reads out the recognition enable / disable corresponding to the image quality state value input from the recognition enable / disable parameter storage unit, and outputs the image quality state value and the recognition enable / disable;
An image quality analysis means for calculating an image quality state value from the image data;
An image quality adjusting means for receiving image data, recognition availability and image quality state value, determining whether the image quality can be adjusted, and, if adjustable, outputting image data obtained by adjusting the image quality of the received image data;
Further comprising
4. The photographing operation guiding system according to claim 2, wherein the analyzing unit receives image data output from the image quality adjusting unit.
In the information processing device,
An analysis process for performing image processing on the image data and outputting a predetermined index;
Recognizability parameter storage processing for storing the index, camera parameter, and recognizability indicating whether or not image data can be recognized;
A recognition / non-recognition determining process for reading out a camera parameter corresponding to the index and recognition / non-recognition from the recognition / non-recognition parameter storage unit, and outputting a camera parameter for recognition when the recognition is impossible.
Display processing for performing guidance display for guiding an operation based on the output camera parameters;
A program characterized by having executed.
The analysis process is a focus state analysis process for analyzing a focus state of image data and outputting a blur amount;
The recognizability parameter storage process stores a blur amount, a distance to a subject, and a recognition possibility indicating whether or not image data can be recognized in association with each other.
The program according to claim 5.
The analysis process is a resolution state analysis process for analyzing a resolution state of image data and outputting a resolution state value;
The recognizability parameter storage process stores a resolution state value, a camera resolution, and a recognition possibility indicating whether or not image data can be recognized in association with each other.
The program according to claim 5.
The recognizability parameter storage process is a process of further storing an image quality state value indicating the image quality state of the image data and a recognition possibility indicating whether the image data can be recognized,
A second recognition enable / disable determination process for receiving an image quality state value as input, reading out the recognition possibility corresponding to the image quality state value input from the recognition enable / disable parameter storage means, and outputting the image quality state value and the recognition enable / disable;
Image quality analysis processing for calculating image quality state values from image data;
An image quality adjustment process for receiving image data, recognition possibility and image quality state value, determining whether the image quality can be adjusted, and outputting image data in which the image quality of the received image data is adjusted when the image data can be adjusted;
To run further,
The program according to claim 6 or 7, wherein the analysis process receives image data output from the image quality adjustment process.

Images