JP2013030200A - Image processor and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user friendly image processor that can suitably carry out image related processing by taking into account blurring of an image.SOLUTION: An imaging unit 100 comprises a CPU8 for carrying out: similarity calculation processing for calculating similarity between a search candidate which is searched for by search processing and a search subject; search processing for controlling the contents of the search processing so as to be different according to whether or not the calculated similarity is greater than a prescribed determination value; and determination value change processing for changing the prescribed determination value regarding similarity determination according to a type or a zoom magnification of the search subject.

Description

  The present invention relates to an image processing apparatus and a program.

  2. Description of the Related Art Conventionally, an image search apparatus that records and manages a plurality of images and searches for an image similar to a desired image among the plurality of images is known (see, for example, Patent Document 1). In this image search apparatus, in order to improve the similarity of search processing, the similarity is determined by weighting according to the similarity of colors to be searched.

  There is also known a digital camera that automatically shoots a subject when it is determined that a predetermined condition is satisfied by detecting the expression of the subject and the direction of the eyes / face.

Japanese Patent Application Laid-Open No. 11-212993

By the way, depending on the type of subject, there is a fast movement, and there is a possibility that a blurred image is shot. In addition, even when the magnification is taken, there is a problem that the captured image becomes more easily blurred as the enlargement magnification is increased. In such a case, there is a problem that if the similarity is determined in the search process without considering the blurring of the image as in Patent Document 1 or the like, the degree of matching cannot be determined properly.
Such a problem also occurs when the subject is automatically photographed, and there is a problem that the photographing timing is lost and the usability is poor.

  Accordingly, an object of the present invention is to provide an easy-to-use image processing apparatus and program capable of appropriately performing image-related processing in consideration of image blurring.

In order to solve the above problem, an image processing apparatus according to claim 1 is provided.
Object specifying means for specifying an object related to image-related processing, and determination means for determining whether or not an equivalent corresponding to the object specified by the object specifying means exists in a newly acquired image A similarity calculation unit that calculates a similarity between the equivalent determined by the determination unit and the target specified by the target specifying unit, and calculated by the similarity calculation unit Image-related processing control means for controlling the content of the image-related processing to be different depending on whether the similarity degree is equal to or higher than a predetermined determination value, and the object specified by the object specifying means Type specifying means for specifying a type and determination value changing means for changing the predetermined determination value according to the type of the object specified by the type specifying means are provided.

The invention according to claim 2 is the image processing apparatus according to claim 1,
The determination value changing means is characterized in that the predetermined determination value is changed so that the larger the movement of the object is, the lower the value is.

An image processing apparatus according to a third aspect of the present invention provides:
Object specifying means for specifying an object related to image-related processing, and determination means for determining whether or not an equivalent corresponding to the object specified by the object specifying means exists in a newly acquired image A similarity calculation unit that calculates a similarity between the equivalent determined by the determination unit and the target specified by the target specifying unit, and calculated by the similarity calculation unit Image-related processing control means for controlling the contents of the image-related processing to differ depending on whether or not the obtained similarity is equal to or greater than a predetermined determination value, and magnification acquisition means for acquiring the enlargement / reduction magnification of the image And determination value changing means for changing the predetermined determination value in accordance with the enlargement / reduction ratio acquired by the magnification acquisition means.

The invention according to claim 4 is the image processing apparatus according to claim 3,
The determination value changing means changes the predetermined determination value so that the larger the enlargement magnification is, the lower the predetermined determination value is.

The invention according to claim 5 is the image processing apparatus according to any one of claims 1 to 4,
The image storage means for storing a plurality of images and the image related processing control means perform a search process for searching for a desired image among the plurality of images stored in the image storage means as the image related processing. Image search means for performing the image search, and the image search means specifies, as the desired image, any one of the plurality of images determined to have the similarity equal to or higher than a predetermined determination value. It is characterized by that.

The invention according to claim 6 is the image processing apparatus according to claim 5,
The apparatus further includes display means for displaying the image specified as the desired image by the image search means.

The invention according to claim 7 is the image processing apparatus according to any one of claims 1 to 4,
The image-related processing control means includes imaging control means for controlling imaging of the object by the imaging means as the image-related processing, and the imaging control means is the similar When it is determined that the degree is equal to or greater than a predetermined determination value, the imaging unit automatically images the object.

The invention according to claim 8 is the image processing apparatus according to any one of claims 1 to 7,
The apparatus further includes determination value instruction means for arbitrarily setting and instructing the predetermined determination value.

The program of the invention according to claim 9 is:
A computer of an image processing apparatus provided with an object specifying means for specifying an object related to image-related processing,
Determination means for determining whether or not an equivalent corresponding to the object specified by the object specifying means exists in the newly acquired image, and the equivalent determined by the determination means that the equivalent exists Similarity calculation means for calculating the similarity between the object and the object specified by the object specifying means, depending on whether the similarity calculated by the similarity calculation means is greater than or equal to a predetermined determination value Image-related processing control means for controlling the contents of the image-related processing to be different, type specifying means for specifying the type of the object specified by the object specifying means, and the object specified by the type specifying means It is characterized by functioning as determination value changing means for changing the predetermined determination value according to the type of the above.

The program of the invention according to claim 10 is:
A computer of an image processing apparatus provided with an object specifying means for specifying an object related to image-related processing,
Determination means for determining whether or not an equivalent corresponding to the object specified by the object specifying means exists in the newly acquired image, and the equivalent determined by the determination means that the equivalent exists Similarity calculation means for calculating the similarity between the object and the object specified by the object specifying means, depending on whether the similarity calculated by the similarity calculation means is greater than or equal to a predetermined determination value Image-related processing control means for controlling the contents of the image-related processing to be different; magnification acquisition means for acquiring an enlargement / reduction ratio of the image; and the predetermined magnification according to the enlargement / reduction ratio acquired by the magnification acquisition means It is characterized by functioning as judgment value changing means for changing the judgment value.

  According to the present invention, image-related processing can be appropriately performed in consideration of image blurring, and usability of the image processing apparatus can be improved.

It is a block diagram which shows schematic structure of the imaging device of Embodiment 1 to which this invention is applied. It is a figure which shows typically an example of the mode 1 coefficient table which concerns on the search process by the imaging device of FIG. It is a figure which shows typically an example of the mode 2 coefficient table which concerns on the search process by the imaging device of FIG. 3 is a flowchart illustrating an example of a main operation performed by the imaging apparatus in FIG. 1. 3 is a flowchart illustrating an example of an operation related to a search process by the imaging apparatus of FIG. 1. It is a flowchart which shows an example of the operation | movement which concerns on the mode 1 process in the search process of FIG. It is a flowchart which shows an example of the operation | movement which concerns on the mode 2 process in the search process of FIG. It is a flowchart which shows an example of the operation | movement which concerns on the automatic imaging | photography process by the imaging device of Embodiment 2 to which this invention is applied. It is a flowchart which shows an example of the operation | movement which concerns on the mode 1 process in the automatic imaging | photography process of FIG. It is a flowchart which shows an example of the operation | movement which concerns on the mode 2 process in the automatic imaging | photography process of FIG.

  Hereinafter, specific embodiments of the present invention will be described with reference to the drawings. However, the scope of the invention is not limited to the illustrated examples.

(Embodiment 1)
FIG. 1 is a block diagram illustrating a schematic configuration of an imaging apparatus 100 according to the first embodiment to which the present invention is applied.

The imaging apparatus 100 according to the present embodiment performs a search process for specifying a desired image file F similar to a search target from a plurality of image files F stored in the recording medium 3. The determination value relating to the determination of the similarity is changed according to the zoom magnification.
Specifically, as illustrated in FIG. 1, the imaging device 100 includes an imaging unit 1, a recording medium control unit 2, a recording medium 3, a display unit 4, an operation input unit 5, a buffer memory 6, A built-in memory 7 and a CPU 8 are provided.

The imaging unit 1 generates an image frame by imaging one scene as an imaging unit. Specifically, although not shown, the imaging unit 1 includes, for example, an imaging lens and a CCD (Charge Coupled Device) or CMOS (Complementary Metal-Metal) that converts a subject image that has passed through the imaging lens into a two-dimensional image signal. An electronic imaging unit composed of oxide semiconductor, etc., and an imaging control unit that controls the electronic imaging unit and controls AE (automatic exposure processing), AF (automatic focusing processing), AWB (automatic white balance), etc. ing.
The imaging control unit causes the electronic imaging unit to image the subject with a predetermined exposure time, and reads an image frame from the imaging area of the electronic imaging unit. Thereafter, the imaging control unit transfers the read image frame to the buffer memory 6 and stores it.

  The recording medium control unit 2 controls the storage of the image file F on the recording medium 3 and the reading of the image file F from the recording medium 3.

The recording medium 3 is configured by, for example, a card-type nonvolatile memory (flash memory), a hard disk, or the like.
The recording medium 3 stores a plurality of image files F,... As image storage means. Here, the image file F may be generated by, for example, imaging of a subject by the imaging unit 1 or may be transferred from an external device via a predetermined communication unit.

  Although not shown, the display unit 4 includes, for example, an image display unit such as a liquid crystal display and a display control unit that controls display of an image frame on the image display unit. The display unit 4 displays the live view image while sequentially updating the image frames captured by the imaging unit 1 at a predetermined frame rate.

Further, the display unit 4 displays an image related to any one of the image files F that is searched from the plurality of image files F and specified as the desired image file F as a search result of the search process.
Here, the display unit 4 constitutes display means for displaying an image specified as a desired image in the search process.

  The operation input unit 5 is for performing a predetermined operation of the imaging apparatus 100. Specifically, although not shown, the operation input unit 5 includes a shutter button for instructing recording of a subject by the imaging unit 1, up / down / left / right cursor buttons for selecting various operation modes and various items, and these cursors. A determination button or the like for instructing determination of an operation mode or an item selected by the button is provided.

Examples of the operation mode include a still image shooting mode for shooting a still image, an image search mode for searching for a desired image file F from a plurality of image files F stored in the recording medium 3, and the like. It is done.
When a predetermined operation mode (for example, an image search mode) is selected by the user, an instruction for setting the operation mode is output to the CPU 8 via an input circuit (not shown). When a setting instruction is input, the CPU 8 controls each unit and performs processing according to the operation mode.

Further, the operation input unit 5 designates a search target (target object) related to a search process (image related process) as a target specifying unit.
Here, as a method for specifying a search target, for example, a search target is selected and specified from icons prepared in advance such as “car” and “person” displayed on a search target specification screen (not shown). Alternatively, the user may specify an image stored in advance.

Further, the operation input unit 5 designates the sensitivity related to the determination of the similarity of the search process.
Here, as a method for specifying the sensitivity, it is possible to select and input from a plurality of sensitivities displayed on the sensitivity selection screen (not shown), or to input a desired sensitivity as a numerical value. Also good.
When a predetermined sensitivity (for example, 70%) is selected by the user, an instruction to set the sensitivity is output to the CPU 8 via an input circuit (not shown). When a setting instruction is input, the CPU 8 controls each unit and performs processing according to the sensitivity.
Here, the operation input unit 5 constitutes a determination value instruction means for arbitrarily instructing to set sensitivity as a predetermined determination value.

  The buffer memory 6 is composed of, for example, a flash memory and temporarily stores data processed by the CPU 8.

  The CPU 8 controls each part of the imaging device 100. Specifically, the CPU 8 performs various control operations according to various processing programs for the imaging device 100 stored in a program memory (described later) of the built-in memory 7.

The built-in memory 7 includes a program memory and stores various programs and data necessary for the operation of the CPU 8.
This program includes a determination processing routine, a similarity calculation processing routine, an image search processing routine, a type identification processing routine, a magnification acquisition processing routine, and a determination value change processing routine, which will be described later.
Here, the routine is a series of instructions that constitute a part of a computer program and have a certain function.

The determination processing routine is a program part for causing the CPU 8 to function as determination means. That is, the determination processing routine determines whether or not a search candidate (equivalent) corresponding to a search target (target) specified based on a predetermined operation of the operation input unit 5 by the user exists in the newly acquired image. A group of instructions for causing the CPU 8 to realize the function related to the determination processing for determining the
The similarity calculation processing routine is a program part for causing the CPU 8 to function as similarity calculation means. That is, the similarity calculation processing routine calculates the similarity between the search candidate determined by the determination process and the search target related to the type specified based on the predetermined operation of the operation input unit 5 by the user. It includes an instruction group for causing the CPU 8 to realize a function related to the similarity calculation process to be calculated.
Specifically, according to the determination processing routine, the CPU 8 newly acquires any one of the plurality of image files F stored in the recording medium 3... It is determined whether or not a search candidate corresponding to the search target specified by the user exists in the image. Thereafter, the CPU 8 calculates, by a predetermined calculation method, the similarity between the search candidate determined by the similarity calculation processing routine and the search candidate determined by the determination process and the search target specified by the user, for example, Calculated as a percentage (%).
In the present embodiment, the determination processing routine and the similarity calculation processing routine are exemplified as separate processing routines, but are not limited to this, and are configured as one processing routine. May be.

The image search processing routine is a program part for causing the CPU 8 to function as an image search means. That is, the image search processing routine includes a group of instructions for causing the CPU 8 to realize a function related to search processing for searching for a desired image among a plurality of images stored in the recording medium 3 as image related processing.
Specifically, according to this image search processing routine, the CPU 8 determines whether or not the search is appropriate according to whether or not the similarity calculated in the similarity calculation processing is equal to or greater than a predetermined determination value. When it is determined that the similarity related to any of the images is equal to or higher than a predetermined determination value, the image related to the determination is specified as a desired image, while the similarity is higher than the predetermined determination value. When it is determined to be small, the image according to the determination is not specified as a desired image.
Here, the CPU 8 functions as an image-related process control unit that controls the contents of the search process to vary depending on whether or not the similarity calculated in the similarity calculation process is equal to or greater than a predetermined determination value. .

The type specifying process routine is a program part for causing the CPU 8 to function as a type specifying unit. That is, the type specifying process routine includes a command group for causing the CPU 8 to realize a function related to the type specifying process for specifying the type of search target specified based on a predetermined operation of the operation input unit 5 by the user.
Specifically, the CPU 8 may specify the type of the search target such as “car” or “person” by specifying the type of icon selected as the search target, for example, by this type specifying processing routine. Alternatively, the content of the image data designated as the search target may be image-recognized to specify the type of search target such as “car” or “person”.

The magnification acquisition processing routine is a program part for causing the CPU 8 to function as a magnification acquisition means. That is, the magnification acquisition processing routine includes a command group for causing the CPU 8 to realize a function related to the magnification acquisition processing for acquiring the enlargement / reduction magnification of the image.
Specifically, by this magnification acquisition processing routine, the CPU 8 refers to the attribute data of the image file F and acquires the zoom magnification of the image.
Note that the attribute data may be, for example, Exif tag information attached to the image file F when the image file F is configured from the image file F in the Exif format.

The judgment value change processing routine is a program part for causing the CPU 8 to function as judgment value changing means. That is, the determination value change processing routine changes the predetermined determination value according to the type of search target specified based on the predetermined operation of the operation input unit 5 by the user, or the zoom magnification acquired by the magnification acquisition processing. And a command group for causing the CPU 8 to realize a function related to the determination value changing process for changing the predetermined determination value according to the above.
Specifically, according to the determination value change processing routine, when the mode 1 process is set, the CPU 8 performs a predetermined operation of the operation input unit 5 by the user based on the mode 1 coefficient table T1 (described later). If the predetermined determination value is changed so as to be lower as the motion of the search target is larger according to the type of search target specified based on the mode 2 processing, the mode 2 coefficient table T2 is set. Based on (described later), the predetermined determination value is changed so that the larger the zoom magnification is, the lower the value is according to the zoom magnification acquired in the magnification acquisition processing.

The program memory stores a mode 1 coefficient table T1 and a mode 2 coefficient table T2 (see FIGS. 2 and 3).
As shown in FIG. 2, the mode 1 coefficient table T1 is a table in which the type of search target is associated with a coefficient related to sensitivity correction for similarity determination. The coefficient is set so that the similarity determination becomes softer. Here, the large movement of the search target is relatively determined in consideration of not only the speed of movement of the search target but also various conditions such as the shooting distance to the search target and the angle of view. is there.
For example, when the type of search target is “vegetables” or “building”, the coefficient 1.0 is associated because there is no need to perform sensitivity correction because there is little or no movement, and the type of search target is In the case of “adult” or “ship”, the coefficient 0.9 is associated because the sensitivity correction needs to be performed to some extent because the movement is slow or the movement speed is slow, and the type of search target is “child” or “ In the case of “Automobile”, since it moves instantaneously or the moving speed is fast, it is necessary to further correct the sensitivity, so a coefficient of 0.8 is associated. When the type of search target is “Animal”, the moving speed Since the sensitivity is fast, it is necessary to perform more sensitivity correction, so the coefficient 0.7 is associated.

As shown in FIG. 3, the mode 2 coefficient table T2 is a table in which the zoom magnification and the coefficient related to sensitivity correction for similarity determination are associated with each other. Specifically, the larger the zoom magnification, the similarity determination. The coefficient is set so that is sweetened.
For example, when the zoom magnification is “× 1”, it is not necessary to perform sensitivity correction, and therefore a coefficient of 1.0 is associated. When the zoom magnification is “× 2 to 6”, blurring is likely to occur to some extent. Since the coefficient 0.9 is associated with the zoom magnification of “× 7 to 11” because the sensitivity correction needs to be performed to some extent from the above, the coefficient 0. When 8 is associated and the zoom magnification is “× 12 or more”, since blurring is more likely to occur, the coefficient 0.7 is associated because it is necessary to perform more sensitivity correction.

  The types and coefficients to be searched in the mode 1 coefficient table T1, and the zoom magnification and coefficients in the mode 2 coefficient table T2 are examples, and are not limited to these.

  4 to 10 are flowcharts for explaining the overall operation of the imaging apparatus 100, and are flowcharts showing the algorithm structure of the program stored in the program memory. Description of specific program codes corresponding to the CPU 8 to be actually used is omitted, but may be designed as appropriate based on this flowchart (algorithm structure).

Next, the main operation of the imaging apparatus 100 will be described with reference to FIG.
FIG. 4 is a flowchart illustrating an example of a main operation performed by the imaging apparatus 100.

As shown in FIG. 4, first, the CPU 8 performs an initialization process for initializing each unit of the imaging apparatus 100 (step S1).
Thereafter, when the execution of the search process is instructed based on a predetermined operation of the operation input unit 5 by the user, the CPU 8 controls each unit to perform the search process (step S2; details will be described later).
When the search process ends, the CPU 8 performs the other process when an instruction to perform the other process is given based on a predetermined operation of the operation input unit 5 by the user (step S3).

Next, the search process will be described with reference to FIGS.
FIG. 5 is a flowchart illustrating an example of an operation related to a search process performed by the imaging apparatus 100.

As shown in FIG. 5, the CPU 8 determines whether or not a search process mode switching instruction is input based on a predetermined operation of the operation input unit 5 by the user (step S21).
Here, when it is determined that a mode switching instruction is input, that is, for example, an instruction to switch mode 1 processing to mode 2 processing is input (step S21; YES), the CPU 8 is input. Processing for setting the mode is performed in response to the mode switching instruction (step S22).

Thereafter, the CPU 8 determines whether or not a sensitivity change instruction related to determination of similarity in the search process has been input (step S23). Even when it is determined in step S21 that the mode switching instruction has not been input (step S21; NO), the CPU 8 shifts the process to step S23.
If it is determined in step S23 that an instruction to change sensitivity is input, that is, for example, an instruction to change sensitivity from 100% to 70% is input (step S23; YES). The CPU 8 performs processing for setting the sensitivity in accordance with the input sensitivity change instruction (step S24).

Next, the CPU 8 determines whether or not a search target change instruction for the search process has been input (step S25). Even when it is determined in step S23 that no sensitivity change instruction has been input (step S23; NO), the CPU 8 shifts the process to step S25.
In step S25, it is determined that an instruction to change the search target has been input, that is, an instruction to change the search target from Mr. A (adult) to Mr. B (child), for example. Then (step S25; YES), the CPU 8 performs a process of setting the search target in accordance with the input search target change instruction (step S26).

Subsequently, the CPU 8 determines whether a search start instruction is input based on a predetermined operation of the operation input unit 5 by the user (step S27). Even when it is determined in step S25 that a search target change instruction has not been input (step S25; NO), the CPU 8 shifts the process to step S27.
If it is determined that a search start instruction has been input (step S27; YES), the CPU 8 branches the process according to the set current mode (step S28).
When “mode 1” is set as the current mode (step S28; mode 1), the CPU 8 controls execution of mode 1 processing (step S29), while “mode 2” is set as the current mode. Is set (step S28; mode 2), the CPU 8 controls execution of the mode 2 process (step S2A).
If it is determined in step S27 that no search start instruction has been input (step S27; NO), the CPU 8 ends the search process.

Next, the mode 1 process will be described with reference to FIG.
FIG. 6 is a flowchart illustrating an example of an operation related to mode 1 processing.

  As shown in FIG. 6, the CPU 8 specifies the type of search target specified based on a predetermined operation of the operation input unit 5 by the user by the type specifying processing routine (step S31), and then mode 1 coefficient table T1. The coefficient 1 associated with the specified type of search target is acquired (step S32).

  Next, the CPU 8 newly acquires any one of the plurality of image files F,... Stored in the recording medium 3 by the determination processing routine, and then acquires an image related to the image file F. Whether or not there is a search candidate corresponding to the search target specified by the user, and then specified by the user and the search candidate determined to exist in the determination process by the similarity calculation processing routine The similarity with the search target is calculated by a predetermined calculation method (step S33).

Then, the CPU 8 makes a determination by multiplying the coefficient 1 acquired in the coefficient acquisition process (step S32) by the sensitivity (for example, 70%) set based on a predetermined operation by the user by the determination value change processing routine. Subsequently, the value is changed, and it is determined by the image search processing routine whether or not the similarity calculated in the similarity calculation process (step S33) is equal to or greater than a determination value (step S34).
Here, if it is determined that the degree of similarity is equal to or higher than the determination value (step S34; YES), the CPU 8 determines that the image according to the determination matches the search target and specifies the desired image (step S35). ). Then, the CPU 8 displays a desired image on the display unit 4 as the search result (step S36). As a result, the user can recognize the search result. If the user recognizes that the search results are not very similar, the user can change the sensitivity to be higher and perform the search process again.

On the other hand, when it is determined that the similarity is smaller than the determination value (step S34; NO), the CPU 8 determines that the image according to the determination does not match the search target (step S37).
The CPU 8 sequentially executes the above-described determination process, similarity calculation process, determination value change process, and image search process for each of the plurality of image files F,... Stored in the recording medium 3.

Next, mode 2 processing will be described with reference to FIG.
FIG. 7 is a flowchart illustrating an example of an operation related to the mode 2 process.

  As shown in FIG. 7, the CPU 8 newly acquires any one of the plurality of image files F,... Stored in the recording medium 3, and then, by a magnification acquisition processing routine, After obtaining the zoom magnification of the image (step S41), the coefficient 2 associated with the specified zoom magnification is obtained with reference to the mode 2 coefficient table T2 (step S42).

  Next, the CPU 8 determines whether or not there is a search candidate corresponding to the search target designated by the user in the image related to the image file F by the determination processing routine, and subsequently, the similarity calculation processing routine Thus, the degree of similarity between the search candidate determined to exist in the determination process and the search target specified by the user is calculated by a predetermined calculation method (step S33).

Then, the CPU 8 makes a determination by multiplying the coefficient 2 acquired in the coefficient acquisition process (step S42) by the sensitivity (for example, 70%) set based on a predetermined operation by the user by the determination value changing process routine. Subsequently, the value is changed, and then it is determined by the image search processing routine whether or not the similarity calculated in the similarity calculation processing (step S33) is equal to or greater than a determination value (step S44).
Here, if it is determined that the similarity is equal to or higher than the determination value (step S44; YES), the CPU 8 determines that the image according to the determination matches the search target, and specifies the desired image (step S45). ). Then, the CPU 8 displays a desired image on the display unit 4 as the search result (step S46).

On the other hand, if it is determined that the similarity is smaller than the determination value (step S44; NO), the CPU 8 determines that the image according to the determination does not match the search target (step S47).
The CPU 8 sequentially executes the above-described determination process, similarity calculation process, determination value change process, and image search process for each of the plurality of image files F,... Stored in the recording medium 3.

As described above, according to the imaging apparatus 100 of the first embodiment, the search process for specifying the desired image file F similar to the search target from the plurality of image files F stored in the recording medium 3. Then, the determination value related to the similarity determination is changed according to the type of search target and the zoom magnification using the mode 1 coefficient table T1 and the mode 2 coefficient table T2, and the similarity between the search target and the search candidate is Any image determined to be greater than or equal to the determination value is specified as a desired image file F.
Thereby, it is possible to appropriately perform the search processing in consideration of image blurring that may occur due to a change in the type of search target and zoom magnification. In other words, when the sensitivity of the similarity determination in the search process is set to a user-desired level, the similarity determination is not performed uniformly for a plurality of types of subjects according to the sensitivity, but the search target type and zoom magnification are considered. Then, by resetting the determination value internally, it is possible to appropriately perform the search process in consideration of image blurring, and to improve the usability of the imaging apparatus 100.

  In particular, by changing the determination value so that the larger the movement of the search target or the larger the zoom magnification, the lower the value, the degree of considering image blurring in the similarity determination of the search process can be adjusted appropriately. The search process can be performed more appropriately according to the type of search target and the zoom magnification.

  In the first embodiment, the desired image file F specified by the search process is displayed on the display unit 4. However, the present invention is not limited to this, and the desired image file F is stored in the recording medium. 3 or a predetermined folder (not shown) in the built-in memory 7.

  Further, although the recording medium 3 is exemplified as the image storage means, the present invention is not limited to this, and a plurality of image files F,... May be stored in the built-in memory 7.

(Embodiment 2)
Hereinafter, the imaging apparatus according to the second embodiment will be described with reference to FIGS.
As shown in FIGS. 8 to 10, the imaging apparatus according to the second embodiment performs automatic shooting processing for recording and saving desired image data similar to a shooting target for each of a plurality of pieces of image data sequentially generated by the imaging unit 1. Then, the determination value related to the determination of the similarity is changed according to the type of the shooting target and the zoom magnification.
Note that the imaging apparatus according to the second embodiment has substantially the same configuration as that of the imaging apparatus 100 according to the first embodiment except that automatic imaging processing is performed, and a description thereof will be omitted.

That is, the program stored in the program memory includes an automatic photographing processing routine in addition to a determination processing routine, a similarity calculation processing routine, a type identification processing routine, a magnification acquisition processing routine, and a determination value change processing routine.
The automatic photographing processing routine is a program part for causing the CPU 8 to function as photographing control means. In other words, the automatic photographing processing routine includes a group of instructions for causing the CPU 8 to realize a function related to automatic photographing processing for controlling subject imaging by the imaging unit 1 as image-related processing.
Specifically, by this automatic photographing processing routine, the CPU 8 generates image data generated by the imaging unit 1 according to whether or not the similarity calculated in the similarity calculation processing is equal to or greater than a predetermined determination value. Whether or not to record and save is determined, and when it is determined that the similarity is equal to or greater than a predetermined determination value, the image data according to the determination is recorded and stored in the recording medium 3, while the similarity is determined to be predetermined When it is determined that the value is smaller than the value, the image data recording and storage related to the determination is not executed.
Here, the CPU 8 functions as an image-related process control unit that controls the contents of the search process to vary depending on whether or not the similarity calculated in the similarity calculation process is equal to or greater than a predetermined determination value. .

In addition, the determination processing routine includes imaging candidates (corresponding objects) corresponding to imaging objects (objects) according to the type specified based on a predetermined operation of the operation input unit 5 by the user in the newly acquired image. Including a group of instructions for causing the CPU 8 to realize a function related to the determination process for determining whether or not.
In addition, the similarity calculation processing routine calculates similarity between the shooting candidate determined to exist in the determination process and the shooting target designated based on a predetermined operation of the operation input unit 5 by the user. A command group for causing the CPU 8 to realize the function related to the degree calculation process is included.
Specifically, the CPU 8 newly acquires each of a plurality of image data sequentially generated by the imaging unit 1 by the determination processing routine, and then, in the image related to the image data, the shooting target specified by the user It is determined whether or not there is a shooting candidate corresponding to. Thereafter, the CPU 8 calculates, by a predetermined calculation method, the similarity between the imaging candidate determined by the similarity calculation processing routine and the imaging candidate determined by the determination process and the imaging target specified by the user, for example, Calculated as a percentage (%).

The type specifying process routine includes a group of instructions for causing the CPU 8 to realize a function related to the type specifying process for specifying the type of the imaging target specified based on a predetermined operation of the operation input unit 5 by the user.
Specifically, by this type specifying process routine, the CPU 8 specifies, for example, the type of icon selected as a photographing target based on a predetermined operation of the operation input unit 5 by the user, and “car” or “person”. The type of shooting target may be specified, or the content of the image data designated as the shooting target may be image-recognized to specify the type of shooting target such as “car” or “person”. good.

The magnification acquisition processing routine includes a command group for causing the CPU 8 to realize a function related to the magnification acquisition processing for acquiring the enlargement / reduction magnification at the time of image capturing.
Specifically, the CPU 8 acquires the zoom magnification at the time of photographing each image by the imaging unit 1 by this magnification acquisition processing routine.

In addition, the determination value change processing routine changes a predetermined determination value according to the type of the imaging target designated based on a predetermined operation of the operation input unit 5 by the user, or the zoom magnification acquired in the magnification acquisition processing And a command group for causing the CPU 8 to realize a function related to the determination value changing process for changing the predetermined determination value according to the above.
Specifically, by this determination value changing process routine, when the mode 1 process is set, the CPU 8 designates based on a predetermined operation of the operation input unit 5 by the user based on the mode 1 coefficient table T1. If the predetermined determination value is changed so that the larger the movement of the shooting target is, the mode 2 processing is set according to the type of the shooting target, and based on the mode 2 coefficient table T2. In accordance with the zoom magnification acquired in the magnification acquisition process, the predetermined determination value is changed so as to decrease as the zoom magnification increases.
The mode 1 coefficient table T1 and the mode 2 coefficient table T2 are the same as those according to the first embodiment, and a detailed description thereof is omitted.

Next, the automatic photographing process will be described with reference to FIGS.
FIG. 8 is a flowchart illustrating an example of an operation related to automatic shooting processing by the imaging apparatus.
The automatic photographing process is executed under the control of the CPU 8 when the execution of the automatic photographing process is instructed based on a predetermined operation of the operation input unit 5 by the user in the main operation of the imaging apparatus (see FIG. 4). Process.

As shown in FIG. 8, the CPU 8 determines whether or not a mode switching instruction for automatic photographing processing is input based on a predetermined operation of the operation input unit 5 by the user (step S101).
If it is determined that a mode switching instruction is input, that is, for example, an instruction to switch mode 1 processing to mode 2 processing is input (step S101; YES), the CPU 8 is input. In response to the mode switching instruction, a mode setting process is performed (step S102).

Thereafter, the CPU 8 determines whether or not a sensitivity change instruction related to determination of the similarity of the automatic photographing process is input (step S103). Even when it is determined in step S101 that no mode switching instruction has been input (step S101; NO), the CPU 8 shifts the process to step S103.
If it is determined in step S103 that a sensitivity change instruction has been input, that is, for example, an instruction to change the sensitivity from 100% to 70% is input (step S103; YES). The CPU 8 performs processing for setting the sensitivity in accordance with the input sensitivity change instruction (step S104).

Next, the CPU 8 determines whether or not an instruction to change the shooting target of the automatic shooting process has been input (step S105). Even when it is determined in step S103 that no sensitivity change instruction has been input (step S103; NO), the CPU 8 shifts the process to step S105.
In step S105, it is determined that an instruction to change the shooting target is input, that is, an instruction to change the shooting target from Mr. A (adult) to Mr. B (child), for example. Then (step S105; YES), the CPU 8 performs a process of setting the shooting target in accordance with the input shooting target change instruction (step S106).

Subsequently, the CPU 8 determines whether or not an instruction to start automatic shooting is input based on a predetermined operation of the shutter button of the operation input unit 5 by the user (step S107). Even when it is determined in step S105 that an instruction to change the imaging target has not been input (step S105; NO), the CPU 8 shifts the process to step S107.
If it is determined that an instruction to start shooting is input (step S107; YES), the CPU 8 branches the process according to the set current mode (step S108).
When “mode 1” is set as the current mode (step S108; mode 1), the CPU 8 controls execution of the mode 1 process (step S109), while “mode 2” is set as the current mode. Is set (step S108; mode 2), the CPU 8 controls execution of the mode 2 process (step S10A).
If it is determined in step S107 that an instruction to start automatic shooting has not been input (step S107; NO), the CPU 8 ends the automatic shooting process.

Next, the mode 1 process will be described with reference to FIG.
FIG. 9 is a flowchart illustrating an example of an operation related to mode 1 processing.

  As shown in FIG. 9, the CPU 8 specifies the type of the imaging target specified based on the predetermined operation of the operation input unit 5 by the user by the type specification processing routine (step S111), and then the mode 1 coefficient table T1. Referring to FIG. 4, the coefficient 1 associated with the specified type of the imaging target is acquired (step S112).

  Next, the CPU 8 newly acquires each of the plurality of image data sequentially generated by the imaging unit 1 by the determination processing routine, and then corresponds to the shooting target designated by the user in the image related to the image data. A predetermined calculation method for determining whether or not there is a shooting candidate to be performed, and subsequently, using a similarity calculation processing routine, the similarity between the shooting candidate determined to exist in the determination process and the shooting target specified by the user Is calculated and calculated (step S113).

Then, the CPU 8 performs determination by multiplying the coefficient 1 acquired in the coefficient acquisition process (step S112) by the sensitivity (for example, 70%) set based on a predetermined operation by the user by the determination value change processing routine. Subsequently, the value is changed, and then it is determined by the automatic photographing process routine whether or not the similarity calculated in the similarity calculation process (step S113) is greater than or equal to a determination value (step S114).
Here, if it is determined that the similarity is equal to or higher than the determination value (step S114; YES), the CPU 8 determines that the image according to the determination matches the subject to be imaged (step S115), and the image according to the image. Data is acquired and stored in the recording medium 3 (step S116).

On the other hand, when it is determined that the degree of similarity is smaller than the determination value (step S114; NO), the CPU 8 determines that the image according to the determination is inconsistent with the imaging target (step S117).
The CPU 8 sequentially executes the determination process, the similarity calculation process, the determination value change process, and the automatic shooting process for each of a plurality of image data sequentially generated by the imaging unit 1.

Next, mode 2 processing will be described with reference to FIG.
FIG. 10 is a flowchart illustrating an example of an operation related to mode 2 processing.

  As shown in FIG. 10, the CPU 8 newly acquires each of the plurality of image data sequentially generated by the imaging unit 1, and subsequently acquires the zoom magnification at the time of shooting the image by the magnification acquisition processing routine. After (step S121), referring to the mode 2 coefficient table T2, the coefficient 2 associated with the specified zoom magnification is acquired (step S122).

  Next, the CPU 8 determines whether or not there is a shooting candidate corresponding to the shooting target specified by the user in the image related to the image data by the determination processing routine, and subsequently, by the similarity calculation processing routine. Then, the similarity between the imaging candidate determined to exist in the determination process and the imaging target specified by the user is calculated by a predetermined calculation method (step S123).

Then, the CPU 8 performs determination by multiplying the coefficient 2 acquired in the coefficient acquisition process (step S122) by the sensitivity (for example, 70%) set based on a predetermined operation by the user by the determination value change processing routine. Subsequently, the value is changed, and then it is determined by the image photographing processing routine whether or not the similarity calculated in the similarity calculation processing (step S123) is greater than or equal to the determination value (step S124).
Here, when it is determined that the similarity is equal to or higher than the determination value (step S124; YES), the CPU 8 determines that the image according to the determination matches the photographing target (step S125), and the image according to the image. Data is acquired and recorded in the recording medium 3 (step S126).

On the other hand, if it is determined that the similarity is smaller than the determination value (step S124; NO), the CPU 8 determines that the image according to the determination does not match the subject to be imaged (step S127).
The CPU 8 sequentially executes the determination process, the similarity calculation process, the determination value change process, and the automatic shooting process for each of a plurality of image data sequentially generated by the imaging unit 1.

As described above, according to the imaging apparatus of the second embodiment, for each of a plurality of pieces of image data that are sequentially captured and generated by the imaging unit 1, automatic imaging processing that records and saves desired image data similar to the imaging target The determination value related to the determination of the similarity is changed according to the type of the shooting target and the zoom magnification using the mode 1 coefficient table T1 and the mode 2 coefficient table T2, and the similarity between the shooting target and the shooting candidate is changed. Image data relating to any image determined to be greater than or equal to the determination value is recorded and stored in the recording medium 3.
Accordingly, it is possible to appropriately perform the automatic photographing process in consideration of image blurring that may occur due to a change in the type of photographing target and the zoom magnification. That is, when the sensitivity of similarity determination in automatic shooting processing is set to a user-desired level, similarity determination is not performed uniformly for a plurality of types of subjects according to the sensitivity, but the type of shooting target and the zoom magnification are set. By re-setting the determination value internally in consideration, it is possible to appropriately perform automatic shooting processing in consideration of image blurring, and to improve the usability of the imaging apparatus.

  In particular, it is possible to appropriately adjust the degree of considering image blurring in the similarity determination of automatic shooting processing by changing the determination value so that the larger the movement of the shooting target or the larger the zoom magnification, the lower the determination value. In addition, the automatic photographing process can be performed more appropriately according to the type of photographing object and the zoom magnification.

The present invention is not limited to the first and second embodiments, and various improvements and design changes may be made without departing from the spirit of the present invention.
For example, the search process and the automatic shooting process are exemplified as the image related process, but the present invention is not limited to these, and any image related process performed by an image processing apparatus such as an imaging apparatus or an image search apparatus may be used. May be.

  In the first and second embodiments, the mode 1 coefficient table T1 and the mode 2 coefficient table T2 are used when changing the determination value for determining the similarity, but these tables T1, T2 are used. Whether or not to use can be arbitrarily changed as appropriate.

  Furthermore, in the first and second embodiments, the sensitivity of similarity determination in the search process and the automatic shooting process is set to a user-desired level. However, the present invention is not limited to this, and a predetermined sensitivity is used. It may be fixed uniformly.

In addition, the configuration of the imaging apparatus 100 is merely an example illustrated in the above embodiment, and is not limited thereto.
Furthermore, although the imaging device 100 has been exemplified as the image processing device, the image processing device is not limited to this, and other image processing devices such as an image search device may be used as long as they perform image-related processing.

  In addition, in the above embodiment, functions as a determination unit, a similarity calculation unit, an image related process control unit, a type identification unit, a determination value change unit, a magnification acquisition unit, an image search unit, and a shooting control unit are predetermined by the CPU. However, the present invention is not limited to this. For example, a logic circuit or the like for realizing various functions may be used.

DESCRIPTION OF SYMBOLS 100 Imaging device 1 Imaging part 3 Recording medium 4 Display part 5 Operation input part 8 CPU

In order to solve the above problem, an image processing apparatus according to claim 1 is provided.
Determining whether or not an object corresponding to the object specified by the object specifying means exists in the newly acquired image and the object specifying means for specifying the object related to the image-related processing ; exists and the similarity calculation means for calculating a similarity between the specified object by the determined the equivalents between the object specifying means, similarity calculated by the similarity calculation means is equal to or more than a predetermined judgment value Acquired by the image acquisition processing control means for controlling the contents of the image related processing to be different depending on whether or not the image, the magnification acquisition means for acquiring the enlargement / reduction magnification of the image, and the magnification acquisition means Determination value changing means for changing the predetermined determination value in accordance with the enlargement / reduction ratio.

The invention according to claim 2 is the image processing apparatus according to claim 1 ,
The determination value changing means changes the predetermined determination value so that the larger the enlargement magnification is, the lower the predetermined determination value is.

The invention according to claim 3 is the image processing apparatus according to claim 1 or 2 ,
The image storage means for storing a plurality of images and the image related processing control means perform a search process for searching for a desired image among the plurality of images stored in the image storage means as the image related processing. Image search means for performing the image search, and the image search means specifies, as the desired image, any one of the plurality of images determined to have the similarity equal to or higher than a predetermined determination value. It is characterized by that.

The invention according to claim 4 is the image processing apparatus according to claim 3 ,
The apparatus further includes display means for displaying the image specified as the desired image by the image search means.

The invention according to claim 5 is the image processing apparatus according to claim 1 or 2 ,
The image-related processing control means includes imaging control means for controlling imaging of the object by the imaging means as the image-related processing, and the imaging control means is the similar When it is determined that the degree is equal to or greater than a predetermined determination value, the imaging unit automatically images the object.

The invention according to claim 6 is the image processing apparatus according to any one of claims 1 to 5 ,
The apparatus further includes determination value instruction means for arbitrarily setting and instructing the predetermined determination value.

The program of the invention described in claim 7 is:
A computer of an image processing apparatus provided with an object specifying means for specifying an object related to image-related processing,
In the image newly acquired, specified with judges whether equivalent resides corresponding to the specified object, by a determined to be the equivalent to the object specifying means lies by the object specifying means Similarity calculation means for calculating the similarity to the target object, and the contents of the image-related processing differ depending on whether the similarity calculated by the similarity calculation means is greater than or equal to a predetermined determination value Image-related processing control means for controlling, a magnification acquisition means for acquiring the enlargement / reduction magnification of the image, and a determination value changing means for changing the predetermined determination value according to the enlargement / reduction magnification acquired by the magnification acquisition means It is characterized by functioning as.

Claims (10)

An object specifying means for specifying an object related to image-related processing;
Determining means for determining whether or not there is an equivalent corresponding to the object specified by the object specifying means in the newly acquired image;
Similarity calculating means for calculating the similarity between the equivalent determined by the determining means and the target specified by the target specifying means;
Image-related processing control means for controlling the content of the image-related processing to be different depending on whether the similarity calculated by the similarity calculating means is greater than or equal to a predetermined determination value;
Type specifying means for specifying the type of the object specified by the object specifying means;
Determination value changing means for changing the predetermined determination value according to the type of the object specified by the type specifying means;
An image processing apparatus comprising:   The image processing apparatus according to claim 1, wherein the determination value changing unit changes the predetermined determination value so that the larger the movement of the object is, the lower the determination value is. An object specifying means for specifying an object related to image-related processing;
Determining means for determining whether or not there is an equivalent corresponding to the object specified by the object specifying means in the newly acquired image;
Similarity calculating means for calculating the similarity between the equivalent determined by the determining means and the target specified by the target specifying means;
Image-related processing control means for controlling the content of the image-related processing to be different depending on whether the similarity calculated by the similarity calculating means is greater than or equal to a predetermined determination value;
A magnification acquisition means for acquiring an enlargement / reduction magnification of the image;
Determination value changing means for changing the predetermined determination value according to the enlargement / reduction ratio acquired by the magnification acquisition means;
An image processing apparatus comprising:   The image processing apparatus according to claim 3, wherein the determination value changing unit changes the predetermined determination value so that the larger the enlargement magnification is, the lower the predetermined determination value is. Image storage means for storing a plurality of images;
The image-related process control means further includes an image search means for performing a search process for searching for a desired image among the plurality of images stored in the image storage means as the image-related process,
5. The image search unit is configured to specify, as the desired image, any one of the plurality of images in which the similarity is determined to be greater than or equal to a predetermined determination value. The image processing apparatus according to any one of the above.   6. The image processing apparatus according to claim 5, further comprising display means for displaying an image specified as the desired image by the image search means. An imaging means for imaging an object;
The image-related processing control means includes a photographing control means for controlling the imaging of the object by the imaging means as the image-related processing,
The imaging control unit causes the imaging unit to automatically image the object when it is determined that the similarity is equal to or higher than a predetermined determination value. The image processing apparatus according to one item.   The image processing apparatus according to claim 1, further comprising determination value instruction means for arbitrarily setting and instructing the predetermined determination value. A computer of an image processing apparatus provided with an object specifying means for specifying an object related to image-related processing,
Determining means for determining whether or not there is an equivalent corresponding to the object specified by the object specifying means in the newly acquired image;
Similarity calculating means for calculating the similarity between the equivalent determined by the determining means and the target specified by the target specifying means;
Image-related processing control means for controlling the content of the image-related processing to be different depending on whether or not the similarity calculated by the similarity calculating means is greater than or equal to a predetermined determination value;
Type specifying means for specifying the type of the object specified by the object specifying means;
Determination value changing means for changing the predetermined determination value according to the type of the object specified by the type specifying means;
A program characterized by functioning as A computer of an image processing apparatus provided with an object specifying means for specifying an object related to image-related processing,
Determining means for determining whether or not there is an equivalent corresponding to the object specified by the object specifying means in the newly acquired image;
Similarity calculating means for calculating the similarity between the equivalent determined by the determining means and the target specified by the target specifying means;
Image-related processing control means for controlling the content of the image-related processing to be different depending on whether or not the similarity calculated by the similarity calculating means is greater than or equal to a predetermined determination value;
A magnification acquisition means for acquiring an enlargement / reduction magnification of the image;
Determination value changing means for changing the predetermined determination value according to the enlargement / reduction ratio acquired by the magnification acquisition means;
A program characterized by functioning as

Images