JP2010147950A5

JP2010147950A5 - Image processing apparatus, control method therefor, and imaging apparatus

Info

Publication number: JP2010147950A5
Application number: JP2008324710A
Authority: JP
Filing date: 2008-12-19
Publication date: 2012-02-09
Anticipated expiration: 2028-12-19

Description

したがって、本発明の目的は、特定の被写体を適切に追跡することができる画像処理装置、その制御方法、及び撮像装置を提供することにある。 Therefore, an object of the present invention is to provide an image processing apparatus , a control method thereof, and an imaging apparatus that can appropriately track a specific subject.

本発明は、上述した課題を解決するために、画像を順次取得する取得手段と、取得手段により取得された画像について所定の被写体を検出する検出手段と、検出手段により検出された所定の被写体を含む領域の画像を抽出し、基準画像として設定する設定手段と、設定手段により基準画像が設定された場合に、基準画像が抽出された画像より後に取得手段により取得された画像について、基準画像に含まれる被写体と同一の被写体と認識した被写体を追跡して検出する追跡手段と、追跡手段により検出された被写体の信頼度を算出する算出手段と、を有し、設定手段は、追跡手段により検出された被写体について、該被写体を含む領域の画像を抽出して新たな基準画像として設定し、追跡手段は、算出手段により算出された信頼度が第１のレベルで得られた場合、被写体検出を継続し、信頼度が第１のレベルより低い第２のレベルで得られた場合、被写体検出を終了する条件を設定することを特徴とする。 In order to solve the above-described problems, the present invention provides an acquisition unit that sequentially acquires images, a detection unit that detects a predetermined subject in the image acquired by the acquisition unit, and a predetermined subject detected by the detection unit. Extracting the image of the area including the setting means to set as a reference image, and when the reference image is set by the setting means, the image acquired by the acquisition means after the image from which the reference image is extracted A tracking unit that tracks and detects a subject recognized as the same subject as the included subject; and a calculation unit that calculates the reliability of the subject detected by the tracking unit. The setting unit is detected by the tracking unit. For the selected subject, an image of an area including the subject is extracted and set as a new reference image, and the tracking unit has a reliability calculated by the calculation unit of the first level. If obtained in Le, it continued subject detection, if the reliability is obtained in the second level lower than the first level, and sets a condition for terminating the subject detection.

また、本発明は、上述した課題を解決するために、画像を順次取得する取得手段と、取得手段により取得された画像について所定の被写体を検出する検出手段と、検出手段により検出された所定の被写体を含む領域の画像を抽出し、基準画像として設定する設定手段と、設定手段により基準画像が設定された場合に、基準画像が抽出された画像より後に取得手段により取得された画像について、基準画像に含まれる被写体と同一の被写体と認識した被写体を追跡して検出する追跡手段と、追跡手段により検出された被写体の信頼度を算出する算出手段と、を有する画像処理装置の制御方法であって、設定手段が、追跡手段により検出された被写体について、該被写体を含む領域の画像を抽出して新たな基準画像として設定する工程と、追跡手段が、算出手段により算出された信頼度が第１のレベルで得られた場合、被写体検出を継続し、信頼度が第１のレベルより低い第２のレベルで得られた場合、被写体検出を終了する条件を設定する工程と、を有することを特徴とする。 In order to solve the above-described problems , the present invention provides an acquisition unit that sequentially acquires images, a detection unit that detects a predetermined subject in the image acquired by the acquisition unit, and a predetermined unit detected by the detection unit. A setting unit that extracts an image of an area including a subject and sets it as a reference image, and when the reference image is set by the setting unit, an image acquired by the acquisition unit after the image from which the reference image is extracted A control method for an image processing apparatus, comprising: a tracking unit that tracks and detects a subject recognized as the same subject as the subject included in the image; and a calculation unit that calculates the reliability of the subject detected by the tracking unit. A setting unit that extracts an image of a region including the subject and sets it as a new reference image for the subject detected by the tracking unit; However, when the reliability calculated by the calculation means is obtained at the first level, the subject detection is continued, and when the reliability is obtained at the second level lower than the first level, the subject detection is finished. And a step of setting a condition to be performed.

Claims

Acquisition means for sequentially acquiring images;
  Detecting means for detecting a predetermined subject in the image acquired by the acquiring means;
  Setting means for extracting an image of a region including the predetermined subject detected by the detection means and setting as a reference image;
  When the reference image is set by the setting unit, a subject that is recognized as the same subject as the subject included in the reference image with respect to an image acquired by the acquisition unit after the image from which the reference image has been extracted. Tracking means to track and detect;
  Calculating means for calculating the reliability of the subject detected by the tracking means;
Have
  The setting unit extracts an image of an area including the subject for the subject detected by the tracking unit and sets it as a new reference image,
  The tracking means includes
    If the reliability calculated by the calculation means is obtained at the first level, subject detection continues,
    When the reliability is obtained at a second level lower than the first level, a condition for ending the subject detection is set.
An image processing apparatus.

The tracking unit does not determine whether or not to continue the subject detection based on the reliability with respect to an image acquired by the acquisition unit after a condition for ending the subject detection is set. The image processing apparatus according to claim 1.

The condition for ending the subject detection is a condition that defines the number of times the subject detection is performed for an image acquired by the acquisition unit after the condition is set,
The tracking unit detects the subject when the number of times the subject detection has been performed on the image acquired by the acquisition unit after the condition for ending the subject detection is set exceeds the number of times specified by the condition. Exit
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.

The condition for ending the subject detection is a condition that defines an elapsed time from the time when the condition is set,
The tracking unit ends the subject detection when an elapsed time from the time when the condition for ending the subject detection is set exceeds a time specified by the condition.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.

The tracking means defines an area larger than the reference image with reference to the center of the reference image extracted from the image in which the condition for ending the subject detection is set.
The condition for ending the subject detection defines the positional relationship between the position of the subject detected by the tracking unit and an area larger than the reference image for the image acquired by the acquisition unit after the condition is set. Is a condition to
The tracking unit is configured to detect the subject when the position of the subject detected with respect to the image acquired by the acquisition unit after a condition for ending the subject detection is set out of an area larger than the reference image. End detection
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.

6. The image according to claim 5 , wherein the region larger than the reference image is set to be smaller as the size of the reference image extracted from the image in which the condition for ending the subject detection is set is smaller. Processing equipment.

The condition for ending the subject detection is a condition that defines an upper limit of the cumulative value of the movement amount between the images of the subject detected by the tracking unit in the image acquired by the acquisition unit after the condition is set And
In the tracking unit, the cumulative value of the movement amount between the detected subject images in the image acquired by the acquiring unit after the condition for ending the subject detection is set exceeds the upper limit defined by the condition. The subject detection is terminated.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.

Upper limit of the cumulative value of the amount of movement according to claim 7, characterized in that the condition for terminating the object detection is set larger as the magnitude of the reference image extracted from the set image Image processing apparatus.

The setting means determines that the predetermined subject detection result by the detection means is more reliable than a detection result of the subject recognized as the same subject by the tracking means. Extract the image of the area including the subject and set it as the reference image
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.

The tracking means determines the first level when the reliability is equal to or higher than a threshold, and determines the second level when the reliability is lower than the threshold.
The image processing apparatus according to claim 1, wherein the image processing apparatus is an image processing apparatus.

Acquisition means for sequentially acquiring images;
  Detecting means for detecting a predetermined subject in the image acquired by the acquiring means;
  Setting means for extracting an image of a region including the predetermined subject detected by the detection means and setting as a reference image;
  When the reference image is set by the setting unit, a subject that is recognized as the same subject as the subject included in the reference image with respect to an image acquired by the acquisition unit after the image from which the reference image has been extracted. Tracking means to track and detect;
  Calculating means for calculating the reliability of the subject detected by the tracking means;
An image processing apparatus control method comprising:
  The setting means extracting, for the subject detected by the tracking means, an image of a region including the subject and setting it as a new reference image;
  The tracking means comprises:
    If the reliability calculated by the calculation means is obtained at the first level, subject detection continues,
    Setting a condition for ending the subject detection when the reliability is obtained at a second level lower than the first level;
A control method for an image processing apparatus, comprising:

An imaging apparatus comprising the image processing apparatus according to claim 1,
An image pickup means for continuously output at Jo Tokoro time interval the images rather based on the incident light through the imaging optical system,
The imaging apparatus, wherein the acquisition unit of the image processing apparatus acquires the image output by the imaging unit.