JP2018205648A5

JP2018205648A5 -

Info

Publication number: JP2018205648A5
Application number: JP2017113870A
Authority: JP
Filing date: 2017-06-09
Publication date: 2020-07-27
Anticipated expiration: 2037-06-09

Description

上記の目的を達成するために、本発明に係る画像処理装置は、撮像データに基づく複数のフレーム画像を取得する取得手段と、視線入力情報を取得する視線入力手段と、前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定手段と、前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出手段と、前記フレーム画像と、該フレーム画像内の前記注目領域と、該フレーム画像内の前記動体領域とを表示部に表示する表示制御手段と、を備えることを特徴とする。 To achieve the above object, an image processing apparatus according to the present invention includes an acquisition means to acquire a plurality of frame images based on the imaging data, the sight line input means to obtain the line of sight input information, the visual axis input information and attention region determining means to determine a region of interest in broadcast or found within the plurality of frame images, in said plurality of frame images, the moving object detection means to detect a moving object region corresponding to the moving object, and the frame image And a display control unit that displays the attention area in the frame image and the moving body area in the frame image on a display unit .

また、本発明に係る画像処理装置は、撮像データに基づく複数のフレーム画像を取得する取得手段と、視線入力情報を取得する視線入力手段と、前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定手段と、前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出手段と、前記動体検出手段により検出された前記動体領域と前記注目領域とに基づく領域を主被写体領域として決定し、該主被写体領域を追尾する追尾手段と、を備えることを特徴とする。Further, the image processing apparatus according to the present invention includes an acquisition unit that acquires a plurality of frame images based on imaged data, a line-of-sight input unit that acquires line-of-sight input information, and a focus in the plurality of frame images from the line-of-sight input information. Based on the attention area determining means for determining an area, the moving body detecting means for detecting a moving body area corresponding to a moving body in the plurality of frame images, and the moving body area and the attention area detected by the moving body detecting means Tracking means for determining the area as the main subject area and tracking the main subject area.

また、本発明に係る画像処理装置の制御方法は、撮像データに基づく複数のフレーム画像を取得する取得ステップと、視線入力情報を取得する視線入力ステップと、前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定ステップと、前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出ステップと、前記フレーム画像と、該フレーム画像内の前記注目領域と、該フレーム画像内の前記動体領域とを表示部に表示する表示制御ステップと、を備えることを特徴とする。Further, the control method of the image processing device according to the present invention includes an acquisition step of acquiring a plurality of frame images based on imaged data, a line-of-sight input step of acquiring line-of-sight input information, and the plurality of frame images from the line-of-sight input information. A region of interest determining step of determining a region of interest, a moving body detection step of detecting a moving body region corresponding to a moving body in the plurality of frame images, the frame image, and the region of interest in the frame image, A display control step of displaying the moving object area in the frame image on a display unit.

また、本発明に係る画像処理装置の制御方法は、撮像データに基づく複数のフレーム画像を取得する取得ステップと、視線入力情報を取得する視線入力ステップと、前記視線入力情報から前記複数のフレーム画像内の注目領域を決定する注目領域決定ステップと、前記複数のフレーム画像内で、動体に対応する動体領域を検出する動体検出ステップと、前記動体検出ステップにて検出された前記動体領域と前記注目領域とに基づく領域を主被写体領域として決定し、該主被写体領域を追尾する追尾ステップと、を備えることを特徴とする。Further, the control method of the image processing device according to the present invention includes an acquisition step of acquiring a plurality of frame images based on imaged data, a line-of-sight input step of acquiring line-of-sight input information, and the plurality of frame images from the line-of-sight input information. An attention area determining step for determining an attention area in the moving body, a moving body detecting step for detecting a moving body area corresponding to a moving body in the plurality of frame images, the moving body area detected in the moving body detecting step and the attention A tracking step of determining a region based on the region and the main subject region and tracking the main subject region.

Claims

An acquisition means to acquire a plurality of frame images based on the captured data,
And line-of-sight input means to get the line-of-sight input information,
And attention region determining means to determine a region of interest of the eye control information or we said plurality of frame images,
In said plurality of frame images, the moving object detection means to detect a moving object region corresponding to the moving object,
Display control means for displaying the frame image, the attention area in the frame image, and the moving body area in the frame image on a display unit;
An image processing apparatus comprising:

Tracking means for determining an area based on the moving body area detected by the moving body detection means and the attention area as a main subject area, and for tracking the main subject area .
An image processing apparatus further comprising:

The tracking unit determines the moving object area as the main subject area when a predetermined number of frames in which the distance between the attention area and the moving object area is within a first threshold value continues. 2. The image processing device according to item 2.

In the case where the tracking unit continues for a predetermined number of frames, the distance between the attention area and the moving body area that is closer to the attention area than the area determined as the main subject area continues within a second threshold value. The image processing apparatus according to claim 3, wherein the moving body area is determined as a new main subject area.

An acquisition means for acquiring a plurality of frame images based on the imaged data,
A line-of-sight input means for obtaining line-of-sight input information,
Attention area determining means for determining attention areas in the plurality of frame images from the line-of-sight input information,
A moving body detecting unit that detects a moving body region corresponding to a moving body in the plurality of frame images;
Tracking means for determining an area based on the moving body area detected by the moving body detection means and the attention area as a main subject area, and for tracking the main subject area,
An image processing apparatus comprising:

The image processing apparatus according to claim 1, further comprising an image pickup unit that generates the image pickup data from a light beam input via a lens.

7. The image processing apparatus according to claim 1, wherein the line-of-sight input means includes a sensor that detects the line-of-sight direction of the user at a constant cycle.

The image processing apparatus according to claim 7, wherein the line-of-sight input means converts the coordinates on the sensor obtained from the sensor into coordinates on the imaging data and acquires the information as the line-of-sight input information.

9. The line-of-sight input means starts acquisition of the line-of-sight input information in response to a change to a mode requiring the line-of-sight input information. The image processing device according to 1.

10. The image processing apparatus according to claim 1, wherein a plurality of pieces of the line-of-sight input information acquired by the line-of-sight input unit are stored in a RAM.

An acquisition step of acquiring a plurality of frame images based on the imaging data,
A line-of-sight input step of acquiring line-of-sight input information,
An attention area determining step of determining attention areas in the plurality of frame images from the line-of-sight input information,
A moving body detecting step of detecting a moving body region corresponding to a moving body in the plurality of frame images;
A display control step of displaying the frame image, the attention area in the frame image, and the moving body area in the frame image on a display unit;
A method for controlling an image processing apparatus, comprising:

An acquisition step of acquiring a plurality of frame images based on the imaging data,
A line-of-sight input step of acquiring line-of-sight input information,
An attention area determining step of determining attention areas in the plurality of frame images from the line-of-sight input information,
A moving body detecting step of detecting a moving body region corresponding to a moving body in the plurality of frame images;
A tracking step of determining an area based on the moving body area and the attention area detected in the moving body detection step as a main subject area, and tracking the main subject area,
A method for controlling an image processing apparatus, comprising: