JP2008193514A5 - - Google Patents

Download PDF

Info

Publication number
JP2008193514A5
JP2008193514A5 JP2007027134A JP2007027134A JP2008193514A5 JP 2008193514 A5 JP2008193514 A5 JP 2008193514A5 JP 2007027134 A JP2007027134 A JP 2007027134A JP 2007027134 A JP2007027134 A JP 2007027134A JP 2008193514 A5 JP2008193514 A5 JP 2008193514A5
Authority
JP
Japan
Prior art keywords
image
subject
unit
acquired
acquiring
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2007027134A
Other languages
Japanese (ja)
Other versions
JP2008193514A (en
JP5092434B2 (en
Filing date
Publication date
Application filed filed Critical
Priority to JP2007027134A priority Critical patent/JP5092434B2/en
Priority claimed from JP2007027134A external-priority patent/JP5092434B2/en
Publication of JP2008193514A publication Critical patent/JP2008193514A/en
Publication of JP2008193514A5 publication Critical patent/JP2008193514A5/ja
Application granted granted Critical
Publication of JP5092434B2 publication Critical patent/JP5092434B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Claims (6)

被写体を繰り返し撮像する撮像素子と、
前記撮像素子により取り込まれた前記被写体の画像から、視覚で得られる前記被写体の視覚情報を含めて前記被写体の形状を表した第1の画像を取得する第1の画像取得部と、
前記撮像素子により取り込まれた前記被写体の画像から、当該撮像素子から前記被写体までの距離情報を含めて前記被写体の形状を表した第2の画像を取得する第2の画像取得部と、
前記撮像素子が撮像を行う毎に、前記第1の画像取得部が取得した前記第1の画像と前記第2の画像取得部が取得した第2の画像とを記憶する記憶部と、
前記撮像素子が撮像を行う毎に、前記第1の画像取得部が取得した前記第1の画像又は前記第2の画像取得部が取得した第2の画像に基づいて前記被写体の位置の変化を検出する位置変化検出部と、
前記位置変化検出部が前記被写体の位置の変化を検出したとき、前記被写体を追尾して、特定の制御を行うための追従領域を移動させる追従領域移動部と、を備え、
前記位置変化検出部は、前記記憶部に記憶された前記第1の画像と前記第1の画像取得部が新たに取得した前記第1の画像とを比較するとともに、前記記憶部に記憶された前記第2の画像と前記第2の画像取得部が新たに取得した前記第2の画像とを比較することにより、いずれか一方の比較結果に基づいて前記被写体の位置の変化を検出する、
ことを特徴とする撮像装置。
An image sensor that repeatedly images a subject;
A first image acquisition unit that acquires a first image representing the shape of the subject including visual information of the subject obtained visually from the image of the subject captured by the imaging device;
A second image acquisition unit that acquires, from the image of the subject captured by the imaging device, a second image that represents the shape of the subject including distance information from the imaging device to the subject;
A storage unit that stores the first image acquired by the first image acquisition unit and the second image acquired by the second image acquisition unit each time the imaging element performs imaging,
Each time the image sensor performs imaging, the position of the subject is changed based on the first image acquired by the first image acquisition unit or the second image acquired by the second image acquisition unit. A position change detection unit to detect;
When the position change detecting unit detects a change in position of the object, by tracking the subject, e Bei and a follow-up region movement section that moves the tracking area for specific control,
The position change detection unit compares the first image stored in the storage unit with the first image newly acquired by the first image acquisition unit, and is stored in the storage unit. Detecting a change in the position of the subject based on one of the comparison results by comparing the second image and the second image newly acquired by the second image acquisition unit;
An imaging apparatus characterized by that.
前記位置変化検出部は、前記撮像素子が撮像を行う毎に、前記記憶部に記憶された前記第1の画像又は前記第2の画像と前記第1の画像取得部又は前記第2の画像取得部が新たに取得した画像とを比較して、前記被写体の前後を横切る他の物体を検出した場合、前記記憶部に記憶された前記第1の画像に含まれる前記被写体と前記第1の画像取得部が新たに取得した前記第1の画像に含まれる前記被写体とを比較して、前記被写体の位置の変化を検出し、
前記撮像素子が撮像を行う毎に、前記記憶部に記憶された前記第2の画像と前記第2の画像取得部が新たに取得した前記第2の画像とを用いて、それぞれの前記第2の画像の画像領域を複数の小領域に区分し、区分された各小領域のエントロピーを取得することにより、それぞれの前記第2の画像に含まれる前記被写体の位置関係を解析して、前記被写体の位置の変化を検出する、
ことを特徴とする請求項に記載の撮像装置。
The position change detection unit acquires the first image or the second image and the first image acquisition unit or the second image acquisition stored in the storage unit every time the image sensor performs imaging. When the object is compared with a newly acquired image and another object crossing the front and rear of the object is detected, the object included in the first image stored in the storage unit and the first image wherein by comparing the object obtaining unit is included in the newly acquired first image, it detects a change in the position of the object,
Each time the image pickup device picks up an image, the second image stored in the storage unit and the second image newly acquired by the second image acquisition unit are used. The image area of the image is divided into a plurality of small areas, and the entropy of each of the divided small areas is obtained, thereby analyzing the positional relationship of the subject included in each of the second images, and the subject Detect changes in the position of
The imaging apparatus according to claim 1 .
前記撮像素子は、前記被写体で反射した光を受光して、前記第1の画像を取得するための第1の画素部と前記第2の画像を取得するための第2の画素部とを1画素ユニットとして、複数の画素ユニットをi行×j列(i,j;自然数)に行列配置て構成されたものであり、
前記第1の画像を取得するように複数の前記第1の画素部を駆動する第1の素子駆動部と、
前記第2の画像を取得するように複数の前記第2の画素部を駆動する第2の素子駆動部と、を備えた、
ことを特徴とする請求項1又は2に記載の撮像装置。
The image sensor receives light reflected by the subject, and includes a first pixel unit for acquiring the first image and a second pixel unit for acquiring the second image. As the pixel unit, a plurality of pixel units are arranged in a matrix of i rows × j columns (i, j; natural numbers) .
A first element driving unit that drives the plurality of first pixel units so as to acquire the first image;
A second element driving unit that drives the plurality of second pixel units so as to acquire the second image.
The imaging apparatus according to claim 1 or 2 , wherein
前記各第1の画素部は、それぞれ、前記被写体で反射した光を色成分毎に受光して信号電荷を発生させ、前記色成分毎に発生した前記信号電荷を出力する複数の受光部からなり、
前記第1の素子駆動部は、前記色成分毎に前記複数の受光部を駆動するものである、
ことを特徴とする請求項に記載の撮像装置。
Each of the first pixel units includes a plurality of light receiving units that receive the light reflected by the subject for each color component to generate a signal charge, and output the signal charge generated for each color component. ,
The first element driving unit drives the plurality of light receiving units for each of the color components.
The imaging apparatus according to claim 3 .
撮像素子に被写体を繰り返し撮像させるステップと、
前記撮像素子が撮像を行う毎に取りこまれた画像から、視覚で得られる前記被写体の視覚情報を含めて前記被写体の形状を表した第1の画像を取得するステップと、
前記撮像素子が撮像を行う毎に取りこまれた画像から、当該撮像素子から前記被写体までの距離情報を含めて前記被写体の形状を表した第2の画像を取得するステップと、
前記撮像素子が撮像を行う毎に、前記第1の画像を取得するステップで取得した前記第1の画像と前記第2の画像を取得するステップで取得した第2の画像とを記憶部に記憶するステップと、
前記撮像素子が撮像を行う毎に取得した前記第1の画像又は前記第2の画像に基づいて前記被写体の位置の変化を検出するステップと、
前記被写体の位置の変化を検出したとき、前記被写体を追尾するように設定された、特定の制御を行うための追従領域を移動させるステップと、を有し、
前記位置の変化を検出するステップは、前記記憶部に記憶された前記第1の画像と前記第1の画像を取得するステップで新たに取得した前記第1の画像とを比較するとともに、前記記憶部に記憶された前記第2の画像と前記第2の画像を取得するステップで新たに取得した前記第2の画像とを比較することにより、いずれか一方の比較結果に基づいて前記被写体の位置の変化を検出する、
ことを特徴とする撮像装置の被写体追従方法。
Causing the image sensor to repeatedly image the subject;
Obtaining a first image representing the shape of the subject including visual information of the subject obtained visually from an image captured each time the image sensor performs imaging;
Obtaining a second image representing the shape of the subject, including distance information from the imaging device to the subject, from an image captured each time the imaging device performs imaging;
Each time the image sensor performs imaging, the storage unit stores the first image acquired in the step of acquiring the first image and the second image acquired in the step of acquiring the second image. And steps to
Detecting a change in the position of the subject based on the first image or the second image acquired each time the image sensor performs imaging;
Moving a tracking area for performing specific control, which is set to track the subject when detecting a change in the position of the subject ,
The step of detecting the change in the position compares the first image stored in the storage unit with the first image newly acquired in the step of acquiring the first image, and By comparing the second image stored in the section and the second image newly acquired in the step of acquiring the second image, the position of the subject is determined based on one of the comparison results. Detect changes in the
An object tracking method for an imaging apparatus.
コンピュータに、
撮像素子に被写体を繰り返し撮像させる手順、
前記撮像素子が撮像を行う毎に取りこまれた画像から、視覚で得られる前記被写体の視覚情報を含めて前記被写体の形状を表した第1の画像を取得する手順、
前記撮像素子が撮像を行う毎に取りこまれた画像から、当該撮像素子から前記被写体までの距離情報を含めて前記被写体の形状を表した第2の画像を取得する手順、
前記撮像素子が撮像を行う毎に、前記第1の画像を取得する手順で取得した前記第1の画像と前記第2の画像を取得する手順で取得した前記第2の画像とを記憶部に記憶する手順、
前記撮像素子が撮像を行う毎に取得した前記第1の画像又は前記第2の画像に基づいて前記被写体の位置の変化を検出する手順、
前記被写体の位置の変化を検出したとき、前記被写体を追尾するように設定された、特定の制御を行うための追従領域を移動させる手順、
を実行させ
前記位置の変化を検出する手順は、前記記憶部に記憶された前記第1の画像と前記第1の画像を取得する手順で新たに取得した前記第1の画像とを比較するとともに、前記記憶部に記憶された前記第2の画像と前記第2の画像を取得する手順で新たに取得した前記第2の画像とを比較することにより、いずれか一方の比較結果に基づいて前記被写体の位置の変化を検出する、
ことを特徴とするプログラム。
On the computer,
A procedure for repeatedly imaging a subject with an image sensor;
A procedure for acquiring a first image representing the shape of the subject including visual information of the subject obtained visually from an image captured each time the image sensor performs imaging,
A procedure for acquiring a second image representing the shape of the subject including distance information from the imaging device to the subject from an image captured each time the imaging device performs imaging;
Each time the image sensor performs imaging, the storage unit stores the first image acquired in the procedure of acquiring the first image and the second image acquired in the procedure of acquiring the second image. Procedure to remember,
A procedure for detecting a change in the position of the subject based on the first image or the second image acquired each time the image sensor performs imaging ;
A procedure for moving a tracking area for performing specific control, which is set to track the subject when detecting a change in the position of the subject;
Was executed,
The procedure for detecting the change in the position compares the first image stored in the storage unit with the first image newly acquired in the procedure for acquiring the first image, and the storage By comparing the second image stored in the unit and the second image newly acquired in the procedure for acquiring the second image, the position of the subject based on one of the comparison results Detect changes in the
A program characterized by that .
JP2007027134A 2007-02-06 2007-02-06 IMAGING DEVICE, SUBJECT FOLLOWING METHOD, AND PROGRAM Expired - Fee Related JP5092434B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2007027134A JP5092434B2 (en) 2007-02-06 2007-02-06 IMAGING DEVICE, SUBJECT FOLLOWING METHOD, AND PROGRAM

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2007027134A JP5092434B2 (en) 2007-02-06 2007-02-06 IMAGING DEVICE, SUBJECT FOLLOWING METHOD, AND PROGRAM

Publications (3)

Publication Number Publication Date
JP2008193514A JP2008193514A (en) 2008-08-21
JP2008193514A5 true JP2008193514A5 (en) 2010-03-18
JP5092434B2 JP5092434B2 (en) 2012-12-05

Family

ID=39753153

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2007027134A Expired - Fee Related JP5092434B2 (en) 2007-02-06 2007-02-06 IMAGING DEVICE, SUBJECT FOLLOWING METHOD, AND PROGRAM

Country Status (1)

Country Link
JP (1) JP5092434B2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5219697B2 (en) * 2008-08-25 2013-06-26 キヤノン株式会社 Image processing apparatus, imaging apparatus, control method for image processing apparatus, and program
JP5482148B2 (en) 2009-11-26 2014-04-23 富士通セミコンダクター株式会社 Autofocus adjustment circuit and imaging apparatus
JP2013186293A (en) * 2012-03-08 2013-09-19 Seiko Epson Corp Image generation device and image display method
JP6989819B2 (en) * 2017-08-10 2022-01-12 富士通株式会社 Data correction device, data correction method, and data correction program

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH01245777A (en) * 1988-03-28 1989-09-29 Matsushita Electric Ind Co Ltd Tracking device for mobile body
JP4259418B2 (en) * 2004-07-30 2009-04-30 パナソニック電工株式会社 Image processing device

Similar Documents

Publication Publication Date Title
JP2005242567A5 (en)
WO2009016924A1 (en) Three-dimensional shape measuring device, three-dimensional shape measuring method, three-dimensional shape measuring program, and recording medium
JP2009296030A5 (en)
JP2010056692A5 (en)
JP2011027724A5 (en)
EP2128868A3 (en) Image pickup apparatus, image pickup method, playback control apparatus, playback control method, and program
JP2014241577A5 (en)
EP2081374A3 (en) Imaging apparatus and its control method
CN106919895B (en) Tracking method and system for moving object
JP2010055266A5 (en)
JP6240016B2 (en) Tracking device and tracking system
JP2008026789A5 (en)
JP6521626B2 (en) Object tracking device, method and program
JP2018205648A5 (en)
JP2006140886A5 (en)
JP2016090911A5 (en)
EP3261331A3 (en) Dual mode image sensor and method of using same
JP2013218177A5 (en)
JP2008193514A5 (en)
WO2017123824A1 (en) Through-focus image combination
WO2008132741A2 (en) Apparatus and method for tracking human objects and determining attention metrics
JP2012085000A5 (en) Video playback apparatus and control method thereof, video management apparatus and control method thereof
JP2008028951A5 (en)
JP2016038554A5 (en) Imaging apparatus, control method therefor, and storage medium
JP2015175982A5 (en) Image processing apparatus, imaging apparatus, and program