JP2008193514A5 - - Google Patents
Download PDFInfo
- Publication number
- JP2008193514A5 JP2008193514A5 JP2007027134A JP2007027134A JP2008193514A5 JP 2008193514 A5 JP2008193514 A5 JP 2008193514A5 JP 2007027134 A JP2007027134 A JP 2007027134A JP 2007027134 A JP2007027134 A JP 2007027134A JP 2008193514 A5 JP2008193514 A5 JP 2008193514A5
- Authority
- JP
- Japan
- Prior art keywords
- image
- subject
- unit
- acquired
- acquiring
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 claims 25
- 238000000034 method Methods 0.000 claims 11
- 238000001514 detection method Methods 0.000 claims 3
- 230000000007 visual effect Effects 0.000 claims 3
- 239000011159 matrix material Substances 0.000 claims 1
Claims (6)
前記撮像素子により取り込まれた前記被写体の画像から、視覚で得られる前記被写体の視覚情報を含めて前記被写体の形状を表した第1の画像を取得する第1の画像取得部と、
前記撮像素子により取り込まれた前記被写体の画像から、当該撮像素子から前記被写体までの距離情報を含めて前記被写体の形状を表した第2の画像を取得する第2の画像取得部と、
前記撮像素子が撮像を行う毎に、前記第1の画像取得部が取得した前記第1の画像と前記第2の画像取得部が取得した第2の画像とを記憶する記憶部と、
前記撮像素子が撮像を行う毎に、前記第1の画像取得部が取得した前記第1の画像又は前記第2の画像取得部が取得した第2の画像に基づいて前記被写体の位置の変化を検出する位置変化検出部と、
前記位置変化検出部が前記被写体の位置の変化を検出したとき、前記被写体を追尾して、特定の制御を行うための追従領域を移動させる追従領域移動部と、を備え、
前記位置変化検出部は、前記記憶部に記憶された前記第1の画像と前記第1の画像取得部が新たに取得した前記第1の画像とを比較するとともに、前記記憶部に記憶された前記第2の画像と前記第2の画像取得部が新たに取得した前記第2の画像とを比較することにより、いずれか一方の比較結果に基づいて前記被写体の位置の変化を検出する、
ことを特徴とする撮像装置。 An image sensor that repeatedly images a subject;
A first image acquisition unit that acquires a first image representing the shape of the subject including visual information of the subject obtained visually from the image of the subject captured by the imaging device;
A second image acquisition unit that acquires, from the image of the subject captured by the imaging device, a second image that represents the shape of the subject including distance information from the imaging device to the subject;
A storage unit that stores the first image acquired by the first image acquisition unit and the second image acquired by the second image acquisition unit each time the imaging element performs imaging,
Each time the image sensor performs imaging, the position of the subject is changed based on the first image acquired by the first image acquisition unit or the second image acquired by the second image acquisition unit. A position change detection unit to detect;
When the position change detecting unit detects a change in position of the object, by tracking the subject, e Bei and a follow-up region movement section that moves the tracking area for specific control,
The position change detection unit compares the first image stored in the storage unit with the first image newly acquired by the first image acquisition unit, and is stored in the storage unit. Detecting a change in the position of the subject based on one of the comparison results by comparing the second image and the second image newly acquired by the second image acquisition unit;
An imaging apparatus characterized by that.
前記撮像素子が撮像を行う毎に、前記記憶部に記憶された前記第2の画像と前記第2の画像取得部が新たに取得した前記第2の画像とを用いて、それぞれの前記第2の画像の画像領域を複数の小領域に区分し、区分された各小領域のエントロピーを取得することにより、それぞれの前記第2の画像に含まれる前記被写体の位置関係を解析して、前記被写体の位置の変化を検出する、
ことを特徴とする請求項1に記載の撮像装置。 The position change detection unit acquires the first image or the second image and the first image acquisition unit or the second image acquisition stored in the storage unit every time the image sensor performs imaging. When the object is compared with a newly acquired image and another object crossing the front and rear of the object is detected, the object included in the first image stored in the storage unit and the first image wherein by comparing the object obtaining unit is included in the newly acquired first image, it detects a change in the position of the object,
Each time the image pickup device picks up an image, the second image stored in the storage unit and the second image newly acquired by the second image acquisition unit are used. The image area of the image is divided into a plurality of small areas, and the entropy of each of the divided small areas is obtained, thereby analyzing the positional relationship of the subject included in each of the second images, and the subject Detect changes in the position of
The imaging apparatus according to claim 1 .
前記第1の画像を取得するように複数の前記第1の画素部を駆動する第1の素子駆動部と、
前記第2の画像を取得するように複数の前記第2の画素部を駆動する第2の素子駆動部と、を備えた、
ことを特徴とする請求項1又は2に記載の撮像装置。 The image sensor receives light reflected by the subject, and includes a first pixel unit for acquiring the first image and a second pixel unit for acquiring the second image. As the pixel unit, a plurality of pixel units are arranged in a matrix of i rows × j columns (i, j; natural numbers) .
A first element driving unit that drives the plurality of first pixel units so as to acquire the first image;
A second element driving unit that drives the plurality of second pixel units so as to acquire the second image.
The imaging apparatus according to claim 1 or 2 , wherein
前記第1の素子駆動部は、前記色成分毎に前記複数の受光部を駆動するものである、
ことを特徴とする請求項3に記載の撮像装置。 Each of the first pixel units includes a plurality of light receiving units that receive the light reflected by the subject for each color component to generate a signal charge, and output the signal charge generated for each color component. ,
The first element driving unit drives the plurality of light receiving units for each of the color components.
The imaging apparatus according to claim 3 .
前記撮像素子が撮像を行う毎に取りこまれた画像から、視覚で得られる前記被写体の視覚情報を含めて前記被写体の形状を表した第1の画像を取得するステップと、
前記撮像素子が撮像を行う毎に取りこまれた画像から、当該撮像素子から前記被写体までの距離情報を含めて前記被写体の形状を表した第2の画像を取得するステップと、
前記撮像素子が撮像を行う毎に、前記第1の画像を取得するステップで取得した前記第1の画像と前記第2の画像を取得するステップで取得した第2の画像とを記憶部に記憶するステップと、
前記撮像素子が撮像を行う毎に取得した前記第1の画像又は前記第2の画像に基づいて前記被写体の位置の変化を検出するステップと、
前記被写体の位置の変化を検出したとき、前記被写体を追尾するように設定された、特定の制御を行うための追従領域を移動させるステップと、を有し、
前記位置の変化を検出するステップは、前記記憶部に記憶された前記第1の画像と前記第1の画像を取得するステップで新たに取得した前記第1の画像とを比較するとともに、前記記憶部に記憶された前記第2の画像と前記第2の画像を取得するステップで新たに取得した前記第2の画像とを比較することにより、いずれか一方の比較結果に基づいて前記被写体の位置の変化を検出する、
ことを特徴とする撮像装置の被写体追従方法。 Causing the image sensor to repeatedly image the subject;
Obtaining a first image representing the shape of the subject including visual information of the subject obtained visually from an image captured each time the image sensor performs imaging;
Obtaining a second image representing the shape of the subject, including distance information from the imaging device to the subject, from an image captured each time the imaging device performs imaging;
Each time the image sensor performs imaging, the storage unit stores the first image acquired in the step of acquiring the first image and the second image acquired in the step of acquiring the second image. And steps to
Detecting a change in the position of the subject based on the first image or the second image acquired each time the image sensor performs imaging;
Moving a tracking area for performing specific control, which is set to track the subject when detecting a change in the position of the subject ,
The step of detecting the change in the position compares the first image stored in the storage unit with the first image newly acquired in the step of acquiring the first image, and By comparing the second image stored in the section and the second image newly acquired in the step of acquiring the second image, the position of the subject is determined based on one of the comparison results. Detect changes in the
An object tracking method for an imaging apparatus.
撮像素子に被写体を繰り返し撮像させる手順、
前記撮像素子が撮像を行う毎に取りこまれた画像から、視覚で得られる前記被写体の視覚情報を含めて前記被写体の形状を表した第1の画像を取得する手順、
前記撮像素子が撮像を行う毎に取りこまれた画像から、当該撮像素子から前記被写体までの距離情報を含めて前記被写体の形状を表した第2の画像を取得する手順、
前記撮像素子が撮像を行う毎に、前記第1の画像を取得する手順で取得した前記第1の画像と前記第2の画像を取得する手順で取得した前記第2の画像とを記憶部に記憶する手順、
前記撮像素子が撮像を行う毎に取得した前記第1の画像又は前記第2の画像に基づいて前記被写体の位置の変化を検出する手順、
前記被写体の位置の変化を検出したとき、前記被写体を追尾するように設定された、特定の制御を行うための追従領域を移動させる手順、
を実行させ、
前記位置の変化を検出する手順は、前記記憶部に記憶された前記第1の画像と前記第1の画像を取得する手順で新たに取得した前記第1の画像とを比較するとともに、前記記憶部に記憶された前記第2の画像と前記第2の画像を取得する手順で新たに取得した前記第2の画像とを比較することにより、いずれか一方の比較結果に基づいて前記被写体の位置の変化を検出する、
ことを特徴とするプログラム。 On the computer,
A procedure for repeatedly imaging a subject with an image sensor;
A procedure for acquiring a first image representing the shape of the subject including visual information of the subject obtained visually from an image captured each time the image sensor performs imaging,
A procedure for acquiring a second image representing the shape of the subject including distance information from the imaging device to the subject from an image captured each time the imaging device performs imaging;
Each time the image sensor performs imaging, the storage unit stores the first image acquired in the procedure of acquiring the first image and the second image acquired in the procedure of acquiring the second image. Procedure to remember,
A procedure for detecting a change in the position of the subject based on the first image or the second image acquired each time the image sensor performs imaging ;
A procedure for moving a tracking area for performing specific control, which is set to track the subject when detecting a change in the position of the subject;
Was executed,
The procedure for detecting the change in the position compares the first image stored in the storage unit with the first image newly acquired in the procedure for acquiring the first image, and the storage By comparing the second image stored in the unit and the second image newly acquired in the procedure for acquiring the second image, the position of the subject based on one of the comparison results Detect changes in the
A program characterized by that .
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007027134A JP5092434B2 (en) | 2007-02-06 | 2007-02-06 | IMAGING DEVICE, SUBJECT FOLLOWING METHOD, AND PROGRAM |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007027134A JP5092434B2 (en) | 2007-02-06 | 2007-02-06 | IMAGING DEVICE, SUBJECT FOLLOWING METHOD, AND PROGRAM |
Publications (3)
Publication Number | Publication Date |
---|---|
JP2008193514A JP2008193514A (en) | 2008-08-21 |
JP2008193514A5 true JP2008193514A5 (en) | 2010-03-18 |
JP5092434B2 JP5092434B2 (en) | 2012-12-05 |
Family
ID=39753153
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2007027134A Expired - Fee Related JP5092434B2 (en) | 2007-02-06 | 2007-02-06 | IMAGING DEVICE, SUBJECT FOLLOWING METHOD, AND PROGRAM |
Country Status (1)
Country | Link |
---|---|
JP (1) | JP5092434B2 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5219697B2 (en) * | 2008-08-25 | 2013-06-26 | キヤノン株式会社 | Image processing apparatus, imaging apparatus, control method for image processing apparatus, and program |
JP5482148B2 (en) | 2009-11-26 | 2014-04-23 | 富士通セミコンダクター株式会社 | Autofocus adjustment circuit and imaging apparatus |
JP2013186293A (en) * | 2012-03-08 | 2013-09-19 | Seiko Epson Corp | Image generation device and image display method |
JP6989819B2 (en) * | 2017-08-10 | 2022-01-12 | 富士通株式会社 | Data correction device, data correction method, and data correction program |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH01245777A (en) * | 1988-03-28 | 1989-09-29 | Matsushita Electric Ind Co Ltd | Tracking device for mobile body |
JP4259418B2 (en) * | 2004-07-30 | 2009-04-30 | パナソニック電工株式会社 | Image processing device |
-
2007
- 2007-02-06 JP JP2007027134A patent/JP5092434B2/en not_active Expired - Fee Related
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP2005242567A5 (en) | ||
WO2009016924A1 (en) | Three-dimensional shape measuring device, three-dimensional shape measuring method, three-dimensional shape measuring program, and recording medium | |
JP2009296030A5 (en) | ||
JP2010056692A5 (en) | ||
JP2011027724A5 (en) | ||
EP2128868A3 (en) | Image pickup apparatus, image pickup method, playback control apparatus, playback control method, and program | |
JP2014241577A5 (en) | ||
EP2081374A3 (en) | Imaging apparatus and its control method | |
CN106919895B (en) | Tracking method and system for moving object | |
JP2010055266A5 (en) | ||
JP6240016B2 (en) | Tracking device and tracking system | |
JP2008026789A5 (en) | ||
JP6521626B2 (en) | Object tracking device, method and program | |
JP2018205648A5 (en) | ||
JP2006140886A5 (en) | ||
JP2016090911A5 (en) | ||
EP3261331A3 (en) | Dual mode image sensor and method of using same | |
JP2013218177A5 (en) | ||
JP2008193514A5 (en) | ||
WO2017123824A1 (en) | Through-focus image combination | |
WO2008132741A2 (en) | Apparatus and method for tracking human objects and determining attention metrics | |
JP2012085000A5 (en) | Video playback apparatus and control method thereof, video management apparatus and control method thereof | |
JP2008028951A5 (en) | ||
JP2016038554A5 (en) | Imaging apparatus, control method therefor, and storage medium | |
JP2015175982A5 (en) | Image processing apparatus, imaging apparatus, and program |