JP5550325B2 - Image processing apparatus and image processing method - Google Patents
Image processing apparatus and image processing method Download PDFInfo
- Publication number
- JP5550325B2 JP5550325B2 JP2009287029A JP2009287029A JP5550325B2 JP 5550325 B2 JP5550325 B2 JP 5550325B2 JP 2009287029 A JP2009287029 A JP 2009287029A JP 2009287029 A JP2009287029 A JP 2009287029A JP 5550325 B2 JP5550325 B2 JP 5550325B2
- Authority
- JP
- Japan
- Prior art keywords
- correction amount
- subject
- correction
- unit
- image processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
- 238000012545 processing Methods 0.000 title claims description 41
- 238000003672 processing method Methods 0.000 title claims description 5
- 238000012937 correction Methods 0.000 claims description 124
- 230000004075 alteration Effects 0.000 claims description 23
- 230000009467 reduction Effects 0.000 claims description 15
- 238000003384 imaging method Methods 0.000 claims description 13
- 238000000034 method Methods 0.000 claims description 5
- 230000008859 change Effects 0.000 claims description 2
- 230000003287 optical effect Effects 0.000 description 14
- 238000001514 detection method Methods 0.000 description 8
- 210000000887 face Anatomy 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000011946 reduction process Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000002040 relaxant effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Landscapes
- Image Processing (AREA)
- Studio Devices (AREA)
Description
本発明は、画像処理装置及び画像処理方法に関する。 The present invention relates to an image processing apparatus and an image processing method.
デジタルカメラや内視鏡などの撮像装置において、立体を平面に投射する際に広角側で像の歪みが発生することは知られており、この歪みは広角歪みと呼ばれている。例えば、広角レンズで集合写真を撮像する場合、横長の画面の横方向の端部の人物が横に拡がったり、画面の四隅の顔や身体が対角方向に伸びたりする。 In imaging devices such as digital cameras and endoscopes, it is known that image distortion occurs on the wide-angle side when a solid is projected onto a plane, and this distortion is called wide-angle distortion. For example, when a group photo is taken with a wide-angle lens, a person at the end in the horizontal direction of the horizontally long screen spreads horizontally, and the face and body at the four corners of the screen extend diagonally.
従来技術としては、特許文献１及び２がある。 As conventional techniques, there are Patent Documents 1 and 2.
パースペクティブ（遠近感）を強調する目的で広角歪みを積極的に使用するユーザもいるが、広範囲又は多くの人物を撮影するという目的で広角レンズを使用するユーザにとっては広角歪みを低減すべき需要がある。しかしながら、広角歪みを除去するための効果的な方法は提案されていなかった。 Some users actively use wide-angle distortion for the purpose of emphasizing perspective, but there is a demand for users who use wide-angle lenses to photograph a wide range or many people to reduce wide-angle distortion. is there. However, an effective method for removing wide-angle distortion has not been proposed.
本発明は、広角歪みを低減することが可能な画像処理装置及び画像処理方法を提供することを例示的な目的とする。 An object of the present invention is to provide an image processing apparatus and an image processing method capable of reducing wide-angle distortion.
本発明の画像処理装置は、画像処理によって撮影された被写体の画像の歪曲収差を補正する補正部と、軸外の位置にある前記被写体の特定領域に前記補正部が与える前記歪曲収差の補正量を、前記軸外の位置に前記被写体の特定領域がない場合に前記軸外の位置に前記補正部が与える前記歪曲収差の補正量よりも小さく、かつ、前記被写体の特定領域の周囲で連続的に変化するように小さくする補正量低減部と、を有することを特徴とする。
An image processing apparatus according to the present invention includes a correction unit that corrects distortion of an image of a subject captured by image processing, and a correction amount of the distortion that the correction unit applies to a specific area of the subject that is located off-axis. , said of the distortion and the correction unit to a position outside the shaft in the absence of specific regions of the off-axis of the object at the position gives the correction amount smaller than and continuously around the specific region of the subject And a correction amount reducing unit that reduces the value so as to change .
本発明によれば、広角歪みを低減することが可能な画像処理装置及び画像処理方法を提供することができることができる。 According to the present invention, it is possible to provide an image processing apparatus and an image processing method capable of reducing wide-angle distortion.
図１は、本実施例の撮像装置（画像処理装置）の一例であるデジタルカメラのブロック図である。撮像装置は、撮像光学系１、撮像素子２、画像処理部３、特定領域検出部４、位置情報取得部５、システム制御部６、入力部７、オートフォーカス（ＡＦ）部８、電子ビューファインダー（ＥＶＦ）部９を有する。 FIG. 1 is a block diagram of a digital camera which is an example of an imaging apparatus (image processing apparatus) according to the present embodiment. The imaging apparatus includes an imaging optical system 1, an imaging element 2, an image processing unit 3, a specific area detection unit 4, a position information acquisition unit 5, a system control unit 6, an input unit 7, an autofocus (AF) unit 8, and an electronic viewfinder. (EVF) part 9 is provided.
撮影光学系１は、３５ｍｍ換算で焦点距離２４ｍｍ又はこれよりも広角の焦点距離を有する単焦点レンズ又はこの範囲をズーム可能なズームレンズの撮影レンズ１ａ、光軸方向に移動可能なフォーカスレンズ、不図示の絞りを有する。撮影光学系１は、光軸を軸とする軸対称の光学系である。 The photographing optical system 1 includes a photographing lens 1a of a single focal lens having a focal length of 24 mm in terms of 35 mm or a wider focal length or a zoom lens capable of zooming this range, a focus lens movable in the optical axis direction, It has the aperture shown. The photographing optical system 1 is an axially symmetric optical system with the optical axis as an axis.
撮影レンズ１ａの歪曲収差量ｄｉｓｔ［％］は、理想像高（歪曲のない状態）ｙ’と実像高ｙにより、ｄｉｓｔ［％］＝｛（ｙ−ｙ’）／ｙ’｝×１００で表される。本実施例の撮影レンズ１ａは、最大像高にて歪曲収差量が１０数％〜３０数％まで残存するように光学設計され、撮影された被写体の画像を画像処理により幾何学的に変形して歪曲収差のない又は少ない画像に変換する。 The distortion aberration amount dist [%] of the photographic lens 1a is expressed by dist [%] = {(y−y ′) / y ′} × 100 according to the ideal image height (state without distortion) y ′ and the real image height y. Is done. The taking lens 1a of the present embodiment is optically designed so that the distortion amount remains at 10% to 30% at the maximum image height, and the photographed subject image is geometrically deformed by image processing. The image is converted to an image with little or no distortion.
このように、撮影レンズ１ａの全ての歪曲収差を光学設計で低減又は除去する代わりに、光学設計の制約を緩和して画像処理によって撮影された被写体の画像の歪曲収差を補正することによって安価で小型の広角レンズ（超広角レンズ）を提供している。 In this way, instead of reducing or removing all distortion aberrations of the photographing lens 1a by optical design, it is inexpensive by correcting the distortion aberration of the image of the subject photographed by image processing by relaxing the constraints of the optical design. We provide small wide-angle lenses (super-wide-angle lenses).
撮影レンズ１ａの焦点距離などの情報はシステム制御部６が予め取得して格納しているか、レンズユニットが着脱可能なカメラであれば不図示のレンズユニットから取得する。 Information such as the focal length of the photographic lens 1a is acquired and stored in advance by the system control unit 6, or from a lens unit (not shown) if the lens unit is a detachable camera.
撮像素子２は、ＣＣＤやＣＭＯＳなどの撮像素子（イメージセンサ）から構成され、撮像光学系１が形成した光学像を光電変換し、電気信号（アナログ画像信号）を出力する。なお、図１では省略されているが、撮像素子２から出力されたアナログ画像信号は、不図示のＡ／Ｄ変換器でデジタル画像信号に変換されて画像処理部３に入力される。 The image sensor 2 is composed of an image sensor (image sensor) such as a CCD or a CMOS, photoelectrically converts an optical image formed by the image pickup optical system 1, and outputs an electrical signal (analog image signal). Although not shown in FIG. 1, the analog image signal output from the image sensor 2 is converted into a digital image signal by an A / D converter (not shown) and input to the image processing unit 3.
広角レンズによって、高い像高にある被写体は像空間に空中像として結像するが、撮像素子２は平面であるため、空中像は撮像素子面に斜めに投影され、画角の１／ｃｏｓ成分の分だけ引き伸ばされる。なお、これはメリディオナル方向の断面であり、サジタル方向の断面においてはこのように引き伸ばされることはない。 An object at a high image height is formed as an aerial image in the image space by the wide-angle lens. However, since the image sensor 2 is a flat surface, the aerial image is projected obliquely on the image sensor surface, and the 1 / cos component of the angle of view. Will be stretched by Note that this is a meridional cross section, and the sagittal cross section is not stretched in this way.
肉眼で認識される物体の大きさは、物体が肉眼に結像する際の全画角である視角によって決定される。視角が同じであれば、遠くの大きな物体と近くの小さな物体は見かけ上同じ大きさに見える。被写体を撮影する時に認識される大きさは撮影時の視角によって決定され、撮影された被写体像を観察する時に認識される大きさは被写体像を観察する視角によって決定される。多くの場合、平面画像における高い像高の同じ被写体を鑑賞する際の視角は、撮影時の視覚と異なる。特に、広角歪みは３５ｍｍ（フィルム）換算で焦点距離２８ｍｍ以下の広角側で問題となる。 The size of the object recognized by the naked eye is determined by the viewing angle, which is the total angle of view when the object forms an image with the naked eye. If the viewing angle is the same, a distant large object and a nearby small object appear to be the same size. The size recognized when shooting the subject is determined by the viewing angle at the time of shooting, and the size recognized when observing the shot subject image is determined by the viewing angle at which the subject image is observed. In many cases, the viewing angle when viewing the same subject with a high image height in a planar image is different from the visual at the time of shooting. In particular, wide-angle distortion becomes a problem on the wide-angle side with a focal length of 28 mm or less in terms of 35 mm (film).
画像処理部３は、システム制御部６によって制御され、撮像素子２が出力する被写体の画像に対応する信号を処理する。具体的には、画像処理部３は、撮像素子２が出力する画像信号から得られるデジタル画像信号に対して、色変換、ホワイトバランス、ガンマ補正等の画像処理、解像度変換処理、画像圧縮処理等を行う。処理された画像は画像処理部３から不図示の記録回路や不図示の表示回路を介してＥＶＦ部９に送られる。 The image processing unit 3 is controlled by the system control unit 6 and processes a signal corresponding to the image of the subject output by the image sensor 2. Specifically, the image processing unit 3 performs image processing such as color conversion, white balance, and gamma correction, resolution conversion processing, image compression processing, and the like on the digital image signal obtained from the image signal output from the image sensor 2. I do. The processed image is sent from the image processing unit 3 to the EVF unit 9 via a recording circuit (not shown) and a display circuit (not shown).
また、画像処理部３は、画像処理によって撮影された被写体の画像の（樽型の）歪曲収差を補正する歪曲補正部３ａを有する。歪曲補正部３ａは、補正量低減部６ａが補正量を低減した場合にはその補正量に従って歪曲補正を行う。 Further, the image processing unit 3 includes a distortion correction unit 3a that corrects (barrel-shaped) distortion aberration of an image of a subject photographed by image processing. When the correction amount reduction unit 6a reduces the correction amount, the distortion correction unit 3a performs distortion correction according to the correction amount.
特定領域検出部４は、被写体の顔や身体などの特定領域を既知のアルゴリズムに従って検出する。本実施例の特定領域検出部４は顔認識部であり、既知のアルゴリズムによって画像中の人物の顔を認識する。 The specific area detection unit 4 detects a specific area such as the face or body of the subject according to a known algorithm. The specific area detection unit 4 of the present embodiment is a face recognition unit, and recognizes the face of a person in the image by a known algorithm.
位置情報取得部５は特定領域検出部４とシステム制御部６に接続され、特定領域検出部４が検出した被写体の特定領域の大きさや像高の情報を取得する。本実施例では、位置情報取得部５は、被写体の顔の大きさや像高の情報を取得する。 The position information acquisition unit 5 is connected to the specific region detection unit 4 and the system control unit 6 and acquires information on the size and image height of the specific region of the subject detected by the specific region detection unit 4. In this embodiment, the position information acquisition unit 5 acquires information on the face size and image height of the subject.
システム制御部６は、ＣＰＵやＭＰＵなどのプロセッサから構成され、撮像装置の各部を制御する。システム制御部６は、歪曲収差を補正する補正量を低減する補正量低減部６ａを含む。 The system control unit 6 includes a processor such as a CPU or MPU, and controls each unit of the imaging apparatus. The system control unit 6 includes a correction amount reducing unit 6a that reduces a correction amount for correcting distortion.
補正量低減部６ａは、軸外の位置に被写体の特定領域がある場合に歪曲補正部３ａが与える歪曲収差の補正量を、軸外の位置に被写体の特定領域がない場合に前記軸外の位置に歪曲補正部３ａが与える補正量（通常の歪曲収差の補正量）よりも小さくする。 The correction amount reducing unit 6a calculates the correction amount of the distortion aberration given by the distortion correcting unit 3a when there is a specific area of the subject at the off-axis position, and the off-axis position when there is no specific area of the subject at the off-axis position. The correction amount is smaller than the correction amount (normal distortion correction amount) given to the position by the distortion correction unit 3a.
より具体的には、本実施例の補正量低減部６ａは、位置情報取得部４からの位置情報とＡＦ部８からの距離情報から被写体の特定領域（本実施例では認識された顔）の撮影距離を取得する。そして、補正量低減部６ａは、近距離で高い像高に被写体の特定領域（本実施例では顔）があると判断した場合に、歪曲補正部３ａによる歪曲収差の補正量を低減する。 More specifically, the correction amount reduction unit 6a of the present embodiment uses the position information from the position information acquisition unit 4 and the distance information from the AF unit 8 to determine the specific area of the subject (the face recognized in this embodiment). Get the shooting distance. The correction amount reducing unit 6a reduces the correction amount of the distortion aberration by the distortion correcting unit 3a when it is determined that there is a specific area (face in this embodiment) of the subject at a high image height at a short distance.
この場合、補正量低減部６ａは３５ｍｍ換算で焦点距離２８ｍｍ以下の広角側で被写体が撮影された場合に歪曲補正部の補正量を小さくしてもよい。この領域で広角歪みの影響が特に大きくなるからである。 In this case, the correction amount reduction unit 6a may reduce the correction amount of the distortion correction unit when the subject is photographed on the wide angle side with a focal length of 28 mm or less in terms of 35 mm. This is because the influence of wide angle distortion becomes particularly large in this region.
複数の顔が同時に検出された場合、補正量低減部６ａは、各顔の像高と撮影距離に応じて補正量を低減する。例えば、補正量低減部６ａは、第１像高を有する被写体の顔に歪曲補正部３ａが与える補正量を、被写体の顔が第１像高よりも小さい第２像高を有する場合の補正量よりも小さくする。また、補正量低減部６ａは、第１撮影距離にある被写体の顔に歪曲補正部３ａが与える補正量を、被写体の顔が第１撮影距離よりも大きい第２撮影距離にある場合の補正量よりも小さくする。 When a plurality of faces are detected simultaneously, the correction amount reducing unit 6a reduces the correction amount according to the image height and shooting distance of each face. For example, the correction amount reduction unit 6a uses the correction amount given by the distortion correction unit 3a to the face of the subject having the first image height, and the correction amount when the subject's face has a second image height smaller than the first image height. Smaller than. Further, the correction amount reducing unit 6a sets the correction amount given by the distortion correcting unit 3a to the face of the subject at the first shooting distance, and the correction amount when the face of the subject is at the second shooting distance larger than the first shooting distance. Smaller than.
顔が画面中心（軸上、低像高）付近にしかない場合や顔がない場合には補正後に画像に残存する歪曲収差量が０又はこれに近くなるように予め設定された通常の歪曲収差の補正を実施する。この場合は、補正量低減部６ａは、歪曲収差の補正量を低減しない。 When the face is only near the center of the screen (on the axis, low image height) or when there is no face, the distortion amount remaining in the image after correction is zero or close to the normal distortion aberration set in advance. Make corrections. In this case, the correction amount reducing unit 6a does not reduce the distortion aberration correction amount.
歪曲収差は画面において光軸を軸として軸対称に生ずる収差である。このため、通常の歪曲収差の補正においては、歪曲補正部３ａは、光軸（画面中心）を軸として画面の動径方向には歪曲収差量に応じて、円周方向においては全方位に等しく座標変換処理を行う。 Distortion is an aberration that occurs symmetrically about the optical axis on the screen. For this reason, in normal correction of distortion, the distortion correction unit 3a uses the optical axis (center of the screen) as an axis in the radial direction of the screen according to the amount of distortion, and is equal in all directions in the circumferential direction. Perform coordinate transformation processing.
一方、顔の像高を最大像高で割った割合が５割（以下、「像高５割」と称する）以上である場合には、補正量低減部６ａは、後述するように、歪曲収差の補正量（補正率）を低減する。このように、本実施例の補正量低減部６ａは、被写体の顔が設定値以上の像高（例えば、像高５割以上）を有する場合に歪曲補正部３ａの補正量を小さくし、被写体の顔が設定値未満の像高（例えば、像高５割未満）である場合には補正量を小さくしない。 On the other hand, when the ratio of the face image height divided by the maximum image height is 50% or more (hereinafter referred to as “image height 50%”) or more, the correction amount reducing unit 6a, as will be described later, The amount of correction (correction rate) is reduced. As described above, the correction amount reduction unit 6a according to the present embodiment reduces the correction amount of the distortion correction unit 3a when the face of the subject has an image height equal to or higher than a set value (for example, the image height is 50% or more). If the face has an image height less than the set value (for example, less than 50% of the image height), the correction amount is not reduced.
歪曲収差の補正前の歪曲収差量をｄｉｓｔ０［％］、歪曲収差の補正後に画像に残存する歪曲収差量をｄｉｓｔ１［％］、歪曲収差の補正率ｄｉｓｔＣＲ［％］とすると、ｄｉｓｔＣＲ［％］＝ｄｉｓｔ１−ｄｉｓｔ０で表される。樽型の歪曲収差の場合、ｄｉｓｔ１［％］＜０であるため、ｄｉｓｔ０［％］＜ｄｉｓｔ１［％］となり、ｄｉｓｔＣＲ［％］＞０となる。歪曲補正率は絶対値が小さいほど歪曲収差を補正しないことを意味し、歪曲収差を除去する場合（ｄｉｓｔ１＝０％のとき）はｄｉｓｔＣＲ［％］＝−ｄｉｓｔ０である。 Assuming that the distortion aberration amount before correction of distortion is dist 0 [%], the distortion aberration amount remaining in the image after correction of distortion is dist 1 [%], and the distortion correction rate distCR [%], distCR [%] = It is represented by dist1-dist0. In the case of barrel distortion, since dist1 [%] <0, dist0 [%] <dist1 [%] and distCR [%]> 0. The distortion correction rate means that the smaller the absolute value is, the more the distortion aberration is not corrected. When the distortion aberration is removed (dist1 = 0%), distCR [%] = − dist0.
入力部７は、各種情報をユーザが入力及び設定可能なスイッチ、ダイアル、ボタンなどを含む。入力部７は、各種の撮影モードを設定する撮影モード設定部７ａと、画像を印刷するサイズ（Ｌ版、２Ｌ版）や画像を出力する表示画面のサイズを設定する鑑賞条件設定部７ｂを有する。 The input unit 7 includes switches, dials, buttons, and the like that allow the user to input and set various types of information. The input unit 7 includes a shooting mode setting unit 7a for setting various shooting modes, and a viewing condition setting unit 7b for setting a size for printing an image (L version, 2L version) and a display screen size for outputting an image. .
撮影モードは、集合写真を撮影するのに適した集合写真モードや背景をぼかして人物を浮かび上がらせるように撮影するためのポートレートモードを含む。また、画像を出力する画面は、パーソナルコンピュータ（ＰＣ）のディスプレイ（又はモニタ）画面や、ＴＶ画面（特に、３２型以上のＴＶ画面）である。 The shooting mode includes a group photo mode suitable for taking a group photo and a portrait mode for shooting so as to make a person appear with a blurred background. The screen for outputting an image is a display (or monitor) screen of a personal computer (PC) or a TV screen (in particular, a TV screen of 32 type or more).
ＡＦ部８は、合焦位置に撮影レンズに含まれる不図示のフォーカスレンズを移動することによって自動焦点調節を行う。焦点検出方法は、コントラスト方式、位相差ＡＦ方式など限定されない。 The AF unit 8 performs automatic focus adjustment by moving a focus lens (not shown) included in the photographing lens to a focus position. The focus detection method is not limited to a contrast method, a phase difference AF method, or the like.
ＥＶＦ部９は、被写体を表示する液晶画面である。 The EVF unit 9 is a liquid crystal screen that displays a subject.
以下、補正量低減部６ａが、画面中の設定された像高に人物の顔を検出した場合に画像全域に等しい補正量低減処理を施す場合について説明する。 Hereinafter, a case will be described in which the correction amount reduction unit 6a performs a correction amount reduction process equal to the entire image area when a human face is detected at the set image height in the screen.
図２の左は、撮影光学系１に含まれる所謂３５ｍｍ換算で焦点距離２４ｍｍの撮影レンズ１ａを使用して軸上の被写体（顔）Ｕと軸外の被写体（顔）Ｖを撮影した場合のメリディオナル方向の断面図である。また、図２の右は、図２の左で撮影された画像を鑑賞する場合を示すメリディオナル方向の断面図である。 The left side of FIG. 2 shows a case where an on-axis subject (face) U and an off-axis subject (face) V are photographed using a so-called 35 mm equivalent focal length of 24 mm included in the photographing optical system 1. It is sectional drawing of a meridional direction. Further, the right side of FIG. 2 is a cross-sectional view in the meridional direction showing a case where the image taken on the left side of FIG. 2 is viewed.
図２の左において、像高８割の位置にある被写体Ｖに対する画角θは概ね３６°である。同じ撮影距離に２人の人物の同じ大きさの顔が画面中心と像高８割において撮影位置から等しい視角ξで撮影されるとする。 On the left in FIG. 2, the angle of view θ with respect to the subject V at an image height of 80% is approximately 36 °. Assume that two persons of the same size at the same shooting distance are shot at the same viewing angle ξ from the shooting position at the center of the screen and an image height of 80%.
撮影レンズ１ａに歪曲収差がない場合、被写体ＵとＶの像空間における空中像はＵ１及びＶ１である。空中像Ｕ１及びＶ１は実質的に像の品質が保たれている焦点深度内の撮像素子２に投影されたＵ２及びＶ２として結像されたものとして入力される。この時、被写体Ｖの像は、画角をθとするとＶ３（Ｖ１／ｃｏｓθ）となって撮影される。 When the photographic lens 1a has no distortion, the aerial images in the image space of the subjects U and V are U1 and V1. The aerial images U1 and V1 are input as images formed as U2 and V2 projected onto the image sensor 2 within the focal depth where the image quality is substantially maintained. At this time, the image of the subject V is taken as V3 (V1 / cos θ), where θ is the angle of view.
撮影レンズ１ａはｄｉｓｔ０＝−２０％の歪曲収差を有し、通常の歪曲収差の補正においては残存する歪曲収差が０％になるように行なう。画像上でｄｉｓｔＣＲ＝−ｄｉｓｔ０の条件で歪曲収差の補正を行うとメリディオナル方向の断面において１／ｃｏｓθ倍された大きさに引き伸ばされた状態で撮像素子上に結像する。 The photographic lens 1a has a distortion of dist0 = −20%, and the normal distortion is corrected so that the remaining distortion becomes 0%. When distortion is corrected on the image under the condition of distCR = −dist0, an image is formed on the image sensor while being stretched to a size multiplied by 1 / cos θ in the cross section in the meridional direction.
画面中心の顔の撮像素子上での大きさをｄとすると、像高８割の人物の顔の撮像素子上での大きさｄ２は、ｄ２＝ｄ／ｃｏｓθ＝ｄ／ｃｏｓ３６°＝１．２４ｄ となる。この画像を図２に示す目Ｐで観察する。この観察条件で被写体Ｖを観察するときの画角をφとすると顔の大きさｄ３はｄ３＝ｄ２・ｃｏｓφ＝１．２４ｄ・ｃｏｓφとなる。 Assuming that the size of the face at the center of the screen on the image sensor is d, the size d2 of the face of a person with an image height of 80% on the image sensor is d2 = d / cos θ = d / cos 36 ° = 1.24d. It becomes. This image is observed with the eyes P shown in FIG. If the angle of view when observing the subject V under this observation condition is φ, the face size d3 is d3 = d2 · cosφ = 1.24d · cosφ.
例えば、画像をＬ版（１２７ｍｍ×８９ｍｍ）に印刷して観察距離ＳをＳ＝３００ｍｍとすると像高８割は６２ｍｍとなり、φ≒１１．７°となるため、ｄ３＝１．２１ｄとなる。 For example, if the image is printed on an L plate (127 mm × 89 mm) and the observation distance S is S = 300 mm, the image height is 80%, which is 62 mm, and φ≈11.7 °, so d3 = 1.21d.
観察条件での画面中心（軸上）の顔に対する視角ηは次式で与えられる。 The viewing angle η with respect to the face at the center of the screen (on the axis) under the viewing conditions is given by the following equation.
像高８割の顔に対する視角εは次式で与えられる。 The viewing angle ε for a face with an image height of 80% is given by the following equation.
この結果、画面中心の人物の顔に対して像高８割の人物の顔はメリディオナル方向に約２０％伸びて見える。ここで、像高８割における歪曲収差が−２０％であるのでｄｉｓｔ０＝−２０％であるが、ｄｉｓｔＣＲ＝０％として歪曲収差の補正を行わない（歪曲ありの）場合、ｄ３はｄと略等しくなり、軸上（画面中心）の人の顔と同じほぼ大きさとなる。このとき、被写体Ｕの視角ηに対して被写体Ｖの視角εはほぼ等しくなる。このため、補正量低減部６ａは歪曲補正部３ａの補正量を０に低減する（補正しないようにする）。 As a result, the face of a person whose image height is 80% appears to extend about 20% in the meridional direction with respect to the face of the person at the center of the screen. Here, since the distortion at the image height of 80% is −20%, dist0 = −20%. However, when the distortion is not corrected (with distortion) with distCR = 0%, d3 is approximately d. It is the same size as the human face on the axis (center of the screen). At this time, the viewing angle ε of the subject V is substantially equal to the viewing angle η of the subject U. Therefore, the correction amount reduction unit 6a reduces the correction amount of the distortion correction unit 3a to 0 (does not correct).
Ｌ版サイズは想定される画像サイズの中で小さいため、撮影時と鑑賞時の視角の差異が大きくなり易い。広範囲を違和感なく撮影しようとするユーザや画像をＬ版〜２Ｌ版プリントで印刷してパーソナルコンピュータ（ＰＣ）のモニタ画面で鑑賞しないユーザにとって観察条件をＬ版に近いものに設定することは広角歪みを除去する上で効果的である。 Since the L size is smaller than the assumed image size, the difference in viewing angle between shooting and viewing tends to be large. It is a wide-angle distortion to set the observation conditions close to the L version for users who want to shoot a wide area without feeling uncomfortable and for users who print images in L to 2L versions and do not view them on the monitor screen of a personal computer (PC). It is effective in removing.
一方、鑑賞条件設定部７ｂがＰＣのモニタ画面（Ａ４サイズ程度）を設定した場合、目Ｐは画像を５００〜６００ｍｍの距離から鑑賞すると仮定すれば、像高８割の位置を見るときの画角は１４〜１６°である。この条件では、Ｌ版プリントの条件に比較して僅かに画角が大きくなって撮影時の条件に近くなるので、補正量低減部６ａは、低減させる補正量を図２よりも少なくし、歪曲補正部３ａが多少補正できるようにする。 On the other hand, when the viewing condition setting unit 7b sets a PC monitor screen (about A4 size), it is assumed that the eye P views the image from a distance of 500 to 600 mm. The angle is 14-16 °. Under these conditions, the angle of view is slightly larger than the conditions for printing on the L plate, and the conditions at the time of shooting are close. Therefore, the correction amount reducing unit 6a reduces the correction amount to be reduced from that in FIG. The correction unit 3a can make some corrections.
本実施例では、撮影時と鑑賞時の被写体Ｕ及びＶの顔の大きさがほぼ一致しているが、鑑賞時に引き伸ばされる分を撮影時の状態に近づけるだけでも効果がある。 In this embodiment, the size of the faces of the subjects U and V at the time of shooting and viewing are almost the same, but it is also effective to bring the stretched size at the time of viewing close to the state at the time of shooting.
被写体の特定領域が設定値未満（例えば、５ｍ未満）の撮影距離を有する場合に補正量を小さくし、被写体の特定領域が設定値以上の撮影距離を有する場合に補正量を小さくしなくてもよい。これは、人物の顔の大きさは決まっているため、撮影距離が大きくなるほど視角と画像上の大きさは小さくなり、撮影時と観察時の差異は目立たなくなるからである。 Even if the specific area of the subject has a shooting distance less than a set value (for example, less than 5 m), the correction amount is reduced, and when the specific area of the subject has a shooting distance greater than the set value, the correction amount is not reduced. Good. This is because the size of a person's face is fixed, and the viewing angle and the size on the image become smaller as the shooting distance increases, and the difference between shooting and observation becomes inconspicuous.
また、顔の像高と撮影距離に応じて歪曲補正率を低減させる量を変更することで広角歪補正の精度を上げることができる。更には、印刷サイズ（Ｌ版、２Ｌ版）に応じて歪曲補正率を低減させる量を変更することで広角歪補正の精度を上げることができる。また、複数の顔が写っている場合には、最も像高の高い顔とその顔までの撮影距離を勘案して歪曲補正率を低減させる量を適宜変更すればよい。 In addition, the accuracy of wide-angle distortion correction can be improved by changing the amount by which the distortion correction rate is reduced according to the image height of the face and the shooting distance. Furthermore, the accuracy of wide-angle distortion correction can be increased by changing the amount by which the distortion correction rate is reduced according to the print size (L plate, 2L plate). In addition, when a plurality of faces are shown, the amount by which the distortion correction rate is reduced may be appropriately changed in consideration of the face with the highest image height and the shooting distance to the face.
更に、画面の所定の像高に顔を検出した場合に画像全域に等しい歪曲補正率の低減処理（広角歪み補正）を実行する代わりに、人物の顔の像高と共に、その位置情報に基づき顔の検出された方位角付近に対してのみ、歪曲補正率の低減処理を実行してもよい。 Further, when a face is detected at a predetermined image height on the screen, instead of executing a distortion correction rate reduction process (wide angle distortion correction) that is equal to the entire image area, the face based on the position information along with the image height of the human face. The distortion correction rate reduction processing may be executed only for the vicinity of the detected azimuth angle.
なお、顔の位置する方位角方向と、顔のない方位角方向との境界領域は連続的に歪曲収差の補正量を変化させ、補正量低減部６ａは歪曲収差の補正量が被写体の顔の周囲で連続的に変化するように補正量を小さくする。また、顔の数が所定の間隔で離れており、上記の境界領域が繰り返される場合には、連続して歪曲補正量の低減を行う。 The boundary region between the azimuth direction where the face is located and the azimuth direction where there is no face continuously changes the correction amount of the distortion aberration, and the correction amount reduction unit 6a sets the correction amount of the distortion aberration of the face of the subject. Reduce the correction amount so that it continuously changes around. Further, when the number of faces is separated by a predetermined interval and the boundary area is repeated, the distortion correction amount is continuously reduced.
顔検出による広角歪補正を自動で行なう代わりに撮影モード設定部７ａは歪曲補正量を低減しないオフモードを設定してもよい。また、撮影モード設定部７ａが集合写真モードやポートレートモードを設定した場合、必ず歪曲収差の補正量を低減するようにしてもよく、この場合、歪曲収差の補正を低減する量は顔の像高と距離の情報を併用して決定すればよい。 Instead of automatically performing wide-angle distortion correction by face detection, the shooting mode setting unit 7a may set an off mode that does not reduce the distortion correction amount. Further, when the photographing mode setting unit 7a sets the group photograph mode or the portrait mode, the correction amount of the distortion aberration may be necessarily reduced. In this case, the amount of the correction of the distortion aberration is the face image. What is necessary is just to determine together using the information of height and distance.
大画面ＴＶでの画像鑑賞では撮影時の条件に近くなる。１６：９の大画面ＴＶの適正視聴距離は画面縦サイズの３倍程度であり、３２〜３７型の場合は１．２〜１．４ｍ、５０型〜６５型では２．０ｍ〜２．４ｍとなる。 When viewing images on a large-screen TV, the conditions for shooting are close. The appropriate viewing distance for a 16: 9 large-screen TV is about three times the screen vertical size, 1.2-1.4 m for 32-37 types, and 2.0 m-2.4 m for 50-65 types. It becomes.
鑑賞条件設定部７ｂが１６：９画面に４：３の画像を表示すると設定したときは、適正視聴距離での像高８割の位置の画角は、約１２．５°であり、Ｌ版プリントの場合と同様の歪曲収差補正の低減を行なえばよい。一方、鑑賞条件設定部７ｂが１６：９画面に１６：９の画像を表示すると設定したときは、適正視聴距離での像高８割の位置の画角は約１５°であり、上述のＰＣモニタ画面でＡ４サイズ程度の画像を鑑賞する場合と同様の歪曲収差補正の低減を行なえばよい。なお、現実の視聴距離は適正視聴距離よりもやや長いことが多いため、図２と同様の処理を行なってもよい。 When the viewing condition setting unit 7b sets to display a 4: 3 image on a 16: 9 screen, the angle of view at an image height of 80% at an appropriate viewing distance is about 12.5 °, and the L version What is necessary is just to reduce distortion correction similar to the case of printing. On the other hand, when the viewing condition setting unit 7b is set to display a 16: 9 image on a 16: 9 screen, the angle of view at an image height of 80% at an appropriate viewing distance is about 15 °. The distortion aberration correction may be reduced in the same manner as when viewing an A4 size image on the monitor screen. Since the actual viewing distance is often slightly longer than the appropriate viewing distance, the same processing as in FIG. 2 may be performed.
補正量低減部６ａはＥＶＦ部９への表示の際に歪曲補正量を低減してもよい。ＥＶＦ画面は小さいので光学歪の低減には効果的であるが、ＥＶＦは最終的な鑑賞手段ではないのでため、図２と同様の処理を行なえばよい。 The correction amount reducing unit 6 a may reduce the distortion correction amount when displaying on the EVF unit 9. Since the EVF screen is small, it is effective in reducing optical distortion. However, since EVF is not the final appreciation means, the same processing as in FIG. 2 may be performed.
撮像装置は、被写体の撮像に適用することができる。 The imaging device can be applied to imaging a subject.
１ａ 撮影レンズ
２ 撮像素子
３ 画像処理部
３ａ 歪曲補正部
４ 特定領域検出部
５ 位置情報取得部
６ システム制御部
６ａ 補正量低減部
７ａ 撮影モード設定部
７ｂ 鑑賞条件設定部
９ 電子ビューファインダー部
DESCRIPTION OF SYMBOLS 1a Shooting lens 2 Imaging element 3 Image processing part 3a Distortion correction part 4 Specific area | region detection part 5 Position information acquisition part 6 System control part 6a Correction amount reduction part 7a Shooting mode setting part 7b Viewing condition setting part 9 Electronic viewfinder part
Claims (9)
軸外の位置にある前記被写体の特定領域に前記補正部が与える前記歪曲収差の補正量を、前記軸外の位置に前記被写体の特定領域がない場合に前記軸外の位置に前記補正部が与える前記歪曲収差の補正量よりも小さく、かつ、前記被写体の特定領域の周囲で連続的に変化するように小さくする補正量低減部と、
を有することを特徴とする画像処理装置。 A correction unit for correcting distortion of an image of a subject photographed by image processing;
The amount of correction of the distortion aberration given to the specific area of the subject at an off-axis position by the correction unit, and the correction section at the off-axis position when the specific area of the subject does not exist at the off-axis position. A correction amount reducing unit that is smaller than a correction amount of the distortion aberration to be given and is small so as to continuously change around a specific region of the subject ;
An image processing apparatus comprising:
前記補正量低減部は前記撮影モード設定部が前記集合写真モードを設定している場合に前記補正部の補正量を小さくすることを特徴とする請求項１〜６のうちいずれか一項に記載の画像処理装置。 It further has a shooting mode setting section that can set the group photo mode,
According to any one of claims 1 to 6 wherein the correction amount reduction unit, characterized in that to reduce the correction amount of the correction unit when the imaging mode setting unit has set the group photograph mode Image processing apparatus.
前記補正量低減部は前記撮影モード設定部が前記ポートレートモードを設定している場合に前記補正部の補正量を小さくすることを特徴とする請求項１〜６のうちいずれか一項に記載の画像処理装置。 It further has a shooting mode setting section that can set the portrait mode,
According to any one of claims 1 to 6 wherein the correction amount reduction unit, characterized in that to reduce the correction amount of the correction unit when the imaging mode setting unit has set the portrait mode Image processing apparatus.
軸外の位置にある前記被写体の特定領域に、画像処理によって前記被写体の画像の歪曲収差を補正する補正部が与える前記歪曲収差の補正量を、前記軸外の位置に前記被写体の特定領域がない場合に前記軸外の位置に前記補正部が与える前記歪曲収差の補正量よりも小さく、かつ、前記被写体の特定領域の周囲で連続的に変化するように小さくすることを特徴とする画像処理方法。 An image processing method for processing a signal corresponding to a photographed subject image,
The correction amount of the distortion given by the correction unit that corrects the distortion of the image of the subject by image processing is applied to the specific region of the subject at the off-axis position, and the specific region of the subject is at the off-axis position. An image processing characterized by being smaller than the correction amount of the distortion aberration given by the correction unit to the off-axis position when there is not , and continuously changing around a specific region of the subject Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009287029A JP5550325B2 (en) | 2009-12-18 | 2009-12-18 | Image processing apparatus and image processing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2009287029A JP5550325B2 (en) | 2009-12-18 | 2009-12-18 | Image processing apparatus and image processing method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2011128913A JP2011128913A (en) | 2011-06-30 |
| JP5550325B2 true JP5550325B2 (en) | 2014-07-16 |
Family
ID=44291444
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2009287029A Expired - Fee Related JP5550325B2 (en) | 2009-12-18 | 2009-12-18 | Image processing apparatus and image processing method |
Country Status (1)
| Country | Link |
|---|---|
| JP (1) | JP5550325B2 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5958082B2 (en) * | 2011-12-28 | 2016-07-27 | 株式会社リコー | Image processing apparatus and image processing method |
| JP5971216B2 (en) * | 2013-09-20 | 2016-08-17 | カシオ計算機株式会社 | Image processing apparatus, image processing method, and program |
| JP6362107B2 (en) * | 2014-09-03 | 2018-07-25 | キヤノン株式会社 | Imaging device |
| JP6032252B2 (en) | 2014-09-09 | 2016-11-24 | カシオ計算機株式会社 | Image correction apparatus, image correction method, and program |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3766308B2 (en) * | 2000-10-18 | 2006-04-12 | 富士写真フイルム株式会社 | Camera and image forming system |
| JP4714174B2 (en) * | 2007-03-27 | 2011-06-29 | 富士フイルム株式会社 | Imaging device |
| JP2009218661A (en) * | 2008-03-07 | 2009-09-24 | Panasonic Corp | Imaging device with image distortion correcting function |
| JP5397751B2 (en) * | 2009-03-19 | 2014-01-22 | 株式会社ニコン | Camera and image correction method |
-
2009
- 2009-12-18 JP JP2009287029A patent/JP5550325B2/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| JP2011128913A (en) | 2011-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11172133B2 (en) | Zoom control device, control method of zoom control device, and recording medium | |
| US8466989B2 (en) | Camera having image correction function, apparatus and image correction method | |
| US9113075B2 (en) | Image processing method and apparatus and digital photographing apparatus using the same | |
| TWI531852B (en) | Device of capturing images and method of digital focusing | |
| WO2017037978A1 (en) | Detection device, detection method, detection program, and imaging device | |
| US9148552B2 (en) | Image processing apparatus, image pickup apparatus, non-transitory storage medium storing image processing program and image processing method | |
| JP2012039591A (en) | Imaging apparatus | |
| JP2011114487A (en) | Imaging apparatus | |
| JP5550325B2 (en) | Image processing apparatus and image processing method | |
| JP2014235224A (en) | Imaging device and control program | |
| US20070002463A1 (en) | Image capturing apparatus | |
| CN105472263B (en) | Image acquisition method and the image capture equipment for using the method | |
| US9025072B2 (en) | Camera module and method for adjusting focus of lens in camera module | |
| JP6516426B2 (en) | Image pickup apparatus, image processing method and program | |
| CN104270571B (en) | Image processing method and electronic equipment | |
| JP5393877B2 (en) | Imaging device and integrated circuit | |
| JP2015095857A (en) | Imaging apparatus | |
| JP2009218661A (en) | Imaging device with image distortion correcting function | |
| WO2013031564A1 (en) | Optical system and imaging device | |
| JP2014179937A (en) | Imaging apparatus, imaging method and imaging program | |
| JP7271316B2 (en) | Imaging device and its control method | |
| JP2012063716A (en) | Hybrid finder device, imaging apparatus, hybrid finder control method | |
| JP5281904B2 (en) | Viewfinder system and imaging apparatus having the same | |
| JP2010117487A (en) | Autofocus system | |
| JP2018037768A (en) | Subject detection apparatus, angular speed calculation apparatus, imaging apparatus, and lens apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20121205 |
|
| A977 | Report on retrieval |
Free format text: JAPANESE INTERMEDIATE CODE: A971007 Effective date: 20130829 |
|
| A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20130910 |
|
| TRDD | Decision of grant or rejection written | ||
| A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20140422 |
|
| A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20140520 |
|
| R151 | Written notification of patent or utility model registration |
Ref document number: 5550325 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R151 |
|
| LAPS | Cancellation because of no payment of annual fees |