JP2019083008A5 - - Google Patents

Download PDF

Info

Publication number
JP2019083008A5
JP2019083008A5 JP2018197847A JP2018197847A JP2019083008A5 JP 2019083008 A5 JP2019083008 A5 JP 2019083008A5 JP 2018197847 A JP2018197847 A JP 2018197847A JP 2018197847 A JP2018197847 A JP 2018197847A JP 2019083008 A5 JP2019083008 A5 JP 2019083008A5
Authority
JP
Japan
Prior art keywords
reflection characteristic
characteristic data
image processing
reflection
input image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2018197847A
Other languages
Japanese (ja)
Other versions
JP2019083008A (en
JP7169841B2 (en
Filing date
Publication date
Application filed filed Critical
Priority to US16/170,203 priority Critical patent/US11037279B2/en
Publication of JP2019083008A publication Critical patent/JP2019083008A/en
Publication of JP2019083008A5 publication Critical patent/JP2019083008A5/ja
Application granted granted Critical
Publication of JP7169841B2 publication Critical patent/JP7169841B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Description

上記課題を解決するために、本発明は、入力画像に仮想光源の効果を付加する前に、前記入力画像に含まれる所定の被写体における第1の仮想光源の反射特性を示す第1の反射特性データと、前記所定の被写体における第2の仮想光源の反射特性を示す第2の反射特性データとを合成する合成処理を行うことにより、合成反射特性データを取得する合成手段と、前記合成処理により得られた前記合成反射特性データが示す反射特性に基づいて、前記入力画像に含まれる被写体における反射成分を生成する生成手段と、前記入力画像に対して、前記生成手段により生成された前記反射成分を付加する付加手段と、を備えることを特徴とする画像処理装置を提供する。 In order to solve the above problems, the present invention has a first reflection characteristic that shows the reflection characteristic of the first virtual light source in a predetermined subject included in the input image before adding the effect of the virtual light source to the input image. A compositing means for acquiring synthetic reflection characteristic data by performing a compositing process of combining the data and the second reflection characteristic data indicating the reflection characteristic of the second virtual light source in the predetermined subject, and the compositing process. obtained on the basis of the reflection characteristics shown synthesizing reflection characteristic data, and generating means for generating a reflection component in the subject contained in the input image, with respect to the input image, the reflection component generated by the generating means Provided is an image processing apparatus comprising, and an additional means for adding the above.

Claims (13)

入力画像に仮想光源の効果を付加する前に、前記入力画像に含まれる所定の被写体における第1の仮想光源の反射特性を示す第1の反射特性データと、前記所定の被写体における第2の仮想光源の反射特性を示す第2の反射特性データとを合成する合成処理を行うことにより、合成反射特性データを取得する合成手段と、
前記合成処理により得られた前記合成反射特性データが示す反射特性に基づいて、前記入力画像に含まれる被写体における反射成分を生成する生成手段と、
前記入力画像に対して、前記生成手段により生成された前記反射成分を付加する付加手段と、
を備えることを特徴とする画像処理装置。
Before adding the effect of the virtual light source to the input image, the first reflection characteristic data showing the reflection characteristic of the first virtual light source in the predetermined subject included in the input image and the second virtual light in the predetermined subject. A synthesis means for acquiring synthetic reflection characteristic data by performing a synthesis process for synthesizing the second reflection characteristic data indicating the reflection characteristic of the light source.
On the basis of the reflection characteristic indicated by the composite reflector characteristic data obtained by the synthesis process, and generating means for generating a reflection component in the subject contained in the input image,
An additional means for adding the reflection component generated by the generation means to the input image, and
An image processing device characterized by comprising.
前記合成手段は、複数の反射特性データの中から前記第1の反射特性データ及び前記第2の反射特性データを選択する
ことを特徴とする請求項1に記載の画像処理装置。
The image processing apparatus according to claim 1, wherein the synthesizing means selects the first reflection characteristic data and the second reflection characteristic data from a plurality of reflection characteristic data.
補正モードを決定する決定手段を更に備え、
前記合成手段は、前記補正モードに基づいて前記第1の反射特性データ及び前記第2の反射特性データを選択する
ことを特徴とする請求項2に記載の画像処理装置。
Further equipped with a determination means for determining the correction mode,
The image processing apparatus according to claim 2, wherein the synthesizing means selects the first reflection characteristic data and the second reflection characteristic data based on the correction mode.
前記決定手段は、前記入力画像に含まれる前記被写体の輝度に基づいて前記補正モードを決定する
ことを特徴とする請求項3に記載の画像処理装置。
The image processing apparatus according to claim 3, wherein the determination means determines the correction mode based on the brightness of the subject included in the input image.
前記合成手段は、ユーザ指示に従って前記第1の反射特性データ及び前記第2の反射特性データを選択する
ことを特徴とする請求項2に記載の画像処理装置。
The image processing apparatus according to claim 2, wherein the synthesizing means selects the first reflection characteristic data and the second reflection characteristic data according to a user instruction.
前記合成手段は、前記合成処理において、前記第1の反射特性データに第1の係数を乗じ、前記第2の反射特性データに第2の係数を乗じる
ことを特徴とする請求項1乃至5のいずれか1項に記載の画像処理装置。
The synthesis means according to claim 1 to 5, wherein in the synthesis process, the first reflection characteristic data is multiplied by a first coefficient, and the second reflection characteristic data is multiplied by a second coefficient. The image processing apparatus according to any one of the following items.
前記合成手段は、前記入力画像に含まれる前記被写体の輝度に基づいて前記第1の係数及び前記第2の係数を決定する
ことを特徴とする請求項6に記載の画像処理装置。
The image processing apparatus according to claim 6, wherein the synthesizing means determines the first coefficient and the second coefficient based on the brightness of the subject included in the input image.
前記所定の被写体と前記入力画像に含まれる前記被写体との形状の相違を補償するように前記合成反射特性データを補正する補正手段を更に備え、
前記生成手段は、前記補正がなされた前記合成反射特性データに基づいて前記反射成分を生成する
ことを特徴とする請求項1乃至7のいずれか1項に記載の画像処理装置。
Further provided with a correction means for correcting the synthetic reflection characteristic data so as to compensate for the difference in shape between the predetermined subject and the subject included in the input image.
The image processing apparatus according to any one of claims 1 to 7, wherein the generation means generates the reflection component based on the corrected synthetic reflection characteristic data.
前記合成反射特性データは、前記所定の被写体の各位置における反射特性を表現する反射特性画像を含み、
前記補正手段は、前記所定の被写体と前記入力画像に含まれる前記被写体との形状の相違を補償するように、前記反射特性画像を幾何学変換する
ことを特徴とする請求項8に記載の画像処理装置。
The composite reflection characteristic data includes a reflection characteristic image expressing the reflection characteristics at each position of the predetermined subject.
The image according to claim 8, wherein the correction means geometrically transforms the reflection characteristic image so as to compensate for the difference in shape between the predetermined subject and the subject included in the input image. Processing equipment.
前記補正手段は更に、前記入力画像に基づいて前記反射特性画像に対して平滑化処理を行う
ことを特徴とする請求項9に記載の画像処理装置。
The image processing apparatus according to claim 9, wherein the correction means further performs a smoothing process on the reflection characteristic image based on the input image.
請求項1乃至10のいずれか1項に記載の画像処理装置と、
前記入力画像を生成する撮像手段と、
を備えることを特徴とする撮像装置。
The image processing apparatus according to any one of claims 1 to 10.
An imaging means for generating the input image and
An imaging device characterized by being provided with.
画像処理装置が実行する画像処理方法であって、
入力画像に仮想光源の効果を付加する前に、前記入力画像に含まれる所定の被写体における第1の仮想光源の反射特性を示す第1の反射特性データと、前記所定の被写体における第2の仮想光源の反射特性を示す第2の反射特性データとを合成する合成処理を行うことにより、合成反射特性データを取得する合成工程と、
前記合成処理により得られた前記合成反射特性データが示す反射特性に基づいて、前記入力画像に含まれる被写体における反射成分を生成する生成工程と、
前記入力画像に対して、前記生成工程により生成された前記反射成分を付加する付加工程と、
を備えることを特徴とする画像処理方法。
An image processing method executed by an image processing device.
Before adding the effect of the virtual light source to the input image, the first reflection characteristic data showing the reflection characteristic of the first virtual light source in the predetermined subject included in the input image and the second virtual light in the predetermined subject. A synthesis process for acquiring synthetic reflection characteristic data by performing a synthesis process for synthesizing the second reflection characteristic data indicating the reflection characteristics of the light source, and
On the basis of the reflection characteristic indicated by the composite reflector characteristic data obtained by the synthesis process, a generation step of generating a reflection component in the subject contained in the input image,
An addition step of adding the reflection component generated by the generation step to the input image, and an addition step.
An image processing method characterized by comprising.
コンピュータを、請求項1乃至10のいずれか1項に記載の画像処理装置の各手段として機能させるためのプログラム。 A program for making a computer function as each means of the image processing apparatus according to any one of claims 1 to 10.
JP2018197847A 2017-10-31 2018-10-19 IMAGE PROCESSING DEVICE, IMAGING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM Active JP7169841B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/170,203 US11037279B2 (en) 2017-10-31 2018-10-25 Image processing apparatus, image capturing apparatus, image processing method, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017211209 2017-10-31
JP2017211209 2017-10-31

Publications (3)

Publication Number Publication Date
JP2019083008A JP2019083008A (en) 2019-05-30
JP2019083008A5 true JP2019083008A5 (en) 2021-11-25
JP7169841B2 JP7169841B2 (en) 2022-11-11

Family

ID=66670459

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018197847A Active JP7169841B2 (en) 2017-10-31 2018-10-19 IMAGE PROCESSING DEVICE, IMAGING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM

Country Status (1)

Country Link
JP (1) JP7169841B2 (en)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015166684A1 (en) * 2014-04-30 2015-11-05 ソニー株式会社 Image processing apparatus and image processing method
JP2016213718A (en) * 2015-05-11 2016-12-15 キヤノン株式会社 Image processing apparatus, image processing method, program, and storage medium
JP6700840B2 (en) * 2016-02-18 2020-05-27 キヤノン株式会社 Image processing device, imaging device, control method, and program

Similar Documents

Publication Publication Date Title
JP2012054827A5 (en) Image processing apparatus, image processing method, and storage medium
JP2017026992A5 (en)
JP6182056B2 (en) Image processing device
JP6611576B2 (en) Image processing apparatus and image processing method
JP2016045240A5 (en)
JP2017102245A5 (en)
JP2018005542A5 (en)
JP2007158824A (en) Image processor, flesh tone adjusting method, and program
JP2015043495A5 (en)
JP6869652B2 (en) Image processing device, imaging device, image processing method, image processing program, and storage medium
JP2017116420A5 (en)
JP2019512188A5 (en)
JP2016173477A5 (en)
JP2020077165A5 (en)
JP6486055B2 (en) Imaging apparatus, control method therefor, and program
JP2020527989A5 (en)
US10565687B2 (en) Image processing apparatus, imaging apparatus, image processing method, image processing program, and recording medium
JP2016076908A5 (en)
JP2020087005A5 (en)
JP2019083008A5 (en)
JP2013128212A5 (en)
JP2013179485A5 (en) Image processing apparatus and image processing method
JP2011254262A5 (en)
JP2016119542A5 (en)
JP2015207841A5 (en)