CN100525389C - Signal processing apparatus and signal processing method - Google Patents

Signal processing apparatus and signal processing method Download PDF

Info

Publication number
CN100525389C
CN100525389C CN 200710101005 CN200710101005A CN100525389C CN 100525389 C CN100525389 C CN 100525389C CN 200710101005 CN200710101005 CN 200710101005 CN 200710101005 A CN200710101005 A CN 200710101005A CN 100525389 C CN100525389 C CN 100525389C
Authority
CN
Grant status
Grant
Patent type
Prior art keywords
unit
image signal
image
signal
sensor
Prior art date
Application number
CN 200710101005
Other languages
Chinese (zh)
Other versions
CN101047788A (en )
Inventor
近藤哲二郎
Original Assignee
索尼株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Grant date

Links

Abstract

一种信号处理单元使从一种采用CMOS传感器等的三-传感器系统的传感器单元输出的第一图像信号经受信号处理,从而获得高图像质量的第二图像信号。 A signal from one processing unit causes the CMOS sensor using a three - to signal processing unit outputs a first sensor signal of an image sensor system, thereby obtaining a second image signal of high image quality. 三个传感器被放置在适于信号处理单元进行信号处理的位置上。 Three sensors are placed at a position adapted to the signal processing unit performs signal processing on. 适合的放置位置已经通过预先执行的学习而获得。 Suitable placement has been obtained by learning performed in advance. 在一种安排中,信号处理单元评估第二图像信号,并根据评估结果来控制三个传感器的放置位置。 In one arrangement, the signal processing unit evaluates the second image signal, and controls the three sensor placement based on the evaluation. 在另一种安排中,第一信号在预定区域中被评估,并且根据评估结果改变预定区域的传感器的特性。 In another arrangement, the first signal is evaluated in a predetermined region, and to change the characteristics of the sensor area according to a predetermined evaluation result. 在另一种安排中,传感器单元根据第一图像信号的级别分布来控制。 In another arrangement, the sensor unit is controlled according to the level distribution of the first image signal. 本发明可被应用到静态或视频数字照相机中。 The present invention may be applied to a digital still or video camera.

Description

信号处理设备和信号处理方法 Signal processing device and signal processing method

本申请是2004年7月30日提交的申请号为200410095944.8、发 This application is No. 2004, July 30 filed 200,410,095,944.8, hair

明名称为"信号处理设备和信号处理方法,程序和记录介质,,的发明申请的分案申请。 Ming divisional application entitled "signal processing device and signal processing method, program and recording medium of the present invention ,, the application.

技术领域 FIELD

本发明涉及一种信号处理设备和一种信号处理方法,以及一种程序和它的记录介质,尤其涉及一种图像拾取设备, 一种信号处理设备和信号处理方法,以及一种程序和它的记录介质,藉此例如为图像信号的信号处理获得适当的图像信号,并且图像信号受信号处理的控制, 从而产生高质量图像信号。 The present invention relates to a signal processing device and a signal processing method, and a program and a recording medium which, in particular, relates to an image pickup apparatus, a signal processing device and signal processing method, and a program and its recording medium, whereby a signal is obtained, for example, an image signal processing appropriate image signal and the image signal processed by the control signal, to produce a high quality image signal.

背景技术 Background technique

图像拾取设备的一个实例是数字照相机(静态的或视频),其具有传感器装置(或成像装置),诸如CCD (电荷耦合器件)或CMOS (互补金属氧化物半导体)成像器(亦称为"CMOS传感器"),例如它们接收物体光(来自物体的光)并输出与所接收的光量相对应的图像信号。 One example of the image pickup apparatus is a digital camera (still or video), having a sensor device (or imaging apparatus), such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) imager (also referred to as "CMOS sensor "), for example, they receive the object light (light from an object) and outputs the received amount of light corresponding to the image signal. 传感器装置充当一种这样的传感器,即通过感测来自物体的光并对其执行光电变换而以电信号的形式输出对应于该物体光的图像信号。 One such sensor device acts as a sensor, i.e., the light from the object by sensing and performs photoelectric conversion to output light corresponding to the image signal of the object as an electrical signal. ,

例如,使用传感器装置的方式有许多种,诸如单-传感器系统和三-传感器系统。 For example, using a sensor device There are many ways, such as single - and three sensor system - the sensor system. 对于单-传感器系统而言,滤色器传导R(红)、 G (绿)和B (蓝)光,例如以称为拜尔矩阵(Bayer array)的模式排列的光学滤光器,并且R、 G或B光之一被投射入传感像素。 For single - in terms of the sensor system, conducting filter of R (red), G (green) and B (blue) light, for example in a matrix pattern called the Bayer (Bayer array) of the optical filter arrangement, and R , G or B light is projected one of the sensing pixels. 因此, 传感器的每一个像素接收R、 G或B之一的光,并且为一个像素输出具有R、 G或B之一的信号分量的图像信号。 Accordingly, each image signal of the pixel light receiving R, G, or one of B, and signal components R, G or B of one pixel of a sensor output. 由此,对于单-传感器系统而言,构成从传感器获得的图像的每一个像素都只具有R、 G或B的一个信号分量,因此随后对每个像素不具有的信号分量执行内插。 Thus, for a single - in terms of sensor systems, each of the pixels constituting the image obtained from a sensor having only one signal component R, G or B, so then performing interpolation on the signal component of each pixel does not have. 例如,注意到一个像素只包含R信号(分量),通过一个邻近的只具有G信号的像素和一个邻近的只具有B信号的像素来预测所关心的像素的G信号和B信号(例如,请参看,公开号为2002-135797的日本未审查专利申请)。 Pixels G and B signals and the pixel signal B has only one adjacent to the predicted interest e.g., a noted pixel includes only the R signal (component), by having only one neighboring G signal (e.g., please See, Publication No. 2002-135797 Japanese Unexamined Patent application).

此外,还有称为插值算法(demosaic)的信号处理,其中将从单一CCD获得的只具有R、 G或B信号之一的像素转换为具有所有R、 G和B信号的像素(例如,参见国际公开No.00/49812)。 In addition, there called interpolation algorithm (a demosaic) signal processing, in which only a pixel conversion from R, G or B signals of one single CCD having obtained all the pixels R, G and B signals (e.g., see, international Publication No.00 / 49812).

另一方面,对于三-传感器系统而言,该传感器装置配置有三个传感器,每一个用于R、 G和B,因此R传感器接收R光,G传感器接收G光,而B传感器接收B光,以致输出每个像素都具有R信号、 G信号和B信号三个分量的图像信号。 On the other hand, for a three - in terms of the sensor system, the sensor device is configured with three sensors, one for each of R, G and B, the sensor receives R R light, G light reception sensor G, and B light receiving sensor B, such that the output of each pixel has an R signal, image signal G and B signals of the three components.

此刻,对于具有三-传感器系统的图像拾取设备而言,请注意某一光线,该所关心的光线通过一个棱镜被分成R、 G和B光,从而R 传感器接收R光,G传感器接收G光,而B传感器接收B光。 At the moment, for a three - in terms of the image pickup device sensor system, note that a light, the light of interest is divided into R, G and B light through a prism, so that the sensor R receives the R light, G light sensor receives G , B and B light receiving sensor. 因此, 用于R、 G和B的每个传感器被置于光学上等效(相同)的位置上, 以便在用于每个R、 G和B的每个传感器上的相同位置处接收所关心光线的R、 G和B光。 Thus, each sensor for R, G and B are placed on the optical equivalent (same) position, so as to receive interest at the same position on each sensor for each of R, G and B light R, G and B light. 请注意,已经提出在图像拾取设备中如此放置G传感器,即,使其相对于R传感器和B传感器偏移1/2像素,以便获得在垂直方向上提高了分辨率的图像信号(例如,请参看,专利申请号为08-256345的日本未审查专利申请)。 Note that the G sensor is placed so it has been proposed in the image pickup apparatus, i.e., so that with respect to the R and B sensors offset 1/2 pixel sensors, increasing the resolution so as to obtain an image signal in the vertical direction (e.g., please See, Patent application No. 08-256345 of unexamined Japanese Patent application).

此外,对于普通设备来说,像电荷耦合器件(以下简称为"CCD") 或互补金属氧化物半导体(CMOS)成像器(以下简称为"CMOS传感器",或',CMOS")这样的感测装置的输出被放大,以获得适当级别(level)的图像信号。 Further, for the conventional apparatus, the sensed such as a charge coupled device (hereinafter referred to as "the CCD") or complementary metal oxide semiconductor (CMOS) imager (hereinafter referred to as "CMOS sensor", or ', CMOS ") the output device is amplified to obtain an appropriate level (level) of image signals.

传感器装置的输出由诸如AGC (自动增益控制器)此类的放大器放大。 Sensor output amplified by the AGC amplifier means (automatic gain controller), such as a class. 然而,在物体的对比度很大的情况下,可能存在使用信号放大器难于获得适当的图像信号级别的情形。 However, in case a large contrast object, there may be difficult to obtain a signal amplifier using appropriate circumstances and an image signal level. 因此,公开号为06-086155的日本未审查专利申请公开了一种方法,其通过使用具有不同增益的两个放大器放大传感器装置的输出,从而轻易地放大一个宽的动态范围。 Thus, Publication No. 06-086155 Japanese Unexamined Patent Application discloses a method which amplifies output of the sensor device by using the two amplifiers having different gains, thereby readily amplifying a wide dynamic range.

现在,传感器装置的后续过程中,通常执行信号处理以便改善传感器装置输出的图像信号的图像质量。 Now, the subsequent process of the sensor device, the signal processing is generally performed in order to improve the image quality of the image signal output from the sensor means. 也就是说,传感器装置(成像 That is, the sensor device (imaging

装置)的CCD或CMOS传感器接收入射光(在预定的曝光时间期间, 对应于像素的范围之内的物体光),并输出对应于所接收光量的图像信号。 Device) CCD or CMOS sensor receiving incident light (at a predetermined time during the exposure, the light corresponding to the object within the scope of the pixels), and outputs an image corresponding to the light amount of the received signal. 因此,可以说传感器好像是在预定的曝光时间期间内,对与像素相对应的范围内的持续光进行时间序列或空间序列采样,并且输出作为图像信号(像素值)的采样结果。 Thus, it can be said if the sensor is within a predetermined exposure time period, the light of the continuous range corresponding to the pixel of the time or spatial sequence sampling sequence, and outputs the sampling result as an image signal (pixel values).

在这种方式下,传感器装置输出的图像信号是时间序列和空间序列持续光的采样结果,这意味着将丟失包含在原始光中的一部分信息。 In this manner, the image signal output from the sensor means is a sampling result of continuous time series and spatial sequence of the light, which means that part of the information contained in the lost of the original light. 因此,与原始光相比较而言,传感器装置输出的图像信号在图像质量(即信息量)方面将有所衰减。 Therefore, the light with the original comparison, the image signal output from the sensor means in the image quality (i.e., information) aspects will be attenuated. 这就是为什么要在传感器装置的后续过程中要执行信号处理,以提高与原始光相比较而言其图像质量已衰减了的图像信号的图像质量。 This is why the signal processing to be performed in a subsequent process of the sensor device, the light to improve image quality compared to the original image in terms of its quality has attenuated image signal.

目前,对于通常配置而言,传感器装置被制造为不对后续过程中执行的信号处理给予任何考虑,并且其输出图像信号的操作也不对后续过程中执行的信号处理给予任何考虑。 Currently, for a typical configuration, the sensor device is manufactured as a signal processing performed in a subsequent process does not give any consideration, and an image signal output operation does not give any consideration to the signal processing performed in a subsequent process. 因此,传感器装置具有与后续过程中中执行的信号处理无关的属性,即传感器装置没有考虑后续过程中执行的信号处理。 Thus, independent of the sensor device has a signal processing performed in a subsequent process properties, i.e., without considering the sensor signal processing means during a subsequent execution. 如此,不仅使得传感器装置具有与后续过程中执行的信号处理的无关的属性,而且也使得以统一的方式输出图像信号,这意味着通过在传感器装置的后续过程中执行信号处理所能改善的图像质量的程度是有限的。 Thus, not only the sensor device has such properties independent of the signal processing performed in a subsequent process, but also in a uniform manner so that an output image signal, which means that in a subsequent process by means of the sensor signal processing can be performed to improve image the degree of quality is limited.

相反地,如果传感器装置能够输出适于在后续过程中执行信号处理的图像信号,那么通过信号处理可以获得更高图像质量的图像信号。 Conversely, if the sensor means can output an image adapted to perform signal processing in the subsequent process, it is possible to obtain a higher quality image signal by the image signal processing.

发明内容 SUMMARY

根据上述观点而提出本发明,并且由此,本发明的一个目的是获得适于信号处理的图像信号并执行图像信号的信号处理,藉此能够获得高质量图像信号。 The present invention is proposed view of the above, and thus, an object of the present invention is to obtain an image signal suitable for signal processing and performing signal processing of the image signal, whereby a high quality image signal can be obtained.

根据本发明第一个方面, 一种信号处理设备包括:传感器装置, 用于感测信息并输出与该信息相对应的信号;以及信号处理装置,用于使传感器装置输出的信号经受信号处理;其中该传感器装置被设置成与信号处理相对应的属性。 According to a first aspect of the present invention, a signal processing apparatus comprising: a sensor means for sensing and outputting information corresponding to the information signal; and a signal processing means, means for outputting the sensor signal to signal processing; wherein the sensor device is arranged to process the signal corresponding to the attribute.

一种相应于本发明笫一个方面的信号处理方法,包括:获取步骤, 用于感测信息并获取由传感器装置输出与该信息相对应的信号;以及信号处理步骤,使传感器装置输出的信号经受信号处理;其中传感器装置被设置成与信号处理相对应的属性。 Zi to a corresponding one aspect of the present invention to a signal processing method comprising: an acquisition step of sensing the information acquisition means and the output of the sensor corresponding to the information signal; and a signal processing step of causing the output signal of the sensor means is subjected to the signal processing; wherein the sensor means is arranged to process the signal attributes corresponding.

一种相应于本发明第一个方面的计算机可读程序,包括:获取步骤代码,该步骤用于感测信息,并获取由传感器装置输出的与该信息相对应的信号;以及信号处理步骤代码,该步骤用于使传感器装置输出的信号经受信号处理;其中传感器装置被设置成与信号处理相对应的属性。 To a corresponding to a first aspect of the present invention, a computer-readable program comprising: an acquisition step of codes, the step of sensing information, and acquires the signal output by the sensor means corresponding to the information; and a signal processing step Code the signal output step for causing the sensor to signal processing; wherein the sensor means is arranged to process the signal corresponding to the attribute.

一种相应于本发明第一个方面的记录介质存储有计算机可读程序,其中该程序包括:获取步骤代码,该步骤用于感测信息,并获取由传感器装置输出的与该信息相对应的信号;以及信号处理步骤代码, 该步骤用于使传感器装置输出的信号经受信号处理;其中传感器装置被设置成与信号处理相对应的属性。 To a corresponding to the first aspect of the present invention, a recording medium storing a computer readable program, wherein the program comprises: code for acquiring step, the step of sensing information, and acquires the output of the sensor means with the information corresponding to signal; and a signal processing step code means for causing the step of outputting the sensor signal to signal processing; wherein the sensor means is arranged to process the signal corresponding to the attribute.

使用根据本发明第一个方面的信号处理设备、信号处理方法、程序和相应的记录介质,在感测信息并输出与该信息相对应的信号的传感器装置所输出的信号上执行信号处理。 Use, performs signal processing on the signal and outputting sensing information of the sensor unit of the information corresponding to the signal outputted from the signal processing apparatus according to a first aspect of the present invention, a signal processing method, a program, and the corresponding recording medium. 在该情况下,传感器装置被设置成与信号处理相对应的属性。 In this case, the sensor device is provided as an attribute corresponding to the signal processing.

根据本发明第二个方面, 一种信号处理设备包括:传感器装置, 具有至少一个用于感测光并输出与该光相对应的图像信号的第一分量的第一传感器,和用于输出该图像信号的第二分量的第二传感器;以及信号处理装置,使从传感器装置的输出中获得的第一数字图像信号经受信号处理并输出第二数字图像;其中通过预先执行的学习,将第一和第二传感器设置在与信号处理相对应的放置状态。 According to a second aspect of the present invention, a signal processing apparatus comprising: sensor means having at least a first sensor for sensing light and outputting a first component corresponding to the optical image signal, and for outputting the the second component of the image sensor of the second signal; and a signal processing means, the first digital image signal obtained from the output of the sensor is subjected to signal processing apparatus and outputs a second digital image; wherein by learning performed in advance, the first and a second sensor disposed in the signal processing corresponding to the placement state.

一种相应于本发明第二个方面的信号处理方法,包括:获取步骤, 用于获取由具有至少感测光并输出与该光相对应的图像信号的第一分量的第一传感器和输出该图像信号的笫二分量的第二传感器的传感器装置输出的图像信号;和信号处理步骤,用于使从传感器装置的输出中获得的第一数字图像信号经受信号处理,并输出第二数字图像信号; 其中通过预先执行的学习,将笫一和笫二传感器设置在与信号处理相对应的放置状态。 To a corresponding signal processing method of the second aspect of the present invention, comprising: an acquisition step for acquiring a sense of having at least a first component and outputting a photometric light corresponding to the image signal output of the first sensor and an image signal output from the second sensor means undertaking of two sensor component of the image signal; and a signal processing step for the first digital image signal obtained from the output of the sensor device is subjected to signal processing, and outputs the second digital image signal ; wherein by learning performed in advance, and the Zi Zi second sensor disposed at the signal processing corresponding to the placement state.

一种相应于本发明第二方面的计算机可读程序,包括:获取步骤代码,用于获得由具有至少感测光并输出与该光相对应的图像信号的第一分量的第一传感器和输出该图像信号的笫二分量的第二传感器的传感器装置输出的图像信号,和信号处理步骤代码,用于使从传感器装置的输出中获得的第一数字图像信号经受信号处理,并输出第二数字图像信号;其中通过预先执行的学习,将第一和第二传感器设置在与信号处理相对应的放置状态上。 To a corresponding second aspect of the computer-readable program of the present invention, comprising: a step of acquiring the code, for obtaining a sense of having at least a first component and outputting a photometric light corresponding to the image signal output of the first sensor and an image signal output from the sensor means of the second sensor undertaking of the two-component image signal, and a signal processing step of codes for causing the first digital image signal obtained from the output of the sensor device is subjected to signal processing, and outputs the second digital the image signal; by learning performed in advance, the first and second sensors disposed in the signal processing corresponding to the placement state.

一种相应于本发明第二方面的记录介质存储了一种计算机可读程序,其中该程序包括:获取步骤代码,用于获得由具有至少感测光并输出与该光相对应的图像信号的第一分量的第一传感器和输出该图像信号的第二分量的第二传感器的传感器装置输出的图像信号;以及信 One kind corresponding to the second aspect of the present invention, a recording medium storing a computer readable program, wherein the program comprising: an acquisition step of codes for obtaining an image signal corresponding to the light having at least sensing and metering outputs of a first sensor and a second output image signal components of the first component of the image signal output from the second sensor means sensor; and the letter

号处理步骤代码,用于使从传感器装置的输出中获得的第一数字图像信号经受信号处理,并输出第二数字图像信号;其中通过预先执行的学习将第一和第二传感器设置在与信号处理相对应的放置状态上。 The processing step number of codes for the first digital image signal obtained from the output of the sensor device is subjected to signal processing, and outputs the second digital image signal; by learning performed in advance of the first and second sensors disposed in the signal placed on the processing corresponding to the state. 对于根据本发明第二方面的信号处理设备和信号处理方法、程序 For the signal processing device and the second aspect of the present invention, a signal processing method, a program

和相应于该程序的记录介质,所述信号处理是在第一数字图像信号上执行的,藉此输出笫二数字图像信号,其中第一数字图像信号是从具有至少一个感测光并输出与该光相对应的图像信号的第一分量的第一传感器和输出该图像信号的第二分量的第二传感器的传感器装置的输出获得的。 And a recording medium corresponding to the program, the signal processing is performed on the first digital image signal, whereby the output of second digital image signal Zi, wherein the first digital image signal and output from the sensing light and having at least one the first component of the first optical sensor corresponding to the image signal output device and the second sensor output of the second sensor component of the image signal is obtained. 在这种情况下,通过预先执行的学习,第一和第二传感器-皮放置在与信号处理相对应的放置状态上。 In this case, by learning performed in advance, the first and second sensor - the skin is placed on the signal processing corresponding to the placement state. 根据本发明的第三方面, 一种信号处理设备包括:信号处理装置, 用于使从感测信息并输出与该信息相对应的信号的传感器装置输出的 According to a third aspect of the present invention, a signal processing apparatus comprising: signal processing means, means for outputting sensing information from and outputs information corresponding to the signal of the sensor

信号经受信号处理;控制装置,用于控制传感器装置的属性;评估装置,用于评估有关具有由控制装置所控制的属性的传感器装置的输出进行信号处理的结果;以及确定装置,用于根据评估装置的评估结果确定与该信号处理相对应的传感器装置的属性,并输出该属性的信息。 Signal to signal processing; and a control means for controlling the properties of the sensor means; evaluation means for evaluating the result of performing signal processing relating to the output of the sensor means having attributes controlled by the control means; and determining means for evaluation evaluation results of the attribute determining means processing the sensor means corresponding to the signal, and outputs the attribute information. 一种相应于本发明第三方面的信号处理方法,包括:信号处理步骤,用于使从感测信息并输出与该信息相对应的信号的传感器装置输出的信号经受信号处理;控制步骤,用于控制传感器装置的属性;评估步骤,用于评估有关对具有在控制步骤中所控制的属性的传感器装置的输出进行信号处理的结杲;以及,确定步骤,用于根据评估步骤的评估结果确定与信号处理相对应的传感器装置的属性,并输出该属性的信息。 To a corresponding to a third aspect of the present invention, a signal processing method, comprising: a signal processing step for subjecting the information signal and the sensed signal processing means outputs an output signal corresponding to the information from the sensor; control step, with sensor means for controlling an attribute; evaluating step for evaluating junction Gao related processing on the output signal of the sensor device in the control step has a property controlled; and, determining step for determining the result of evaluation of the evaluating step attribute corresponding to the sensor signal processing apparatus, and outputs information of the attribute.

一种相应于本发明第三方面的计算机可读程序,包括:信号处理步骤代码,使从感测信息并输出与该信息相对应的信号的传感器装置输出的信号经受信号处理的信号处理;控制步骤代码,用于控制传感器装置的属性;评估步骤代码,用于评估有关对具有在控制步骤中所控制的属性的传感器装置的输出进行信号处理的结果;以及,确定步骤代码,用于根据代码的评估结果确定与信号处理相对应的传感器装置的属性,并输出该属性的信息。 To a corresponding to a third aspect of the present invention, a computer-readable program comprising: a signal processing step codes the signal processing to signal processing and signal sensing information output means outputs the information corresponding to a signal from the sensor; Control step codes for controlling the properties of the sensor means; evaluation step of codes for performing signal processing relating to the evaluation result of the output of the sensor means having attributes controlled control step; and the step of determining the code, according to the code the evaluation results to determine the properties of the sensor means corresponding to the signal processing, and outputs the attribute information.

一种相应于本发明第三方面的记录介质存储了一种计算机可读程序,其中该程序包括:信号处理步骤代码,用于使从感测信息并输出与该信息相对应的信号的传感器装置输出的信号经受信号处理;控制步骤代码,用于控制传感器装置的属性;评估步骤代码,用于评估有关对具有在控制步骤中所控制的属性的传感器装置的输出进行信号处理的结果;以及,确定步骤代码,用于根据代码的评估结果确定与该信号处理相对应的传感器装置的属性,并输出该属性的信息。 To a corresponding to a third aspect of the present invention, a recording medium storing a computer readable program, wherein the program comprises: a signal processing step of codes for causing the sensor means for sensing information and outputs a signal corresponding to the information from the signal output to signal processing; step control codes for controlling the properties of the sensor means; evaluation step of codes for performing signal processing relating to the evaluation result of the output of the sensor means having attributes controlled control step; and, the step of determining the code, the sensor means for determining a property of a process corresponding to the result of the evaluation in accordance with the code signal, and outputs the attribute information.

对于根据本发明第三方面的信号处理设备、信号处理方法、程序 The signal processing apparatus according to a third aspect of the present invention, a signal processing method, a program

和相应于该程序的记录介质,其中信号处理是在感测信息并输出与该信息相对应的信号的传感器装置输出的信号上执行的,而在另一方面, 传感器装置的属性被控制,并且评估在具有被控制属性的传感器装置的输出上进行的信号处理的结果。 And a recording medium corresponding to the program, wherein the signal processing is performed on the signal output from the sensor means sensing information and outputs a signal corresponding to the information, and on the other hand, the properties of the sensor means is controlled, and evaluation results of the signal processing performed at the output of a sensor means is controlled attribute. 根据评估结果确定与信号处理相对应的传感器装置的属性,并输出该属性的信息。 Sensor means to determine the properties corresponding to the signal processing based on the evaluation result, and outputs the attribute information.

根椐本发明第四方面, 一种信号处理设备,包括:信号处理装置, 使从传感器装置的输出中获得的第一数字图像信号经受信号处理,该传感器装置具有至少一个感测光并输出与该光相对应的图像信号的笫一分量的第一传感器和用于输出该图像信号的第二分量的第二传感器;控制装置,用于控制第一和第二传感器的放置状态;评估装置, 用于评估对传感器装置的输出进行信号处理所获得的第二数字图像信号,其中,第一和第二传感器的放置状态由控制装置控制;并且根据评估装置的评估结果确定与该信号处理相对应的第一和第二传感器的放置状态,并输出放置状态的信息。 As noted in the fourth aspect of the present invention, a signal processing apparatus, comprising: signal processing means, the first digital image signal obtained from the output of the sensor is subjected to a signal processing apparatus, the apparatus having at least one sensor to sense light and output Zi component of the first sensor corresponding to the optical image signal and a second sensor for outputting a second component of the image signal; and a control means for controlling placement state of the first and second sensors; evaluation device, a second evaluation of the digital image signal output of the sensor means is obtained by performing signal processing, wherein the first and second sensor placement state controlled by the control means; and determining processing corresponding to the signal based on the evaluation of the evaluation device first and second sensor placement state, and outputs the placement state information.

一种相应于本发明第四方面的信号处理方法,包括:信号处理步 To a corresponding to a fourth aspect of the present invention, a signal processing method, comprising: a signal processing step

骤,用于使从传感器装置获得的信号经受信号处理,该传感器装置具有至少一个感测光并输出与该光相对应的图像信号的第一分量的笫一 Step, for a signal obtained from the sensor is subjected to a signal processing apparatus, the apparatus having at least one sensor to sense light and output a first component of the image signal corresponding to the light of a Zi

传感器和输出图像信号的第二分量的第二传感器;控制步骤,用于控制第一和第二传感器的放置状态;评估步骤,用于评估通过对传感器装置的输出进行信号处理所获得的笫二数字图像信号,其中第一和第二传感器的放置状态是在控制步骤中控制的;以及确定步骤,用于根据评估步骤的评估结果确定与该信号处理相对应的第一和第二传感器的放置状态,并输出该放置状态的信息。 A second sensor and a second sensor component output image signal; a control step for controlling the state of placing the first and second sensors; evaluation step for performing signal processing Zi two assessments of the output of the sensor means obtained the digital image signal, wherein the first and second sensor placement state is controlled in the control step; and a determination step for determining the first and second sensors corresponding to the processed signal according to the result of the evaluation of the evaluation step of placing state, and outputs information of the placement state.

一种相应于本发明第四方面的计算机可读程序,包括:信号处理步骤代码,使从传感器装置的输出中获得的信号经受信号处理,该传感器装置具有至少一个感测光并输出与该光相对应的图像信号的第一分量的第一传感器和输出图像信号的第二分量的第二传感器;控制步骤代码,用于控制第一和第二传感器的放置状态;评估步骤代码,用于评估对传感器装置的输出进行信号处理所获得的第二数字图像信号,其中第一和第二传感器的放置状态是在控制步骤中控制的;以及确定步骤代码,用于根据评估步骤的评估结果,确定与该信号处理相对应的第一和第二传感器的放置状态,并输出该放置状态的信息。 To a corresponding to a fourth aspect of the present invention, a computer-readable program comprising: a signal processing step of codes, a signal obtained from the output of the sensor is subjected to a signal processing device, the sensor device having at least one sensing light and the output light the second component of the first sensor of the second component of the image signal corresponding to the first sensor and the output image signal; code for a control step for controlling the placement state of the first and second sensors; the code evaluation step for evaluating the a second sensor output signal of the digital image signal processing apparatus obtained, wherein a first state and a second sensor is disposed in the control step controls; and a step of determining codes, according to the results of evaluation of the evaluating step, determining processing the signal corresponding to the placement state of the first and second sensors, and outputs information of the placement state.

一种相应于本发明第四方面的记录介质存储了一种计算机可读程 To a corresponding to a fourth aspect of the present invention, a recording medium storing a computer-readable drive

序,其中该程序包括:信号处理步骤代码,用于使从传感器装置的输 Sequence, wherein the program comprises: a signal processing step of codes for causing the output from the sensor means

出中获得的信号经受信号处理,该传感器装置具有至少一个感测光并输出与该光相对应的图像信号的第一分量的第一传感器和输出图像信 The signal obtained is subjected to signal processing, the sensor device having a first sensor and an output image signal and outputs at least a first sensing light component of the light corresponding to the image signal

号的第二分量的第二传感器;控制步骤代码,用于控制第一和第二传感器的放置状态;评估步骤代码,用于评估通过对传感器装置的输出进行信号处理所获得的第二数字图像信号,其中笫一和第二传感器的放置状态是在控制步骤中控制的;以及确定步骤代码,用于根据评估步骤的评估结果,确定与该信号处理相对应的第一和第二传感器的放置状态,并输出该放置状态的信息。 The second component of the second sensor number; step control codes for controlling the placement state of the first and second sensors; codes evaluation step, a second digital evaluation signal processing of the output of the sensor means of the obtained image signal, wherein Zi and a second sensor placement state is controlled in the control step; and a step of determining codes, according to the results of evaluation of the evaluating step, determining a first and second sensors corresponding to the processing of the signal is placed state, and outputs information of the placement state.

对于根据本发明第四方面的信号处理设备、方法、程序和相应于 The signal processing apparatus according to a fourth aspect of the present invention, a method, and a program corresponding to

该程序的记录介质,所述信号处理是在第一数字图像信号上执行的, 该第一数字图像是从具有至少一个用于感测光并输出与该光相对应的图像信号的第一分量和输出该图像信号的第二分量及输出第二数字图像信号的传感器的输出中获得的,藉此输出第二数字图像信号,而另一方面,控制第一和第二传感器的放置状态,并评估通过在具有所控制的放置状态的传感器装置的输出上执行信号处理而获得第二数字图像。 The program recording medium, the signal processing is performed on the first digital image signal, the first digital image is used for sensing light from the at least one component and having a first output image signal corresponding to the light and the output of the image signal component and a second output of the second digital image signal obtained in the sensor, whereby the output of the second digital image signal, on the other hand, the control placement state of the first and second sensor, and evaluate the second digital image is obtained by performing signal processing on the output of the sensor means having a state controlled placement. 根据评估结果确定与信号处理相对应的第一或第二传感器装置的放置状态,并输出该放置状态的信息。 Placement state evaluation result of the determination of the first or second sensor means corresponding to the signal processing, and outputs the information according to the placement state.

根据本发明第五个方面, 一种信号处理设备包括:图像转换装置, 使从成像装置的输出中获得的第一数字图像经受图像转换处理,该成像装置具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的笫二分量并输出第二数字图像信号的第二传感器;评估装置, 用于评估笫二数字图像信号;控制装置,根据评估装置的评估控制第一和第二传感器至少一个的放置状态。 According to a fifth aspect of the present invention, a signal processing apparatus comprising: an image converting means, the first output of the digital image obtained from the image forming apparatus is subjected to image conversion processing, the image forming apparatus having at least a first component of a video signal obtained a first sensor and the obtained two-component image signal Zi and outputs the second sensor signal, the second digital image; evaluation means for evaluating the second digital image signal Zi; control means, based on the assessment of the evaluation device controls the first and second at least one sensor placed state.

一种相应于本发明第五方面的信号处理方法,包括:图像转换步骤,使从成像装置的输出中获得的第一数字图像经受图像转换处理,该成像装置具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的笫二分量并输出第二数字图像信号的第二传感器;评估步骤,用于评估第二数字图像信号;以及控制步骤,用于根据评估步骤的评估控制第一和第二传感器至少一个的放置状态。 To a corresponding to a fifth aspect of the present invention, a signal processing method, comprising: an image conversion step, the first output of the digital image obtained from the image forming apparatus is subjected to image conversion processing, the image forming apparatus having at least a first image signal obtained the first sensor component and the obtained two-component image signal Zi and outputs the second sensor signal, the second digital image; evaluating step for evaluating a second digital image signal; and a control step of controlling according to the evaluation of the evaluation step of and a second sensor disposed in at least one state. 一种相应于本发明第五方面的计算机可读程序,该程序包括:图像转换步骤代码,用于使从成像装置的输出中荻得的第一数字图像经受图像转换处理,该成像装置具有至少一个获得图像信号的第一分量的笫一传感器和获得图像信号的第二分量并输出第二数字图像信号的第二传感器;评估步骤代码,评估笫二数字图像信号;以及控制步骤代码,用于根据评估步骤的评估控制第一和第二传感器至少一个的放置状态。 To a corresponding to a fifth aspect of the present invention, a computer-readable program, the program comprising: an image converting step of codes for causing the first digital image output from the imaging device Di was subjected to image conversion processing, the image forming apparatus having at least Zi obtain a first sensor image component and a second component signal to obtain an image signal and outputs the second sensor signal, the second digital image; evaluating step code, evaluation Zi second digital image signal; and a control step of codes for the first and second sensor controls evaluation evaluation step of placing at least one state. 一种相应于本发明第五方面的记录介质存储了一种计算机可读程序,其中该程序包括:图像转换步骤代码,使从成像装置的输出中获得的第一数字图像经受图像转换处理,该成像装置具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的第二分量并输出第二数字图像信号的第二传感器;评估步骤代码,评估第二数字图像信号;以及控制步骤代码,用于根据评估步骤的评估控制第一和第二传感器至少一个的放置状态。 To a corresponding to a fifth aspect of the present invention, a recording medium storing a computer readable program, wherein the program comprises: an image converting step codes the first digital image obtained from the output of the image forming apparatus is subjected to image conversion processing, the a first sensor and a second imaging device having a first component at least one component to obtain an image signal obtained by the image signals and outputs the second sensor signal, the second digital image; codes evaluation step, evaluation of the second digital image signal; and a control step code for controlling the first and second sensor evaluation step according to the evaluation of at least one placement state. 对于根据本发明第五方面的信号处理设备、信号处理方法、程序和相应于该程序的记录介质,该图像转换处理是在第一数字图像上执行的,该第一数字图像信号是从具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的第二分量并输出第二数字图像信号的第二传感器的成像装置的输出中获得的。 For the, the first digital image signal processing apparatus of the fifth aspect of the present invention, a signal processing method, a program and a program corresponding to the recording medium, the image conversion processing is performed on a first digital image having at least from obtaining a first sensor output of the first image signal component and a second component to obtain a second image signal and outputting a digital image signal forming means from the second sensor obtained. 此外,评估第二数字图像信号,并根据评估控制第一和第二传感器中的至少一个的放置状态。 In addition, evaluation of the second digital image signal, and a placement state of the at least first and second sensor evaluation control in accordance with. 根据本发明第六方面, 一种信号处理设备包括:参数获取装置, 用于获得预定的参数;控制装置,用于控制具有至少一个获取图像信号的第一分量的第一传感器和根据预定参数获取图像信号的笫二分量的第二传感器的成像装置的第一传感器或第二传感器中的至少一个的放置状态;以及图像转换装置,用于使从成像装置的输出中获得的第一数字图像信号经受与预定参数相对应的图像转换处理,并输出第二数字图像信号。 According to a sixth aspect of the present invention, a signal processing device comprising: parameter acquiring means for acquiring predetermined parameters; and a control means for controlling at least a first sensor having a first component of a captured image signal according to predetermined parameters and acquisition a first sensor of the imaging device of the second sensor undertaking of two component of the image signal or the second sensor disposed in at least one state; and an image converting means, so as to obtain a first digital image forming apparatus from the output image signal It is subjected to image conversion processing corresponding to a predetermined parameter, and outputs the second digital image signal. 一种相应于本发明第六方面的信号处理方法,包括:获取步骤, 用于获得预定的参数;控制步骤,用于控制具有至少一个获取图像信号的第一分量的第一传感器和根据预定参数获取图像信号的第二分量的第二传感器的成像装置的第一传感器或第二传感器中的至少一个的放置状态;以及图像转换步骤,用于使从成像装置的输出中获得的第一数字图像信号经受与预定参数相对应一个的图像转换处理,并输出第二数字图像信号。 To a corresponding to a sixth aspect of the present invention, a signal processing method, comprising: obtaining step of obtaining predetermined parameters; control step for controlling at least a first sensor having a first component of a captured image signal according to predetermined parameters and obtaining a second image signal component of the first image forming apparatus the sensor or the second sensor a second sensor disposed in at least one state; and an image conversion step, so as to obtain a first digital image forming apparatus from the output image It is subjected to the parameter signal corresponding to a predetermined image conversion processing, and outputs the second digital image signal. 一种相应于本发明第六方面的计算机可读程序,包括:获取步骤代码,用于获得预定的参数;控制步骤代码,用于控制具有至少一个获取图像信号的第一分量的第一传感器和根据预定参数获取图像信号的笫二分量的第二传感器的成像装置的笫一传感器或第二传感器中的至少一个的放置状态;以及图像转换步骤代码,使从成像装置的输出中获得的第一数字图像信号经受与预定参数的图像转换处理,并输出第二数字图像信号。 To a corresponding computer-readable sixth aspect of the present invention, program comprising: an acquisition step of codes for obtaining predetermined parameters; codes control step for controlling at least a first sensor having a first component of a captured image signal, and according to at least one of a placement state sensor imaging apparatus Zi second predetermined sensor parameter acquisition undertaking of two-component image signal or the second sensor; and an image conversion step of the code obtained from the output of the first image forming apparatus the digital image signal is subjected to predetermined image conversion processing with the parameters, and outputs the second digital image signal. 一种相应于本发明第六方面的记录介质存储了一种计算机可读程序,其中该程序包括:获取步骤代码,用于获得预定的参数;控制步骤代码,控制具有至少一个获取图像信号的第一分量的第一传感器和根据预定参数获取图像信号的第二分量的第二传感器的成像装置的第一传感器或笫二传感器中的至少一个的放置状态;以及图像转换步骤代码,使从成像装置的输出中获得的第一数字图像信号经受与预定参数相对应的图像转换处理,并输出第二数字图像信号。 To a corresponding to a sixth aspect of the present invention, a recording medium storing a computer readable program, wherein the program comprising: a step of acquiring the code, for obtaining a predetermined parameter; a step control codes, the control having at least a first acquired image signal a first sensor a first sensor component and the image forming apparatus according to a second predetermined sensor parameter of the second component of the captured image signal or the undertaking of two sensors disposed in at least one state; and the code image converting step of the image forming apparatus from a first digital image signal output from the image obtained is subjected to the conversion processing corresponding to a predetermined parameter, and outputs the second digital image signal. 对于根据本发明第六方面的信号处理设备、信号处理方法、程序和相应于该程序的记录介质而言,具有至少一个获取图像信号的第一分量的第一传感器和获取图像信号的第二分量的第二传感器的成像装置的第一传感器或第二传感器中的至少一个的放置状态根据预定参数控制,并且在从成像装置的输出获得的第一数字图像信号上执行与预定参数相对应的图像转换处理,藉此输出第二数字图像信号。 For purposes of signal processing apparatus according to a sixth aspect of the present invention, a signal processing method, a program and a recording medium corresponding to the program, a first sensor having a first component at least one acquired image signal and the captured image signal of the second component a first sensor of the imaging device or the second sensor a second sensor disposed in at least one state according to a predetermined control parameters, and performs a predetermined parameter corresponding to the image on the first digital image signal obtained from the output of the imaging apparatus conversion processing, thereby outputting the second digital image signal. 根据本发明第七方面, 一种信号处理设备包括:获取装置,用于获得预定的参数;图像转换装置,使从具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的第二分量并输出第二数字图像信号的第二传感器的成像装置的输出中获得的第一数字图像经受图像处理;控制装置,用于控制笫一或第二传感器中的至少一个的放置状态;评估装置,用于评估第二数字图像信号;以及存储装置,与评估装置的评估相对应以关联的方式存储预定参数和笫一或笫二传感器的放置状态。 According to a seventh aspect of the present invention, a signal processing apparatus comprising: acquiring means for acquiring predetermined parameters; image conversion means, so as to obtain a first image from a first signal having a first component at least one sensor to obtain an image signal and two first digital image output component signal and outputs the second digital image forming apparatus of the second sensor obtained is subjected to image processing; and a control means for controlling at least one of Zi or a placement state of the second sensor; evaluation means for evaluating the second digital image signal; evaluating and storing means, with the corresponding evaluation device associated manner placement state and a predetermined parameter storage Zi or Zi two sensors. 一种相应于本发明第七方面的信号处理方法,包括:获取步骤, 用于获得预定的参数;图像转换步骤,使从具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的第二分量并输出第二数字图像信号的第二传感器的成像装置的输出中获得的第一数字图像经受图像处理;控制步骤,用于控制第一或第二传感器中的至少一个的放置状态;评估步骤,用于评估第二数字图像信号;以及存储步骤, 与评估装置的评估相对应以关联的方式存储预定参数和第一或第二传感器的放置状态。 To a corresponding to a seventh aspect of the present invention, a signal processing method, comprising: obtaining step of obtaining predetermined parameters; an image conversion step, so as to obtain an image signal from a first sensor having a first component at least one image signal is obtained and first digital image output from the second component signal and outputs the second digital image forming apparatus of the second sensor obtained is subjected to image processing; control step for controlling the first or the second sensor disposed in at least one state ; evaluating step for evaluating a second digital image signal; and a storage step of evaluation and evaluation device associated manner corresponding placement state and a predetermined parameter stored in the first or second sensor. 一种相应于本发明第七方面的计算机可读程序,包括:获取步骤代码,用于获得预定的参数;图像转换步骤代码,使从具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的第二分量并输出第二数字图像信号的第二传感器的成像装置的输出中获得的第一数字图像经受图像处理;控制步骤代码,控制第一或第二传感器中的至少一个的放置状态;评估步骤代码,评估第二数字图像信号;以及存储步骤代码,与评估装置的评估相对应以关联的方式存储预定参数和第一或笫二传感器的放置状态。 To a corresponding computer-readable seventh aspect of the present invention, program comprising: an acquisition step of codes for obtaining predetermined parameters; the code image converting step, the first sensor having a first component at least one of an image signal obtained from and the second component of the obtained image signal and outputting a first digital image output signal of the second digital image forming apparatus of the second sensor obtained is subjected to image processing; step control codes, controlling at least one of the first or the second sensor placement state; the code evaluation step, evaluation of the second digital image signal; and a storage step of the code evaluation, the evaluation device in a manner corresponding to the associated stored predetermined placement state parameter and the first or second sensor is great undertaking. 一种相应于本发明第七方面的存储介质存储了一种计算机可读程序,其中程序包括:获取步骤代码,用于获得预定的参数;图像转换步骤代码,使从具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的笫二分量并输出第二数字图像信号的第二传感器的成像装置的输出中获得的第一数字图像经受图像处理;控制步骤代码,控制第一或第二传感器中的至少一个的放置状态;评估步骤代码,评估笫二数字图像信号;以及存储步骤代码,与评估装置的评估相对应以关联的方式存储预定参数和笫一或第二传感器的放置状态。 To a corresponding to a seventh aspect of the present invention, a storage medium storing a computer readable program, wherein the program comprising: a step of acquiring the code, for obtaining a predetermined parameter; the code image converting step, at least one image signal is obtained having a first sensor output of the first digital image and obtain an image of the first component of the two component signals Zi and outputs the second digital image signal of the imaging device obtained in the second sensor is subjected to image processing; step control codes, or the first control at least one sensor disposed in a second state; evaluating step code, evaluation Zi second digital image signal; and a step of storing the code, and assessment evaluation device should be placed in a manner opposing a predetermined parameter associated storage and Zi or a second sensor status. 对于根据本发明第七方面^信号处理设备、信号处理方法、程序和相应于该程序的记录介质,该图像处理是在第一数字图像上执行的, 该第一数字图像信号是从具有至少一个获得图像信号的第一分量的第一传感器和获得图像信号的第二分量并输出第二数字图像信号的第二传感器的成像装置的输出中获得的。 For, the first digital image signal according to a seventh aspect of the present invention ^ the signal processing apparatus, signal processing method, a program and a program corresponding to the recording medium, the image processing is performed on the first digital image with at least one from obtaining a first sensor output of the first image signal component and a second component to obtain a second image signal and outputting a digital image signal forming means from the second sensor obtained. 此外,控制第一和第二传感器中的至少一个的放置状态,评估笫二数字图像信号,并且与该评估相对应,以关联的方式存储预定参数和第一或第二传感器的放置状态。 Further, the control of the placement state at least a first and a second sensor, evaluate Zi second digital image signal and corresponding to the evaluation, in a manner associated with a predetermined parameter stored in the placement state and the first or second sensor. 根据本发明第八方面, 一种信号处理设备包括:图像转换装置, 使从具有多个光电转换装置的传感器装置的输出中获得的第一数字图像信号经受图像转换处理,并输出第二数字图像信号;以及评估装置, 评估预定区域的第一数字图像信号;其中与预定区域的第一数字图像信号相对应的一部分传感器装置被改变为与在评估装置所进行的评估相对应的特性(capability)。 According to an eighth aspect of the present invention, a signal processing apparatus comprising: an image converting means, the first digital image signal output from the photoelectric conversion device having a plurality of sensor apparatus is subjected to image conversion processing, and outputs the second digital image signal; and an evaluation means evaluates the first digital image signal of a predetermined area; wherein the first digital image signal corresponding to a predetermined area of ​​the portion of the sensor means is changed to be evaluated in the evaluation device corresponding characteristics (Capability) . 一种相应于本发明第八方面的信号处理方法,包括:图像转换步骤,使从具有多个光电转换装置的传感器装置的输出中获得的笫一数字图像信号经受图像转换处理,并输出第二数字图像信号;以及评估步骤,评估预定区域的笫一数字图像信号;其中与预定区域的第一数字图像信号相对应的一部分传感器装被改变为与在评估步骤所进行的评估相对应的特性。 To a corresponding to an eighth aspect of the present invention, a signal processing method, comprising: an image conversion step, Zi digital image signal output from the photoelectric conversion device having a plurality of sensor apparatus is subjected to image conversion processing, and outputs a second a digital image signal; and an evaluation step of assessing a digital image signal Zi predetermined area; wherein the first digital image signal corresponding to a predetermined area of ​​a portion of the sensor means is changed to be evaluated in the evaluation step performed corresponding characteristics. 一种相应于本发明第八方面的计算机可读程序,包括:图像转换步骤代码,使从具有多个光电转换装置的传感器装置的输出中获得的第一数字图像信号经受图像转换处理,并输出第二数字图像信号;以及评估步骤代码,评估预定区域的第一数字图像信号;其中与预定区域的第一数字图像信号相对应的一部分传感器装被改变为与在评估步骤所进行的评估相对应的特性。 To a corresponding to an eighth aspect of the present invention, a computer-readable program comprising: an image converting step codes the first digital image signal output from the plurality of photoelectric conversion devices having a sensor device is subjected to image conversion processing, and outputs a second digital image signal; and an evaluation step of the code, a first evaluation of the digital image signal of a predetermined area; wherein the first digital image signal corresponding to a predetermined area of ​​a portion of the sensor means is changed to be evaluated in the evaluation step corresponding to features. 一种相应于本发明第八方面的存储介质存储了一种计算机可读程序,其中该程序包括:图像转换步骤代码,使从具有多个光电转换装置的传感器装置的输出中获得的第一数字图像信号经受图像转换处理,并输出第二数字图像信号;以及评估步骤代码,用于评估预定区域的笫一数字图像信号;其中与预定区域的笫一数字图像信号相对应的一部分传感器装被改变为与在评估步骤所进行的评估相对应的特性。 To a corresponding to an eighth aspect of the present invention, a storage medium storing a computer readable program, wherein the program comprises: an image conversion step of the code, the first number obtained from the output of the sensor device having a plurality of photoelectric conversion device the image signal subjected to the image conversion processing, and outputs the second digital image signal; and an evaluation step of codes for evaluating a digital image signal Zi predetermined area; and wherein Zi, a digital image signal corresponding to a predetermined area of ​​a portion of the sensor means is changed and evaluation in the evaluation step is carried out corresponding to the characteristic. 对于根据本发明第八方面的信号处理设备、信号处理方法、程序和相应于该程序的记录介质而言,图像转换处理是在从传感器装置的输出获得的笫一数字图像上执行的,并输出笫二数字图像信号。 The signal processing apparatus for an eighth aspect of the present invention, a signal processing method, a program and a program corresponding to the recording medium in accordance with the image conversion processing is executed on a digital image obtained Zi output from the sensor means, and outputs Zi second digital image signal. 另一方面,评估预定区域的第一数字图像信号,以及与预定区域的第一数字图像信号相对应的一部分传感器装置被改变为与预定区域的第一数字图像信号的评估相对应的特性。 On the other hand, the digital image signal of a predetermined first evaluation region, and a portion of the sensor device and the first digital image signal corresponding to the predetermined region is changed evaluating the first digital picture signal with the predetermined region corresponding to the characteristic. 根据本发明第九方面, 一种执行将第一图像信号转换为第二图像信号的信号处理的信号处理设备,包括:类分类装置,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布将第二图像信号分到多个类中的一个之中;控制装置,根据第一图像信号的级别分布控制成像装置;抽头因数输出装置,为通过学习所获得的每一个类输出抽头因数;以及计算装置,通过使用由控制装置控制的成像装置输出的第一图像信号和类分类装置获得的类的抽头因数来执行计算以获得第二图像信号。 According to a ninth aspect of the present invention, a method of performing a first image signal into a signal processing device for signal processing of the second image signal, comprising: a category classification apparatus, the imaging means outputs the object light from the object into an image signal in accordance with level distribution of the first image signal assigned to the second image signal into a plurality of classes; control means for controlling the image forming apparatus according to the level distribution of the first image signal; tap coefficient output means is obtained by learning each class output tap factor; and calculating means performs calculation by using the tap factor obtained from the first image signal and image forming means for outputting class classification means controlled by the control class to obtain a second image signal. 一种相应于本发明第九方面的执行将第一图像信号转换为第二图像信号的信号处理的信号处理方法,包括:类分类步骤,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布将第二图像信号分到多个类中的一个之中;控制步骤,根据第一图像信号的级别分布控制成像装置;抽头因数输出步骤,为通过学习所获得的每一个类输出抽头因数;计算步骤,通过使用在控制步骤中所控制的成像装置输出的第一图像信号和类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 A method for signal processing corresponding to a ninth aspect of the present invention performs a first image signal into a signal of the second image signal processing, comprising: a class classification step, the object image forming apparatus light from the object into an image signal in accordance with level of the first image signal output from the second image signal distribution assigned among a plurality of classes; control step of controlling the image forming apparatus according to the level distribution of the first image signal; tap coefficient output step, is obtained by learning the output of each class tap factor; calculation step, the tap factor by using the output imaging device in the controlling step controlled the obtained first image signal and the class class classification step performs calculation to obtain a second image signal. —种相应于本发明第九方面的执行将第一图像信号转换为第二图像信号的信号处理的计算机可读程序,包括:类分类步骤代码,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布将第二图像信号分到多个类中的一个之中;控制步骤代码,根据第一图像信号的级别分布控制成像装置;抽头因数输出步骤代码,为通过学习所获得的每一个类输出抽头因数;计算步骤代码,通过使用在控制步骤中所控制的成像装置输出的第一图像信号和类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 - corresponding to a ninth aspect of the present invention performs a first kind of image signals into the signal processing computer readable program the second image signal, comprising: a class classification step of the code, according to the object light from the object into an image signal, level distribution of the first image signal output from the imaging device assigned to the second image signal into a plurality of classes; step control codes, the image forming apparatus of the first-level distribution control in accordance with an image signal; tap coefficient output step codes for obtained through learning for each class output tap factor; codes calculation step, the tap factor by using the output imaging device control step of controlling the first image signal obtained by class classification step and the class to perform calculations to obtain first second image signal. 一种相应于本发明第九方面的执行将第一图像信号转换为第二图像信号的信号处理的存储介质,其存储了一种计算机可读程序,其中该程序包括:类分类步骤代码,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布将第二图像信号分到多个类中的一个之中;控制步骤代码,根据第一图像信号的级别分布控制成像装置;抽头因数输出步骤代码,为通过学习所获得的每一个类输出抽头因数;计算步骤代码,通过使用在控制步骤中所控制的成像装置输出的第一图像信号和类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 To a corresponding to a ninth aspect of the present invention performs a first image signal into a signal processing storage medium second image signal, which is stored a computer readable program, wherein the program comprises: code for class classifying step, in accordance with level of the object from the object light is converted into an image signal output of the imaging apparatus of the first image signal distribution of the second image signal assigned among a plurality of classes; step control codes, according to the level distribution of the first image signal controlling the imaging apparatus; tap coefficient output step codes, output tap for each class obtained by the learning factor; codes calculation step, by using the output of the imaging means in the controlling step controlled first image signal and a class classification step to obtain class tap factor calculation is performed to obtain a second image signal. 对于根据本发明第九方面的信号处理设备、信号处理方法、程序和相应于该程序的记录介质而言,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布来执行将第二图像信号分到多个类中之一的类分类,并且根据第一图像信号的级别分布控制成像装置。 For the signal processing apparatus of the ninth aspect of the present invention, a signal processing method, a program and a program corresponding to the recording medium in accordance with the level of the object from the object light is converted into an image signal output of the imaging apparatus of the first image signal in accordance with distribution performs class classification assigned to the second image signal is one of a plurality of classes, and controls the image forming apparatus according to the level distribution of the first image signal. 此外,为通过学习所获得的每一个类输出抽头因数, 并使用控制装置控制的成像装置输出的第一图像信号和类分类装置获得的类的抽头因数来执行计算,藉此获得第二图像信号。 In addition, for each output class tap obtained by the learning factor, and the tap factor using a first image signal output from the imaging means and control means for controlling the means for obtaining a class classification class to perform the calculation, thereby obtaining a second image signal . 根据本发明第十方面, 一种执行将第一图像信号转换为第二图像信号的信号处理的信号处理设备,包括:类分类装置,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布将第二图像信号分到多个类中的一个之中;活动检测装置,检测第一图像信号的活动;控制装置,根据第一图像信号的活动控制成像装置;抽头因数输出装置,为通过学习所获得的每一个类输出抽头因数;以及计算装置,通过使用由控制装置控制的成像装置输出的第一图像信号和类分类装置获得的类的抽头因数来执行计算以获得第二图像信号。 According to a tenth aspect of the present invention, a method of performing a first image signal into a signal processing device for signal processing of the second image signal, comprising: a category classification apparatus, the object light from the object into an image signal according to the output of the imaging apparatus level distribution of the first image signal assigned to the second image signal into a plurality of classes; activity detection means for detecting the activities of the first image signal; and a control means for controlling the image forming apparatus according to the activity of the first image signal; tap coefficient output means outputting for each class tap obtained by the learning factor; and calculating means performs calculation by using the tap factor obtained from the first image signal and class classification means for outputting a control device for controlling the image forming apparatus of the class to obtain a second image signal.

一种相应于本发明第十方面的执行将第一图像信号转换为第二图 To a corresponding to a tenth aspect of the present invention performs a first image signal into a second FIG.

像信号的信号处理的信号处理方法,包括:类分类步骤,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布将第二图像信号分到多个类中的一个之中;活动检测步骤,检测 The signal processing method of image signal processing a signal, comprising: a class classification step, the object according to the level converting light from an object into an image signal output of the imaging apparatus of the first image signal, the second image signal into multiple classes Distribution one among; activity detection step of detecting

第一图像信号的活动;控制步骤,根据第一图像信号的活动控制成像装置;抽头因数输出步骤,为通过学习所获得的每一个类输出抽头因数;计算步骤,通过使用在控制步骤所控制的成像装置输出的第一图像信号和类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 Activities first image signal; a control step of controlling the image forming apparatus according to the activity of the first image signal; tap coefficient output step, for each output class tap obtained by the learning factor; calculation step, by using the control in the control step a first image signal output from the imaging device and the tap factor of the class class classification step to obtain calculation is performed to obtain a second image signal.

一种相应于本发明第十方面的执行将第一图像信号转换为第二图 To a corresponding to a tenth aspect of the present invention performs a first image signal into a second FIG.

像信号的信号处理的计算机可读程序,包括:类分类步骤代码,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号 Image signal processing computer readable program signal, comprising: a class classification step of the code, according to a first object image from the object light is converted into an image signal output of the imaging means signal

的级别分布将第二图像信号分到多个类中的一个之中;检测步骤代码, 检测第一图像信号的活动;控制步骤代码,根据第一图像信号的活动控制成像装置;抽头因数输出步骤代码,为通过学习所获得的每一个类输出抽头因数;计算步骤代码,通过使用在控制步骤中控制的成像装置输出的第一图像信号和类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 Level distribution of the second image signal assigned among a plurality of classes; the code detecting step of detecting a first image signal activity; step control codes, the image forming apparatus in accordance with the control signal active a first image; tap coefficient output step code output taps for each class obtained by the learning factor; codes calculation step, and the tap factor of the first image signal output by using a class classification step of the image forming apparatus in the control step controls the obtained classes to perform computations to obtaining a second image signal.

一种相应于本发明笫十方面的执行将第一图像信号转换为第二图像信号的信号处理的存储介质,其存储了一种计算机可读程序,其中该程序包括:类分类步骤代码,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布将第二图像信号分到多个类中的一个之中;活动检测步骤代码,根据第一图像信号的级别分布检测成像装置;抽头因数输出步骤代码,为通过学习所获得的每一个类输出抽头因数;计算步骤代码,通过使用在控制步骤中控制的成像装置输出的第一图像信号和类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 Zi to a corresponding execution to the 30th aspect of the present invention, the first image signal into a signal processing storage medium second image signal, which is stored a computer readable program, wherein the program comprises: code for class classifying step, in accordance with level of the object from the object light is converted into an image signal output of the imaging apparatus of the first image signal distribution of the second image signal assigned among a plurality of classes; activity detection step of the code, according to the level of the first image signal distribution detection imaging device; tap coefficient output step codes, output tap for each class obtained by the learning factor; codes calculation step, by using the output of the imaging device in the control step controls the first image signal and a class classification step to obtain class tap factor calculation is performed to obtain a second image signal.

对于根据本发明第十方面的信号处理设备、信号处理方法、程序和相应于该程序的记录介质,根据把来自物体的物体光转换为图像信号的成像装置输出的笫一图像信号的级别分布来执行将第二图像信号分到多个类中之一的分类。 The signal processing apparatus according to a tenth aspect of the present invention, a signal processing method, a program and a recording medium corresponding to the program, according to the level of the object from the object light is converted to an output signal of the image forming apparatus of an image signal Zi distribution performing the second image signal classification assigned to one of a plurality of classes. 此外,检测第一图像信号的活动,并且根据第一图像信号的活动控制成像装置。 Further, the first image signal is detected event, and controls the image forming apparatus according to the activity of the first image signal. 为通过学习所获得的每一类输出抽头因数,并使用控制装置控制的成像装置输出的第一图像信号和类分类装置获得的类的抽头因数来执行计算,藉此获得第二图像信号。 Tap factor for each type of output taps obtained by the learning factor, and using the output control means controls the image forming apparatus of the first image signal and the class classification means for obtaining a class to perform the calculation, thereby obtaining a second image signal.

根据本发明笫十一方面, 一种执行将第一图像信号转换为第二图 According to Zi-first aspect of the present invention, a method of performing a first image signal is converted to a second FIG.

像信号的信号处理的信号处理设备,包括:类分类装置,根据把来自物体的物体光转换为图像信号的成像装置产生的第一图像信号的级别 Image signal processing apparatus for signal processing a signal, comprising:, an image signal level of the first image forming apparatus the generated object light from the object into an image signal according to the class classification means

分布将第二图像信号分到多个类中的一个之中;参数输出装置,输出表示第二图像信号的分辨率的参数;控制装置,根据该参数控制成像装置;抽头因数生成装置,从通过学习所获得的因数种子数据和该参数中为每一个类产生抽头因数;以及计算装置,通过使用控制装置控制的成像装置输出的第一图像信号和类分类装置获得的类的抽头因数来执行计算以获得笫二图像信号。 Distribution of the second image signal assigned to one among the plurality of classes; parameter output means outputs a parameter indicating a resolution of the second image signal; and a control means for controlling the image forming apparatus based on the parameter; tap factor generating means from by learning factor obtained seed data and the parameter is generated for each class tap factor; and a computing means, the tap factor of the first image signal output from the imaging apparatus by using the control means and control means for obtaining a class classification class to perform the calculations to obtain a second image signal Zi.

一种相应于本发明第十一方面的执行将第二图像信号转换为第二图像信号的信号处理的信号处理方法,包括:类分类步骤,根据把来自物体的物体光转换为图像信号的成像装置输出的第二图像信号的级 Signal processing method corresponding to the eleventh aspect of the present invention performs the second image signal into a signal of the second image signal processing, comprising: a class classification step of imaging the object light from the object into an image signal in accordance with the second stage of the image signal output apparatus

别分布将第二图像信号分到多个类中的一个之中;参数输出步骤,输出表示第二图像信号的分辩率的参数;控制步骤,根据该参数控制成像装置;抽头因数生成步骤,从通过学习所获得的因数种子数据和该参数中为每一个类产生抽头因数;计算步骤,通过使用在控制步骤中控制的成像装置输出的笫一图像信号和在类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 Distribution of the second image signal is not assigned among a plurality of classes; parameter output step of outputting a parameter indicating a resolution of the second image signal; a control step of controlling the image forming apparatus based on the parameter; tap factor generating step, from by studying the obtained factor seed data and the parameter generated in the tap factor for each class; calculation step, by using the output of the imaging device in the control step controls the tap Zi an image signal and obtained by the class classification step classes factor calculation is performed to obtain a second image signal.

一种相应于本发明第十一方面的执行将第一图像信号转换为第二图像信号的信号处理的计算机可读程序,包括:类分类步骤代码,根据把来自物体的物体光转换为图像信号的成像装置产生的第一图像信号的级别分布将第二图像信号分到多个类中的一个之中;参数输出步骤代码,输出表示第二图像信号的分辩率的参数;控制步骤代码,根据该参数控制成像装置;抽头因数生成步骤代码,从通过学习所获得的因数种子数据和该参数中为每一个类产生抽头因数;计算步骤代码, 通过使用在控制步骤中控制的成像装置输出的第一图像信号和在类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 To a corresponding to the eleventh aspect of the present invention performs a first image signal into computer-readable program for signal processing of the second image signal, comprising: a class classification step of the code, according to the object light from the object into an image signal image signal level of the first imaging device produces the second image signal distribution assigned among a plurality of classes; the code parameter output step, a parameter indicating an output resolution of the second image signal; a control step of codes, in accordance with this parameter controls the image forming apparatus; tap factor generating step code generating tap factors for each class from by learning the obtained factor seed data and the parameter; calculating step codes, the first device output from the imaging by using the control in the control step an image signal and the tap factor of the class obtained in the classification step of performing class is calculated to obtain a second image signal.

一种相应于本发明第十一方面的执行将第一图像信号转换为第二图像信号的信号处理的存储介质,其存储了产生计算机可读程序,其中该程序包括:类分类步骤代码,根据把来自物体的物体光转换为图像信号的成像装置产生的第一图像信号的级别分布将笫二图像信号分到多个类中的一个之中;参数输出步骤代码,输出表示第二图像信号的分辩率的参数;控制步骤代码,根据该参数控制成像装置;抽头因数生成步骤代码,从通过学习所获得的因数种子数据和该参数中为每一个类产生抽头因数;计算步骤代码,通过使用在控制步骤中控制的成像装置输出的第一图像信号和在类分类步骤中获得的类的抽头因数来执行计算以获得第二图像信号。 To a corresponding to the eleventh aspect of the present invention performs a first image signal into a signal processing storage medium second image signal, which generates a computer-readable program stored, wherein the program comprises: code for class classifying step, in accordance with the object of converting light from the object-level distribution of the first image signal generated by an imaging apparatus of an image signal assigned to the undertaking of the second image signal into a plurality of classes; parameter output step codes, outputs a second image signal the resolution parameter; a step control codes, the image forming apparatus based on the control parameter; tap factor codes generating step, a tap is generated from factor for each class obtained by learning factor seed data and the parameter; codes calculation step, by using a first image signal output from the imaging device and the control step controls the tap factor of the class obtained in the classification step of performing class is calculated to obtain a second image signal.

对于根据本发明第十一方面的信号处理设备、信号处理方法、程序和相应于该程序的记录介质而言,根据把来自物体的物体光转换为图像信号的成像装置输出的第一图像信号的级别分布来执行将第二图像信号分到多个类中的一个之中的分类。 For purposes of signal processing apparatus according to an eleventh aspect of the present invention, a signal processing method, a program and a program corresponding to the recording medium, the first image signal of the object from the object light is converted to an output signal of an imaging apparatus of an image performs classification level distribution of the second image signal is divided into a plurality of classes into a. 此外,输出表示第二图像信号的分辩率的参数,以及根据该参数控制成像装置。 Further, the output parameter indicating a resolution of the second image signal, and an image forming apparatus based on the control parameter. 此外,从通过学习所获得的因数种子数据和该参数中为每一个类产生抽头因数,使用在控制步骤中控制的成像装置输出的第一图像信号和在类分类步骤中获得的类的抽头因数来执行计算,藉此获得第二图像信号。 Further, a tap is generated from factor for each class obtained by learning factor seed data and the parameter, the imaging apparatus using the output tap factor control in a control step and a first image signal obtained in the class in the class classifying step calculation is performed, thereby obtaining a second image signal.

附图说明 BRIEF DESCRIPTION

图1示出了已应用本发明的图像拾取设备的一个具体实施例的配置实例的方框图; FIG 1 illustrates a block diagram of a configuration example of a specific embodiment of the image pickup apparatus of the present invention has been applied;

图2示出了信号处理单元4和输出单元5的配置实例的方框图;图3示出了传感器单元1的配置实例的方框图; Figure 2 shows a block diagram of a configuration example of the signal processing unit 4 and output unit 5; FIG. 3 shows a block diagram of a configuration example of the sensor unit 1;

图4示出了信号处理单元11的配置实例的方框图; FIG 4 illustrates a block diagram of a configuration example of the signal processing unit 11;

图5是描述图像拾取设备的操作的流程图; 5 is a flowchart describing the operation of the image pickup apparatus;

图6示出了图像转换单元31的配置实例的方框图; FIG 6 illustrates a block diagram of a configuration example of the image converting unit 31;

图7示出了因数输出单元124的配置实例的方框图; FIG. 7 shows a block diagram of a configuration example of the coefficient output unit 124;

图8示出了学习抽头因数的学习设备的配置实例的方框图; FIG 8 illustrates a block diagram of a configuration example of a learning apparatus learning of the tap factor;

图9是描述学习抽头因数的学习过程的流程图; FIG 9 is a flowchart describing learning process learning the tap factor;

图10是描述图像转换单元31的处理的流程图; FIG 10 is a flowchart of the image conversion unit 31 is described;

图11示出了作为学习放置位置上学习设备的图像拾取设备的笫 Zi FIG. 11 shows a learning apparatus as learning image placement on the pickup device

一具体实施例的配置实例的方框图; A block diagram of a configuration example of a particular embodiment of the embodiment;

图12示出了传感器231的配置实例的方框图; FIG 12 illustrates a block diagram of a configuration example of the sensor 231;

图13A到13D是描述控制R感光器单元256、G感光器单元256G 13A to 13D are described units control the R photoreceptor 256, G photoreceptor unit 256G

和B感光器单元256B的放置位置的框图; And B photoreceptor unit 256B is a block diagram showing the placement position;

图14示出了评估单元235的配置实例的方框图; FIG 14 illustrates a block diagram of a configuration example of the evaluation unit 235;

图15示出了位置确定单元236的配置实例的方框图; FIG 15 illustrates a block diagram of a configuration example of the position determination unit 236;

图16是描述图像拾取设备作为学习设备的学习过程的流程图; FIG 16 is a flowchart of the learning process as the image pickup apparatus described learning device;

图17示出了已应用本发明的计算机的配置实例的方框图; FIG 17 illustrates a block diagram of a configuration example of a computer according to the present invention has been applied;

图18示出了已应用本发明的图像拾取设备的第二具体实施例的 FIG 18 shows a second embodiment of the present invention has been applied to an image pickup apparatus

配置实例的方框图; Configuration example of a block diagram;

图19示出了信号处理单元404和输出单元405的配置实例的方框 FIG 19 shows a block configuration example of the signal processing unit 404 and the output unit 405

图; Figure;

图20示出了传感器单元401的配置实例的方框图; 图21A到21D是描述控制R感光器单元423R、 G感光器单元423G 和B感光器单元423RB的放置位置的框图; FIG 20 illustrates a block diagram of a configuration example of the sensor unit 401; FIG. 21A to 21D are described 423R, a block diagram of the placement of the photoreceptor unit 423G G and B photoreceptors control unit 423RB R photoreceptor unit;

图22是说明信号处理单元411的配置实例的方框图; FIG 22 is a block diagram of a configuration example of the signal processing unit 411 is described;

图23是说明评估单元433的第一配置实例的方框图; FIG 23 is a block diagram of the evaluation unit 433 of the first configuration example described;

图24是说明偏移量和相关值之间的关系的框图; FIG 24 is a block diagram of the relationship between the offset values ​​and the associated instructions;

图25是描述图像拾取设备的操作的流程图; FIG 25 is a flowchart describing the operation of the image pickup apparatus;

图26是描述评估单元433所进行的评估处理的流程图;图27是说明已应用本发明的图像拾取设备的第三具体实施例的配置实例的方框图; FIG 26 is a flowchart showing the evaluation processing for the evaluation unit 433 is described; FIG. 27 is a block diagram of a configuration example of a third embodiment of the present invention has been applied to an image pickup apparatus described;

图28是说明信号处理单元411的配置实例的方框图; 图29是说明图像转换单元431的配置实例的方框图; 图30是说明因数输出单元124的另一配置实例的方框图; 图31是描述抽头因数更新处理的流程图; FIG 28 is a block diagram of a configuration example of the signal processing unit 411 is described; FIG. 29 is a block diagram of a configuration example of an explanatory image converting unit 431; FIG. 30 is a block diagram illustrating another configuration example of a coefficient output unit 124; FIG. 31 is described with tap factor flowchart of a process of updating;

图32是说明学习因数种子数据的学习设备的第一配置实例的方框图; FIG 32 is a block diagram of a first configuration example of a learning apparatus described learning factor seed data;

图33是描述学习因数种子数据的学习方法的框图; 图34是描述学习因数种子数据的学习过程的流程图; 图35是描述学习因数种子数据的学习方法的框图; 图36是说明学习因数种子数据的学习设备的第二配置实例的方框图; FIG 33 is a block diagram describing the learning method of learning factor seed data; FIG. 34 is a flowchart describing the process of learning the learning factor seed data; FIG. 35 is a block diagram describing the learning method of learning factor seed data; FIG. 36 is a learning factor seed a block diagram of a second configuration example of the learning apparatus of the data;

图37是说明信号处理单元411的配置实例的方框图; FIG 37 is a block diagram of a configuration example of the signal processing unit 411 is described;

图38是说明控制单元211的配置实例的方框图; FIG 38 is a block diagram showing a configuration example of the control unit 211 is described;

图39是描述图像拾取设备的操作的流程图; FIG 39 is a flowchart describing the operation of the image pickup apparatus;

图40是说明学习参数表的学习设备的配置实例的方框图; FIG 40 is a block diagram of a configuration example of a learning apparatus described learning parameter table;

图41是说明位置确定单元5 3 5的配置实例的方框图; FIG 41 is a block diagram illustrating an example of the configuration unit 535 to determine a position;

图42是描述学习一种参数表的学习过程的流程图; FIG 42 is a flowchart describing learning a learning process parameter table;

图43是描述对位置确定单元535进行评估处理的流程图; FIG 43 is a flowchart describing the position determination unit 535 of the evaluation process;

图44是说明已应用本发明的图像拾取设备的第四具体实施例的 FIG 44 is a diagram illustrating a fourth embodiment of the present invention is applied has an image pickup device

配置实例的方框图; Configuration example of a block diagram;

图45A和45B是描述传感器单元601根据信号处理单元601输出 45A and 45B are described sensor unit 601 according to a signal processing unit 601 outputs

的控制信号而在特性上变化的框图; A block diagram of a control signal change in characteristic;

图46是说明传感器601的配置实例的方框图; FIG 46 is a block diagram illustrating a configuration example of the sensor 601;

图47是说明信号处理单元604的配置实例的方框图; FIG 47 is a block diagram showing a configuration example of the signal processing unit 604 is described;

图48是说明级别评估单元623的第一配置实例的方框图; FIG 48 is a block diagram showing a configuration example of a first level evaluation unit 623 described;

图49是描述图像拾取设备的操作的流程图; FIG 49 is a flowchart describing the operation of the image pickup apparatus;

图50是描述级别评估单元623的处理的流程图;图51是描述图像拾取设备的操作的流程图; 图52是说明级别评估单元623的第二配置实例的方框图; 图53是说明级别评估单元623的第三配置实例的方框图; 图54是说明图像转换处理目标的区域的框图; 图55是说明已应用本发明的传感器系统的第五具体实施例的配置实例的方框图; FIG 50 is a flowchart of the level evaluation unit 623 is described; FIG. 51 is a flowchart describing the operation of the image pickup apparatus; FIG. 52 is a block diagram of the second level evaluation unit 623 described configuration example; FIG. 53 illustrates the level of the evaluation unit a block diagram of a third configuration example 623; FIG. 54 is a block diagram of the image conversion processing target region explanatory; FIG. 55 is a configuration example of a fifth embodiment of the present invention has been applied to the sensor system block diagram;

图56是说明DRC电路802的第一配置实例的方框图; 图57A和57B分别是说明分类抽头和预测抽头的框图; 图58A到58C是说明已应用本发明的传感器系统的配置实例的框 FIG 56 is a block diagram of the first configuration example described DRC circuit 802; FIGS. 57A and 57B are diagrams prediction tap and the class tap of a block diagram; FIGS. 58A to 58C are explanatory block configuration example of the sensor system applied to the present invention.

图; Figure;

图59A和59B是描述控制聚光镜852的位置的框图; FIGS 59A and 59B are a block diagram depicting the position control of the condenser lens 852;

图60A和60B是描述分类代码的框图; FIGS 60A and 60B is a block classification codes are described;

图61是描述DRC电路802的处理的流程图; FIG 61 is a flowchart describing the processing circuit 802 of the DRC;

图62是描述控制信息产生处理的流程图; FIG 62 is a flowchart description of the control information generating processing;

图63A到63C是描述控制聚光镜852的位置的框图; 63A to FIG. 63C is a block diagram depicting the position control of the condenser lens 852;

图64是描述控制信息产生处理的流程图; FIG 64 is a flowchart description of the control information generating processing;

图65是说明DRC电路802的第二配置实例的方框图; FIG 65 is a block diagram illustrating a second configuration example of the DRC circuit 802;

图66A和66B是描述分类抽头的动态范围的框图; FIGS 66A and 66B are a block diagram depicting the dynamic range of the class tap;

图67是描述DRC电路802的处理的流程图; FIG 67 is a flowchart describing the processing circuit 802 of the DRC;

图68是描述控制信息产生处理的流程图; FIG 68 is a flowchart description of the control information generating processing;

图69是描述控制信息产生处理的流程图;以及 FIG 69 is a flowchart description of the control information generating process; and

图70是说明DRC电路802的第三配置实例的方框图。 FIG 70 is a block diagram of a third configuration example of a DRC circuit 802 will be described.

具体实施方式 detailed description

接下来,将描述本发明的具体实施例。 Next, a specific embodiment of the present invention will be described. 第一具体实施例 First embodiment

图1示出了已应用本发明的图像拾取设备的第一具体实施例的配置实例。 FIG 1 shows a configuration example of a first embodiment of an image pickup apparatus of the present invention has been applied. 请注意图1所示的这个图像拾取设备可以是例如数字式静态照相机或摄像机。 Note that the image pickup apparatus shown in FIG. 1 may be, for example, a digital still camera or a video camera. 假定在这里该图像拾取设备是一种数字摄像机。 Here it is assumed that the image pickup apparatus is a digital camera.

传感器单元l包括多个与像素相对应的光电转换元件,用于感测从物体发出的物体光,并输出与该物体光相对应的图像信号。 The sensor unit comprises a plurality l photoelectric conversion element corresponding to a pixel for sensing the object light emitted from the object, and outputs an image signal corresponding to light the object. 也就是说,传感器单元1接收物体光并向信号调整单元2提供与所接收的光量相对应的电信号形式的图像信号。 That is, to provide an electrical signal in the form of two sensor unit 1 receives object light signal adjusting unit quantity of light corresponding to the received image signal.

信号调整单元2执行相关的复式抽样(CDS),以消除包含在传感器单元1输出的图像信号中的所谓的复位噪音,并且将获得的作为处理结果的图像信号提供给A/D转换单元3。 Signal adjusting unit 2 performs correlation duplex sampling (the CDS), in order to eliminate a so-called reset noise included in the image signal of the sensor unit 1 is outputted, and provides an image signal processing result to the A / D converting unit 3 will be obtained. A/D转换单元3对信号调整单元2提供的图像信号执行模数转换,即量化图像信号并将所获得的作为其结果的数字图像信号提供给信号处理单元4。 A / D conversion unit 3 to provide a signal adjusting unit 2 performs analog to digital conversion image signal, i.e., as a result of the quantization of the image signal and a digital image signal obtained to the signal processing unit 4.

信号处理单元4将A/D转换单元3提供的数字图像信号(以下简称为',图像信号")作为第一图像信号,并使第一图像信号经受预定的图像转换处理,并向输出单元5输出作为其结果的数字图像信号作为第二图像信号。 Digital image signal processing unit 4 A / D conversion unit 3 (hereinafter referred to as "image signal") as a first image signal, and the first image signal is subjected to predetermined image conversion processing to the output unit 5 as a result, output digital image signal as the second image signal.

输出单元5接收信号处理单元4输出的第二图像信号,并输出这些第二图像信号。 Receiving a second signal output unit 5 outputs the image signal processing unit 4, and outputs the second image signal. 也就是说,输出单元5从未示出的输出端输出来自信号处理单元4的笫二图像信号,或者将其显示在未示出的监视器上。 That is, the output terminal of the output unit 5 has never been shown Zi two output image signal from the signal processing unit 4, or be displayed on a monitor (not shown). 此外,输出单元5将第二图像信号存储在未示出的记录介质中,诸如光盘、磁盘、磁光盘、磁带,半导体存储器等等,或者通过如电话线、 因特网、局域网或其他的如电缆或无线传输介质发送这些图像信号。 Further, the output unit 5 of the second image signal stored in a recording medium (not shown), such as optical disk, magnetic disk, optical disk, magnetic tape, semiconductor memory, etc., or by such as a telephone line, the Internet, a local area network or cable, or other wireless transmission medium transmitting the image signals.

对于上述配置的图像拾取设备而言,物体光是在传感器单元l处接收的,并且通过信号调整单元2和A/D转换单元3,将与所接收到的光量相对应的电信号形式的图像信号提供给信号处理单元4。 For the above configuration the image pickup device concerned, and the object light by the signal adjusting unit 2 and A / D conversion unit 3, the amount of light received and the form of electrical signals corresponding to the image received at the sensor unit l, signal to the signal processing unit 4. 信号处理单元4使传感器单元1通过信号调整单元2和A/D转换单元3提供的图像信号作为第一图像信号经受信号处理,该信号处理是像例如通过提高分辩率来提高图像质量的图像转换处理,并且将已藉此提高了图像质量的第二图像信号提供给输出单元5。 The sensor signal processing unit 4 is subjected to a signal processing unit 1 as a first image signal and an image signal through two A / D conversion unit 3 is supplied a signal adjustment unit, the image signal processing is to improve the image quality by improving the resolution of the image conversion e.g. processing, and thereby has improved image quality of the second image signal is supplied to the output unit 5. 在输出单元5中,输出信号处理单元4提供的第二图像信号。 The second image signal output unit 5, the output signal processing unit 4 is provided.

此时,传感器单元1被设置为与在信号处理单元4处执行的信号处理相对应的属性,即设置属性以使从传感器单元1输出适合于信号处理单元4执行信号处理的图像信号。 In this case, the sensor unit 1 is set to the signal processing unit 4 performs signal processing corresponding to the property, i.e., property is provided so that the image signal output from the sensor unit adapted to perform signal processing in the signal processing unit 4.

更具体地说,传感器单元1是一种三-传感器系统传感器装置, More specifically, the sensor unit 1 is a three - sensor means sensor system,

例如包括三个用于获得图像信号的R、 G和B分量(随后所述的R感光器单元23R、 G感光器单元23G和B感光器单元23B)的传感器。 Includes, for example three sensors for obtaining image signals R, G and B components (subsequently said R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B) is. 因此,传感器单元1为每个像素输出具有R信号、G信号和B信号三个分量的图像信号。 Thus, for each pixel of the sensor unit 1 outputs a signal of R, G and B signals of three components of the image signal. 此外,事先通过随后所描述的学习来获得用于从传感器单元1输出适合于信号处理单元4执行信号处理的图像信号的与传感器单元1的属性有关的信息,并且将传感器单元1设置为该属性。 Further, by learning described later in advance to obtain an output from the sensor unit 1 is adapted to the information related to the image signal processing unit 4 performs signal processing unit 1 and the properties of the sensor, and the sensor unit 1 is set as the attribute . 具体地说,传感器单元1的三个传感器中的一个或多个传感器的放置状态被设置为下述状态:即由此传感器单元1输出适于信号处理单元4执行信号处理的图像信号,即被设置为与信号处理单元4执行的信号处理相对应的放置状态。 Specifically, the three sensors the sensor unit 1 in a state of placing or more sensors are provided to a state: i.e., whereby the sensor unit is adapted to output the image signal processing unit 4 performs signal processing, i.e. to the signal processing unit 4 performs signal processing corresponding to the placement state. 此刻,传感器放置状态包括传感器的放置位置,和传感器的空间角度(转动状态)。 At the moment, the sensor placement state comprises placing a position sensor, and the spatial angle sensor (rotation state). 然而,请注意对于当前具体实施例而言,为了便于描述,传感器单元1的传感器的放置位置将被作为传感器单元1的属性利用。 Note, however, for purposes of this embodiment, for convenience of description, the sensor placement sensor unit 1 will be used as the sensor unit 1 of the attribute. 当然,这并不意味着传感器的空间角度不能同样作为传感器单元1的属性来使用。 Of course, this does not mean the same spatial angle sensor used as the sensor unit 1 of the attribute.

如上所述,传感器单元1被设置为与信号处理单元4执行的信号处理相对应的属性,藉此传感器单元1输出适于信号处理单元4执行信号处理的图像信号。 As described above, the sensor unit 1 is set to the signal processing unit 4 performs signal processing corresponding to the attribute, whereby the sensor unit is adapted to output the image signal processing unit 4 performs signal processing. 从而,在信号处理单元4使图像信号经受信号处理可以获得高质量图像信号。 Thus, in the signal processing unit 4 of the image signal is subjected to signal processing high-quality image signal can be obtained.

图2是说明图l所示的信号处理单元4和输出单元5的配置实例的方框图; FIG 2 is a block diagram illustrating the configuration of the signal processing unit and the output unit 4 shown in an example of FIG. 5 L;

信号处理单元4包括三个信号处理单元,IIR、 11G和IIB。 The signal processing unit 4 comprises three signal processing unit, IIR, 11G and IIB. 信号处理单元IIR接收A/D转换单元3提供的具有R、 G和B信号的第一图像信号,并使该第一图像信号经受信号处理,藉此获得第二图像信号的R信号(分量)将其输出到输出单元5。 The signal processing unit receives the IIR A / a first image signal having R, G and B signals supplied D conversion unit 3, and the first image signal is subjected to signal processing, thereby obtaining a second image signal, the R signal (component) outputs to the output unit 5. 信号处理单元IIG接收A/D转换单元3提供的具有R、 G和B信号的第一图像信号,并使第一图像信号经受信号处理,藉此获得第二图像信号的G信号(分量)5。 IIG signal processing unit receives the A / a first image signal having R, G and B signals supplied D conversion unit 3, and a first image signal is subjected to signal processing, thereby obtaining a second image signal, G signal (component) 5 . 信号处理单元11B接收A/D转换单元3提供的具有R、 G和B信号的第一图像信号,并使第一图像信号经受信号处理,藉此获得第二图像信号的B信号(分量),然后将其输出到输出单元5。 The signal processing unit 11B receives the A / having a first image signals R, G and B signals supplied D conversion unit 3, and a first image signal is subjected to signal processing, thereby obtaining the B signal (component) of the second image signal, and then output to the output unit 5.

输出单元5包括输出单元12R、 12G和12B。 The output unit 5 includes an output unit 12R, 12G and 12B. 输出单元12R、 12G 和12B分别接收并输出信号处理单元11R、 IIG和IIB输出的第二图像信号的R信号、G信号和B信号。 R signal output unit 12R, 12G and 12B of the second image signals are received and output signal processing unit 11R, IIG and output IIB, G and B signals. 请注意,在下文中,只要适当的时候,信号处理单元11R、 11G和/或IIB也可以是整体或个体,筒称为"信号处理单元11"。 Note that, hereinafter, as long as the appropriate time, the signal processing unit 11R, 11G, and / or IIB may be wholly or individual tube referred to as "signal processing unit 11."

接着,图3是说明图1和2所示的传感器单元1的配置实例的方框图;物体光射入透镜21,并且透镜21通过棱镜22将物体光聚集到R感光器单元23R、 G感光器单元23G和B感光器单元23B的每一个上。 Next, FIG. 3 is a block diagram illustrating a configuration example of the sensor unit shown in FIG. 2 and 1; object light enters lens 21, lens 21 and the object light onto the R photoreceptor unit 23R, G photoreceptor unit through the prism 22 23G and B on each photoreceptor unit 23B. 也就是说,射入透镜21中的物体光被发射到棱镜22。 That is, the lens 21 is incident on the object light is emitted to the prism 22. 棱镜22将来自透镜21的物体光分解为R、 G和B光,并且分别沿R感光器单元23R、 G感光器单元23G和B感光器单元23B所处位置的方向发射R、 G和B光。 Prism 22 from the object lens 21 photodecomposition of R, G and B light, and emit R, G and B light direction R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B's location .

R感光器单元23R、 G感光器单元23G和B感光器单元23B #皮配置为光电转换装置,像例如光电二级管此类,其从棱镜22接收R、 G 和B光,并藉此产生作为与所接收的光量相对应的电信号形式的R信号、G信号和B信号,然后将这些信号输出到信号调整单元2。 R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B # photoelectric conversion apparatus configured to skin, such as for example a photodiode, which receives R, G and B light from the prism 22, and thereby generating as a form of electrical signals received light amount corresponding to the signals R, G and B signals, and then outputs these signals to the signal adjusting unit 2.

可以用于R感光器单元23R、G感光器单元23G和B感光器单元23B的装置的一个实例是CCD(电荷耦合器件)。 R may be used in the photoreceptor unit 23R, an example of a device G photoreceptor unit 23G, and B photoreceptor unit 23B is a CCD (charge coupled device). 但是,请注意R感光器单元23R、G感光器单元23G和B感光器单元23B绝非仅限于CCD, 其也可以使用CMOS传感器,或HARP(高增益雪崩沖击非晶态光电导体)来替换,该HARP是利用发生在a-Se (非晶态硒)半导体的光电导靶中的电子雪崩现象的显象管。 However, note that R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B no means limited to CCD, boosts a CMOS sensor may be used, or the HARP (High Impact Avalanche gain amorphous photoconductor) is replaced , using the HARP kinescope electron avalanche phenomenon occurs in the photoconductive target a-Se (amorphous selenium) in a semiconductor.

对于上述配置的传感器单元1而言,R感光器单元23R、 G感光器单元23G和B感光器单元23B的放置位置被设置到适于在信号处理单元4的信号处理单元IIR、 IIG和11B中进行信号处理的图像信号的RGB信号被输出的位置上。 For the above-described configuration of the sensor unit 1, R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B is arranged to place in the signal processing unit adapted to signal processing unit 4 of IIR, IIG and 11B position RGB signal of the image signal subjected to signal processing are output on. 也就是说,R感光器单元23R、 G感光器单元23G和B感光器单元23B被放置在与信号处理单元4执行信号处理相对应的位置上。 That is, R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B is disposed at a position signal processing unit performs signal processing on the corresponding 4. 此刻,例如通过执行随后所描述的学习来事先获得与信号处理单元4执行信号处理相对应的R感光器单元23R、 G 感光器单元23G和B感光器单元23B的放置位置。 At the moment, for example, prior to the placement of the signal processing unit 4 performs signal processing corresponding to the R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B by performing the learning described later.

在这里为了便于描述,假定整个R感光器单元23R的放置位置已被设置到通过学习获得的位置上。 For ease of description herein, it is assumed throughout the placement R photoreceptor unit 23R has been set to the position obtained by learning. 此外,假定整个G感光器单元23G 和B感光器单元23B的放置位置已被设置到通过学习获得的位置上。 Furthermore, assuming that the placement of the entire G photoreceptor unit 23G, and B photoreceptor unit 23B has been set to the position obtained by learning. 然而,应注意为了将R感光器单元23R的每一像素放置在通过学习获得的位置上,可以使用MEMS (微机电系统)技术来进行安排,由此所利用的R感光器单元23R是一个在其中像素的放置位置基本可以改变(移动)的感光器单元,R感光器单元23R的每一像素的放置位置都是通过学习预先获得的,且对应于在信号处理单元4处进行的信号处理。 However, it should be noted that for each pixel of the R photoreceptor unit 23R disposed in a position obtained by learning on, may be used MEMS (microelectromechanical systems) technology to arrange, whereby utilized R is a photoconductor unit 23R in wherein the placement of the pixel can be substantially changing (moving) the photoreceptor unit, the placement of each pixel unit 23R R photoreceptor is obtained in advance by learning, and the signal corresponding to the signal processing unit 4 is performed. 这对于G感光器单元23G和B感光器单元23B也同样成立。 This is also true for the G photoreceptor unit 23G, and B photoreceptor unit 23B.

接着,图4是示出了2所示的信号处理单元11的配置实例;已向信号处理单元IIR、 IIG和IIB提供由传感器l输出的并经过图像校正单元2和A/D转换单元3的作为第一图像信号的图像信号。 Next, FIG. 4 is a diagram illustrating a configuration example of the signal processing unit 11 shown in FIG. 2; a signal processing unit has IIR, IIG and IIB provided by the output of the sensor l and after the image correcting unit 2 and A / D conversion unit 3 a first image signal as an image signal.

信号处理单元11R包括图像转换单元31R。 The signal processing unit includes an image converting unit 11R 31R. 提供给信号处理单元11R的第一图像信号被提供给图像转换单元31R。 A first image signal to the signal processing unit 11R are supplied to the image converting unit 31R. 图像转换单元31R 使第一图像信号经受图像转换处理,以例如通过提高分辩率来提高图像质量,并向输出单元5提供作为信号处理结果的具有提高图像质量的R数字图像信号作为笫二图像信号的R信号。 The image converting unit 31R of the first image signal subjected to the image conversion processing, for example, to improve the image quality by improving the resolution and provides the output unit 5 R digital image signal with enhanced image quality as the signal processing result as the second image signal Zi R signal.

信号处理单元11G包括图像转换单元31G。 The signal processing unit includes an image converting unit 11G 31G. 提供给信号处理单元1直G的第一图像信号被提供给图像转换单元31G。 A first image signal supplied to the signal processing unit G 1 is supplied to a linear image conversion unit 31G. 图像转换单元31G 使第一图像信号经受图像转换处理,以例如通过提高分辩率来提高图像质量,并向输出单元5提供作为信号处理结果的具有提高图像质量的G数字图像信号作为第二图像信号的G信号。 The image conversion unit 31G of the first image signal subjected to the image conversion processing, for example, to improve the image quality by improving the resolution, and G 5 provides a digital image signal with enhanced image quality as the signal processing result as the second image signal output unit G signal.

信号处理单元11B包括图像转换单元31B和图像存储单元32B。 The signal processing unit 11B includes an image converting unit 31B, and an image memory unit 32B. 提供给信号处理单元11B的第一图像信号被提供给图像转换单元31B。 A first image signal supplied to the signal processing unit 11B is supplied to the image converting unit 31B. 图像转换单元31B使第一图像信号经受图像转换处理,以例如通过提高分辩率来提高图像质量,并向输出单元5提供作为信号处理结果的具有提高图像质量的B数字图像信号作为第二图像信号的B信号。 The image conversion unit 31B of the first image signal subjected to the image conversion processing, for example, to improve the image quality by improving the resolution, and B digital image signals 5 to provide an image having improved quality as a result of the signal processing as the second image signal output unit B signal.

应注意,图像转换单元31R、 31G和31B具有相同的配置,并因此可视情况而合称或分称为"图像转换单元31"。 It is noted that the image conversion unit 31R, 31G, and 31B have the same configuration, and thus optionally be partial or collectively referred to as "the image conversion unit 31."

紧接着,将参考图5中的流程图来描述图l和2所示的图像拾取设备的操作。 Then, with reference to the flowchart of FIG. 5 to FIG l and operations of the image pickup apparatus shown in FIG. 2 is described.

对于图像拾取设备来说,首先,在步骤Sl中,信号处理羊元4 从传感器单元1获得将要经受信号处理的第一图像信号。 For the image pickup device, first, in step Sl, the signal processing unit 4 sheep 1 was subjected to a first image signal to be processed signal from the sensor unit. 也就是说, .在步骤Sl中,传感器单元l接收物体光,然后执行光电转换,藉此获得电信号形式的图像信号(即,使物体成像),并将图像信号提供给信号调整单元2。 That is, at step Sl, the light sensor unit to receive objects l, and then perform photoelectric conversion, thereby obtaining an electric signal in the form of an image signal (i.e., an object image), and supplies the image signal to the signal adjustment unit 2. 信号调整单元2使传感器单元1提供的图像信号经受CDS处理,然后将这些图像信号提供给A/D转换单元3。 Signal adjusting unit sensor unit 2 of the image signal is subjected to a CDS processing, and then supplies image signals to the A / D conversion unit 3. A/D转换单元3对信号调整单元2提供的图像信号执行A/D转换,然后将其作为笫一图像信号提供给信号处理单元4,从而,信号处理单元4获得第一图像信号,然后,流程步骤S1进行到步骤S2。 A / D conversion unit 3, the image signal adjustment unit provided 2 performs A / D conversion, and then supplied as an image signal Zi to the signal processing unit 4, whereby the signal processing unit 4 to obtain a first image signal, and then, process step S1 proceeds to step S2.

在步骤S2中,在信号处理单元4处,信号处理单元ll的图像转换单元31(图4 )使A/D转换单元3提供的第一图像信号经受作为信号处理的图像转换处理,藉此在第一图像信号之上产生图像质量提高的第二图像信号,然后流程进行到步骤S3。 In step S2, the signal processing unit 4, an image signal processing unit ll converting unit 31 (FIG. 4) of the first image signal A / D conversion unit 3 is subjected to image conversion processing as signal processing, whereby generating a second image on the first image signal of the image signal of improved quality, then the flow proceeds to step S3.

在步骤S3中,信号处理单元11输出在步骤S2获得的第二图像信号给输出单元5,藉此完成一个帧(或场)的处理。 In step S3, the second image signal processing unit 11 outputs the signal obtained at step S2 to the output unit 5, thereby completing the processing of one frame (or field). 对于图像拾取设备而言,重复根据图5的流程图的处理,直到例如用户下达停止图像拾取的命令。 For the image pickup apparatus, the processing is repeated in accordance with the flowchart of FIG. 5, for example, a user issued a stop command until the image pickup.

如上所述,传感器单元1 (图3 )的R感光器单元23R、 G感光器单元23G和B感光器单元23B的放置位置已被设置到适于在信号处理单元4 (信号处理单元IIR、 11G和11B )进行信号处理的RGB图像信号被输出的位置上。 As described above, the sensor unit 1 (FIG. 3) of the R photoreceptor unit 23R, G photoreceptor unit 23G, and the B photoreceptor unit 23B has been set to the placement of suitable 4 (IIR signal processing unit the signal processing unit, 11G RGB image signal and the position 11B) performing signal processing is outputted on. 也就是说,R感光器单元23R、 G感光器单元23G和B感光器单元23B被放置在与信号处理单元4的信号处理相对应的位置上。 That is, R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B is disposed at a position signal processing unit processing a signal of the corresponding 4. 因此,适于在信号处理单元4进行信号处理的图像信号从传感器单元1输出,如此通过使图像信号经受信号处理可以获得高质量图像。 Thus, the image signal 4 is adapted to perform signal processing of the signal processing unit outputs from the sensor unit 1, thus a high quality image can be obtained by passing the image signal to signal processing.

接着,图6是说明图4所示的图像转换单元31的配置实例的方框图。 Next, FIG. 6 is a block diagram illustrating the configuration example of FIG 4, the image converting unit 31 shown in FIG. 图像转换单元31使提供给其的第一图像信号经受图像转换处理, 并输出通过图像转换处理而获得的第二图像信号。 Image converting unit 31 is supplied to a first image signal which is subjected to the image conversion processing, and outputs a second image signal obtained by the image conversion processing.

此刻,如果我们例如说,第一图像信号是低分辨率图像信号,而笫二图像信号是高分辨率图像信号,那么图像转换处理可以说成是分辩率提高处理。 Now, if we say, for example, the first image signal is a low resolution image signal, and the undertaking of two high-resolution image signal is an image signal, the image conversion processing can be said to improve the resolution process. 此外,如果我们例如说,第一图像信号是低-S/N(信号/噪音,信噪比)图像信号,而第二图像信号是高-S/N图像信号, 那么图像转换处理可以说成是噪音去除处理。 Also, if we say, for example, the first image signal is a low -S / N (signal / noise noise ratio) image signal, and the second image signal is a high -S / N image signal, the image conversion processing can be said to a noise removal process. 此外,如果我们例如说, 第一图像信号是预定大小的图像信号,而第二图像信号是大于或小于第一图像信号的大小的图像信号,那么图像转换处理也可以说成是图像缩放(扩大或缩小)处理。 Also, if we say, for example, the first image signal is an image signal of a predetermined magnitude, and the second image signal is an image signal is larger or smaller than the size of the first image signal, the image conversion process may be said to be an image scaling (expansion or reduction) processing.

在图像转换单元31中,要经受图像转换处理的第一图像信号被提供给预测抽头提取单元121和特征提取单元122。 A first image signal in the image conversion unit 31, to be subjected to the image conversion processing is supplied to the prediction tap extracting unit 121 and feature extraction unit 122.

预测抽头提取单元121顺序地获得构成第二图像信号的像素作为所关心像素,并且进一步提取构成第一图像信号的几个像素(其像素值)作为预测抽头。 Prediction tap extracting unit 121 sequentially obtain a second image signal composed of pixels as a pixel of interest, and further extracts several pixels (pixel values) constituting the prediction tap as the first image signal. 具体地说,预测抽头提取单元121从第一图像信号提取在第一图像信号中的与所关心的像素相对应的笫一图像信号中的某一像素(例如,第一图像信号中的最接近所关心的空间序列和时间序列像素的像素)的邻近空间序列或时间序列的多个像素,作为预测抽头。 The pixel of interest corresponding to an image signal Zi Specifically, the prediction tap extracting unit 121 extracts a first image signal from the first image signal of a certain pixel (e.g., the first image signal closest to pixel spatial sequence and time series of the pixel of interest) of the plurality of pixels adjacent to the spatial sequence or time series, as a prediction tap. 预测抽头提取单元121然后将有关所关心的像素的预测抽头提供给计算单元125。 Prediction tap extracting unit 121 and the pixel of interest related to the prediction tap to the calculating unit 125.

特征提取单元122使用第一图像信号提取所关心像素的特征,并将该特征提供给类分类单元123。 Using the first image signal unit 122 extracts a feature extraction feature pixel of interest, and supplies the features to the class classifying unit 123. 可被使用的所关心像素的实例包括第一图像信号中的与所关心的像素相对应的第一图像信号中某一像素的邻近空间序列或时间序列的多个像素的像素值的级别分布,等等。 Examples which may be used include the pixel of interest level distribution of pixel values ​​of the first image signal a first image signal and the pixel of interest corresponding to a plurality of pixels adjacent to the certain pixel or spatial sequence of the time series, and many more. 类分类单元123执行类分类,以根据来自特征提取单元122的所关心像素的特征,将所关心的像素分到多个类中的一个,并且将作为结果所获得的与该类相对应的分类代码提供给因数输出单元124。 Class classification unit 123 performs class classification for the feature pixel of interest from the feature extraction unit 122, the pixel of interest assigned to more than one class, and the results obtained with a corresponding class classification code to the coefficient output unit 124. 也就是说,在所关心的像素的特征由学者值,或通过量化学者值而获得的量化值表示时,类分类单元123输出学者值本身作为分类代码。 That is, when the quantization value represents a pixel of interest characterized by a scholar value obtained by quantization or the scholar value, class classifying unit 123 outputs a class code value itself scholars. 此外,在所关心像素的特征由多个分量构成的矢量值表示时,类分类单元123输出通过量化矢量值而获得的值,或是通过ADRC (自适应动态范围编码)获得的值作为分类代码。 Further, when the value of the vector represents the pixel of interest is characterized by a plurality of components constituting the class classifying unit 123 outputs a vector obtained by quantizing the value, or the value by the ADRC (Adaptive Dynamic Range Coding) as a class code obtained .

此刻,对于K位ADRC而言,例如检测构成表示所关心像素的特征的矢量值的分量的最大值MAX和最小值MIN,并且使用作为一组的局部动态范围的DR-MAX-MIN,才艮据这个动态范围DR将构成所关心像素的特征的分量再次量化成K位。 At the moment, for the K-bit ADRC, for example, indicating the detection of characteristic pixels constituting a component of interest maximum value MAX and minimum value MIN vector value, and using the DR-MAX-MIN as a local dynamic range of a group, it Gen According to this dynamic range DR of the pixels constituting the feature of interest re-quantized into K bits components. 也就是说,最小值MIN被从构成所关心像素的特征的分量中减去,并且被减的值除(被量化) DR/2K。 That is, the minimum value MIN is subtracted from the component constituting the feature of the pixel of interest, and the other is decremented value (quantized) DR / 2K. 在其中根据预定顺序排列构成所关心像素的特征的K位分量的一位串被作为ADRC代码输出。 Wherein it is output as an ADRC code string K bits according to a predetermined order of components constituting the feature of the pixel of interest. 因此,在表示所关心像素的特征的矢量值经受l位ADRC处理的情况下,构成所关心像素的特征的每个分量除以最大值MAX和最小值MIN的平均值(舍入到小数),借此每个分量变为一个位(即,二进位化)。 Accordingly, in the pixel of interest in showing a case where the vector value is subjected to l-bit ADRC processing, wherein each component constituting the pixel of interest divided by the maximum value MAX and the minimum value MIN is an average value (rounded to one decimal), whereby each component becomes a bit (i.e., binarized). 其中以预定顺序排列l位分量的位串被作为ADRC代码输出。 Arranged in a predetermined order wherein the ADRC code output bit string is used as component l bits. 类分类单元123输出例如通过对所关心像素的特征进行ADRC处理所获得的ADRC代码作为分类代码。 Class classifying unit 123, for example, ADRC code output by the pixel of interest is characterized in ADRC processing as the class code obtained.

因数输出单元124存储每一类的抽头因数,并且此外对已存储的抽头因数,向计算单元125输出类分类单元123提供的分类代码的类 Factor class tap coefficient output unit 124 stores for each class, and in addition to the tap factor stored, the calculation unit 125 provides the category classification unit 123 outputs a class code

的抽头因数。 Tap factor. 应当注意的是,在这里抽头因数等于在数字滤波器中的所谓抽头中乘以输入数据的因数。 It should be noted that where the tap factor is equal to the so-called tap in a digital filter in the input multiplied by a factor of data.

计算单元125获得预测抽头提取单元121输出的预测抽头和因数输出单元124输出的抽头因数,并且使用预测抽头和抽头因数执行预定的预测计算,以获得所关心像素的真实值的预测值。 Factor calculating unit 125 obtains the prediction tap output from the tap extracting unit 121 and the prediction tap output from the coefficient output unit 124, and performs a predetermined prediction calculation using the prediction taps and the tap factor to obtain predicted values ​​of the true value of the pixel of interest. 因此,计算单元125获得并输出所关心像素的像素值(更准确地说,或它的预测值), 即构成第二图像信号的像素的像素值。 Accordingly, the calculation unit 125 and outputs the pixel value of the pixel of interest (more accurately, or its predicted value), i.e., pixel values ​​of pixels constituting the second image signal. 接着,图7是说明图6所示的因数输出单元124的配置实例的方框图。 Next, FIG. 7 is a block diagram illustrating a configuration example of coefficient output unit shown in FIG. 6 124. 在图7中,因数输出单元124包括因数存储器181。 In FIG. 7, the output unit 124 comprises a factor memory 181 factor. 因数存储器181存储通过随后所述学习而预先获得的每个类的抽头因数。 The memory 181 stores factor by subsequent learning in advance of the class tap obtained for each factor. 一旦类分类单元123已将分类代码提供到该因数存储器181,因数存储器181就读出该分类代码的抽头因数,并将其提供给计算单元125。 Once the class classifying unit 123 has classification code memory 181 is supplied to the factor, the factor memory 181 reads the tap factor of the class code, and supplies it to the calculation unit 125.

接着,将描述在图6所示的计算单元125中执行的预测计算和用于预测计算的存储在图7所示的因数存储器181中的抽头因数的学习。 Next, the tap factor learning prediction calculation performed in the calculation unit 125 shown in FIG. 6 and stored in the prediction calculation factor for the memory 181 shown in FIG 7 will be described.

假定我们有作为第二图像信号的高图像质量图像信号和作为第一图像信号的低质量信号,该低质量信号是通过使用降低其分辨率的LPF (低通滤波器)对高图像质量图像信号进行过滤而获得。 Suppose we have a high image quality image signal as the second image signal as the low quality signal and a first image signal, the low quality signal is obtained by reducing the resolution using the LPF (low pass filter) on the image signal of high image quality filtering to obtain. 现在我们将考虑这样的例子,即从低图像质量图像信号提取预测抽头,并根据预定的预测计算,使用预测抽头和抽头因数来获得高图像质量像素的像素值。 We will now consider the example in which the low image quality image signal extracting prediction tap and a predetermined prediction calculated, using the prediction taps and the tap factor to obtain high image quality pixel value of the pixel.

例如使用线性基本预测计算作为预定的预测计算,通过以下线性基本表达式可以获得高图像质量像素的像素值y。 For example, substantially linear prediction calculates a predetermined prediction calculation, the pixel can obtain a high image quality pixel value y by the following linear primary expression.

y= !>nxn y =!> nxn

n爿(1) n valves (1)

其中Xn表示构成有关高图像质量像素y的预测抽头的第n个低图像质量图像信号像素的像素值(以下视情况称为"低图像质量像素"), 和Wn表示要与笫n个低图像质量像素的像素值相乘的第11个抽头因数。 Wherein Xn represents a pixel value of the image constituting prediction taps for the high-quality pixel y of the n-th low image quality image signal of the pixel (hereinafter, optionally referred to as "low image quality pixel"), and Wn indicates to the n low image Zi multiplying the pixel values ​​of the pixels of mass of 11 taps factor. 请注意,在表达式(1)中,预测抽头包括N个低图像质量像素 Note that, in Expression (1), the prediction tap comprising N low image quality pixels

Xl、 X2等等直到Xn。 Xl, X2, and so on until Xn.

此刻,高图像质量像素的像素值y可以通过二次表达式或更高阶的表达式来获得,而不是表达式(1)的线性基本表达式。 At the moment, the high image quality pixel value y of a pixel may be obtained by a quadratic expression or higher order expression instead of the linear expression (1) a primary expression.

对于由yk表示的第k个采样的高图像质量像素的像素值的真实值和从表达式1获得的真实值yk的预测值yk'而言,它的预测误差&如以下表达式示出。 For the pixel k-th sample high quality image represented by the true value yk and the pixel values ​​of the true value yk obtained by Expression 1 from the predicted value yk ', the prediction error & such that the following expression is shown.

ek„' (2)在这里,表达式(2)中的预测值yk'是根据表达式(1)获得的, 因此根据表达式(1)代入表达式(2)的yk'中而得到下列表达式。 ,w 、 ek " '(2) Here, the prediction value yk expression (2)' in is the expression (1) obtained according to yk thus obtained has the following expression (1) is substituted into the expression (2) 'of expressions., w,

Vn=1 / (3) 请注意,在表达式(3)中,Xn,k表示构成有关笫k个采样的高图 Vn = 1 / (3) Note that, in Expression (3), Xn, k represents the k samples constituting about Zi FIG high

像质量像素的预测抽头的第n个低图像质量像素。 The image quality of the pixel of the n-th prediction tap low image quality pixels.

此刻,虽然在表达式(3)(或在表达式(2))中具有预测误差ek为0的抽头因数wn对于预测高图像质量像素是最佳的,但是为所有高图像质量像素获得像抽头因数wn这样的抽头因数通常是很困难的。 At the moment, although the expression (3) (or Expression (2)) having a tap to the prediction error ek for predicting factor wn 0 pixel high image quality is the best, but to obtain the pixel image of high image quality for all the taps such factors wn tap factor is often very difficult.

因此,使用作为最佳抽头因数Wn的标准表示的最小平方法,可以通过最小化下列表达式表示的误差平方和E来获得最佳抽头因数Wn。 Thus, as a standard method of least squares optimal tap factor Wn represented, and can be squared error E expressed by minimizing the following expression to obtain the optimal tap factor Wn.

E= f ek2 E = f ek2

k=1 (4) k = 1 (4)

其中K表示多组高图像质量像素yk和构成有关高图像质量像素 Wherein K represents a plurality of sets of the high image quality pixel yk and the high image quality pixel constituting about

yk的预测抽头的低图像质量像素Xl,k、 X2,k等直到Xn,k的采样数量(即, yk prediction tap low image quality pixel Xl, k, X2, k, etc. until the number of samples Xn, k (i.e.,

学习采样的数量)。 Learn number of samples).

使用Wn获得表达式(4)中的误差平方和E的最小值(极小值), 其中使用抽头因数Wn对和E进行偏微分而得到0,如表达式(5)所示。 Expression obtained using the minimum value Wn (4) of the square error E (minimum value), using the tap factor of Wn and obtained by partially differentiating E 0, expression (5).

<formula>formula see original document page 36</formula>因此,使用Wn对上述表达式(3)进行偏微分而给出了下列表达 <Formula> formula see original document page 36 </ formula> Thus, using Wn above expression (3) given by partially differentiating the following expression

式, formula,

,『,k, } =—X2,k,,,.,鲁(k=1, 2,…,K) , ", K,} = -X2, k ,,,., Lu (k = 1, 2, ..., K)

下列表达式是根据表达式(5)和(6)获得的<formula>formula see original document page 37</formula>(7) The following expression is a document according to the expression (5) and (6) obtained in <formula> formula see original page 37 </ formula> (7)

将表达式(3 )代入表达式(7 )中的ek中,从而使得表达式(7 ) 表示为表达式(8)的正规方程式。 The expression (3) into the expression (7) in ek, so that the expression (7) as represented by the normal equation of Expression (8).

<table>table see original document page 37</column></row> <table> <Table> table see original document page 37 </ column> </ row> <table>

例如,使用消去计算(高斯-乔丹消去法),表达式(8)的正规方程式可以解算出抽头因数Wn。 For example, using erasing calculated (Gauss - Jordan elimination method), the expression (8) can be calculated by equation regular tap factor Wn. 为每个类解算表达式(8)的正规方 For each class, solving the expression (8) is a regular square

程式,使得能够为每个类获得最佳抽头因数Wn (在这种情况下,该抽头因数使误差平方和E最小)。 Program, allows to obtain optimal tap factor Wn for each class (in this case, the tap factor so that the minimum sum of squared errors E).

紧接着,图8说明执行学习以通过为每个类解算表达式(8)的正 Then, FIG. 8 illustrates performed for each class by learning in solving expression (8) is positive

规方程式而获得每个类的抽头因数Wn的学习设备的配置实例。 Regulation equation is obtained a configuration example of each class tap factor Wn learning device.

用于学习抽头因数Wn的学习图像信号被输入学习设备。 Learning image signal for learning of the tap factor Wn is input learning apparatus. 在这里, 学习图像信号的一个实例为高分辨率的高图像质量图像信号。 High image quality image signal here, one example of a learning image signal is high resolution. 学习图像信号被提供给学习设备的导师数据生成单元131和学生数据生成单 Tutor data generating unit learning image signal is supplied to the learning apparatus 131 and the student data generation unit

元133。 133 yuan.

导师数据生成单元131从供给其的学习图像信号中生成导师数据,并将它们提供给导师数据存储单元132。 Tutor data generating unit 131 generates supervisor data from the learning image signal supplied thereto, the tutor and provides them to the data storage unit 132. 也就是说,在这里,导师数据生成单元131将高图像质量图像信号作为学习图像信号不加变化的提供到导师数据存储单元132作为导师数据。 That is, where the tutor data generating unit 131 as an image signal of high image quality without change of the learning image signal is supplied to the supervisor data storage unit 132 as teacher data. 导师数据存储单元131存储由导师数据生成单元131生成的作为导师数据的高图像质量图像信号。 Supervisor data storage unit 131 stores the teacher data generating unit 131 an image signal of high image quality as teacher data is generated.

学生数据生成单元133从学习图像信号中生成学生数据,并将这个学生数据提供给学生数据存储单元134。 Student data generating unit 133 generates student data from the learning image signal, and supplies the student data to the student data storage unit 134. 也就是说,学生数据生成单元133执行作为学习图像信号的高图像质量图像信号的过滤,以便降低它的分辨率,藉此生成低图像质量图像信号并作为学生数据提供给学生数据存储单元134。 That is, the student data generating unit 133 performs filtering as learning image signal an image signal of high image quality, in order to reduce its resolution, thereby generating a low image quality image signal as the student data and the student data supplied to the storage unit 134. 学生数据存储器134存储来自于学生数据生成单元133的学生数据。 The memory 134 stores the student data in the student data from the student data generating unit 133.

预测抽头提取单元135连续地获得作为所关心导师像素的像素, 这些像素构成作为存储在导师数据存储单元132中的导师数据的高图像质量图像信号,并从构成作为存储在学生数据存储单元134中的学生数据的低图像质量图像信号的低图像质量像素中提取预定的一个像素,藉此设置一个预测抽头,该预测抽头具有与图6所示的预测抽头提取单元121配置的预测抽头相同的抽头结构,并提供给加法单元38。 Prediction tap extraction unit 135 continuously obtained supervisor pixel as a concern, high image quality of the image signals of pixels as stored in the supervisor data storage unit 132 tutor data, and from the composition as a storage student data storage unit 134 low image quality pixel signal is low image quality image data extracting students of a predetermined pixel, whereby a prediction tap is provided, which has the same prediction tap and the prediction tap extracting prediction tap unit 121 shown in FIG. 6 tap configuration structure, and supplied to the addition unit 38.

与所关心的导师像素相对应,特征提取单元136以与图6所示特征提取单元122同样的方式使用构成低图像质量图像信号的低图像质量像素来提取所关心导师像素的特征,并提供给类分类单元137,该低图像质量图像信号作为存储在学生数据存储单元134中的学生数据。 And supervisor pixel of interest corresponds to the feature extraction unit 136 in the same manner as the feature extraction unit 6122 shown in FIG using low image quality pixels constituting the low image quality image signal to extract the feature of the pixel of interest tutor, and supplied to the 137, the low image quality image signal class classifying unit student data in the student data memory 134 as a storage unit.

根据特征提取单元136输出的所关心的导师像素的特征,类分类单元137执行与图6所示的类分类单元123相同的类分类,并且向加法单元138输出与所获得的作为结果的类相对应的分类代码。 The tutor interest feature extraction unit 136 outputs feature pixel, the class classification unit class classification unit 137 shown in FIG 6123 performs the same class classification, and phase to the class addition unit 138 outputs the obtained result as corresponding classification code.

类分类单元137输出的有关所关心导师像素的分类代码被提供给加法单元138。 For the pixel of interest tutor class code output from the class classifying unit 137 is supplied to the addition unit 138. 加法单元138从导师数据存储单元132中读出所关心的像素,并为类分类单元137提供的每个分类代码执行有关所关心的导师像素和学生数据的相加,该学生数据构成预测抽头提取单元135 提供的关于所关心的导师像素所配置的预测抽头。 The addition unit 138 reads from the supervisor data storage unit 132 in the pixel of interest, and performs pixel addition tutor and student-related data of interest for each class code provided by the class classifying unit 137, the student data constituting the prediction tap extracting predictions about the tutor pixel of interest 135 unit configured to provide tap.

也就是说,向加法单元138提供存储在导师数据存储单元132中的导师数据yk、从预测抽头提取单元135输出的预测抽头xo,k和从类分类单元137输出的分类代码。 That is, the adding unit 138 provides the supervisor data yk stored in the supervisor data storage unit 132, the prediction tap extracting unit 135 from the prediction tap outputted xo, k output from the class classifying unit 137 classification code.

对于类分类单元137提供的与分类代码相对应的每个类而言,加 For each class class classification unit 137 provided with a corresponding classification code, the plus

法单元138使用预测抽头(学生数据)Xn,k执行计算,该计算等于表达式(8)的矩阵左边中的学生数椐的一个与另一个(xn,kxn,,k)的乘积和 Method using the prediction unit 138 taps (student data) Xn, k performs calculation that is equal to a number of other noted in the left matrix expression (8) in the student (xn, kxn ,, k) and the product

其相加和(i:)。 And its addition (i :).

同样,对于类分类单元137提供的与分类代码相对应的每个类而言,加法单元138使用预测抽头(学生数据)Xn,k和导师数据yk执行 Similarly, for each class class classification unit 137 provided with a corresponding classification code, the addition unit 138 uses the prediction taps (student data) Xn, k and supervisor data yk performed

计算,该计算等于表达式(8)右侧的矢量中的学生数据Xn,k和导师数 Calculation that is equal to the number of student data vector Xn of the right side, k and supervisor expression (8)

据yk的乘积(xn, k,yk)和其相加和(S)。 According yk product (xn, k, yk), and their addition and (S).

也就是说,加法单元138在它的存储器(未示出)中存储的表达式(8)所获得的将早先的作为所关心导师像素的有关导师数据的其左侧矩阵分量(SXn,k xn,,k)和右侧分矢量(Sxn,kyk),并加上矩阵分量(2xn,kXn,,k)或分矢量(£xn,kyk)、有关作为所关心的导师像素的新 That is, the adding unit 138 in its memory (not shown) stored in the expression (8) about the tutor data of the previous supervisor pixel of interest obtained as the left side of the matrix components (SXn, k xn ,, k) and the right-side vector (Sxn, kyk), and adding the matrix component (2xn, kXn ,, k) or sub-vector (£ xn, kyk), the relevant supervisor as the new pixel of interest

的导师数据的相应分量Xn,w、 Xn,,w或Xn,wyw,使用导师数据y^和学生数椐Xn,w计算相应分量 Xn corresponding components of tutor data, w, Xn ,, w or Xn, wyw, using students and teacher data y ^ noted in the number Xn, w calculated respective components

Xn,k-lXn,,k陽l 或(即执行表 Xn, k-lXn ,, k l or male (i.e., performing a table

达式(8)表示的求和的加法)。 Summing adder) of the formula (8).

加法单元138使用导师数据存储单元132存储的所有导师数据作为所关心导师像素来执行这一加法,以便为每个类构成表达式(8)给出的正规方程式,然后输出该正规方程式给抽头因数计算单元139。 The adding unit 138 using the supervisor data storage unit 132 stores all data as teacher tutors pixel of interest to perform this addition, for each class is given to constitute the expression (8) normal equation, and outputs the normal equations to a tap factor calculation unit 139. 抽头因数计算单元139为每个类解算加法单元138提供的正规方程式, Tap factor computation unit 139 for each class, solving the normal equation adding unit 138 is provided,

从而为每个抽头获得并输出最佳抽头因数Wn。 Thereby obtaining and outputting the optimal tap factor Wn for each tap.

图7所示的因数存储器181为通过图8所示的学习设备而获得的 Factor of the memory 181 shown in Figure 7 is obtained by the learning apparatus shown in FIG. 8

每个类存储抽头因数Wn。 Each storage class tap factor Wn.

请注意,对于上述方案而言,学习图像信号是作为与没有变化的第二图像信号相对应的导师数据获得的,以及其中已经降低了学习图像信号的分辨率的低图像质量图像信号作为与第一图像信号相对应的学生数据,根据此执行抽头因数的学习,因此可以启动图像转换处理而获得抽头因数,其中可以实现对第一图像信号进行分辨率提高处理从而将其处理为具有提高的分辨率的第二图像信号。 Note that for the above-described embodiment, the learning image signal as the tutor data of the second image signal is not changed corresponding to the obtained, and which has reduced resolution image signal is low image quality as the learning image signal and the second an image signal corresponding to the student data, a tap executed based on this study factor, it is possible to obtain an image conversion process to start the tap factor, which may be implemented on a first image signal resolution enhancement process so as to be treated as having improved resolution rate of the second image signal.

此刻,依赖于与第一图像信号相对应的学生数据的图像信号和与第二图像信号相对应的导师数据的图像信号是如何选择的,可以获得用于各种类型的图像转换处理的抽头因数。 At the moment, depending on how the first image signal and the image signal corresponding to the student data and the second image signal corresponding to the image signal is tutor data selected, the tap factor can be obtained various types of image conversion processing . 也就是说,例如,对于其中高图像质量图像信号被作为导师数据, 并且噪音是被附加在导师数据高图像质量图像信号上以产生被作为学生数据的带有噪音的图像信号的安排中,执行学习处理,藉此可以获得执行图像转换处理的抽头因数,该图像转换处理是将第一图像信号转换为已去除了(或减少)包含在其中的噪音的第二图像信号的去除处理。 That is, for example, for which high image quality as the image signal is tutor data, and the noise is added to the high-quality image signal is tutor data of the image is arranged to generate an image signal as the student data with noise, the execution learning process, thereby performing a tap factor obtained image conversion process, the image conversion processing is converted into the first image signal has been removed (or decrease) in the removal process comprises a second image signal wherein noise.

同样,例如,对于这样的方案而言,即其中所给出的图像信号作为导师数据以及减少作为导师数据的图像信号所具有的像素数量的图像信号而产生作为学生数据的图像信号,或者其中所给出的图像信号作为学生数据以及根据预定减少比例减少作为学生数据的图像信号所具有的像素数量的图像信号以产生作为导师数据的图像信号,执行学习处理,藉此可以获得执行图像转换处理的抽头因数,该图像转换处理为缩放处理,其将第一图像信号转换为被扩大或减小的第二图像。 Also, for example, for purposes of this embodiment, i.e., wherein the image signal given as teacher data, and reducing the number of pixels of an image signal as an image signal having the tutor data generated as an image signal is student data, or wherein an image signal is given as the student data and the number of pixels of an image signal as the image signal data of the student in accordance with a predetermined reduction ratio to generate a reduced image signal as the tutor data and performing a learning process, thereby performing the image conversion processing can be obtained in the tap factor, the scaling processing for the image conversion process, which is a first image signal into a second image expanded or reduced. 此外,以某一方式设置作为导师数据和学生数据的图像信号,允许获得执行各种图像转换处理的抽头因数,诸如像素数量的转换、高宽比的转换等。 Further, the image signal is arranged in a manner as tutor data and student data, the tap factor allows to obtain a variety of performing image conversion processing, such as pixel number conversion, aspect ratio conversion, and the like.

紧接着,将参考图9的流程来描述通过图8所示的学习设备执行的处理,即学习处理。 Then, the process will be described with reference to FIG. 9 processing by the learning apparatus shown in FIG. 8 is executed, i.e. the learning process.

首先,在步骤S51中,导师数据生成单元131和学生数据生成单元133分别从学习图像信号产生导师数据和学生数据,然后输出。 First, in step S51, the tutor data generating unit 131 and the student data generating unit 133 respectively generate teacher data and the student data from the learning image signal, and then output. 也就是说,导师数据生成单元131未作改变而输出学习图像信号作为导师数据。 That is, the tutor data generating unit 131 outputs an unaltered learning image data signal as the tutor. 同样,学生数据生成单元133使用LPF以预定的切断频率过滤该学习图像信号,藉此为每个帧生成并输出有关导师数据(学习图像信号)的学生数据。 Similarly, the student data generating unit 133 using a predetermined LPF cutoff frequency of the learning image signal filtering, thereby generates and outputs the relevant supervisor data (learning image signal) of student data for each frame.

导师数据生成单元131输出的导师数据被提供给导师数据存储单元132并存储在其中,而学生数据生成单元133输出的学生数据被提供给学生数据存储单元134并存储在其中。 Tutor data generating tutor data output unit 131 is supplied to the supervisor data storage unit 132 and stored therein, the student data and the student data generating unit 133 outputs is supplied to the student data storage unit 134 and stored therein.

随后,流程进行到步骤S52,在该步骤中,从存储在导师数据存储单元132中的导师数据中,预测抽头提取单元135取出作为还没有被作为所关心的导师像素的一个所关心的导师像素。 Subsequently, the flow proceeds to step S52, in this step, from the tutor data stored in the supervisor data storage unit 132, the prediction tap extracting unit 135 extracted supervisor pixels as has not been as a teacher pixel of interest of interest . 此外,在步骤S52 中,预测抽头提取单元135从存储在学生数据存储单元134中的学生数据设置关于所关心的导师像素的预测抽头,然后将其提供给加法单元138,然后流程进行到步骤S53。 Further, in step S52, the prediction tap extracting unit 135, the student data set prediction tap regarding teacher pixel of interest from the stored in the student data memory unit 134, and then supplies it to the addition unit 138, and then the flow proceeds to step S53 .

在步骤S53中,特征提取单元136使用学生数据存储单元134存储的学生数据提取所关心的导师像素的特征,然后将其提供给类分类单元137,然后流程进行到步骤S54。 Characterized in supervisor pixel step S53, the feature extraction unit 136 using the student data stored in the storage unit 134 extracts the student data of interest, and provides it to the class classifying unit 137, and then the flow proceeds to step S54.

在步骤S54中,类分类单元137根据来自于特征提取单元136的与所关心的导师像素有关的所关心特征的像素执行所关心导师像素的分类,并向加法单元138输出藉此获得的与该类相对应的分类代码, 然后流程进行到步骤S55。 In the step S54, the class classification unit 137 performs the pixel of interest related to the feature of interest pixels tutor extraction unit 136 according to the feature from the pixel of interest classified tutor, and thereby obtaining the output of adding unit 138 classification code corresponding to the class, then the flow proceeds to step S55.

在步骤S55中,加法单元138为类分类单元137提供的分类代码从导师数据存储单元132中读出所关心的导师像素,执行表达式(8) 的相加,该相加有关所关心的导师像素和构成预测抽头提取单元135 提供的有关所关心的导师像素所配置的预测抽头,于是流程进行到步骤S56。 In step S55, the adder unit 138 for the class classifying unit 137 supplied from the class-code reading tutor data storage unit 132 the supervisor pixel of interest, the sum expression is executed (8), the added concern about the tutor pixel constituting the prediction tap extracting unit 135, the prediction tap supplied tutor pixel of interest related to the configuration, then the flow proceeds to step S56.

在步骤S56中,确定预测抽头提取单元135是否在导师数据存储单元132中存储了还没有作为所关心的导师像素的导师数据。 In step S56, the determination whether the prediction tap extracting unit 135 has not stored a teacher pixel of interest as teacher data of teacher data storage unit 132. 如果在步骤S56所作的确定是预测抽头提取单元135在导师数据存储单元132中仍存储有还没有作为所关心的导师像素的导师数据,那么对于还没有作为所关心导师像素的导师数据,预测抽头提取单元135返回到步骤S52,并重复执行相同的处理。 If it is determined in step S56 made a prediction tap extracting unit 135 in the supervisor data storage unit 132 still stores yet tutor as the pixel of interest tutor data, for yet tutor pixel teacher data as of interest, the prediction tap extraction unit 135 returns to step S52, and repeats the same processing. 另一方面,如果步骤S56所作的确定是预测抽头提取单元135在导师数据存储单元132中不再有还没有作为所关心的导师像素的导师数据,那么加法单元138为迄今为止通过处理所已经获得的每个类将表达式(8)的左侧矩阵和右侧矢量提供给计算单元139,接着流程进行到步骤S57。 On the other hand, if the determination is made in step S56, the prediction tap extracting unit 135 in the supervisor data storage unit 132 has not yet no teacher pixels as teacher data of interest, then the addition unit 138 by the processing so far has been obtained each class of the expression (8) in the left and right side matrix calculation unit 139 is supplied to the vector, then the flow proceeds to step S57.

在步骤S57中,抽头因数计算单元139为加法单元138提供的每个类解算构成表达式(8)的左侧矩阵和右侧矢量的每个类的正规方程 In step S57, the tap factor computation unit 139 for each class addition unit 138 supplied solving the normal equations for each class constituting the left and right matrix expression vector (8)

式,藉此为每个类获得并输出抽头因数Wn,接着结束处理。 Formula, thereby obtaining and outputting the tap factor Wn for each class, and then the process ends. 虽然可能存在这种情况,即由于学习图像信号的数量不够等原因, 不能获得为获得抽头因数所需的正规方程式的数量,但是例如可安排抽头因数计算单元139为这样的类输出缺省的抽头因数。 While there may be the case that due to insufficient number of learning image signal, and the like, can not be obtained in order to obtain the required number of normal equations tap factor, but can be arranged e.g. tap factor computation unit 139 for such a tap output of the default class factor.

图7所示的因数存储器181为如上述那样所获得的每个类存储抽头因数。 Factor of the memory 181 shown in FIG. 7 as described above for each class is stored as the tap factor obtained. 然而,应注意图4所示的图像转换单元31R的因数存储器181 存储通过执行只使用图像信号的R信号作为导师数据和图像信号的R、 G和B信号作为学生数据的学习所获得的抽头因数。 However, it should be noted that the image conversion unit 31R of FIG. 4, FIG factor using the image signal stored in the memory 181 by performing only the R signal as the tutor data and the image signals R, G, and B signals as student data obtained by learning the tap factor . 同样,图4 所示的图像转换单元31G的因数存储器181存储通过执行只使用图像信号的G信号作为导师数据和图像信号的R、 G和B信号作为学生数据的学习所获得的抽头因数。 Similarly, the image converting unit 181 stores the memory cycle shown in FIG. 4 31G of the G signal is used as the image signals R, G and B signals as learning the tap factor of the obtained student data and tutor data signal by performing an image only. 另外,图4所示的图像转换单元31B的因数存储器181存储通过执行只使用图像信号的B信号作为导师数据和图像信号的R、G和B信号作为学生数据的学习所获得的抽头因数。 Further, the image converting unit 181 stores the memory cycle shown in FIG. 4 31B is used as the B signal of the image signal R, G and B signals as learning the tap factor of the obtained student data and tutor data signal by performing an image only.

接着,将参考图10中的流程图来描述由图6所示的图像转换单元31执行的图像转换处理。 Next, with reference to the flowchart in FIG. 10 will be described image conversion processing image converting unit 31 shown in FIG. 6 is performed. 请注意,参考图10所描述的图像转换处理是在图5的步骤S2中执行的处理。 Note that the image conversion processing described with reference to FIG. 10 is a process executed in step S2 of FIG. 5.

在步骤S61中,预测抽头提取单元121将构成第二图像信号的还没有作为所关心像素的一个像素作为所关心的像素,并且提取构成第一图像信号的几个像素(事实上,像素的像素值)作为预测抽头,该像素用于预测第二图像信号的所关心的像素的像素值,然后流程进行到步骤S62。 In step S61, the prediction tap extracting unit 121 constituting the second image signal has not pixel by pixel as the pixel of interest as the interest, and extracts several pixels forming the first image signal (in fact, the pixel value) as a predictive tap, the pixel value of the pixel for the pixel of interest predicted second image signal, and then the flow proceeds to step S62.

在步骤S62中,特征提取单元122使用第一图像信号提取所关心像素的特征,并将该特征提供给类分类单元123,然后流程进行到步骤S63。 In step S62, a first image feature extraction signal features extraction unit 122 uses the pixel of interest, and supplies the features to the class classifying unit 123, and then the flow proceeds to step S63. 在步骤S63中,类分类单元123根据特征提取单元122提供的所关心的像素的特征执行用于将所关心像素分类在多个类中的一个的类分类处理,并提供与作为处理结果所获得的类相对应的分类代码给因数输出单元124,然后流程进行到步骤S64。 In step S63, the feature of the pixel of interest in the class classification unit 122 according to the feature extraction unit 123 performs a pixel classification to a plurality of classes in a class classification process of interest, and provides the processing result obtained as class classification code corresponding to the coefficient output unit 124, and then the flow proceeds to step S64. 在步骤S64中,因数输出单元124读出类分类单元123提供的分类代码的类的抽头因数, 然后将其输出给计算单元125,然后流程进行到步骤S65。 In S64, the tap factor factor output unit 124 reads out the classification code provided by the class classifying unit 123 class steps, and then outputs it to the computing unit 125, and then the flow proceeds to step S65.

在步骤S65,计算单元125使用抽头提取单元121提供的预测抽头和从因数输出单元124输出的所关心像素的类的抽头因数来执行表达式(1)的计算,藉此获得所关心像素的像素值。 In step S65, the calculating unit 125 calculates the prediction tap using the tap unit 121 and performs the pixel of interest from the tap factor of the class output unit 124 outputs a factor of expression (1) extraction, thereby obtaining a pixel of the pixel of interest value.

图像转换单元31为作为一屏(即, 一帧或场)的所关心像素的第二图像信号的所有像素执行步骤S61到S65的处理,然后流程返回。 The image converting unit 31 as a screen S65 to the process (i.e., a frame or field) step all pixels of interest of the second image signal S61, a pixel, and the flow returns.

接着,图ll说明作为用于执行学习传感器单元l属性信息的学习设备的图像拾取设备的布置的配置实例,该传感器单元1用于输出适于图1所示的信号处理单元4执行的信号处理的图像信号,该属性信息即有关R感光器单元23R、 G感光器单元23G和B感光器单元23B的放置状态的信息,其与信号处理单元4执行的信号处理相对应。 Next, the configuration example of FIG. Ll described arrangement of the image pickup apparatus as a learning device for performing the learning l attribute information sensor unit, the sensor signal processing unit 1 for processing the signal output unit shown in FIG. 4 is adapted to perform image signal, i.e., information about the attribute information R photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B placement state, the signal processing with the signal processing unit 4 corresponding to the executed. 传感器单元231具有多个与像素相对应的光电转换设备,以检测投射入其中的物体光,并且输出与物体光相对应的图像信号。 A sensor unit 231 having a plurality of photoelectric conversion devices corresponding to the pixels to detect light projected into an object therein, and outputs light corresponding to the object image signals. 也就是说,传感器单元231接收物体光并获得与所接收光量相对应的电信号形式的图像信号,然后将其提供给信号调整单元232和238。 That is, the sensor unit 231 receives the object light and obtains the image signal in the form of an electrical signal corresponding to the light amount of the received signal and provides it to the adjustment means 232 and 238.

请注意,如下所述,安排传感器单元231以能够获得等于图l所示的传感器单元1获得的图像信号(以下视情况也称为"正常图像信号")和高质量图像信号,该高质量图像信号(以下视情况也称为"评估图像信号',)用于随后描述的评估单元235,其等于图l所示的信号处理单元输出的第二图像信号。传感器单元231向信号调整单元232提供正常图像信号,并将评估图像信号提供给信号调整单元238。 Note that, as described below, to arrange the sensor unit 231 can obtain the sensor unit shown in FIG l is equal to 1 to obtain an image signal (hereinafter, optionally referred to as "normal image signal") and a high-quality image signal, the high quality image signal (hereinafter optionally referred to as "evaluation image signal ') for the evaluation unit 235 described later, which is equal to the second image signal processing unit outputs a signal as shown in FIG. l, the sensor unit 231 to the signal adjusting unit 232 normal image signal and the image signal to the signal evaluation unit 238 adjustment.

同时,将来自于控制器240的控制信号提供给传感器单元231。 Meanwhile, the control signal from the controller 240 is provided to the sensor unit 231. 传感器单元231的属性根据控制器240提供的控制信号变化,并且根据变化的属性来获得与物体光相对应的正常图像信号。 The sensor unit 231 changes the attribute controller 240 provides a control signal, and to obtain a normal light image signal corresponding to the object according to the attribute change.

如同图1中的信号调整单元2—样,信号调整单元232使传感器单元231输出的正常图像信号经受CDS处理,并将获得的作为处理结果的图像信号提供给A/D转换单元233。 As in Figure 1 the signal adjusting units 2- comp, signal adjusting unit 232 of the sensor unit 231 outputs a normal image signal is subjected to CDS processing, and supplies the processing result to the image signal A / D converting unit 233 is obtained.

如同图1中的A/D转换单元3 —样,A/D转换单元233使信号调整单元232提供的正常图像信号经受A/D转换,即采样及量化正常图像信号,并将作为处理结果而获得的数字图像信号作为第一图像信号提供给信号处理单元234。 As in FIG. 1 A / D conversion unit 3 - like, A / D conversion unit 233 that the signal adjusting unit 232 provides a normal image signal is subjected to A / D conversion, i.e., a normal image signal is sampled and quantized, and as a result of the processing a digital image signal to the signal processing unit 234 as a first image signal. 以与图2所示的信号处理单元4相同的方式设置信号处理单元234,并且使来自于A/D转换单元233的第一图像信号经受像图6到图10所迷信号处理的图像转换处理,藉此获得第二图像信号(R、 G和B信号)并将此提供给评估单元235。 In the same signal processing unit 24 shown in FIG provided a signal processing unit 234, and the first image signal from the A / D conversion unit 233 is subjected to image conversion processing of image resolution process scientific Figures 6 to 10 of , thereby obtaining a second image signal (R, G, and B signals) and to the evaluation unit 235 is provided.

向评估单元235提供来自于信号处理单元234的第二图像信号,以及控制器240提供的控制传感器单元231的属性的控制信号和来自于A/D转换单元239的评估图像信号。 A second image signal to the evaluation unit 235 from the signal processing unit 234, a sensor and a control unit controller 240 provides a control signal 231 from the evaluation properties of the image signal and A / D conversion unit 239. 评估单元235使用A/D转换单元239提供的评估图像信号评估信号处理单元234提供的第二图像信号,并且在获得该评估时,关联该评估和控制信号表示的传感器单元231的属性,也就是说,在获得第一图像信号时,关联该评估和表示传感器单元231的属性的属性信息,这是在信号处理单元234处进行信号处理的目的,以便获得评估后的第二图像信号。 Second image signal evaluation unit 235 using the A / D conversion unit 239 provides the evaluation signal evaluation image signal processing unit 234 is provided, and when obtaining this evaluation, the evaluation association property sensor unit and the control signal represents 231, i.e. He said first image signal obtained at the time, associated with the assessment and attribute information indicating attributes of the sensor unit 231, which is the object of the signal processing in the signal processing unit 234, so as to obtain a second image signal evaluation. 此外,评估单元235将该组第一图像信号的评估和属性信息提供给位置确定单元236。 Further, the attribute information and evaluate the set of the evaluation unit 235 of the first image signal supplied to the position determination unit 236.

当获得适于在信号处理单元234进行信号处理的第一图像信号时,位置确定单元236根据评估单元235提供的该组的第二图像信号的评估和属性信息确定传感器231单元的属性,即与信号处理单元234处的信号处理相对应(因此传感器单元1的属性与图1所示的信号处理单元4的信号处理相对应)的传感器单元231的属性,并且将标识属性的属性信息提供给位置存储单元237。 When adapted to obtain first image signal processing unit 234 performs signal processing, position determination unit 236 determines the attribute of the sensor unit 231 according to the evaluation of the second group of image signal evaluation unit 235 and attribute information provided, i.e. the signal processing at the signal processing unit 234 corresponds to (and therefore attribute the sensor unit of FIG. 1 shown in the signal processing unit 4 corresponding to the signal processing) unit 231 of the sensor properties, and provide information identifying attribute to the location attribute The storage unit 237. 位置存储单元237存储位置确定单元236提供的属性信息。 Attribute information storage unit 236 provides a position determining unit 237 storage locations.

如同信号调整单元232 —样,信号调整单元238使传感器单元231输出的评估图像信号经受CDS处理,并且将作为处理结果获得的评估图像信号提供给A/D转换单元239。 As signal adjusting unit 232-- like, the signal adjustment unit 238 that the evaluation image signal output from the sensor unit 231 is subjected to CDS processing, and the evaluation image signal obtained as the processing result to the A / D conversion unit 239. 但是,请注意,由于信号调整单元232处理正常图像信号,信号调整单元238处理图像质量高于正常图像信号的评估图像信号,因此信号调整单元238具有比信号调整单元232高的能力,以便保持评估图像信号的图像质量。 However, note that, since the signal processing unit 232 to adjust the normal image signal, the signal processing unit 238 to adjust the image quality of a normal image signal is higher than the evaluation image signal, the signal adjusting unit 238 has a high specific capacity signal adjusting unit 232, in order to maintain evaluation the image quality of the image signal.

如同A/D转换单元233 —样,A/D转换单元239使信号调整单元238提供的评估图像信号经受A/D转换,即采样和量化评估图像信号,并且将作为其结果而获得的数字评估图像信号提供给评估单元235。 Like A / D conversion unit 233-- like, A / D conversion unit 239 makes the evaluation image signal adjustment unit 238 is subjected to A / D conversion, the sampling and the quantitative evaluation of the image signal, and as a result obtained by the digital evaluation The image signal 235 is supplied to the evaluation unit. 但是,请注意,由于A/D转换单元233处理正常图像信号,A/D转换单元239处理图像质量高于正常图像信号的评估图像信号,因此A/D转换单元239具有比A/D转换单元233高的能力(例如,比A/D转换单元233更多的量化位或更高的采样频率),以便保持评估图像信号的图像质量。 However, note that, since the A / D converting a normal image signal processing unit 233, A / D conversion unit 239 processes the image signal evaluation image quality than the normal image signal, so A / D conversion unit 239 has a ratio A / D conversion unit 233 high capacity (e.g., ratio of a / D conversion unit 233 the quantization bit or more higher sampling frequency), in order to maintain the image quality evaluation of the image signal.

控制器240向传感器单元231和评估单元235提供用于控制传感器单元241的属性的控制信号。 The controller 240 provides a control signal for controlling the properties of the sensor unit 241 to the sensor unit 231 and evaluation unit 235.

接着,图12示出图11所示的传感器单元231的配置实例。 Next, FIG. 12 shows a configuration example of a sensor unit 231 shown in Fig. 物体光投射入透镜251中,然后透镜251通过半反射镜252和棱镜253将物体光聚集在评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B上,同时通过半反射镜252和棱镜254将物体光聚集在R感光器单元256R、G感光器单元256G和B感光器单元256B上。 Object light is projected into the lens 251 and the lens 251 through the half mirror 252 and the prism 253 the object light to be focused evaluation R photoreceptor unit 255R, evaluate the G photoreceptor unit 255G and assessment B photoreceptor unit 255B, simultaneously by semi-reflective mirror prism 252 and object light 254 will collect on the R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B.

也就是说,投射入透镜251中的物体光被发射到半反射镜252。 That is, the projection lens 251 in the object light is emitted to the half mirror 252. 半反射镜252将一部分物体光从透镜251反射到棱镜253,并且将剩余部分发送到棱镜254。 A portion of the half mirror 252 reflected light from the object lens 251 to the prism 253, and the remaining portion transmitted to the prism 254.

棱镜253将来自于半反射镜252的物体光分离为R、 G和B光,并将R、 G和B光发射到评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B各自所在位置的方向上。 The half prism 253 from the light mirror object 252 is separated into R, G and B light, and R, G and B light emitted to the photoconductor unit 255R evaluation R, G photoreceptor unit 255G assessment and evaluation of the photoreceptor unit B 255B in the direction of their respective position. 评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B设置有光电转换单元,诸如光电二极管等等,以便从棱镜253接收R、G和B光,并获得相应于所接收的光量的电信号形式的R信号、G信号和B信号。 Assessment R photoreceptor unit 255R, 255G evaluation photoconductor unit G and B photoreceptors evaluation unit 255B is provided with a photoelectric conversion unit, such as a photodiode and the like, so as to receive R, G and B light from the prism 253, and obtained corresponding to the received the form of electrical signals of the light amount of the R, G and B signals. 然后,由R信号、G信号和B信号组成的图像信号然后被作为评估图像信号输出到信号调整单元238 (图11)。 Then, the image signal from the R signal, G signal and the B signal component is then assessed as to the image signal output from the signal adjustment unit 238 (FIG. 11). 评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B的实例包括CCD、 CMOS传感器、HARP等等。 Assessment R photoreceptor unit 255R, G photoreceptor evaluation examples and evaluation unit 255G B photoreceptor unit 255B includes a CCD, CMOS sensor, HARP like.

棱镜254将来自于透镜251的物体光分离成RGB光,并在R感光器单元256R、 G感光器单元256G和B感光器单元256B各自所在的位置的方向上发射R、 G和B光。 The prism 254 from the object lens 251 of light into RGB light, and emitting R, G and B light in the direction of position R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B each is located. R感光器单元256R、 G感光器单元256G和B感光器单元256B设置有光电转换单元,诸如光电二极管等等,以便从棱镜254接收R、 G和B光,并获得与所接收的光量相对应的电信号形式的R信号、G信号和B信号。 R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B is provided with a photoelectric conversion unit, such as a photodiode and the like, so as to receive R, G and B light from the prism 254, and obtains the amount of light received by the corresponding in the form of electrical signals R, G and B signals. 由R信号、G信号和B信号组成的图像信号然后被作为正常图像信号输出到信号调整单元232 (图11) 。 Signal from the image signals R, G and B signals are then outputted composed as a normal image signal to the signal adjusting unit 232 (FIG. 11). R感光器单元256R、 G感光器单元256G和B感光器单元256B的实例包括CCD、 CMOS传感器、HARP等。 R photoreceptor unit 256R, 256G Examples G and B photoreceptor unit 256B includes a photoconductor unit CCD, CMOS sensor, HARP like. 然而,R感光器单元256R、 G感光器单元256G和B感光器单元256B优选地具有与图3所示的H感光器单元23R、G感光器单元23G和B感光器单元23B相同的特性。 However, R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B preferably has a H photoreceptor unit 23R, G element 23G and B photoreceptor photoreceptor shown in FIG. 3 the same characteristics of the cell 23B.

R控制单元257R、 G控制单元257G和B控制单元257B每一个都根据控制器240 (图11)提供的控制信号对R感光器单元256R、 G感光器单元256G和B感光器单元256B的;^文置位置的移动进行控制,藉此改变传感器单元251的属性。 R control unit 257R, G 257G and a B control unit 257B controls each unit according to a control signal of the controller 240 (FIG. 11) provided in the R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B; ^ mobile text placement position is controlled, thereby changing the properties of the sensor unit 251.

现在,为了便于描述,我们在此假定R控制单元257R控制整个R感光器单元25(;R的放置位置,G控制单元257G控制整个G感光器单元256G的放置位置,以及B控制单元257B控制整个B感光器单元256B的放置位置。然而,应注意,例如〗吏用MEMS^支术,允许R感光器单元25(5R的像素的放置位置能够基本上被改变(移动),藉此可以独立地控制R感光器单元256R的单个像素的放置位置。这对于G感光器单元256G和G控制单元257G,以及B感光器单元256B以及B控制单元257B同样成立。 Now, for convenience of description, we assumed here that R control unit 257R controls the entire R photoconductor unit 25 (; placement position R, G control unit 257G controls the entire G photoreceptor placement unit 256G, and a B control unit 257B controls the entire B photoreceptor unit 256B is placed. However, it should be noted that, for example, a MEMS ^〗 officials branched surgery, allowing R photoconductor unit 25 (5R placement of the pixel can be substantially changed (moved), thereby independently controlling the placement of a single pixel of the R photoreceptor unit 256R. the same holds for G 256G and the G photoreceptor unit control unit 257G, and 256B and the B photoreceptor unit B a control unit 257B.

同样,评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B具有比获得正常图像信号的R感光器单元256R、G感光器单元256G和B感光器单元256B高的特性,由于藉此将获得高质量的评估图像信号。 Similarly, evaluation R photoreceptor unit 255R, the evaluation unit 255B has, G photoreceptor unit 256G and the B photoreceptor unit 256B is higher than obtain a normal image signal R photoreceptor unit 256R G photoreceptor unit 255G and assessment B photoreceptor characteristics, Since thereby obtained a high-quality evaluation image signal. 也就是说,评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B具有例如比R感光器单元256R、 G感光器单元256G和B感光器单元256B宽的动态范围、更多的数量或像素,等等。 That is, the R photoreceptor evaluation unit 255R, 255G evaluation photoconductor unit G and B photoreceptor evaluation unit 255B has a dynamic range of, for example, the ratio R photoreceptor unit 256R, 256G photoconductor unit G and B photoreceptor unit 256B wide, more the number of pixels or more, and so on.

接着,将参考图13A到13D描述由图12所示的R控制单元257R、G控制单元257G和B控制单元257B对R感光器单元256R、 G感光器单元256G和B感光器单元256B中每一个的控制。 Next, will be described with reference to FIGS. 13A to 13D R control unit 12 shown in FIG. 257R, G and B, the control unit the control unit 257B 257G the R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B each control.

图13A所示的R感光器单元256R、图13B所示G感光器单元256G和图13C所示的B感光器单元256B每一个都具有有限区域的像素(相应于一个光电二极管等等),并输出与在每个像素处所接收的光量相对应的图像信号。 R photoreceptor unit 256R shown in FIG. 13A, FIG. 13B photosensitive G and B unit 256G shown in FIG. 13C photoreceptor unit 256B each pixel having a limited area (corresponding to one photodiode, etc.), and output amount of light received in each pixel of the image signal corresponding to the spaces. 请注意,在图13A到13D中,像素是每边为有限长度的正方形。 Note that, in FIGS. 13A to 13D, the pixel is limited to the length of each side of the square.

在这里,R感光器单元256R、 G感光器单元256G和B感光器单元256B的像素的每个位置各自由像素的正方形的重心表示,并且R感光器单元256R、 G感光器单元256G和B感光器单元256B的像素分别由点、圆和X表示。 Here, R photoreceptor unit 256R, the square of the center of gravity G of each pixel position of the photoreceptor unit 256G, and 256B of the photoconductor unit B are each represented by a pixel, and R photoreceptor unit 256R, G and B photoreceptors photosensitive unit 256G pixel units 256B, respectively, represented by the circle and the X point. 以制造图像拾取设备的观点来看,诸如撮像机或静态照相机,例如R感光器单元256R、 G感光器单元256G和B感光器单元256B的相应像素的位置完全在光学上相匹配。 In view of manufacturing the image pickup view of the device, such as a still camera or the imaging unit, for example, exact match of the corresponding pixel position of R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B in the optical respect. 也就是说,R感光器单元256R、 G感光器单元256G和B感光器单元256b被全部排列在光学等效位置上,以便通过相应的像素接收光线的R、 G和B射线。 That is, R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256b is arranged entirely in the optical equivalent position, for receiving light through the respective pixels R, G, and B rays.

R控制单元257R、 G控制单元257G和B控制单元257B根据控制器240 (图11)提供的控制信号分别移动R感光器单元256R、 G感光器单元256G和B感光器单元256B的放置位置,该放置位置为传感器单元241的属性。 R control unit 257R, G and B, the control unit the control unit 257B 257G control signal controller 240 (FIG. 11) are provided in accordance with movement of the photoreceptor unit placement R 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B, which is placement of the sensor unit 241 of the attribute. 也就是说,R感光器单元256R、 G感光器单元256G和B感光器单元256B的放置位置不是固定的而是可移动的,并且因此传感器单元241中的R感光器单元256R、 G感光器单元256G和B感光器单元2;56B的相应像素没必要在光学上相同的位置上。 That is, placement R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B is not fixed but movable, and therefore the photoreceptor unit 256R R sensor unit 241, G photoreceptor unit 256G and the B photoreceptor unit 2; corresponding pixel 56B is not necessary to optically same position.

如图13D所示,对于作为参考的R感光器单元256R的像素的位置(图13A和13D所示的点)而言,在G感光器单元256G的像素位置的水平方向和垂直方向上偏移度(图13B和13D所示的圆圈)被表示为PIig和PvG,在B感光器单元256B的像素位置的水平方向和垂直方向上偏移度(图13C和13D所示的X)被表示为PIib和Pvb。 13D, as for the positions of pixels 256R (13A and point shown in FIG. 13D) with reference to the R photoreceptor unit, the offset in the G photoreceptor unit 256G pixel position in the horizontal direction and the vertical direction degree (13B and circles shown in FIG. 13D) and is expressed as PIig PvG, pixel positions in the horizontal direction of the B photoreceptor unit 256B and the vertical direction of the offset (X shown in FIG. 13C and 13D) is expressed as PIib and Pvb.

H控制单元2:57R、 G控制单元257G和B控制单元257B根据控制器240提供的控制信号移动R感光器单元256R、 G单元256G和B感光器单元256B的放置位置,以便实现Phc、 PvG、 P1ib和Pvb的偏移量。 The control unit H 2: 57R, G in accordance with a control signal 257B controls movement R photoconductor unit controller 240 provides 256R, G, B photoreceptor unit 256G and 257G placement unit and the control unit B unit 256B in order to achieve Phc, PvG, P1ib Pvb and offset.

现在,在这种情况下,在其中可做一些安排,例如,R感光器单元256R的位置是固定的,只移动G感光器单元256G和B感光器单元256B。 Now, in this case, do some arrangements in which, for example, a position R photoreceptor unit 256R is fixed, moving only the photoreceptor unit 256G G and B photoreceptor unit 256B. 或者,可在其中做另一种安排,即除R控制单元257R外,G控制单元257G和B控制单元257B中的一个是固定的,移动剩佘的两个,此外可在其中做这样的安排,即可以移动所有的R感光器单元256R、 G感光器单元256G和B感光器单元256B。 Alternatively, another arrangement made therein, i.e., except for the R control unit 257R, G 257G, and the control unit 257B in the control unit B is a fixed, moving left two SHE, and further may be made therein such an arrangement that can move all the R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B.

同样,在图12所示的传感器单元241中,虽然评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B在光学上具有相同位置的像素位置,但可以移动R感光器单元256R、 G感光器单元256G和B感光器单元256B的放置位置。 Also, the sensor unit 241 shown in FIG. 12, although the evaluation R photoreceptor unit 255R, G assessment and evaluation of the photoreceptor unit 255G photoreceptor unit 255B having the B pixel positions in the same position on the optical, but may be moved photoreceptor R unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B of placement. 也就是说,对于评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B被全部置于光学上等效的位置上,如此光线的R、 G和B射线由相应的像素接收。 That is, for evaluation R photoreceptor unit 255R, the G photoreceptor equivalent evaluation unit 255G, and B photoreceptor evaluation unit 255B is placed all the optical position, thus the light R, G and B rays from the corresponding pixel receive.

图14说明图11所示的评估单元235的配置实例。 Figure 14 illustrates the evaluation unit 11 shown in FIG configuration example 235. 评估单元235包括图像存储单元261、相关性计算单元262和评估值存储单元263。 Evaluation unit 235 includes an image storage unit 261, the correlation calculation unit 262 and the evaluation value storage unit 263. 图像存储单元261为传感器231通过信号调整单元238和A/D转换单元239提供的某一物体光存储评估图像信号。 The image storage unit 261 stores object light as a signal evaluation image sensor 231 via signal conditioning unit 238 and A / D conversion unit 239 is provided.

相关性计算单元262使用图像存储单元261中存储的评估图像信号评估从正常图像信号获得的第二图像信号,该第二图像信号相应于存储在图像存储单元261中的信号处理单元234提供的评估图像信号,即相关性计算单元262获得信号处理单元234提供的第二图像信号和存储在图像存储单元261中的评估图像信号之间的相关值,并且将其的相关值提供到评估值存储单元263,作为信号处理单元234提供的评估结果或第二图像信号的评估值。 A second image signal using the correlation calculation unit 262 stores the image evaluation unit evaluates the image signal 261 stored in the image signal obtained from normal, evaluates the second image signal corresponding to the signal processing unit 261 is stored in the image storage unit 234 provided in image signal, i.e., the correlation calculation unit 262 to obtain the correlation between the evaluation values ​​in the image storage unit 261 in the second image signal and an image signal processing unit 234 stores the signal supplied thereto and supplies the correlation value to the evaluation value storage unit 263, the evaluation value as an evaluation result provided by the signal processing unit 234 or the second image signal.

此时,第二图像信号和评估图像信号的一个帧(场)之间的相关值的实例是第二图像信号和评估图像信号之间的位于相同位置的部分或全部像素的差分的绝对值之和的倒数。 In this case, examples of the correlation value between the (field) image signal and the second evaluation image signal of the absolute value of a frame at the same position of some or all of the pixels of the difference between the image signal and the second signal evaluation image and reciprocal.

除了来自于相关性计算单元262的笫二图像信号的评估值,还向评估值存储单元263提供控制器240输出的控制信号。 In addition to the evaluation value Zi of the second image signal from the correlation calculation unit 262, controller 240 also provides control signals output to the evaluation value storage unit 263. 由控制器240 输出的控制信号表示当用于获得相关性计算单元262输出的第二图像信号的评估值的第一图像已通过传感器单元231获得时,该传感器231 的属性,即图12所示的R控制单元257R、 G控制单元257G和B控制单元257B的放置位置。 When the image represents a first evaluation value for obtaining the second image signal output of the correlation calculating unit 262 has been obtained by the sensor unit 231, the attribute sensor 231, i.e., 240 in FIG. 12 by a control signal output from the controller the R control unit 257R, G and B, the control unit 257G 257B placement of the control unit. 评估值存储单元263以相关的方式存储放置位置和来自于相关性计算单元262的第二图像信号的评估值。 Evaluation value storage unit 263 stores in a manner related to placement and evaluation value from the second image signal correlation calculation unit 262. 评估值存储单元263为有关预先设定的多个位置(以下简称为,,设定位置,,) 的每个位置的多个图像的每个第二图像信号存储评估值,该设定位置有关R感光器单元256R、 G感光器单元256G和B感光器单元256B 的位置,然后将评估值提供给位置确定单元236 (图11)。 263 for each of the second plurality of image signals stored in the image evaluation value for each location of the plurality of predetermined position (hereinafter referred to as ,, ,, setting position) of the evaluation value storage unit, the setting position relating position R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B, and then supplies the evaluation value to the position determining unit 236 (FIG. 11).

请注意,在这里,图11所示的控制器240输出作为用于控制传感器241 (图12 )的R感光器单元256R、 G感光器单元256G和B感光器单元256B的放置位置的控制信号,该信号表示在G感光器单元256G的像素位置的水平方向和垂直方向上的偏移量Ph(j和Pv。和在B感光器单元256B的像素位置的水平方向和垂直方向上的偏移量PhB 和PVB(这些偏移量Phc、 PvG、 PhB和PvB可以建成为"偏移量P")。 Note that, here, the output controller 240 as shown in FIG. 11 R photoreceptor unit 256R for controlling the sensor 241 (FIG. 12), the control signal G placement position photoconductor unit 256G and the B photoreceptor unit 256B, this signal indicates offset to the G photoreceptor unit 256G pixel position in the horizontal direction and the vertical direction of Ph (j and Pv. B and offset to the photoconductor unit pixel position in the horizontal direction and the vertical direction of 256B PhB and PVB (these offsets Phc, PvG, PhB and PvB can be built as an "offset P").

接着,图15是说明图11所示的位置确定单元236的配置实例; Next, FIG. 15 illustrates the position shown in FIG configuration example of the determination unit 236;

向评估值整合单元271提供有关多个设定位置的多个第二图像信号的每个的评估值,该评估值由评估单元235的评估值存储单元263 输出。 Providing a plurality of setting a plurality of positions about the evaluation value of each of the second image signal to the evaluation value integrating unit 271, the evaluation value by the evaluation unit evaluates the output value storage unit 263 235. 评估值整合单元271为多个设定位置的每个位置的多个第二图像信号的每个图像信号的有关设定位置整合评估值,并且将通过整合所获得的评估值(以下视情况也称为"整合评估值")提供给最佳位置确定单元272。 Evaluation value setting position relating to the integration of image signals for each of a plurality of positions each evaluation value integration unit 271 set a plurality of positions to a second image signal, and the evaluation value (hereinafter also optionally obtained by integrating referred to as "integrated evaluation value") is provided to determine the best location unit 272.

最佳位置确定单元272根据评估值整合单元271提供的多个设定位置的每个位置的整合评估值确定与要在信号处理单元234进行信号处理相对应的设定位置,即确定图12所示的R感光器单元256R、 G 感光器单元256G和B感光器单元256B的放置位置,并且将该放置位置作为在信号处理单元234处(以及信号处理单元4)进行信号处理的最佳位置提供给位置存储单元237 (图11)。 Optimal position determination unit 272 determines signal processing to be performed in the signal processing unit 234 according to a set position corresponding to the integrated evaluation value for each position of the plurality of set positions of the evaluation value provided by integrating unit 271, i.e., FIG. 12 is determined R photoreceptor unit shown 256R, G, and B photoreceptor unit 256G photoreceptor placement unit 256B, and the placement provided as at 234 (and the signal processing unit 4) optimum position for signal processing in the signal processing unit a position storage unit 237 (FIG. 11).

接下来,将参考图16所示的流程图来描述图ll所示的图像拾取设备的最佳位置的学习过程(学习过程)。 Next, with reference to the flowchart shown in FIG. 16 will be described as shown in FIG ll image pickup device optimal position learning process (learning process).

首先,在步骤S201中,控制器240将所关心组的多个放置位置中所关心的一个放置位置作为图12所示的传感器单元241的R感光器单元256R、 G感光器单元256G和B感光器256B放置位置,并且将表示所关心的放置位置的控制信号提供给图14所示的评估单元235的评估值存储单元263。 First, in step S201, the controller 240 will place a plurality of placement positions of interest in the group of interest, as shown in FIG. 12 in the sensor unit R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor 241 placement unit 256B, a control signal and the placement position of interest to the evaluation unit 14 shown in FIG. 235 evaluation value storage unit 263. 此外,在步骤S201中,控制器240将表示所关心的放置位置的控制信号提供给传感器单元241的R控制单元257R、 G控制单元257G和B控制单元257B,并将R感光器单元257R、 G 感光器单元257G和B感光器单元257B的放置位置移动到所关心的放置位置,接着流程进行到步骤S202。 Further, in step S201, the controller 240 a control signal indicating the placement position of interest is supplied to the sensor unit control unit 257R 241 R, G, B and the control unit control unit 257B 257G, and R photoreceptor unit 257R, G photoreceptor unit 257G, and B photoreceptor unit 257B is moved to place the placement of interest, then the flow proceeds to step S202.

在步骤S202中,信号处理单元234获得传感器单元231输出的图像信号。 In step S202, the signal processing unit 234 obtains an image signal output from the sensor unit 231. 也就是说,在步骤S202中,传感器单元231接收物体光,然后执行光电转换,藉此获得作为电信号的图像信号(即,使物体成像), 并将图像信号提供给信号调整单元232和238。 That is, in step S202, the sensor unit 231 receives the object light and then perform photoelectric conversion, thereby obtaining an image signal as an electric signal (i.e., an object image), and supplies the image signal to the signal adjusting unit 232 and 238 . 信号调整单元232使传感器单元231提供的图像信号经受CDS处理,并且将这些图像信号提供给A/D转换单元233。 Signal adjusting unit 232 of the image signal provided by the sensor unit 231 is subjected to CDS processing, and supplies the image signals to the A / D conversion unit 233. A/D转换单元233对信号调整单元232提供的图像信号进行A/D转换,并将其作为第一图像信号提供给信号处理单元234。 A / D conversion unit 233 on the image signal adjustment unit 232 performs A / D conversion, and supplies it to the signal processing unit 234 as a first image signal. 另一方面,信号调整单元238使传感器单元231提供的图像信号经受CDS处理,并且将这些图像信号提供给A/D转换单元239。 On the other hand, the image signal adjustment unit 238 that the sensor unit 231 provides a signal is subjected to CDS processing, and supplies the image signals to the A / D conversion unit 239. A/D转换单元239对信号调整单元238提供的图像信号进行A/D 转换,并将其作为评估图像信号提供给评估装置235。 A / D conversion unit 239 on the image signal adjustment unit 238 performs A / D conversion, and supplies an image signal to an evaluation as an evaluation device 235.

也就是说,在传感器单元231处,放置在所关心的放置位置上的R感光器单元256R、 G感光器单元256G和B感光器单元256B获得与入射物体光相对应的正常图像信号。 That is, the sensor unit 231 placed in the placement position of interest on the R photoreceptor unit 256R, G photoreceptor unit 256G and the B photoreceptor unit 256B obtain a normal image signal corresponding to light incident on the object. 通过信号调整单元232和A/D 转换单元233向信号处理单元234提供该正常图像信号。 233 supplies the normal image signal to the signal processing unit 234 by the signal adjusting unit 232 and the A / D conversion unit.

此外,在传感器231处,评估R感光器单元255R、评估G感光器单元255G和评估B感光器单元255B获得同样与入射物体光相对应的评估图像信号。 Further, in the sensor 231, R photoreceptor evaluation unit 255R, 255G evaluation photoconductor unit G and B photoreceptor unit 255B assessment evaluation image is obtained similarly to the signal corresponding to the light incident on the object. 通过信号调整单元238和A/D转换单元239向评估单元235提供评估图像信号。 Evaluation image signal 239 provided to the evaluation unit 235 by the signal adjusting unit 238 and A / D conversion unit. 在图14所示的评估单元235处,在图像存储单元261中存储评估图像信号。 In the evaluation unit 235 shown in FIG. 14, in the image storage unit 261 evaluation image signal.

然后,流程从步骤S202进行到步骤S203,信号处理单元234使通过A/D转换单元232提供的笫一图像信号经受与图l所示的信号处理单元4执行的信号处理相同的图像转换处理,藉此获得具有在第一图像信号之上改善了图像质量的第二图像信号,并将第二图像信号提供给评估单元235,然后流程进行到步骤S204。 Then, the flow proceeds to step S203 from step S202, the signal processing unit 234 so that an image signal Zi supplied through A / D conversion unit 232 is subjected to the same signal processing converts the image signal processing unit shown in FIG. 4 executes L, thereby obtaining a first image signal having the above improves the image quality of the second image signal, and supplies the second image signal to the evaluation unit 235, and then the flow proceeds to step S204.

在步骤S204中,评估单元235执行评估信号处理单元234提供的笫二图像信号的评估处理,然后流程进行到步骤S205。 In step S204, the evaluation unit 235 performs the second image signal Zi evaluation process evaluation signal processing unit 234 is supplied, then the flow proceeds to step S205. 也就是说,在图14所示的评估单元235处,相关性计算单元262从存储在图像存储单元261中的评估图像信号中读出评估图像信号作为所关心的评估图像信号,该评估图像信号从与用于获得信号处理单元234提供的第二图像信号的正常的图像信号的物体光相同的物体光中获得。 That is, the signal evaluation image evaluation unit shown in FIG. 14 at 235, the correlation calculating unit 262 reads out the image signals from the evaluation evaluation image signal stored in the image storage unit 261 as of interest, the evaluation image signal obtained from the object to obtain a normal image signal of the second image signal processing unit 234 provides a signal of the object light for the same light. 此外,相关性计算单元262获得信号处理单元234提供的第二图像信号和所关心的评估图像信号之间的相关值,并将该相关值作为信号处理单元234 提供的第二图像信号的评估值提供给评估值存储单元263。 Furthermore, the correlation calculation unit 262 to obtain the correlation value between the second image signal processing unit 234 provides the evaluation image and the signal of interest, as the evaluation value and the second image signal processing unit 234 provides a signal to the correlation value to the evaluation value storage unit 263.

评估值存储单元263将来自于相关性计算单元262的第二图像信号的评估值与刚才前面的步骤S201中的控制器240提供的所关心的设定位置的控制信号关联起来,并存储与所关心的设定位置关联的评估值。 Evaluation value storage unit 263 in association with the control signal from the controller 240 and the evaluation value of the preceding second image signal correlation calculation unit 262 is just provided in step S201 to set a position of interest, and stores the set position to assess the value of the associated interest.

在步骤S205中,控制器240确定预定数目的帧中的每个帧是否已获得有关所关心的设定位置的评估值。 In step S205, the controller 240 determines whether a predetermined number of frames each frame evaluation value has been obtained on setting the positions of interest. 如果在步骤S205中确定预定数目的帧中的每个帧还没有获得有关所关心的设定位置的评估值,那么流程返回步骤S202,传感器单元231在那时接收入射物体光,并施行光电转换,以便获得电信号形式的图像信号,然后重复相同的处理。 If it is determined in a predetermined number of frames each frame in step S205 the evaluation value has not been obtained on setting the positions of interest, then the flow returns to step S202, the sensor unit 231 receives light incident on the object at that time, and the photoelectric conversion purposes , in the form of an electrical signal so as to obtain an image signal, and then repeats the same processing.

同样,如果在步骤S205中确定预定数目的帧中的每个帧已获得有关所关心的设定位置的评估值,那么流程进行到步骤S206,并且控制器240确定所有多个设定位置是否已被作为所关心的设定位置。 Similarly, if the step of determining the predetermined number of frames, each frame having been obtained in S205 the evaluation value related to the setting position of interest, then the flow proceeds to step S206, and the controller 240 determines whether all of the plurality of setting positions It is set as the position of interest.

如果在步骤S206中确定还并非所有的多个设定位置都被作为所关心的设定位置,那么流程返回步骤S201,控制器240测定还没有被作为所关心的设定位置的多个设定位置之一,并随后重复相同的处理。 If it is determined not to set all of the plurality of setting a plurality of positions are set as a position of interest, then the flow returns to step S201, the determination controller 240 has not been set as a position of interest in step S206 one of the positions, and then repeats the same processing.

同样,如果在步骤S206中确定所有多个设定位置都被作为所关心的设定位置,即如果为预定数目的帧中的每个帧已经获得与多个设定位置中的每个设定位置相对应的评估值,并将其存储在图14所示的评估单元235的评估值存储单元263中,那么评估值存储单元263将已为预定数目的帧的每个图像获得的与多个设定位置中的每个设定位置相对应的评估值提供给位置确定单元236,然后流程进行到步骤S207。 Similarly, if it is determined that all the plurality of positions set in step S206 are set as a position of interest, i.e., if the predetermined number of frames, each frame has been obtained for each set of a plurality of set positions corresponding to the relative position of the evaluation value and the evaluation value storage unit 263 shown in FIG. 14, the evaluation unit 235, the evaluation value storage unit 263 which has been stored for each image a predetermined number of frames and a plurality of each setting position corresponding to the set position to the position evaluation value determination unit 236, and then the flow proceeds to step S207.

在步骤S207,图15所示的位置确定单元236的评估值整合单元271为多个设定位置中的每个设定位置整合已为预定数目的帧的每个图像获得的与多个设定位置中的每个设定位置相对应的评估值,从而获得多个设定位置中的每个设定位置的整合评估值,然后将其提供给最佳位置确定单元272。 In step S207, the position determining unit shown in FIG. 15 with a plurality of settings for each image acquired predetermined number of frames is set to a position 271 into a plurality of integrated evaluation value setting position integration unit 236 in each of the each setting position corresponding to a position evaluation value to obtain a plurality of integrated evaluation value for each set position set position, and then supplies it to the optimal position determination unit 272. 也就是说,评估值整合单元271获取某一设定位置,获得例如为预定数目的图像帧中的每个图像帧获得的评估值的平均值、极大值、最小值等等,作为所关心的设定位置的整合评估值,并将其提供给最佳位置确定单元272。 That is, the evaluation value integration unit 271 acquires a set position, for example, to obtain an average value of evaluation values ​​obtained for the predetermined number of image frames in each image frame, maximum value, minimum value, etc., as interest the integrated evaluation value set position, and supplies it to the optimal position determination unit 272.

流程从步骤S207进行到步骤S208,在此最佳位置确定单元272 根据评估值整合单元271提供的多个设定位置的每个设定位置的整合评估值确定与信号处理单元234的信号处理相对应的设定位置,即图 Flow proceeds from step S207 to step S208, the determination unit 272 determines the signal processing unit 234 with the signal processing in the optimum position in accordance with this integrated evaluation value for each set position of the plurality of positions of the evaluation value setting unit 271 provides the integration corresponding to the set position, i.e., FIG.

12所示的传感器单元241中的R感光器单元256R、G感光器单元256G 和B感光器单元256B的放置位置。 R photoreceptor unit 256R sensor unit 241 shown in FIG. 12, G photoreceptor unit 256G and the B photoreceptor unit 256B of placement.

也就是说,在步骤S208中,最佳位置确定单元272例如从评估值整合单元271提供的多个设定位置中的每个设定位置的整合评估值中获得最大值,并且确定与最大整合评估值相对应的设定位置,将其作为与信号处理单元234的信号处理相对应的设定位置,即为图l所示的信号处理单元4的信号处理而放置图3所示的R感光器单元23R、 G感光器单元23G和B感光器单元23B的最佳放置位置。 That is, in step S208, the optimum position determining unit 272, for example, integration of a plurality of set position evaluation value from the evaluation value integrating unit 271 provided for each set position obtained maximum value, and determines the maximum integration an evaluation value corresponding to the set position, as will be the signal processing with the signal processing unit 234 corresponding to the set position, the signal processing unit 4 is shown a signal processing that is shown in FIG. 3 l R photosensitive placed FIG. unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B of optimal placement. 此外,在步骤S208中,最佳位置确定单元272在位置存储单元237中存储表示最佳位置的信息(相当于上述的属性信息),然后结束流程。 Further, in step S208, the information unit 272 in the preferred position 237 stores a position storage means (corresponding to the attribute information) to determine the optimum position, and then ends the process.

在图l所示的传感器单元l中,R感光器单元23R、 G感光器单元23G和B感光器单元23B (图3 )被放置在通过上述学习过程所存储在位置存储器237中的信息所表示的最佳位置上。 In view of the sensor unit shown in FIG. L l, R & photoreceptor unit 23R, G photoreceptor unit 23G, and B photoreceptor unit 23B (FIG. 3) is placed in the learning process by the information stored in the location indicated by the memory 237 the best position. 因此,对于图1 所示的传感器单元1,可以获得适于在信号处理单元4进行信号处理的图像信号,并且对从传感器单元1获得的图像信号执行信号处理又使得能够获得高图像质量的图像信号。 Thus, the sensor unit shown in FIG. 11, the signal can be adapted to obtain an image signal processed in the signal processing unit 4, and performs signal processing on the image signal obtained from the sensor unit 1 and causes the image of high image quality can be obtained signal.

在上述实例中,第二图像信号被描述为通过获得第二图像信号和评估图像信号之间的相关性来评估的,但是应注意,例如可以根据第二图像信号的S/N来执行。 In the above example, the second image signal is described as being obtained by a correlation between the image signal and the second signal evaluation image is evaluated, it should be noted, for example, may be performed according to a second image signal S / N. 此外,可以从外部输入第二图像信号的评估。 In addition, evaluation of the second image signal input from the outside. 也就是说,可以实施这样的安排,其中显示第二图像信号,并且例如由观察显示图像的用户输出第二图像信号的评估。 That is, an arrangement may be implemented, wherein the displaying the second image signal, for example, the user evaluation of the output image displayed by the second image signal is observed.

接下来,可以由专用硬件或软件来执行上述的由信号处理单元4 和234、评估单元235、位置确定单元236、控制器240等执行的一系列处理。 Next, may be performed by dedicated hardware or software by the aforementioned signal processing unit 4 and 234, the evaluation unit 235, the position determination unit 236 performs a series of processing, the controller 240 and the like. 在使用软件执行这一系列处理的情况下,构成该软件的程序被安装在微型电脑、通用计算机等等中。 In the case where the series of processes is executed using software, a program constituting the software is installed in a microcomputer, and the like in a general purpose computer.

现在,图17说明要在其中安装用于执行上述系列处理程序的计算机的配置实例。 Now, FIG. 17 to be described a configuration example in which a computer mounted for performing the above-described series of processing procedures.

该程序可以存储在硬盘305或ROM 303中,这些都是计算机内置的记录介质。 The program may be stored in a hard disk 305 or the ROM 303, which are recording media built into the computer. 或者,该程序还可以临时或永久地存储在可移去存储介质311上,诸如软磁盘、CD-ROM (压缩光盘只读存储器);MO (磁光盘)盘;DVD(数字化通用光盘)、磁盘、半导体存储器等等。 Alternatively, the program may also be temporarily or permanently stored on a removable storage medium 311, such as a floppy disk, CD-ROM (Compact Disc Read Only Memory); the MO (magneto-optical) disc; DVD (digital versatile disc), a magnetic disk, The semiconductor memory and the like. 这样的一种可移动记录介质311可以作为所谓的压缩软件提供。 Such a removable recording medium 311 may be provided as a so-called compression software.

除了从这种可移动记录介质311向计算机安装程序之外,可以从下载站点通过卫星、诸如数字广播卫星无线地,或者通过诸如LAN(局域网)或因特网此类的网络有线地将该程序传送到计算机中,计算机使用通信单元308接收所传送的程序,并将其安装在内置硬盘305中。 Apart from such a removable recording medium 311 installed outside the computer program from a download site via satellite, such as a digital satellite broadcast wirelessly, or through a LAN (Local Area Network) or the Internet, a wired network such as the program to be transmitted a computer, the computer uses the communication unit 308 receives the transferred program and install it in the built-in hard disk 305. 计算机具有内置的CPU (中央处理器)302。 The computer has a built-in CPU (Central Processing Unit) 302. 输入/输出接口310 通过总线301连接于CPU 302,并且当用户通过使用由诸如键盘、鼠标、麦克风等此类組成的输入单元307来输入命令,通过输入/输出接口310,相应的批f行存储在ROM(只读存储器)303中的程序。 The input / output interface 310 via a bus 301 connected to CPU 302, and when the user 307 by using the input unit to input commands such as composed of a keyboard, a mouse, a microphone, etc., via the input / output interface 310, the corresponding grant line storage f program in a ROM (Read Only memory) 303. 或者, CPU 302可以将存储在硬盘305上、或通过卫星或网络传送的由通信单元308接收并安装在硬盘305上、或者从装配在驱动器309上的可移动记录介质311中读出并安装在硬盘305上的程序载入RAM(随机存取存储器)304以便执行。 Alternatively, CPU 302 may be stored on hard disk 305, or by the communication unit transmits via satellite or a network 308 receives and installed on the hard disk 305 or read out from the fitting removable recording medium 311 on the drive 309 and installed in Loading the program on the hard disk 305 a RAM (random access memory) 304 for execution. 因此,CPU 302根据上述流程或上述方框图的配置执行处理。 Thus, CPU 302 performs processing based on the above-described block diagrams or flow configuration. 然后,CPU 302根据需要使用输入/输出接口310 从由LCD (液晶显示器)或扬声器构成的输出单元306输出,或者从通信单元308传送处理结果,或将其存储在硬盘305中,等等。 Then, CPU 302 using the required input / output interface 310 from an output unit composed of LCD (Liquid Crystal Display) or a speaker 306, or transmits the processing result from the communication unit 308 or stored in the hard disk 305, and the like.

现在,在当前的说明书中,以程序代码的形式描述处理步骤以使计算机执行并不需按流程图给出的时间序列顺序处理的各种处理,可以并行或单独地被执行(例如,并行处理或基于对象的处理)。 Now, in the present specification, the form of program code description of the process steps to make a computer execute various processes are not time-series basis having a flowchart given in the order of processing may be performed in parallel or individually (e.g., parallel processing or object-based processing). 此外, 该程序可由单机或多个计算机来处理。 In addition, the program may be a stand-alone computer or a plurality of processing. 而且,可将该程序传送到远程计算机上执行。 Further, the program may be executed on a remote computer to transmit.

请注意,信号处理单元4和234可以执行除了上述图像转换处理之外的用于获得第二图像信号的处理,诸如使第一图像信号经受数字钳位处理、白色均衡调整处理、伽马校正处理、线性内插处理,等等。 Note that, the signal processing unit 4, and 234 may be performed in addition to the above-described image conversion processing for obtaining the second image signal processing, such as the first image signal is subjected to digital clamping process, white balancing adjustment processing, gamma correction processing , linear interpolation processing, and the like.

同时,虽然所描述的当前具体实施例为传感器单元1和231使用所谓的三-传感器装置,但是传感器单元1和231也可以使用单-传感器、双-传感器、或四个或以上的传感器系统。 Meanwhile, although the described embodiment of the current sensor unit 231, and a so-called three - sensor means, the sensor unit 231 may also be used and a single - sensor, bis - sensors, or four or more sensor systems.

此外,对于当前具体实施例,已相对于传感器单元1和231作出了描述,传感器单元1和传感器231感测光并输出与该光相对应的图像信号,但是,可以在其中作这样的安排,即传感器单元1和231是感测声音的麦克风,并且其输出与该声音相对应的音频信号,或者传感器单元1和232是感测例如温度或加速度等其它类型的信息并输出与该信息相对应的信号的传感器。 In addition, the current embodiment, the sensor unit 1 has with respect to the description and 231, the sensor unit 1 and the sensor 231 senses the light and the output light corresponding to the image signal, however, which may make such arrangements, i.e., the sensor unit 1 and 231 that senses a sound microphone, and outputs it to the sound corresponding to the audio signal, or the sensor unit 1 and 232 are sensed, for example, such as temperature and acceleration of other types of information and outputs the information corresponding to sensor signals. 尽管这样,请注意,根据所感测的信息类型,在传感器单元1和231的后阶段所执行的信号处理不同。 Despite this, please note that, according to the type of information being sensed, different signal processing stages 1 after the sensor unit 231 and executed. 同样,除了R感光器单元23R、 G感光器单元23G和B感光器单元23B的放置状态之外,传感器单元1 (和传感器231同样)的属性的实例包括用于将光聚集在像素上的片上透镜的放置位置,与每个像素已存储的电荷相对应的电压(电流)放大率,等等。 Similarly, in addition to the R photoreceptor 23R, G placement state photoconductor unit 23G and a B cell 23B photoreceptor cell, examples of the sensor unit 1 (and the same sensor 231) attributes include a light collected on a pixel on the sheet placement of the lens, and the charge stored in each pixel corresponding to the voltage (current) magnification, and the like.

第二具体实施例 Second embodiment

接下来,将描述本发明的笫二具体实施例。 Next, an embodiment will be described in two specific Zi present invention.

图18说明已应用本发明的图像拾取设备的第二具体实施例的配置实例。 18 DETAILED DESCRIPTION FIG applied a second image pickup apparatus according to the present invention, a configuration example of an embodiment. 该图18所示的图像拾取设备例如可以是数字静态照相机或数字摄像机。 The image pickup apparatus shown in FIG. 18, for example, may be a digital still camera or digital video camera.

同图1所示的传感器单元1 一样,传感器401包括与像素相对应的多个光电转换单元,其用于感测投射到其中的物体光,并向信号调整单元402输出与所接收光量相对应的电信号形式的图像信号。 The sensor unit shown in FIG. 1 with the same sensor 401 comprising a plurality of photoelectric conversion units corresponding to the pixel, for sensing light which is projected onto the object, and adjusting means 402 outputs a signal corresponding to the amount of light received an electrical signal in the form of an image signal. 同样, 与图1所示的传感器单元1不同,传感器单元401根据信号处理单元404提供的控制信号来改变它的状态。 Similarly, the sensor unit shown in FIG. 1 is different from the sensor unit 401 to change its state according to a control signal provided by the signal processing unit 404.

信号调整单元402执行CDS处理以去除包含在传感器401输出的图像信号中的复位噪音,并且将作为处理结果所获得的图像信号提供给A/D转换单元403。 Signal adjusting unit 402 performs the CDS processing to remove reset noise contained in the image signal output from the sensor 401, and the image signal obtained as a processing result is supplied to the A / D conversion unit 403. A/D转换单元403对信号调整单元402提供的图像信号执行A/D转换,即通过采样量化图像信号并将作为结果所获得的数字图像提供给信号处理单元404。 A / D conversion unit 403 on the image signal adjustment unit 402 performs the A / D conversion, and supplies the digital image that is obtained as a result to the signal processing unit 404 by sampling the quantized image signal.

信号处理单元404将A/D转换单元403提供的数字图像信号(以下简称为',图像信号")作为第一图像信号,并使第一图像信号经受预定的图像转换处理,并向输出单元405输出作为其结果所获得的数字图像信号作为第二图像信号。同样,信号处理单元404对作为它的结果所获得的第二图像信号进行评估,并将与该评估相对应的控制信号提供给传感器单元401,以控制传感器单元401的状态。 The signal processing unit 404 the digital image signal A / D conversion unit 403 is provided (hereinafter referred to as "image signal") as a first image signal, and the first image signal is subjected to predetermined image conversion processing to the output unit 405 outputting a digital image signal obtained as a result thereof as the second image signal. Similarly, the signal processing unit 404 as a second image signal obtained as a result of its assessment, and supplies the sensor and the evaluation corresponding to the control signal unit 401 to control the state of the sensor unit 401.

输出单元405接收信号处理单元404输出的第二图像信号,并输出这些第二图像信号。 The second image signal output unit 405 outputs the reception signal processing unit 404, and outputs the second image signal. 也就是说,输出单元405从未示出的输出端输出来自信号处理单元404的第二图像信号,或者将其显示在未示出的监视器上。 That is, the output unit 405 never output terminal shown in the second image signal from the signal processing unit 404, or display it on a monitor (not shown). 此外,输出单元405将第二图像信号存储在未示出的记录 Further, the output unit 405 of the second image signal stored in the unillustrated recording

介质中,诸如光盘、磁盘、磁光盘、磁带,半导体存储器等等,或者通过像电话线、因特网、局域网或其他像电缆或无线传输介质发送这些图像信号。 Media, such as optical disk, magnetic disk, optical disk, magnetic tape, semiconductor memory, etc., or the image signal, the Internet, a local area network or other transmission medium, like cables or wireless transmission as a telephone line.

对于上述配置的图像拾取设备来说,在传感器单元401处接收物体光,并通过信号调整单元402和A/D转换单元403将与所接收光量相对应的电信号形式的图像信号提供给信号处理单元404。 For the above-described configuration of an image pickup apparatus, the sensor unit 401 receives the object light 403 and provides the image signal in the form of an electrical signal corresponding to the amount of light received to the signal processing by the signal adjusting unit 402 and A / D conversion unit unit 404. 信号处理单元404使传感器401通过信号调整单元402和A/D转换单元403提供的图像信号作为第一图像信号经受诸如图像转换处理此类的信号处理,并向输出单元405输出藉此已提高图像质量的第二图像信号,该图像转换处理例如通过提高分辨率来提高图像质量。 The signal processing unit 404 of the sensor 401 is subjected to signal processing such as the image conversion processing such as the first image signal by the image signal adjustment unit 402 and A / D conversion unit 403 is provided, and thereby the output unit 405 outputs the image has improved quality of the second image signal, the image conversion processing, for example, to improve the image quality by improving the resolution. 在输出单元405 中,输出信号处理单元404提供的第二图像信号。 In the output unit 405, an output signal of the second image signal processing unit 404 is provided.

同样,信号处理单元404评估通过使来自于传感器单元401的第一图像信号经受图像转换处理所获得的第二图像信号。 Similarly, the signal processing unit 404 by making the evaluation of the second image signal from the image signal of a first sensor unit 401 is subjected to image conversion processing obtained. 此外,信号处理单元404向传感器401提供与其评估相对应的控制信号以控制传感器401的状态。 Further, the signal processing unit 404 corresponding to the sensor 401 provide control signals to control its assessment of the state of the sensor 401.

传感器401根据信号处理单元404提供的控制信号改变其状态, 并输出在遵循改变的状态下所获得的图像信号。 Sensor 401 changes its state according to a control signal provided by the signal processing unit 404, and outputs an image signal to follow changes in the state obtained.

传感器401是一种三-传感器成像传感器装置,例如包括三个用于获得图像信号的R、 G和B分量的传感器(随后所述的R感光器单元23R、 G感光器单元23G和B感光器单元23B)。 Sensor 401 is a three - sensor imaging sensor device including a sensor to obtain image signals R, G, and B components for three (subsequent said R photoreceptor unit 23R, G element 23G and B photoreceptor photoreceptor unit 23B). 因此,传感器单元1为每个像素输出具有R信号、G信号和B信号三个分量的图像信号。 Thus, for each pixel of the sensor unit 1 outputs a signal of R, G and B signals of three components of the image signal. 传感器401根据信号处理单元404提供的控制信号来改变三个传感器中的一个或多个传感器的放置状态。 Sensor 401 is placed to change the state of the three sensors or more sensors according to a control signal processing unit 404 is provided. 因此,传感器401的传感器放置状态是由信号处理单元404提供的控制信号来控制的。 Thus, the sensor 401 of the sensor placement state by the control signal processing unit 404 to provide control. 此刻,传感器放置状态包括传感器的放置位置和传感器的姿态(转动状态)。 At the moment, the sensor comprises a placement state attitude sensor placement and sensor (rotational state). 然而,请注意对于当前具体实施例,为了便于描述,将进行有关使用来自于信号处理单元404的控制信号控制传感器或传感器单元401的放置位置的描述。 Note, however, for this particular embodiment, for convenience of description, description will be made on the use of sensors or sensor control signal 404 of the placement unit 401 from the signal processing unit. 也应注意传感器的姿态同样可以控制。 Note also that the sensor can also control the attitude. 图19说明图18所示的信号处理单元404和输出单元405的配置实例。 19 illustrates a configuration example of the signal processing unit shown in FIG. 18 405 404 and the output unit. 信号处理单元404包括三个信号处理单元411R、 411G和411B。 The signal processing unit 404 includes three signal processing units 411R, 411G, and 411B. 信号处理单元411R接收A/l>转换单元403提供的具有R、 G和B信号的第一图像信号,并使第一图像信号转换经受图像转换处理,藉此获得第二图像信号的R信号(分量),然后将该R信号输出到输出单元405。 The signal processing unit 411R receives the A / l> a first image signal having R, G and B signals supplied to the conversion unit 403, and converts a first image signal subjected to the image conversion processing, thereby obtaining a second image signal, the R signal ( component), and then outputs the signal to the output unit 405 R. 信号处理单元411G接收A/D转换单元403提供的具有R、 G 和B信号的第一图像信号,并使第一图像信号转换经受图像转换处理, 藉此获得第二图像信号的G信号(分量),然后将该G信号输出到输出单元405。 The signal processing unit 411G receives the A / a first image signal having R, G and B signals D conversion unit 403 is supplied, and converting the first image signal is subjected to image conversion processing, thereby obtaining a second image signal, G signal (component ), and then outputs the G signal to the output unit 405. 信号处理单元411G同样对第二图像信号的G信号进行评估,并根据这个评估控制传感器单元401的各传感器的放置状态。 The signal processing unit 411G for G signals the same second image signal are evaluated, based on this assessment and status of each sensor is placed a sensor control unit 401. 信号处理单元411B接收A/D转换单元403提供的具有R、 G和B信号的第一图像信号,并使第一图像信号转换经受图像转换处理,藉此获得第二图像信号的B信号(分量),然后将该B信号输出到输出单元405。 The signal processing unit 411B receives the A / a first image signal having R, G and B signals D conversion unit 403 is supplied, and converting the first image signal is subjected to image conversion processing, thereby obtaining a second image signal, the B signal (component ), then the output signal B to the output unit 405.

注意,在这里,信号处理单元411G对第二图像信号的G信号进行评估,获得向输出单元405提供的第二图像信号的B信号(分量)。 Note that, here, the signal processing unit 411G for the G signal of the second image signal are evaluated to obtain a B signal (component) of the second image signal supplied to the output unit 405. 然而,虽然安排信号处理单元411G对第二图像信号的G信号进行评估,并根据该评估控制传感器或传感器单元401的放置状态,但是也可以通过评估第二图像信号的R信号或B信号中的任一个而不是评估G信号来对传感器单元401进行控制,或者也可以对第二图像信号的R、 G和B信号的两个或多个信号进行评估。 However, although the arrangement of the signal processing unit 411G G signal of the second image signal are evaluated, and the control state of the sensor or sensor placement unit 401 based on the assessment, but may be an R signal or the B signal by a second image signal Evaluation any of a G instead of evaluating the sensor signals to the control unit 401, or may be two or more assessment signals R, G and B signals of the second image signal.

输出单元405包括输出单元412R、412G和412B。 The output unit 405 includes an output unit 412R, 412G, and 412B. 输出单元412R、 412G和412B分别接收并输出信号处理单元411R、 411G和411B输出的第二图像信号的R信号、G信号和B信号。 An output unit 412R, 412G, and 412B respectively receive and output signal processing unit 411R, R image signal of the second output signal 411G and 411B, G, and B signals. 请注意,在下文中, 只要适当的时候,信号处理单元411R、 411G和/或411B也可以是合称或分称为"信号处理单元411"。 Note that, hereinafter, as long as the appropriate time, the signal processing unit 411R, 411G and / or 411B may be collectively referred to as a partial or "signal processing unit 411."

接着,图20是说明图18和19所示的传感器单元401的配置实例; 物体光射入透镜421中,并且透镜421通过棱镜422将物体光聚集到R感光器单元423R、 G感光器单元423G和B感光器单元423B的每一个上。 Next, FIG 20 is a configuration example of the sensor unit 18 shown in FIG. 19 and 401; the light is incident on the object lens 421, the lens 421 through the prism 422 and the object light onto the R photoreceptor unit 423R, G photoreceptor unit 423G and B on each of the photoconductor unit 423B. 也就是说,投射入透镜421中光被发射到棱镜422中。 That is, the projection lens 421 into light is emitted to the prism 422. 棱镜422将来自于透镜421的物体光分解为R、 G和B光,并且沿相应于R感光器单元423R、 G感光器单元423G和B感光器单元423B所处位置的方向发射R、 G和B光。 The prism 422 from the object lens 421 photodecomposition of R, G and B light, and emits a direction R corresponding to the photoconductor unit R, G and B photoreceptor unit 423G 423B photoconductor unit's location 423R, G, and B light.

R感光器单元423R、 G感光器单元423G和B感光器单元423B 被配置为光电转换装置,像例如光电二级管此类,其从棱镜422接收R、 G和B光,并藉此产生与所接收光量相对应的电信号形式的R信号、G信号和B信号,然后将这些信号输出到信号调整单元402。 R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B is configured as a photoelectric conversion means, such as for example a photodiode, which from the prism 422 receives R, G and B light, and thereby generating R form of electrical signals corresponding to the amount of light received, G, and B signals, and then outputs these signals to the signal adjusting unit 402.

可以用于R感光器单元423R、G感光器单元423G和B感光器单元423B装置的一个实例是CCD(电荷耦合器件)。 R may be used in the photoreceptor unit 423R, 423B example of a device G photoreceptor unit 423G, and B is a unit photosensitive CCD (charge coupled device). 然而,请注意R感光器单元423R、 G感光器423G和B感光器423B并不限于CCD,也可以用CMOS传感器或HARP来替换。 Note, however, R photoreceptor unit 423R, G and B photoreceptors 423G photoreceptor 423B is not limited to the CCD, may be replaced by a CMOS sensor or HARP.

R控制单元424R、 G控制单元424G和B控制单元424B其每一个都根据信号处理单元411G提供的控制信号对R感光器单元423R、 G感光器单元423G和B感光器单元423B i欠置位置的移动进行控制。 R control unit 424R, G control unit 424G and a B control unit 424B each of which is set to a position according to a control signal processing unit 411G provided in the R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B i owe movement control.

在这里为了便于描述,假定整个R感光器单元423R的位置已被设置到由R控制单元424R获得的位置上。 For ease of description herein, it is assumed position of the entire R photoreceptor unit 423R has been set to the position indicated by R obtained by the control unit 424R. 此外,假定整个G感光器单元423G和B感光器单元423B的放置位置已被设置到由G控制单元424G和B控制单元424B获得的位置上。 Furthermore, assuming that the placement of the entire photoconductor unit G 423G, and B photoreceptor unit 423B has been set to position B units 424G and 424B controlled by the control unit G on obtained. 但是,应注意可以使用MEMS技术来进行安排,借此所利用的R感光器单元423R是一个在其中像素的放置位置基本可以改变(移动)的感光器单元,因此R控制单元424R可以个别地控制R感光器单元423R的每个像素的放置位置。 However, it should be noted that the use of MEMS technology to be arranged, whereby R utilized photoconductor unit 423R is placed in a position in which the pixel can be substantially changing (moving) the photoreceptor unit, the control unit 424R thus R may be individually controlled R photoreceptor unit disposed in the position of each pixel 423R. 这对于G感光器单元423G、 G控制单元424G、 B感光器单元423B和B控制单元424B也同样成立。 This 423G, G control unit 424G, B photoreceptor unit 423B and 424B control unit B is also true for the G photoreceptor unit.

接下来,将参考附图21A到21D来描述图21所示的使用R控制单元424R、 G控制单元424G和B控制单元424B对R感光器单元423R、 G感光器单元423G和B感光器单元423B中的每一个所进行的控制。 Next, with reference to the accompanying drawings FIGS. 21A to 21D will be described using the R control unit 424R, G and B, the control unit 424G on the control unit 424B R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B shown in FIG. 21 each of the control performed.

图21A所示的R感光器单元423R、图21B所示的G感光器单元423G和图21C所示的B感光器单元423B,其每个都具有有限区域(相应于一个光电二极管等等)的像素,并输出在每个像素与所接收的光量相对应的图像信号(像素值)。 Shown in FIG. 21A R photoreceptor unit 423R, G photoreceptor unit B shown in FIG. 21B photoreceptor shown in FIG. 21C unit 423G and 423B, each having a limited area (corresponding to a photodiode, etc.) pixels and outputs each pixel to the amount of received light corresponding to the image signal (pixel values). 请注意,在图21A到21D中,所述 Note that, in FIGS. 21A to 21D, the

像素是每个边都具有有限长度的正方形。 Each pixel is a square having a side length limited.

在这里,R感光器单元423R、 G感光器单元423G和B感光器单元423B的像素的位置每一个由作为像素的正方形的重心表示,并且R 感光器单元423R、 G感光器单元423G和B感光器单元423B的像素分别由点、圆和X代表。 Here, R photoreceptor unit 423R, the positions of pixels G photoreceptor unit 423G and the B photoreceptor unit 423B each of the center of gravity of square pixels as expressed and R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor pixel unit 423B by dots, circles, and X represents a respectively. 接近表明图像拾取设备,诸如摄像机或静态照相机,R感光器单元423R、G感光器单元423G和B感光器单元423B 的例如相应像素的位置全部在光学上匹配。 Indicates that close the image pickup apparatus, such as a video camera or a still camera, R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit, for example, a corresponding pixel positions of all optically matched 423B. 也就是说,R感光器单元423R、 G感光器单元423G和B感光器单元423B被全部放置在光学上等效位置上,以使光线的R、 G和B射线由相应的像素接收。 That is, R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B is placed on all of the optically equivalent positions, so that the light R, G and B rays received by the respective pixels.

R控制单元424R、 G控制单元424G和B控制单元424B其分别根据信号处理单元411G (图11)提供的控制信号对R感光器单元423R、 G感光器单元423G和B感光器单元423B的位置移动进行控制。 R control unit 424R, 424B that controls signals from the signal processing unit 411G (FIG. 11) provided in G control unit 424G and a B control unit R photoconductor unit position 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B of control. 也就是说,R感光器单元423R、 G感光器单元423G和B感光器单元423B的放置位置不是固定的而是可移动的,并因此传感器401 中的R感光器单元423R、 G感光器单元423G和B感光器单元423B 的相应像素没有必要在光学上相同的位置上。 That is, R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B of the placement position is not fixed but movable, and thus the sensor 401 R photoreceptor unit 423R, G photoreceptor unit 423G and B photoreceptor unit 423B corresponding to the pixels are not necessarily on the same position on the optics.

如图21D所示,对于作为参考的R感光器单元423R的像素的位置(图13A和13D的点所示)而言,在G感光器单元423G的像素位置的水平方向和垂直方向上的偏移量(由图21所示的圆表示)被表示为Phc;和Pvg,而在B感光器单元423B的像素位置的水平方向和垂直方向上的偏移量(由图21中的X表示)净皮表示为PhB和PVB。 , For the position (shown in FIGS. 13A and 13D of points) as a reference in terms of the R photoreceptor unit pixels 423R, migraine FIG. 21D photoconductor unit on a G pixel position in the horizontal direction and the vertical direction of 423G shift amount (denoted by a circle shown in FIG. 21) is expressed as Phc; and Pvg, but offset to the B photoreceptor unit 423B pixel position in the horizontal direction and the vertical direction (indicated by in FIG. X-21) net Paper expressed as PhB and PVB.

R控制单元424R、 G控制单元424G和B控制单元424B根据信号处理单元411G提供的控制信号移动R感光器单元423R、 G单元423G和B感光器单元423B得放置位置,以便实现偏移量PhG、 PvG、 PhB、 PvB。 R control unit 424R, G and B, the control unit 424G according to a control signal control unit 424B moves R photoreceptor unit 411G provided in the signal processing unit 423R, G, and B unit 423G photoreceptor unit 423B have the placement, in order to achieve the offset PhG, PvG, PhB, PvB.

现在,在这种情况下,在其中可做一些安排,例如,R感光器单元423R的位置是固定的,只移动感光器单元423G和B感光器单元423B。 Now, in this case, do some arrangements in which, for example, a position R photoreceptor unit 423R is fixed, only the moving photoreceptor unit 423G and the B photoreceptor unit 423B. 或者,可在其中另一个安排,即R感光器单元423R、 G感光器单元423G和B感光器单元423B中除R感光器单元423R之外的另一个感光器单元是固定的,而剩余的两个可以移动,此外可在其中做这样的安排,即可以移动所有的R感光器单元423R、 G感光器单元423G和B感光器单元423B。 Alternatively, another arrangement in which, i.e. R photoreceptor unit 423R, the G photoreceptor unit 423G and the B photoreceptor unit 423B other than the R photoreceptor unit 423R another photoconductor unit is stationary, while the remaining two a movable, in addition may be made therein such an arrangement, i.e. can move all the R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B.

接下来,图22说明图19所示的信号处理单元411的配置实例。 Next, FIG. 22 illustrates a configuration example of the signal processing unit 411 shown in FIG. 19. 信号处理单元411R、411G和411B已提供来自传感器401并通过信号调整单元402和A/D转换单元403的图像信号作为第一图像^言号。 The signal processing unit 411R, 411G, and 411B have been provided by the signal adjusting unit 401 and the image signal 402 and the A / D conversion unit 403 as the number of words from a first image sensor ^.

信号处理单元411R包括图像转换单元431R和图像存储单元432R。 The signal processing unit 411R and 431R includes an image converting unit image storage unit 432R. 提供给信号处理单元411R的第一图像信号被提供给图^^转换单元431R。 A first image signal to the signal processing unit 411R is supplied to the conversion unit of FIG ^^ 431R. 图像转换单元431R使第一图像信号经受图像转换处理, 以例如通过提高分辩率来提高图像质量,并向图像存储单元432R提供具有作为信号处理结果的提高图像质量的R数字图像信号作为第二图像信号的R信号。 The image converting unit 431R of the first image signal subjected to the image conversion processing, for example, to improve the image quality by improving the resolution, and 432R provide a digital image signal having R as a result of signal processing to improve the image quality of the image as the second image storage unit the R signal.

图像存储单元432R临时存储图像转换单元431R提供的第二图像信号。 Second image signal image storing unit for temporarily storing image converting unit 432R 431R supplied. 此外,图像存储单元432R根据信号处理单元411G的评估单元433提供的用于选择图像的选择信息从所存储的第二图像信号中读出第二图像信号,并将读出的第二图像信号提供给输出单元405。 Further, the image storage unit 432R according to the second image signal to the image selection information is read out from the second image signal stored in the signal processing unit 411G provided in the evaluation unit 433, and a second image signal read out to provide to the output unit 405.

信号处理单元411G包括图像转换单元431G、图像存储单元432G 和评估单元433。 The signal processing unit includes an image converting unit 411G 431G, 432G image storage unit 433 and evaluation unit. 提供给信号处理单元411G的第一图像信号^^提供给图像转换单元431G。 The signal processing unit is supplied to the first image signal ^^ 411G is supplied to the image converting unit 431G. 图像转换单元431G使第一图像信号经受图像转换处理,以例如通过提高分辩率来提高图像质量,并向图像存储单元 The image converting unit 431G of the first image signal subjected to the image conversion processing, for example, to improve the image quality by improving the resolution, and image storage unit

432G和评估单元433提供具有作为信号处理结果的提高图像质量的G 数字图像信号作为第二图像信号的G信号。 432G G and evaluation unit 433 provides a digital image signal having a signal processing result of improving image quality as the G signal of the second image signal.

图像存储单元432G临时存储图像转换单元431G提供的第二图像信号。 Second image signal image storing unit for temporarily storing image converting unit 432G 431G supplied. 此外,图像存储单元"2^G根据信号处理单元411G的评估单元433提供的用于选择图像的选择信息从所存储的第二图像信号中读出第二图像信号,并将读出的第二图像信号提供给输出单元405。评估单元433对图像转换单元431g提供的第二图像信号的g信号进行评估,并且向传感器单元401提供相应于评估的控制信号,藉此控制传感器401的r感光器单元423r、 g感光器单元423g和b 感光器单元423b的放置位置(图20)。此外,评估单元433将相应于第二图像信号的评估的选择信息提供给图像存储单元432g,并进一步将相同的选择信息提供给信号处理单元411r的图像存储单元432r 和信号处理单元411b的图像存储单元432b。 Second Further, the image storage unit "2 ^ G signal is read in accordance with the selection information processing unit 411G provided in the evaluation unit 433 for selecting an image from the second image signal stored in the second image signal, and supplies the read g signal of the image signal to the second image signal output unit 405. the evaluation unit 433 provides the image conversion unit 431g is evaluated, and the evaluation to provide a control signal to the sensor unit 401, thereby controlling the photosensitive sensor 401 r unit 423R, placement (FIG. 20) g photoconductor unit 423g and 423b of the photoconductor unit b. further, the evaluation unit 433 corresponding to the selection information evaluation second image signal to the image storing unit 432g, and further the same the selection information to the signal processing unit of the image storage unit 411r 432r and signal processing unit in the image storage unit 432b 411b.

信号处理单元411b包括图像转换单元431b和图像存储单元432b。 The signal processing unit 411b includes an image converting unit 431b, and an image storage unit 432b. 提供给信号处理单元411b的第一图像信号被提供给图像转换单元431b。 A first image signal to the signal processing unit 411b is supplied to the image converting unit 431b. 图像转换单元431b使第一图像信号经受图像转换处理, 以例如通过提高分辩率来提高图像质量,并向图像存储单元432b提供具有作为信号处理结果的提高图像质量的b数字图像信号作为第二图像信号的b信号。 The image converting unit 431b causes the first image signal subjected to the image conversion processing, for example, to improve the image quality by improving the resolution, b and 432b to provide a digital image signal having a signal processing result of improving image quality as a second image storage unit the signal b.

图像存储单元432b临时存储图像转换单元431b提供的第二图像信号。 Second image signal image storing unit 432b for temporarily storing image conversion unit 431b is provided. 此外,图像存储单元432b根据信号处理单元411g的评估单元433提供的用于选择图像的选择信息从所存储的第二图像信号中读出第二图像信号,并将读出的第二图像信号提供给输出单元405。 Further, the image storage unit 432b according to the second image signal to the image selection information is read out from the second image signal stored in the signal processing unit 433 provides an evaluation unit 411g, and a second image signal read out to provide to the output unit 405.

请注意,图《象转换单元431r、 431g和431b具有相同的配置, 因此可视情况,合称或分称为"图像转换单元431"。 Note that FIG. "Image conversion unit 431r, 431g and 431b have the same configuration, therefore optionally, collectively referred to as a partial or" image converting unit 431. " 此外,应注意图像存储单元432r、 432g和432b具有相同的配置,因此视情况,可合称或分称为"图像存储单元432"。 Further, to be noted that the image storage unit 432r, 432g and 432b have the same configuration, therefore, as the case may be partial or collectively referred to as "image storage unit 432."

接着,图23说明图22所示的评估单元433的配置实例;评估单元433包括存储单元441、相关性计算单元442、确定评估单元443和控制信号输出单元444,并且评估图像转换单元431g提供的第二图像信号的G信号的图像质量。 Next, FIG. 23 illustrates a configuration example of the evaluation unit 433 shown in FIG. 22; the evaluation unit 433 includes a storage unit 441, the correlation calculation unit 442, determination unit 443 and evaluation unit 444 outputs a control signal, the image conversion unit 431g and the evaluation provided G quality image signal of the second image signal.

更具体地说,图像存储单元441临时存储图像转换单元431g提供的第二图像信号。 More specifically, the second image signal of the image memory unit 441 temporarily stores the supplied image conversion unit 431g. 相关性计算单元442计算图像转换单元431G上次提供的第二图像信号和图像转换单元431G这次提供的第二图像信号之间的相关性,并将作为计算结果获得的相关值提供给确定评估单元443。 The correlation between the second image signal correlation calculating unit 442 calculates the image converting unit 431G second image signal and the image converting unit 431G provided the last offer, and supplies the correlation value obtained as the calculation result to the determination of evaluation unit 443.

确定评估单元443根据相关性计算单元442提供的相关值来评估图像转换单元431G输出的第二图像信号,并获得效果为第二图像信号的图像质量是高,或是低的评估结果。 Evaluation results of evaluation of the second image signal is determined to evaluate an output image converting unit 431G according to the correlation value calculation unit 442 of unit 443, and the image quality is obtained for the effect of the second image signal is high or low. 此外,确定评估单元443将第二图像信号的评估结果提供给控制信号输出单元444,并根据该评 In addition, the evaluation unit 443 determines the evaluation result of the second image signal supplied to the control signal output unit 444, and based on the assessment

估结果向图22所示的图像存储单元432R、 432G和432B输出选择信 Estimation result 432R, 432G, and 432B outputs the selection signal to the image storage unit 22 shown in FIG.

White

控制信号输出单元444向传感器401的R控制单元424R、 G控制单元424G和B控制单元424B提供控制传感器401的R感光器单元423R、 G感光器单元423G和B感光器单元423B (图20 )的放置位置的控制信号,该控制信号与来自确定评估单元443的第二图像信号的评估结果相对应。 Control signal output unit 444 control unit 424R to the R sensor 401, G control unit 424G and a B control unit 424B provides R photoreceptor control sensor 401 units 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B (FIG. 20) placement of the control signal, the control signal is determined from the evaluation result of the second image signal 443 corresponding to the evaluation unit. 因此,R感光器单元423R、 G感光器单元423G 和B感光器单元423B的放置位置得到控制。 Thus, R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B is controlled placement.

对于如上述设置的评估单元433而言,存储单元441连续地存储图像转换单元431G提供的第二图像信号。 As for the second image signal of the evaluation unit 433 of the above arrangement, the memory unit 441 successively stores the supplied image converting unit 431G. 当相关性计算单元442接收图像转换单元431G提供的新的第二图像信号时,其计算这些第二图像信号和图像转换单元431G上次提供的并存储在存储单元441中的第二图像信号之间的相关值。 When the second image signal of a new image signal of the second correlation calculation unit 442 receives image conversion unit 431G is provided, which calculates the second image signal and the previous image converting unit 431G provided and stored in the storage unit 441 correlation values ​​between.

此时,第二图像信号的两个帧(场)之间的相关值的实例是两个图像信号之间的位于相同位置的部分或所有像素的差分绝对和的倒数。 In this case, examples of the correlation value between the two frames (fields) are part of the second image signal at the same position between the two image signals of all pixels or the difference and the reciprocal of the absolute.

相关性计算单元442将获得的相关值提供给确定评估单元443。 Correlation value calculation unit 442 supplies the obtained evaluation unit 443 to the determination. 确定评估单元443根据相关性计算单元442提供的相关值来评估图像转换单元431G输出的第二图像信号,并获得效果为第二图像信号的图像质量是高,或是低的评估结果。 Evaluation results of evaluation of the second image signal is determined to evaluate an output image converting unit 431G according to the correlation value calculation unit 442 of unit 443, and the image quality is obtained for the effect of the second image signal is high or low. 如果确定评估单元443获得的效果为第二图像信号的图像质量是低的评估结果,那么确定评估单元443 将评估结果提供给控制信号输出单元444。 If the results obtained by the evaluation unit 443 determines the image quality of the second signal is low image evaluation result, the evaluation unit 443 determines the evaluation result to the control signal output unit 444.

如图21所示,当接收到效果为第二图像信号的图像质量为低的评估结果时,控制信号输出单元444向传感器401提供与评估结果相对应控制传感器401的R感光器单元423R、 G感光器单元423G和B 感光器单元423B (图20)的放置位置的控制信号,即,参考R感光器单元423R的像素位置,改变G感光器单元423G的像素位置的偏移量值Phc和PvG,以及B感光器单元423B的像素位置的偏移量值Phu和Pvb的控制信号。 21, when receiving the effect of the image quality of the second image signal is low evaluation result, the control unit 444 outputs a signal corresponding to the sensor units control the R photoreceptor 401 to 423R and evaluation results of the sensors 401, G control signal placement of the photoreceptor unit 423G and the B photoreceptor unit 423B (FIG. 20), i.e., the reference pixel position R photoreceptor unit 423R, the G photoreceptor unit changes the offset value Phc 423G and the pixel position PvG , and the offset value of the B pixel positions of photoconductor unit 423B Phu Pvb and control signals. 现在,对于具有当前偏移量PhG、 PvG、 PhB Now, with respect to the current offset PhG, PvG, PhB

和PVB为分量的四维矢量而言,它的分量表示为矢量P (PhG、 PVG、 PVB and a four-dimensional vector components, the component which is represented by a vector P (PhG, PVG,

PhB、 PvB),以及四维无穷小矢量表示为Ap,在成像某一帧时,控制信号输出单元444新设置一个还没被设置的矢量P+Ap,并输出用于控制R感光器单元423R、 G感光器单元423G和B感光器单元423B偏移到与矢量P+Ap的分量值相匹配的位置的控制信号。 PhB, PvB), and a four-dimensional vector expressed as Ap infinitesimal, when forming a frame, the control signal output unit 444 has not been provided a new set of vectors P + Ap, and outputs a control R photoreceptor unit 423R, G B photoreceptor unit 423G and 423B photoconductor unit control signal is shifted to a position P + vector component values ​​of Ap matches. 此时,无穷小矢量Ap的分量例如可以是随机数。 At this time, infinitesimal component of the vector Ap may be a random number, for example.

在这种情况下,根据控制信号输出单元444提供的控制信号移动传感器401的R感光器单元423R、 G感光器单元423G或B感光器单元423B(图20)的放置位置。 In this case, the placement of the control signal in accordance with a movement sensor 444 provides a control signal output unit 401 R photoreceptor unit 423R, G or B photoreceptor unit 423G photoreceptor unit 423B (FIG. 20). 此外,传感器401的R感光器单元423R、 G感光器单元423G和B感光器单元423B随其移动接收物体光,并输出与所接收的光量相对应的图像信号。 Further, R photoreceptor unit 401 of the sensor 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B receives the light with which the object moves, and outputs the received amount of light corresponding to an image signal. 通过信号调整单元402和A/D 转换单元403,由传感器401输出的图像信号被作为新的第一图像信号提供给信号处理单元411。 To the signal processing unit 411 by the signal adjusting unit 402 and A / D conversion unit 403, the image signal output from the sensor 401 is used as a new first image signal. 图22所示的信号处理单元411的图像转换单元431使新的第一图像信号经受图像转换处理,并将作为图像转换处理的结果所获得的新的第二图像信号提供给图像存储单元432并存储在其中。 A signal processing unit 411 shown in the image conversion unit 22431 for the new first image signal subjected to the image conversion processing, and provides a new second image signal as a result of the image conversion processing to the obtained image storage unit 432 and stored. 此外,图像转换单元431R将新的第二图像信号提供给评估单元433。 Further, the image converting unit 431R new second image signal to the evaluation unit 433.

评估单元433的相关性计算单元442从图像转换单元431R接收新的第二图像信号,并计算该第二图像信号和图像转换单元431G上次提供的并存储在存储器411中的第二图像信号之间的相关值,该相关值将提供给确定评估单元443。 The evaluation unit 433 correlation calculation unit 442 receives a new second image signal from the image converting unit 431R, and calculates a second image of the second image signal and an image signal converting unit 431G last supplied and stored in the memory 411 correlation value between the correlation evaluation value supplied to the determination unit 443.

通过重复上述处理,确定评估单元443获得从以偏移量PhG、PvG、 Obtained from an offset PhG, PvG by repeating the above process, the evaluation unit 443 determines,

PhB和PVB成像的第一图像信号中获得的第二图像信号的相关值。 Correlation value of the second image signal of the first image signal and PVB imaging PhB obtained.

现在,图24说明对于每个值,偏移量PhG、 PvG、 PI1b和PVb之间的关系和使用从以偏移量Phc、 PvG、 PhB和PVB成像的第一图像信 Now, FIG. 24 illustrates the relationship between each value and use, offset PhG, PvG, PI1b PVb from the first image signal and an offset Phc, PvG, PhB and PVB imaging

号中获得的第二图像信号的相关值。 Correlation value of the second image signal obtained number. 相关值表示由某一偏移量PhG、 PvG、 PllB和PVB得到的第二图像信号和由偏移量PhG,、 PvG,、 PhB,和PVB,得到的第二图像信号之间的相关性,该偏移量PhG,、 PvG,、 PhB, 和PVB,由相应于上述无穷小矢量Ap的无穷小量来偏移。 Correlation value that represents the second image signal obtained by an offset PhG, PvG, PllB and PVB and PhG ,, correlation between PvG ,, PhB, PVB and the second image signal, obtained by the offset, the offset PhG ,, PvG ,, PhB, and PVB, be offset by a corresponding to the infinitesimal vector Ap is infinitely small.

因此,某一偏移量PhG、 PvG、 PhB、 PvB的低相关值表示由偏移 Thus, a low correlation value at an offset PhG, PvG, PhB, PvB represented by the offset

量PhG、 PVG、 PhB、 PVB得到的第二图像信号是具有模糊边缘而没有 The amount of the second image signal PhG, PVG, PhB, PVB having a blurred edge is obtained without

锐化的低图像质量。 Sharpen the low image quality. 另一方面,某一偏移量PhG、 PvG、 PhB、 Pvb的 On the other hand, an offset PhG, PvG, PhB, Pvb of

高相关值表示由偏移量PhG、 PVG、 PhB、 PVB得到的第二图像信号是 High correlation value that represents the second image signal by a shift amount PhG, PVG, PhB, PVB is obtained

具有锐化边缘的高图像质量。 Sharpened edge having high image quality.

因此,如果相关性计算单元442提供的相关值是低的,那么图23 所示的确定评估单元443将第二图像信号的图像质量评估为低,相反如杲相关值是高的,例如如果如图24所示的那样获得最大值(或最高值),那么将第二图像信号的图像质量评估为高。 Thus, if the correlation value of the correlation computing unit 442 is low, then the determination shown in FIG. 23 to evaluate the image quality evaluation unit 443 of the second image signal is low, as contrary Gao correlation value is high, for example if, as obtained as a maximum value (or maximum value) as shown in FIG. 24, the image quality evaluation of the second image signal is high. 如果评估结果是第二图像信号的图像质量为高,那么确定评估单元443向图像存储单元432输出效果为获得这些评估结果时所用来计算相关值的两个第二图像信号中的一个将要被选择的选择信息(图22)。 If the evaluation result of the image quality of the second image signal is high, the determining unit 443 to evaluate the image storage unit 432 outputs the results to those obtained when the evaluation result is a two calculated correlation values ​​in the second image signal is to be selected the selection information (FIG. 22).

在图像存储单元432R、 432G和432B处,根据该选择信息的第二图像信号,即关于所获评估结果是图像质量为高的第二图像信号, 从上述存储的第二图像信号中读出,并将其提供给输出单元405。 At the image storage unit 432R, 432G, and 432B, the second image signal in accordance with the selection information, i.e., the evaluation result obtained on the image quality of the second image signal is high, read out from the second image signal of the stored, and supplies it to an output unit 405.

接下来,将参考图25中的流程图来描述图18和19所示的图像拾取设备的操作。 Next, the flowchart in FIG. 25 will be described operation of the image pickup apparatus 18 and 19 shown with reference to FIG.

对于图像拾取设备而言,首先,在步骤S101中,传感器401接收物体光,然后执行光电转换,藉此获得电信号形式的图像信号(即, 使物体成像),并且将图像信号提供给信号调整单元402。 For the image pickup device, first, in step S101, the object light receiving sensor 401, and performs photoelectric conversion, thereby obtaining an electric signal in the form of an image signal (i.e., an object image), and supplies adjusted image signals to the signal unit 402. 信号调整单元402使传感器单元401提供的图像信号经受CDS处理,然后将这些信号提供给A/D转换单元403。 The sensor unit 401 provides the image signal adjustment unit 402 is subjected to CDS processing, and then supplies these signals to the A / D conversion unit 403. A/D转换单元403对信号调整单元402提供的图像信号执行A/D转换,然后作为第一图像信号提供给信号处理单元404,因此,信号处理单元404获得第一图像信号,从而流程从S101进行到步骤S102。 A / D conversion unit 403 on the image signal adjustment unit 402 performs the A / D conversion, and then supplied to the signal processing unit 404 as a first image signal, and therefore, the signal processing unit 404 obtains a first image signal, so that the flow from S101 proceeds to step S102.

在步骤S102中,在信号处理单元404处,信号处理单元411的图像转换单元431 (图22 )使来自于A/D转换单元403的第一图像信号经受作为信号处理的图像转换处理,藉此在笫一图像信号之上产生图像质量提高的第二图像信号,并提供给图像存储单元432并存储在其中。 In step S102, at the signal processing unit 404, a signal processing unit 411 of the image converting unit 431 (FIG. 22) so that a first image signal from the A / D conversion unit 403 as a signal processing is subjected to image conversion processing, whereby Zi is generated on the second image signal of an image signal to improve image quality, and supplied to the image storage unit 432 and stored therein. 此外,在步骤S102中,图像转换单元431G将作为图像转换处理的结果所获得的第二图像信号提供给评估单元433,从而流程进行到步骤S103。 Further, in step S102, the second image signal of the image converting unit 431G as a result of the image conversion processing is supplied to the obtained evaluation unit 433, so that the flow proceeds to step S103.

在步骤S103中,评估单元433执行用于对图像转换单元431G提供的第二图像信号进行评估的评估处理,然后流程进行到步骤S104。 In step S103, the evaluation unit 433 performs a second image signal for the image conversion unit 431G provided by assessment evaluation process, and then the flow proceeds to step S104. 在步骤S104中,评估单元433确定所获评估结果是图像质量为高的笫二图像是否已经获得。 In step S104, the evaluation unit 433 determines the image quality evaluation results obtained for the undertaking of the two images is high has been obtained.

在步骤S104中,如果确定在步骤S104中,如果确定所获评估结果是图像质量为低的第二图像已被获得,那么流程进行到步骤S105, 而且评估单元433将向传感器401提供控制信号以指定偏移量PhG、 PvG、 PhB和PvB,藉此移动传感器单元401的R感光器单元423R、 G感光器单元423G或B感光器单元423B (图20 )的放置位置,然后流程返回步骤SlOl。 In step S104, if it is determined in step S104, if the evaluation result is obtained is determined as the second image with low image quality has been obtained, the flow proceeds to step S105, and the evaluation unit 433 will provide a control signal to sensor 401 specify an offset PhG, PvG, PhB and PVB, whereby the movement of the sensor unit 401 R photoreceptor unit 423R, 423G or 423B photoconductor unit B (FIG. 20) placement of the G photoreceptor unit, and the flow returns to step SlOl.

在步骤SIOI中,在先前步骤S105中已移动到的放置位置处为传感器单元401的R感光器单元423R、 G感光器单元423G或感光器单元423B中的每一个获得图像信号,并且重复相同的处理。 In step SIOI in the placement position has moved to in the previous step S105, the sensor unit R photoreceptor 401 units 423R, G photoreceptor unit 423G or the photoreceptor unit 423B each obtained image signal, and repeats the same deal with.

在步骤S104中,如果确定所获评估结果是图像质量为高的第二图像信号已被获得,那么评估单元433向图像存储单元432提供产生评估结果的第二图像信号将被选择的选择信息,然后流程进行到步骤S106。 In step S104, if the evaluation result is obtained is determined as the image of the second image signal of a high quality has been obtained, the evaluation information selecting unit 433 provides the second image signal generation evaluation result to be selected to the image storage unit 432, then the flow proceeds to step S106.

在步骤S106中,图像存储单元432R、 432G和432B根据评估单元433提供的选择信息从在步骤S102状态下存储的剩余第二图像信号中选择并读出第二信号,即高图像质量的第二图像信号,并输出到输出单元405,从而图像数据的一个帧(或场)的处理结束。 In S106, image storage unit 432R, 432G, and 432B according to the selection information provided by the evaluation unit 433 selects and reads out a second residual signal of the second image signal stored in step S102 from the state, i.e., the second step of high image quality image signal, and outputs to the output unit 405, thus ending the processing of image data of one frame (or field). 图像拾取设备根据图25的流程图重复处理,例如直到用户给出图像拾取停止指令。 The image pickup apparatus 25 repeats the process according to the flowchart of FIG, for example until the user gives an instruction to stop the image pickup.

接下来,将参考图26的流程图来描述图25的在步骤S103中由图23所示的评估单元433执行的评估处理。 Next, with reference to the flowchart of FIG. 26 to evaluate the evaluation unit processing in step S103 shown in FIG 23 FIG 25 433 describes performed.

在评估处理中,首先,在步骤S311中,存储单元411存储在前步骤S102中图像转换单元431G提供的第二图像信号(图25),并且相关性计算单元442接收这些第二图像信号。 Second image signal in the evaluation process, first, in step S311, the storage unit 411 stores the previous step S102, the image converting unit 431G provided (FIG. 25), and the correlation calculation unit 442 receives the second image signal. 此外,在步骤S311中,相关性计算单元442计算图像转换单元431G提供的笫二图像信号和存储单元441在先前步骤S311中存储的第二图像信号之间的相关值,并将相关值提供到确定评估单元443,然后流程进行到步骤S312。 Further, in step S311, the correlation calculating unit 442 calculates the second image signal Zi and a storage unit 431G provided in the image converting unit 441 correlation value between the second image signal stored in the previous step S311, and supplied to the correlation values determining an evaluation unit 443, and then the flow proceeds to step S312.

在步骤S312中,在取得用于获得相关值的两个第二图像信号之一时,确定评估单元443临时存储相关性计算单元442以与偏移量Ph(j、 Pvc;、 PhB和Pvb相关的形式提供的相关值,然后流程进行到步骤S313。 此时,当取得用于获得相关性计算单元422提供的相关值的两个第二图像信号之一时,确定评估单元443从控制信号输出单元444获得偏移量PhG、 Pvg、 P1ib和Pvb。 In step S312, when obtaining a second image signal to obtain one of the two correlation values, determining the evaluation unit 443 temporarily stores the correlation calculation unit 442 to the offset associated with Ph (j, Pvc ;, PhB and Pvb of provided in the form of the correlation value, then the flow proceeds to step S313. At this time, when one of the acquired two correlation values ​​for obtaining the second image signal correlation calculation unit 422 is provided, the evaluation unit 443 to determine the control signal output unit 444 obtaining offset PhG, Pvg, P1ib and Pvb.

在步骤S313中,对于迄今为止在步骤S312存储的相关值和偏移量之间的关系,确定评估单元443确定是否已获得相关值的最大值。 In step S313, the date for the relationship between the correlation values ​​stored in step S312 and the shift amount determining unit 443 determines whether the evaluation value is the maximum correlation has been obtained. 如果在步骤S313中确定还没有获得相关值的最大值,那么流程进行到步骤S314,确定评估单元443做出效果为第二图像信号是低图像质量的图像信号的评估,然后流程返回图25中的步骤S104。 If it is determined in step S313 not yet been obtained maximum correlation value, then the flow proceeds to step S314, the evaluation unit 443 to make a determination of the effect of the second image signal is a signal evaluation image of low image quality, and the flow returns to FIG. 25 the step S104.

在这种情况下,在图25的步骤S104中,确定评估单元443确定还没有获得效果为图像质量是高的评估结果,并因此将评估结果,即效果为第二图像信号是低图像质量的评估结果提供给控制信号输出单元444。 In this case, in step S104 of FIG. 25, determination evaluation unit 443 determines not yet been obtained a high effect of image quality evaluation result, and therefore the evaluation result, i.e. the effect of the second image signal is low image quality evaluation results are provided to the control signal output unit 444. 在步骤S105中,控制信号输出单元444接收效果为第二图像信号是低图像质量的评估结果,并向传感器单元401提供与该评估结果相对应的用于指定新的偏移量PhG、 Pvg、 PIib和Pvb的控制信号。 In step S105, the control signal reception unit 444 outputs a second image signal is low image quality evaluation results, and to provide a corresponding 401 for specifying new offset PhG, Pvg sensor unit and the evaluation result, PIib Pvb and control signals.

返回步骤S26,如果在步骤S313中确定已经获得相关值的最大值, 那么流程进行到步骤S315,确定评估单元443做出效果为第二图像信然后流程返回图25中的步骤S104。 Return to step S26, the maximum value is determined if the correlation values ​​that have been obtained in step S313, the flow proceeds to step S315, the evaluation unit 443 to make a determination of the effect of the second image signal and the flow returns to step S104 in FIG. 25.

在这种情况下,在图25的步骤S104中,如果确定所获评估结果是图像质量为高的第二图像信号已被获得,那么评估单元433向图像存储单元432提供效果为产生评估结果的第二图像信号将被选择的选择信息,然后流程进行到步骤S106。 In this case, in step S104 of FIG. 25, if the evaluation result is obtained is determined as the image of the second image signal of a high quality has been obtained, the evaluation unit 433 to the image storage unit 432 provides the effect of generating an evaluation result the second image signal to be selected by the selection information, then the flow proceeds to step S106.

在步骤S106中,图像存储单元432R、 432G和432B根据评估单元433提供的选择信息从在步骤S102状态下存储的剩余第二图像信号中选择并读出第二信号,即具有高图像质量的第二图像信号。 In S106, 432R, 432G and 432B of the evaluation unit 433 according to selection information provided by the second signal is selected and read out in the remaining second image signal stored in step S102 from the state, i.e., having a high image quality image storage unit in step second image signal.

如上所述,对第二数字图像信号进行评估,根据评估结果控制偏移量PhG,PvG,PhB,和PvB,如此控制传感器单元401的R感光器单元423R、 G感光器单元423G和B感光器单元423B (图20 )的放置位置,因此对于具有;^文置在与偏移量PhG、 PvG、 PhB和PvB相对应的位置上的R感光器单元423R、G感光器单元423G和B感光器单元423B 的传感器单元401而言,输出适于在图像转换单元431进行图像转换处理的图像信号,从而在图像转换单元431可以获得高图像质量的第二图像信号。 As described above, the second digital image signal to be evaluated, controls the offset PhG results of an evaluation, PvG, PhB, and PVB, so the sensor control unit 401 of the R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B (FIG. 20) is placed in position, with respect to; ^ and disposed in offset paper PhG, PvG, PhB and PvB corresponding position on the R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B of the sensor unit 401, the output image is adapted to the image signal conversion processing of the image conversion unit 431, so that the image conversion unit 431 may obtain a second image signal of high image quality.

虽然在上述描述中,在步骤S313中获得的相关值是最大值的情况下,做出效果为第二图像信号是高图像质量的评估结果,但是可以应用一个替换的安排,其中如果在步骤S313中获得的相关值的最大值超过了预定阈值的最大值,那么做出效果为第二图像信号是高图像质量的评估结果。 Although in the above description, the correlation value obtained in step S313 is the maximum value, the effect is to make the second image signal is a high image quality evaluation results, but may be applied to an alternative arrangement, wherein if at step S313 the maximum correlation value obtained exceeds the maximum predetermined threshold value, then the effect is to make the second image signal is a high image quality evaluation results.

同样,在上述情况中,第二图像信号是以根据相关值评估的形式描述的,但是可以使用替换的安排,其中根据相对于偏移量Phc、 PvG、 Also, in the above case, the image signal is the second form according to the correlation value assessments described alternative arrangement may be used, according to which the relative offset Phc, PvG,

PhB和PVB的每个值获得的第二图像信号的S/N来对第二图像信号进 PhB second image signal S and each value obtained PVB / N to the second image signal into the

行评估。 Be assessed. 此外,可以从外部输入第二图像信号的评估。 In addition, evaluation of the second image signal input from the outside. 也就是说,例如可以实施这样的安排,其中显示第二图像信号,并且例如通过观察所显示图像的用户输出第二图像信号的评估。 That is, for example, an arrangement may be implemented, wherein the displaying the second image signal, for example, by observing the displayed image, the user evaluation of the second image signal is output.

此外,可以对有关的偏移量进行安排,其中预先准备几个值,获得有关所有几个偏移量值的相关值,当获得最高相关值时,在图25的步骤S106中输出两个图像信号之一。 Further, arrangements may be related to an offset, wherein several values ​​prepared in advance, about the several correlation values ​​obtained offset values, when the highest correlation value, outputs of the two images 25 at step S106 of FIG. one of the signals.

同样,可以做这样的安排,即在一个帧(场)时期之内尽可能多 Similarly, you can do so arranged that as much as possible within one frame (field) period of

次的执行图25中的步骤S101到S105的循环,并且在图25的步骤S106 中,当获得在循环处理期间所获得的相关值的最高相关值时,输出两个图像信号之一。 Loop of steps S101 to S105 of FIG. 25 times of execution, at step S106 of FIG. 25, when the highest correlation value of the correlation value obtained during the processing cycle, the output of one of the two image signals.

图22所示的图像转换单元431的设置与图4所示的图像转换单元31相同,因此在这里省略了对它的描述(请参照图6至10及对它的描述)。 The same as the image converting unit 431 shown in FIG. 22 the image converting unit 431 shown in FIG disposed, so description thereof is omitted herein (and 6 to 10 describe it with reference to FIG.).

第三具体实施例 Third embodiment

紧接着,图27是说明已应用本发明的图像拾取设备的第三具体实施例的配置实例。 Then, FIG. 27 is a diagram illustrating a configuration example of an embodiment of the present invention has been applied to an image pickup apparatus in the third specific embodiment. 请注意,相应于图18或19中的那些部件以相同的附图标记给出,并且视情况省略了其中的描述。 Note that the values ​​in FIG. 18 or 19, those components are given the same reference numerals, and the description is omitted as the case in which the. 简单地说,除了进一步提供的操作单元185之外,根据图27所示的第三具体实施例的图像拾取设备基本上与根据图18和19所示的第二具体实施例的图像拾取设备相同。 Briefly, in addition to the operation unit 185 is further provided, the image pickup apparatus according to a third embodiment of the apparatus shown in FIG. 27 is substantially the same as the image pickup apparatus 18 and a second embodiment 19 shown in FIG. .

操作单元185是例如通过用户操作的按钮,并且向信号处理单元404输出与该操作相对应的参数。 The operation unit 185 is operated by a user such as a button, and the signal processing unit 404 outputs to the parameter corresponding to the operation. 图27中的信号处理单元404配置有信号处理单元411R、 411G和411B,如图19所说明的那样。 FIG 27 is configured with a signal processing unit 404 signal processing unit 411R, 411G, and 411B, as illustrated in FIG. 19.

图28说明组成图27所示的信号处理单元404的信号处理单元411R、 411G和411B的配置实例。 28 illustrates a schematic diagram showing a configuration example of the signal processing unit 27 shown in the signal processing unit 404 411R, 411G, and 411B of. 请注意,与图22中的那些部件相对应的部件以相同的附图标记表示,并且视情况省略了其中的描述。 Note that those components of FIG. 22 corresponding to parts with the same reference numerals, and the description is omitted as the case in which the. 就所关心的信号处理单元411R、 411G和411B而言,它们都是以与图22所示的相同方式配置的,但是在此所作安排的不同点在于从操作单元185输出的参数被提供给图像转换单元431 (由431R、 431G和431B组成),使用图像转换单元431施行与该参数相对应的图像转换处理。 Different points of interest signal processing unit 411R, 411G, and 411B, they are all in the same manner as the arrangement shown in FIG. 22, but this arrangement is that it is made available to the operating parameters from the image output unit 185 conversion unit 431 (by the 431R, 431G, and 431B composed), performed using the image converting unit 431 converts the image processing parameter corresponding to the.

图29是说明图28所示的图像转换单元431的配置实例。 FIG 29 is a configuration example of an image conversion unit 431 shown in FIG. 28. 请注意, 与图6中的那些部件相对应的部件以相同的附图标记表示,并且视情况省略了其中的描述。 Note that those components of FIG. 6 corresponding components the same reference numerals, and the description is omitted as the case in which the. 在这里,图22所示的图像转换单元431具有与图4所示的图像转换单元31相同的配置,而且图4所示的图像转换单元31已以图6到图IO的方式描述过了。 Here, the image conversion unit shown in FIG. 22, 431 has the same configuration as the image converting unit 31 shown in FIG. 4, and FIG. 4, the image conversion unit 31 has been shown in Figures 6 to IO manner as described before. 然而,操作单元185输出的参数被提供给因数输出单元124。 However, the parameter operation unit 185 is supplied to the output unit 124 output factor.

图30是说明图29所示的因数输出单元124的另一配置实例。 FIG 30 is a further factor output unit 124 shown in FIG. 29 configuration example. 在这里同样使用相同的参考数字来表示与图7所示的那些部件相对应的部件。 Also here the same reference numerals as those components shown in FIG. 7 corresponding parts.

虽然图7所示的安排包括因数输出单元124,存储通过预先学习而获得的每个类的抽头因数,但是对于图30中的安排而言,因数输出单元124为每个类从好似作为种子的抽头种子数据和预定参数中生成能够产生所希望质量的图像的抽头因数。 Although the arrangement includes a coefficient output unit 124 shown in FIG. 7, stores beforehand by learning to obtain tap factor for each class, but for the arrangement in FIG. 30, the output unit 124 for each factor from the class of the like as a seed generating a predetermined parameter and seed data tap in the tap factor can generate a desired image quality.

因数存储器181为每个类存储因数生成单元182提供的抽头因数。 Factor for each class stored in the memory 181 factor generating unit 182 provided in the tap factor. 一旦类分类单元123提供分类代码,因数存储器181从为每个类存储的抽头因数中读取分类代码表示的类的抽头因数,并输出到计算单元125。 Once the class classifying unit 123 provides a classification code, 181 denotes a memory read cycle classification code factor for each class taps from the tap factor stored in the class, and outputs to the calculation unit 125.

因数生成单元182根据存储在因数种子存储器183中的因数种子数据和存储在参数存储器184中的参数为每个类生成抽头因数,该抽头因数被提供给因数存储器181并通过覆盖而被存储。 The factor factor generating unit 182 and stored seed data stored in the memory 183 of the seed factor parameter in the parameter memory 184 to generate class taps for each factor, the factor is supplied to the tap factor of the memory 181 and is stored by overwriting.

因数种子存储器183为每个类存储通过学习随后描述的因数种子数据而获得的因数种子数据。 Factor factor seed memory 183 stores seed data for each class factor seed data by learning described later is obtained. 因数种子数据是作为生成抽头因数的种子的数据。 Seed factor data as a seed to generate a tap factor data.

如果用户运行操作单元185,参数存储器184就根据该操作通过覆盖来存储操作单元185输出的参数。 If the user runs the operation unit 185, the parameter memory 184 outputs the parameter being covered by the operation unit 185 based on the storage operation.

对于图30所示的因数输出单元124而言,对于每个抽头存储(设置)在因数存储器181中的抽头因数,即计算单元125使用的每个类的抽头因数而言,根据用户对操作单元185所作的操作对其进行更新。 For factor output unit 124 shown in FIG. 30, for each tap is stored (set) in tap factor factor in the memory 181, i.e., calculates the tap factor of each class used in unit 125, according to user operation unit 185 operations made to update it.

现在,将参考附图31的流程图来描述为每个类更新抽头因数的处理,该处理是在图30所示的因数输出单元124处执行的,即抽头因数更新处理。 Now, a flow chart 31 will be described with reference to the accompanying drawings to process each class tap update factor, the process is performed at a factor that is the tap coefficient output unit 124 shown in FIG. 30, the update process. 首先,在步骤S171中,参数存储器184确定操作单元185是否已提供了参数,并且当在步骤S171中确定操作单元185已提供参数,那么流程进行到步骤S172,其中参数存储器184通过覆盖存储所提供的参数,然后流程进行到步骤S173。 First, in step S171, the parameter memory 184 determines whether the operation unit 185 has been provided parameters, and when it is determined the operation unit in step S171 185 provided parameters, the flow proceeds to step S172, the wherein the parameter memory 184 is provided by covering the storage parameter, then the flow proceeds to step S173.

此外,如果在步骤S171中确定操作单元185还没有提供参数,那么跳过步骤S172,流程进行到步骤S173。 Further, if the determination unit 185 in step S171 the parameter has not been provided, then skips step S172, the flow proceeds to step S173.

因此,对于参数存储器184而言,如果操作单元185由用户操作并且操作单元185提供了与用户操作相对应的参数,那么以提供的参数更新所存储的内容。 Thus, for the parameter memory 184, if the operation unit 185 operated by a user and the operation unit 185 provides the parameters corresponding to the user operation, then the parameter update to the stored content provided.

在步骤S173中,因数生成单元182为每个类从因数种子存储器183中读出因数种子数据,并且从参数存储器184中读出参数,藉此获得因数种子数据和参数,并根据因数种子数据和参数为每个类获得抽头因数。 In step S173, the factor generating unit 182 for each class of data read out from the seeds factor factor seed memory 183, and reads parameters from the parameter memory 184, thereby obtaining factor seed data and parameters and data according to the factor and the seed parameters obtained for each class tap factor. 然后流程进行到步骤S174,在这里,因数生成单元182将每个类的抽头因数提供给因数存储器181,并通过覆盖存储。 Then the flow proceeds to step S174, the where factor factor generating unit 182 of each class tap is supplied to the factor memory 181, and stored by overwriting. 流程从步骤S174返回到S171,此后重复相同的处理。 The flow returns from step S174 to S171, the same processing is repeated thereafter.

因此,在图29中的图像转换单元431处,使用以该参数更新的抽头因数来利用先前的表达式(1)执行将第一图像信号转换为第二图像信号的图像转换处理,即与该参数相对应的图像转换处理。 Thus, the image converting unit 431 in FIG. 29, the parameters used to update the tap factor using the previous expression (1) performing a first image signal into the image conversion processing to the second image signal, i.e., the parameters corresponding to the image conversion processing.

请注意,在图31中,如果新的参数在参数存储器184中被覆盖, 那么将执行步骤S173和S174中的处理,否则将被跳过。 Note that, in FIG. 31, if the new parameters in the parameter memory 184 is covered, then the process performed in step S173 and S174, otherwise it is skipped.

紧接着,将对有关在因数生成单元182处生成抽头因数和学习要被存储在因数种子存储器183中的因数种子数据作出描述。 Then, the tap will be the relevant factor, and generating at the learning factor generating unit 182 to be stored in the seed data described factor factor seed memory 183.

假定我们有高图像质量的图像信号作为第二图像信号和低质量信号作为第一图像信号,该低质量信号通过使用降低分辨率的LPF (低通滤波器)对高图像质量图像信号进行过滤获得。 We have assumed that the image signal of high image quality as the second image signal and the low-quality image signal as the first signal, the low quality signal by using a reduced resolution LPF (low pass filter) on the high image quality image signal obtained by filtration . 现在我们将考虑这样的例子,即从低图像质量图像信号提取预测抽头,并根据预定的预测计算,例如表达式(1)的线性基本预测计算,使用预测抽头和抽头因数来获得高图像质量像素的像素值。 We will now consider the example in which the low image quality image signal extracting prediction tap and a predetermined prediction calculation in accordance with, for example, substantially linear prediction expressions (1) is calculated, using the prediction taps and the tap factor to obtain high image quality pixel the pixel value.

此时,高图像质量像素的像素值y可以通过二次表达式或更高的表达式来获得,而非线性基本表达式(1)。 In this case, high image quality pixel value y of a pixel may be obtained by a quadratic expression or a higher expression, rather than a linear primary expression (1).

另一方面,在因数生成单元182处,根据存储在因数种子存储器183中的因数种子数据和存储在参数存储器184中的参数生成抽头因数wn,在此假定使用因数种子数据和参数来利用下列表达式执行因数 On the other hand, the factor generating means 182 generates the tap factor wn factor based on the parameters stored in the seed data storage and factor seed memory 183 in the parameter memory 184, herein assumed factor seed data and parameters with the following expression style execution factor

生成单元182处的抽头因数Wn的生成。 Generating unit 182 generates a factor Wn at the tap.

ffl=l (9) ffl = l (9)

其中Pm,n表示用于获得第n个抽头因数Wn的第m个因数种子数据, 而Z表示参数。 Pm is wherein, n represents the n-th taps for obtaining the factor of the m-th factor Wn seed data, and Z represents a parameter. 请注意,在表达式(9)中,使用M个因数种子数据j3n,j、 Pn,2等直到Pn,M来获得抽头因数Wn。 Note that, in Expression (9) using seed data by a factor of M j3n, j, Pn, 2, etc. until Pn, M taps to obtain factor Wn.

现在,应当理解从因数种子P^和参数Z中获得抽头因数Wn的表达式并不仅限于表达式(9)。 Now, it will be appreciated that the tap factor obtained from the expression Wn factor seed parameter Z and P ^ and is not limited to the expression (9).

在表达式(9)中的由参数z确定z^的值通过引入一个新的变量U By the parameter z in the expression (9) determines a value z ^ by introducing a new variable U

来使用下列表达式定义。 To use the following expression is defined.

tm=zml(m=l,2,."M) (10) tm = zml (m = l, 2,. "M) (10)

将表达式(10)代入表达式(9)中产生下列表达式。 The expression (10) is substituted into the expression (9) produced in the following expression.

m=l (11) m = l (11)

根据表达式(11 ),通过因数种子数据Pm,n和变量的tm线性基本表达式来获得抽头因数Wn。 Expression (11), to obtain the tap seed data by a factor Wn factor Pm, tm substantially linear and variable according to the expression n.

此刻,高图像质量像素的像素值的第k个采样的真实值为yk,以及真 At the moment, the high image quality pixel yk is the k-th real pixel values ​​of the samples, and the true

实值yk的预测值为yk,,预测误差ek使用下列表达式表达。 Real-valued prediction value yk ,, the prediction error ek yk following expression expression. ek,k - yk' (12) ek, k - yk '(12)

此刻,表达式(12)中的预测值yk,是根据表达式(1)获得的,因此根据表达式(1)将yk,代入表达式(12)而得到下列表达式(l)。 Now, the prediction value yk expression (12), based on the expression (1) is obtained, so according to the expression (1) yk, is substituted into the expression (12) obtained by the following expression (l). e『yk- Zwnxn'k) e "yk- Zwnxn'k)

\n=1 / (13) \ N = 1 / (13)

其中Xn,k表示构成有关高图像质量像素的第k个采样的预测抽头的第 Wherein Xn, k represents the pixel constituting the prediction tap about a high image quality of the k-th sample

n个低图像质量像素。 n low image quality pixels.

将表达式(11)代入表达式(13 )的Wn中产生下列表达式。 The expression (11) is substituted into the expression (13) is produced in the following expression Wn. <formula>formula see original document page 72</formula> <Formula> formula see original document page 72 </ formula>

此刻,对于预测高图像质量像素而言,其中在表达式(14)中的预测误差w是O的因数种子数据p"是最佳的,但是对于所有高图像 At the moment, for high image quality in terms of prediction pixels, wherein the prediction error w in the expression (14) is a factor O seed data p "is the best, but for all the high image

质量像素而言,要获得这样的因数种子数据Pm,n—般是困难的。 In terms of the quality of the pixels, to get such a factor seed data Pm, n- like is difficult.

因此,例如可以利用最小平方法并最小化误差平方和E来获得其中因数种子数据15m,n是最佳的范围。 Thus, for example, using the least squares method and minimize the squared error E obtained where the factor seed data 15m, n is the optimum range.

恭7 Christine 7

<formula>formula see original document page 72</formula> <Formula> formula see original document page 72 </ formula>

其中K表示高图像质量像素yk和低图像质量像素Xl,k、 X2,k等直到XN,k的组的采样数量(即,学习采样的数量),该低图像质量像素构成有关高图像质量像素yk的预测抽头。 Wherein K represents the high image quality pixel yk and low image quality pixel Xl, k, X2, k, etc. until XN, the sample number k of the group (i.e., learning the number of samples), the low image quality pixels constituting about high image quality pixel yk prediction tap.

使用|3m,n获得表达式(15 )中的误差平方和E的最小值(极小值), 其中使用因数种子数据l,n对和E进行偏微分而得到O,如表达式(16) 所示。 Use | 3m, n minimum value obtained expression (15) of the square error E (minimum value), in which seed data factor l, n, and E to O obtained by partially differentiating, Expression (16) Fig.

3E :u一 3E: u a

将表达式(13)代入表达式(16)中产生下列表达式。 The expression (13) is substituted into the expression (16) yields the following expression.

<formula>formula see original document page 72</formula> <Formula> formula see original document page 72 </ formula>

我们同样如公式(18 )和(19 )那样来定义Xi,p,j,q和yik We also equation (18) and (19) are defined as Xi, p, j, q and yik

Xi,p, j,q= Z Xj. ktpXj'ktq k爿 Xi, p, j, q = Z Xj. KtpXj'ktq k valves

(i = 1,2,…'N:j-1,2, '..,N:p=1,2,…J:qH,2, •.. J) (18) Yi,P= Zxi,ktpyk (I = 1,2, ... 'N: j-1,2,' .., N: p = 1,2, ... J: qH, 2, • .. J) (18) Yi, P = Zxi, ktpyk

k=, (19) 在该情况中,公式(17)通过使用Xi,p,j,q和yi,p而能够表达为如公式(20)所示的正规方程式。 k =, (19) In this case, the equation (17) by use of Xi p, j, q and yi, p and capable of expressing, as is shown in the normal equation (20) equation.

Xi,i,u • ■' X〗,1,u Xl,1,2,1 ■ 丫u Xi, i, u • ■ 'X〗, 1, u Xl, 1,2,1 ■ Ah u

Xl,2,1,1 Xl,2,1,2 • •. Xu,1,m Xu,2,1 ■ Xl, 2,1,1 Xl, 2,1,2 • •. Xu, 1, m Xu, 2,1 ■

A,((u,2 • --Xm,l,m Xi,iu, i • -Xi,m,M "1 二 Yu A, ((u, 2 • --Xm, l, m Xi, iu, i • -Xi, m, M "1 two Yu

乂2,1,U . X2,m,m iSl,2 Y2.1 Qe 2,1, U. X2, m, m iSl, 2 Y2.1

丫M Ah M

(20> (20>

例如,使用消去计算(高斯-乔丹消去法),表达式(20)的正规方程式可以解算出因数种子数据j3m,n。 For example, using erasing calculated (Gauss - Jordan elimination method), the expression (20) can be calculated by equation formal factor seed data j3m, n.

图29所示的因数种子存储器183存储通过其中运用大量的高图像质量像素y" y2等直到yK作为学习的导师的导师数据,和构成高图像 Factor seed memory 183 shown in FIG. 29 wherein the memory by the use of a large number of high image quality pixel y "y2 other until yK tutor data as tutor for learning, images, and constitute a high

质量像素每一个yk的预测抽头的低图像质量像素Xl,k、 X2,k等直到XN,k Quality pixel yk prediction tap for each of a low image quality pixel Xl, k, X2, k, etc. until XN, k

作为学习的学生的学生数据,来解算表达式(20)的学习所获得的因数种子数椐pm,n。 As a student studying student data to the solver factor seed expression (20) is noted in the number of learning obtained pm, n. 因数生成单元182根据表达式(9 )从因数种子数据 Factor generating unit 182 according to Expression (9) data from the seeds factor

Pm,n和存储在参数存储器184中的参数Z中生成抽头因数Wn。 Pm, Z n, and the parameters stored in the parameter memory 184 to generate the tap factor Wn. 计算单元125然后使用抽头因数Wn和构成有关所关心像素的预测抽头的低图像质量像素(第一图像信号的像素)Xn计算表达式(1 ),该所关心像素是高图像质量像素,藉此获得所关心像素的近似预测值,该所关心像素是高图像质量像素。 Then the calculation unit 125 using the tap factor Wn constituting the prediction tap related to the pixel of interest is low image quality pixels (pixels of the first image signal) Xn calculation expression (1), the pixel of interest is the high image quality pixel, whereby obtain an approximate prediction value of the pixel of interest, the pixel of interest is the high image quality pixel.

紧接着,图32说明通过设置和解算表达式(20)的正规方程式来获得因数种子数据P,的学习设备的配置实例。 Then configuration example, FIG. 32 illustrates a resolver is provided by expression (20) is normal equation to obtain P factor seed data, the learning apparatus. 请注意,相应于图8 中的那些部件以相同的附图标记表示,并且视情况省略了其中的描述。 Note that, in FIG. 8 correspond to those components with the same reference numerals, and the description is omitted as the case in which the. 用于学习因数种子数据IVn的学习图像信号被输入学习设备。 Factor for learning learning image signal is input seed data IVn learning apparatus. 例如,高图像质量图像信号可以用于学习图像信号。 For example, high image quality image signal can be used for learning the image signal.

在学习设备中,学习图像信号被提供给导师数据生成单元131和 In the learning device, the learning image signal is supplied to the tutor data generating unit 131, and

学生数据生成单元133。 Student data generating unit 133. 导师数据生成单元131从供给其的学习图像信号中生成导师数据,然后将导师数据提供给导师数据存储单元132。 Tutor data generating unit 131 generates supervisor data from the learning image signal supplied thereto, and then the supervisor data to the supervisor data storage unit 132. 也就是说,在此,导师数据生成单元131将高图像质量图像信号作为学习图像信号不加变化的提供给导师数据存储单元132作为导师数据。 That is, in this case, the tutor data generating unit 131 as an image signal of high image quality without learning image signal to provide varying supervisor data storage unit 132 as teacher data. 导师数据存储单元132存储由导师数据生成单元132生成的作为导师数据的高图像质量图像信号。 High image quality image signal is tutor data storage unit 132 stores generated by the tutor data generating unit 132 as teacher data.

学生数据生成单元133从学习图像信号中生成学生数据,并将学生数椐提供给学生数据存储单元134。 Student data generating unit 133 generates student data from the learning image signal, and supplies the student number noted in the data storage unit 134 to the student. 也就是说,学生数据生成单元133对作为学习图像信号的高图像质量图像信号执行过滤,以便降低它的分辨率,藉此生成低图像质量图像信号,并且将该低图像质量图像信号作为学生数据提供给学生数据存储单元134。 That is, the student data generating unit 133 as an image signal of high image quality learning image signal is performed for filtering, in order to reduce its resolution, thereby generating a low image quality image signal, and the low image quality image signal as the student data provided to the student data storage unit 134.

此时,除了向学生数据生成单元133提供学习图像信号之外,还向其提供向图30中的参数存储器184提供的参数z的范围内的多个值,这些值由参数生成单元191提供。 In this case, in addition to providing a learning image signal to the student data generating unit 133, but also to provide it a plurality of values ​​within a range of parameter z supplied to the parameter memory 30 of FIG. 184, unit 191 provides the parameter values ​​are generated by these. 也就是说,如果我们假定可以将参数z的范围假定为0到Z范围内的实数,那么从参数生成单元191 向学生数据生成单元133提供例如2=0、 1、 2,等等直到Z。 That is, if we assume that the range of the parameter z can be assumed to be real number in the range 0 to Z, then the data generation unit 191 from the parameter generating unit 133 provided to the students, for example, 2 = 0, 1, 2, and so on through Z.

此外,学生数据生成单元133使用LPF,相应于提供给其的参数z,以预定的切断频率来过滤作为学习图像信号的高图像质量图像信号,藉此生成作为学生数据的低图像质量图像信号。 In addition, the student data generating unit using the LPF 133, corresponding to the parameter z supplied to it to a predetermined cutoff frequency to filter the image signal of high image quality as a learning image signal, thereby generating a low image quality image signal as the student data.

因此,在这种情况下,在学生数据生成单元133处,根据作为学习图像信号的高图像质量图像信号,生成了具有不同分辨率的作为学生数据的Z+l种类型的低图像质量图像信号,如图33所示。 Thus, in this case, the student data generating unit 133, in accordance with an image signal of high image quality as a learning image signal, generating the types of Z + l low image quality image signals having different resolutions as student data shown in Figure 33. 请注意例如参数Z值越高,用于过滤高图像质量图像信号所使用的LPF的切断频率就越高,藉此生成作为学生数据的低图像质量图像信号。 Please note that the higher the parameter Z value e.g., the LPF cutoff frequency for filtering the high image quality image using the higher signal, thereby generating a low image quality image signal as the student data. 因此, 参数z的值越大,与其相对应的低图像质量图像信号的分辩率就越高。 Therefore, the larger the value of parameter z, the higher the resolution of its corresponding low image quality image signal.

同样,对于本实例而言,为了便于描述,在学生数据生成单元133生成低图像质量图像信号,在其中分辩率在高图像质量图像信号的水平方向和垂直方向上已降低了相应于参数Z的数量。 Similarly, for purposes of this example, for convenience of description, the student data generating unit 133 generates an image signal is low image quality, in which the resolution in the horizontal direction of the image signal of high image quality has decreased and the vertical direction corresponding to the parameter Z number.

返回图32,学生数据存储单元134存储学生数据生成单元133提供的学生数据。 Returning to FIG. 32, the student data student data storage unit 134 stores the student data generating unit 133 is provided.

预测抽头提取单元135连续地获得作为所关心导师像素的像素, Prediction tap extraction unit 135 continuously obtained as a tutor pixel of interest,

所述像素构成作为存储在导师数据存储单元132中的导师数据的高图 The pixels constituting the teacher data as teacher data stored in the storage unit 132 in FIG high

像质量图像信号,并从构成作为存储在学生数据存储单元134中的作为学生数据的低图像质量图像信号的低图像质量像素中提取预定的一 Image quality of the image signal, and store the extracted from the composition as student data in a predetermined storage unit 134 is low image quality pixel as low image quality image data of the student signal

个,藉此配置一个预测抽头,该预测抽头具有与通过图29所示的预测抽头提取单元121所配置的预测抽头相同的配置,将预测抽头提供给加法单元192。 A, whereby a prediction tap configuration, the same prediction taps and the prediction tap extracted by the prediction tap shown in FIG. 29 configured configuration unit 121, the prediction taps are supplied to the addition unit 192.

相对于所关心的导师像素而言,特征提取单元136以与图29所示特征提取单元122相同的方式使用存储在学生数据存储单元134中的作为学生数据的低图像质量像素来提取所关心导师像素的特征,并将这些特征提供给类分类单元137。 For teacher pixel of interest with respect to the feature extraction unit 136 shown in FIG. 29 wherein the extraction unit 122 uses the same manner as the student data stored in the storage unit 134 is low image quality pixel as student data to extract interest tutor characteristic pixels, and supplies the features to the class classifying unit 137.

请注意,预测抽头提取单元135和特征提取单元136接收参数生成单元191生成并提供的参数z,而且预测抽头提取单元135和特征提取单元136使用相应于参数生成单元191提供的参数z所生成的学生数据构成预测抽头或提取所关心导师像素的特征(在此,是使用具有相应于参数z的LPF的切断频率生成作为学生数据的低图像质量信号)。 Note that the prediction parameter z tap extracting unit 135 and feature extractor 136 receives the parameter unit generating unit 191 generates and provides, and the prediction tap extracting unit 135 and feature extraction unit 136 using the corresponding parameter generation parameter z unit 191 provides the generated wherein tutor student data constituting the prediction tap or extracting pixel of interest (in this case, using a cutoff frequency corresponding to the parameter z have the LPF generates low image quality signal as student data).

根据特征提取单元136输出的所关心的导师像素,类分类单元137 执行与图29所示的类分类单元123相同的类分类,并且向加法单元192输出与类分类结果的类相对应的分类代码。 The tutor feature extraction unit 136 outputs the pixel of interest, the class classifying unit class classification unit 137 shown in FIG. 29 123 performs the same classification categories and corresponding to the adding unit 192 outputs a category classification result of class classification code .

加法单元192从导师数据存储单元132中读出所关心的导师像素, 并为类分类单元137的每个类执行有关所关心的导师像素和学生数据以及当产生学生数据时参数z的相加,该学生数据构成有关预测抽头提取单元135提供的所关心的导师像素设置的预测抽头。 The adding unit 192 reads from the supervisor data storage unit 132 the supervisor pixel of interest, and the class classifying unit tutor and the student data and the pixel of interest 137 relating to the execution of each class is generated when adding the student data parameter z, For the student data constituting the prediction tap extracting unit 135 provides a prediction tap teacher pixel of interest set.

也就是说,向加法单元192提供存储在导师数据存储单元132中的导师数据yk、预测抽头提取单元135输出的预测抽头Xi,k(Xj,k)、和从类分类单元137中输出的分类代码,以及由参数生成单元191提供的生成用于配置预测抽头的学生数据的参数z。 That is, a supervisor data yk stored in the supervisor data storage unit 132 to the adding unit 192, the prediction tap extracting unit 135 outputs the prediction tap of Xi, k (Xj, k), and 137 output from the classification class classifying unit code, and by the parameter generation unit 191 generates a parameter z supplied configuration data of the prediction tap students.

同样,对于每个与类分类单元137提供的分类代码相对应的类而言,加法单元192使用预测抽头(学生数据)Xi,k (Xj,k)和参数z执行计算,该计算等于用于获得表达式(20)左侧矩阵中的表达式(18) Similarly, for each class code provided by the class classification unit 137 corresponding to the class, the adding unit 192 using the prediction taps (student data) Xi, k (Xj, k) and the parameter z to execute calculation that is equal to the (20) expression (18) left in the matrix expression is obtained

所定义的分量Xi,p,j,q的学生数据和参数Z的乘法(Xi,ktpXj,ktq ),以及它 Xi defined component, p, j, q and student data multiplication parameter Z (Xi, ktpXj, ktq), and its

们的加法(S)。 Their addition (S). 请注意,表达式(18)中的tp是根据表达式(10)从参 Note that the expression (18) from the reference tp the expression (10)

数Z中计算出来的。 The number Z is calculated. 这对于表达式(18)中的tq来说也是成立的。 This is the expression (18) tq is also established.

同样,对于每个与类分类单元137提供的分类代码相对应的类而言,加法单元192使用预测抽头(学生数据)Xj,k、导师数据yk和参数z执行计算,该计算等于用于获得表达式(20)右侧的矢量中的表达式(19)中所定义的分量yi,p的学生数据Xi,k、导师数据yk和参数z的乘法(Xi,ktpyk),以及它们的加法(X)。 Similarly, for each class code provided by the class classification unit 137 corresponding to the class, the adding unit 192 using the prediction taps (student data) Xj, k, supervisor data yk, and the parameter z performing calculation that for obtaining equal component expression (19) in the right side of the expression vector (20) defined yi, p student data Xi, k, and the supervisor data yk multiplication parameter z (Xi, ktpyk), and their addition ( X). 请注意,表达式(19)中的tp 是根据表达式(10)从参数z中计算出来的。 Note that the expression (19) is tp expression (10) is calculated from the parameter z according out.

也就是说,加法单元192在它的存储器(未示出)中存储有关将导师数据看作先前感兴趣的导师像素而获得的表达式(20)的左侧矩 That is, the adding unit 192 in its memory (not shown) left moments Expression (20) stored in the teacher data as teacher about the pixel of interest obtained previously

阵分量Xi,p,j,q和右侧分矢量yi,p,并加上与矩阵分量Xi,p,j,q或分矢量 Matrix component Xi, p, j, q and right sub-vectors yi, p, and adding the matrix component Xi, p, j, q or sub-vectors

ys,p相对应的有关作为所关心导师像素获得的新导师数据的分量Xi,ktpXj,ktq或分量Xi,ktpyk,使用导师数据yk、学生数据 The new teacher mentor pixel data obtained ys, p corresponding concern about a component Xi, ktpXj, ktq or component Xi, ktpyk, instructors use data yk, the student data

Xi,k ( Xj,k )和参 Xi, k (Xj, k) and reference

数z计算相应分量Xi,ktpXj,ktq或Xi,ktpyk (即,执行表达式(18 )中的分量Xi,p,j,q或表达式(19)中的分量yi,p的相加和所表示的加法)。 Calculating the corresponding number z component Xi, ktpXj, ktq or Xi, ktpyk (i.e., the component Xi execution component Expression (18), p, j, q or the expression (19) yi, p, and adding the He represents addition).

对于参数z的所有值0、 1等等直到Z,加法单元192使用导师数据存储单元132存储所有导师数据作为所关心的导师像素执行这个加法,以便为每个类构成表达式(20)给出的正规方程式,然后将正规方程式提供给抽头因数计算单元193。 0 for all values ​​of parameter z, and so on until a Z, the adding unit 192 using the supervisor data storage unit 132 stores all data as teacher tutors a pixel of interest to perform this addition in order to give an expression for each class configuration (20) the normal equation, and then the normal equations to the tap factor computation unit 193. 抽头因数计算单元193解算加法单元192所提供的每个类的正规方程式,并因此为每个类获得并输 Tap factor computation unit 193 resolver normal equations for each class provided by the adding unit 192, and outputs thus obtained for each class and

出因数种子数据Pm,n。 A factor seed data Pm, n.

参数生成单元191生成多个值z=0、 1、 2等等直到Z,要提供给图30中的参数存储器184的参数z的范围可以如上迷假定,并将这些值提供给学生数据生成单元133。 Parameter generating unit 191 generates a plurality of values ​​of z = 0, 1, 2 and so on through Z, to be supplied to the parameter memory 184 in FIG. 30, the parameter z can range assumed as fans, and provides these values ​​to the student data generating unit 133. 此外,参数生成单元191将生成的参数z提供给预测抽头提取单元135、特征提取单元136和加法单元192。 Further, the parameter generating unit 191 generates the parameter z supplied to the prediction tap extracting unit 135, a feature extraction unit 136 and the addition unit 192.

接下来,将参考图34的流程图来描述图32所示的学习设备执行的处理(学习过程)。 Next, with reference to the flowchart of FIG. 34 to process (learning process) in FIG. 32 performed in the learning apparatus will be described.

首先,在步骤S181中,导师数据生成单元131和学生数据生成单元133分别从学习图像信号中生成导师数据和学生数据,将后将它们输出。 First, at step S181, the tutor data generating unit 131 and the student data generating unit 133 generates student data and teacher data from the learning image signal, and outputs them after. 也就是说,导师数据生成单元131不加变化的输出学习图像信号作为导师数据。 That is, the learning image signal 131 output without change as the tutor data generating unit tutor data. 同样,向学生数据生成单元133提供通过参数生成单元191生成的具有z+l值的参数z,并且学生数据生成单元133,与使用LPF以与参数生成单元191生成的具有z+l个值(O、 1等等直到z)的参数z相对应的切断频率过滤学习图像信号,藉此生成并输出有关每个帧的导师数据(学习图像信号)的学生数据的z+l个帧。 Similarly, the student data generating unit 133 supplies the parameter z with z + l value unit 191 generates a generation parameter, and the student data generating unit 133, using the LPF to generate the parameter generating unit 191 has a z + l values ​​( O, 1, etc. up to z), corresponding to the parameter z cutoff frequency learning image signal filtering, thereby generates and outputs z + l th frame data tutor student-related data (learning image signal) each frame.

导师数据生成单元131输出的导师数据被提供给导师数据存储单元132并被存储在导师数据存储单元132中,学生数据生成单元133 输出的学生数据被提供给学生数据存储器134并存储在其中。 Tutor data generating tutor data output unit 131 is supplied to the supervisor data storage unit 132 and stored in the supervisor data storage unit 132, the student data generating unit 133 outputs student data is supplied to the student data memory 134 and stored therein.

随后,流程进行到步骤S182,在这里,参数生成单元191将参数z设置到初值、例如零,并且将这个参数z提供给预测抽头提取单元135、特征提取单元136和加法单元192,然后流程进行到S183。 Subsequently, the flow proceeds to step S182, the here, the parameter generating unit 191 is set to the initial value of the parameter z, such as zero, and the parameter z supplied to the prediction tap extracting unit 135, a feature extraction unit 136 and the addition unit 192, and the flow proceeds to S183. 在步骤S183中,预测抽头提取单元135从存储在导师数据存储单元132 中的导师数据中获得还没有被作为所关心的导师像素获得的一个所关心的导师像素。 In step S183, the prediction tap extracting unit 135 obtaining a pixel supervisor has not been of interest as a teacher pixel of interest obtained from the tutor data stored in the supervisor data storage unit 132 in. 此外,在步骤S183中,与所关心的导师像素相对应, 预测抽头提取单元135从学生数据存储单元134所存储的学生数据中配置关于参数生成单元191输出的参数z的预测抽头,(通过使用与参数z相对应的切断频率的LPF过滤与作为所关心的导师像素的导师数据相对应的学习图像信号而生成学生数据),并将其提供给加法单元192,然后流程进行到步骤S184。 Further, in step S183, the teacher pixel of interest corresponds to the prediction tap extracting unit 135 configured prediction tap on the parameter z parameter generating unit 191 outputted from the student data student data storage unit 134 stored, (by using tutor supervisor pixel data LPF filtering with the frequency corresponding to the parameter z cutting of interest to generate the relative signal corresponding to the student learning image data), and supplies it to the addition unit 192, and then the flow proceeds to step S184.

在步骤S184中,特征提取单元136使用学生数据存储器134存储的与参数生成单元191输出的参数z有关的学生数据提取所关心的导师像素的特征,然后将其提供给类分类单元137,然后流程进行到步骤S185。 In step S184, the feature extraction unit 136 using the student data memory 134 stores the feature supervisor pixel student data extraction associated with the parameter z parameter generating unit 191 outputs of interest, and then supplies it to the class classifying unit 137, and the flow proceeds to step S185.

在步骤S185中,类分类单元137根据有关来自于特征提取单元136的所关心的导师像素的所关心特征的像素执行所关心导师像素的分类,并输出藉此获得的与该类相对应的分类代码给加法单元192, 然后流程进行到步骤S186。 Classification supervisor pixel of interest characterized by performing the supervisor pixel of interest in step S185, the class classifying unit 137 extracting unit 136 according to the feature of interest from the relevant, and outputs the class corresponding to the classification obtained thereby Code to the addition unit 192, and then the flow proceeds to step S186.

在步骤S186中,加法单元192从导师数据存储单元132中读出所关心的导师像素,并且使用所关心的导师像素、预测抽头提取单元135 提供的预测抽头和参数生成单元191输出的参数z来计算表达式(20 ) 的左侧矩阵分量Xi,ktpXj,ktq和右侧分矢量Xi,ktpyk。 In step S186, the addition unit 192 reads out the teacher pixel of interest from the supervisor data storage unit 132, and uses the teacher pixel of interest, the prediction tap extracting parameter prediction tap and the parameter unit 135 provides generation unit 191 outputs z, calculation expression (20) of the left component of the matrix Xi, ktpXj, ktq and right sub-vectors Xi, ktpyk. 此外,对已获得的矩阵分量和分矢量,加法单元192在类分类单元137的分类代码的矩阵分量和分矢量上加上与其相对应的从所关心的像素、预测抽头和参数z荻得的矩阵分量Xi,ktpXj,ktq和分矢量Xi,ktpyk,然后流程进行到步骤S187。 In addition, the matrix elements of the matrix components and sub-acquired vector addition unit 192 in the class classifying unit 137, and the classification code vector components plus corresponding thereto from the pixel of interest, the prediction taps, and the parameter z Di obtained matrix component Xi, ktpXj, ktq points and vectors Xi, ktpyk, then the flow proceeds to step S187.

在步骤S187中,参数生成单元191确定输出的参数z是否等于Z 可以假定的最大值。 In step S187, the parameter generating unit 191 determines whether the parameter z output Z can be assumed equal to the maximum value. 如果在步骤S187中确定参数z不等于(即,小于) Z可以假定的最大值,那么流程进行到步骤S188,参数生成单元191 使参数z加1,并向预测抽头提取单元135、特征提取单元136和加法单元192输出新的参数z。 If the feature extraction unit determines the parameter z is not equal in step S187 (i.e., less than) Z can be assumed that the maximum value, the flow proceeds to step S188, the parameter generating unit 191 so that the parameter z is incremented by 1 and the prediction tap extracting unit 135, 136 and the addition unit 192 outputs the new parameter z. 然后流程返回步骤S183,随后重复相同的处理。 The flow then returns to step S183, and then repeats the same processing.

同样,如果在步骤S187中确定参数z等于Z可以假定的最大值, 那么流程进行到步骤S189,并且预测抽头提取单元135确定是否还有没有作为所关心的导师像素的导师数据存储在导师数据存储单元132 中。 Similarly, if it is determined in step S187 the parameter z is equal to the maximum value of Z can be assumed, the flow proceeds to step S189, and the prediction tap extracting unit 135 determines whether or not there is stored as the teacher data of interest tutor data stored in the pixel mentor the unit 132. 如果确定还没有作为所关心的导师像素获得的导师数据仍然还存储在导师数据存储单元132中,那么预测抽头提取单元135携带还没有作为所关心的导师像素的导师数据返回步骤S182,并重复相同的处理。 If it is determined there is no supervisor data tutor as the pixel of interest to obtain still further stored in the supervisor data storage unit 132, the prediction tap extracting unit 135 carrying yet tutor pixel teacher data as interest returns step S182, the and repeats the same processing.

另一方面,如果在步骤S189中确定导师数据存储单元132不再有还没有作为所关心的导师像素的导师数据,那么加法单元192向抽头因数计算单元193提供迄今为止通过处理已获得的每个类的表达式(20)的左边矩阵和右侧矢量,然后流程进^f于到步骤S190。 On the other hand, if it is determined in step S189 supervisor data storage unit 132 has not yet no teacher pixel of interest as tutor data, the adding unit 192 calculates the tap factor to the unit 193 by the processing so far has provided each of the obtained expression (20) of the matrix and the right to the left class vector, then the flow proceeds to step ^ f in S190.

在步骤S190中,抽头因数计算单元193为加法单元192提供的每个类解算构成表达式(20)的左侧矩阵和右侧矢量的每个类的正规方程式,藉此获得并输出每个类的因数种子数据|5m,n,接着结束处理。 In step S190, the class tap of each factor computation unit 193 to the adding unit 192 configured to provide a resolver normal equations for each class of the left and right matrix expression vector (20), thereby obtaining and outputting each seed data class factor | 5m, n, then the process ends.

虽然可能存在这种情况,即由于学习图像信号的数量不够等原因, 不能获得为获得周数种子数据所需的正规方程式的数量,例如可安排因数种子计算单元193为这样的类输出缺省的因数种子数据。 While there may be the case that due to insufficient number of learning image signal, and the like, can not be obtained in order to obtain the required number of normal equations weeks seed data, for example seed can be arranged factor calculation unit 193 outputs the default class of such a factor seed data.

此时,对于图32所示学习设备而言,已将学习描述为以高图像质量图像信号作为导师数据的学习图像信号和通过相应于参数z来降低高图像质量图像信号的分辩率而获得低图像质量图像信号作为学生数据,从表达式(11)的因数种子数据p^所表示的抽头因数wn、相应 In this case, for learning apparatus shown in FIG. 32, it has been described as learning the learning image signal an image signal of high image quality as teacher data and the parameter z to obtain the corresponding lower resolution to reduce the high image quality image signal by factor wn image quality of the tap signal as student data, from the expression (11) by a factor p ^ seed data represented by respective

于参数Z的变量tn和学生数据Xn中直接获得因数种子数据卩m,n而执行的,该抽头因数Wn使由表达式(1)的线性基本表达式预测的导师 Tn the parameter variables Z and directly obtained in student data Xn factor seed data Jie m, n performed, the taps of the linear factor Wn by the expression (1) is the predicted primary expression tutor

数据的预测值y的误差平方和最小化,如图33所示;然而,因数种子 Y squared prediction error value and a minimum of data, as shown in FIG. 33; however, a factor seed

数据Pm,n的学习并不限于这些,例如也可以替代地使用图35所示而执行。 Data Pm, n is not limited to the learning, for example, may alternatively be used as shown in FIG. 35 is performed.

也就是说,对于图35所示的安排而言,同图33的情况类似,作为学习图像信号的高图像质量图像信号作为导师数据,和通过使用与参数z相对应的切断频率的LPF降低高图像质量图像信号的水平方向和垂直方向分辨率而获得的低图像质量图像信号作为学生数据,首先, That is, for the arrangement shown in FIG. 35, the same situation is similar to FIG. 33, a high image quality image signal of an image signal as a teacher of learning data, and the LPF parameter z by using a frequency corresponding to the reduction of high cut low image quality image quality of the image signal in the horizontal direction and the vertical direction of the image signal obtained by resolution as student data, first of all,

为参数Z的每个值(在这里,Z=0、 1等等直到Z)从抽头因数Wn和学生数据Xn获得抽头因数Wn,该抽头因数Wn使由表达式(1)的线性 For each value of parameter Z (where, Z = 0, 1, etc. up to Z) Xn obtains the tap factor Wn Wn tap factor and student data from the tap factor Wn so that by the expression (1) linear

基本表达式预测的导师数据的预测值y的误差平方和最小化。 Minimizing the squared error prediction value y of the predicted primary expression tutor data. 此外对 In addition to

于图35中的安排而言,获得的抽头因数Wn作为导师数据而参数Z作为学生数据,为获得因数种子数据(in^而执行学习,该因数种子数据Pm,J吏作为导师数据<formula>formula see original document page 80</formula> Arrangement in FIG. 35, the tap factor Wn obtained as the parameter tutor data as student data Z, to obtain factor seed data (in ^ learning is performed, the factor seed data Pm, J officials as tutor data <formula> formula see original document page 80 </ formula>

数Z的变量tn预测的。 Variable number of Z tn predicted. 此时,通过解算表达式(8)的正规方程式,可 At this time, by solving expression (8) of the normal equation, can be

以为每个类的每个参数值(z=0、 1等等直到Z )获得给出由表达式(11) 的线性基本预测表达式预测的导师数据的预测值y的误差平方和E的最小(最小的)值的抽头因数Wn,如图8所示的学习设备的情况。 For each parameter value for each class (z = 0, 1, etc. until Z) is obtained and the minimum squared error E of the prediction value y is given by a substantially linear prediction expression (11) is an expression of the predicted data tutor (minimum) value of the tap factor Wn, the learning device 8 shown in FIG.

此时,从因数种子数据pn^中获得抽头因数和与参数Z相对应的 In this case, the tap factor obtained from factor pn ^ and seed data corresponding to the parameter Z

变量tn,如表达式(11)所表示的那样。 Variable tn, as the expression (11) represents. 这意味着,对于从表达式(11) This means that for the expression (11)

获得的抽头因数Wn'而言,其中由表达式(11)获得的最佳抽头因数 Obtaining tap factor Wn 'purposes, wherein by expression (11) obtained optimal tap factor

Wn和抽头因数Wn'之间的误差en是0的因数种子数据pm,n是用于预测 And the error en between the tap factor Wn Wn 'is a factor of the seed data pm 0, n being a prediction

下列表达式(21)所示的最佳抽头因数Wn的最佳因数种子数据Pm,n, 但是对于所有抽头因数Wn来说获得这种因数种子数据Pm,n—般是困难的。 The following expression (21) shown optimal tap factor Wn seed data optimum factor Pm, n, but this factor is obtained for all the tap seed data Pm for factor Wn, n- like is difficult.

en=wn —wn' (21) en = wn -wn '(21)

通过表达式(11)可以将表达式(21)修改为下列表达式。 Expression (21) can be modified to the following expression by the expression (11).

/ M 、 / M,

、m=1 / (22) , M = 1 / (22)

此时,在这种情况下将采用最小平方法作为指示因数种子数据Pm,n是最佳的标准,可以通过最小化下列表达式中的误差平方和E来获得最佳因数种子数据(5m,n。 At this time, in this case using the least squares method as a factor indicating the seed data Pm, n being the best standard may be optimum factor seed data by minimizing the following expression squared error E (5m, n.

E= Z en2 E = Z en2

n=1 (23) n = 1 (23)

使用因数种子数据Pm,n来获得表达式(23)中的误差平方和E的最小值(极小值),其中使用因数种子数据j5m,n对和E进行偏微分产生0,如表达式(24)所示。 Factor using seed data Pm, n to the minimum value of Expression (23) of the square error E (minimum value), in which factor seed data j5m, n 0 is generated, expression (and to partially differentiating E ) 24 shown in FIG.

将表达式(22)代入表达式(24)中产生下列表达式。 The expression (22) is substituted into the expression (24) yields the following expression. 在这种情况下,使用Xi,j和yi表达式(25)可以由表达式(28) 所示的正规方程式给出。 In this case, using Xi, j and yi Expression (25) can be given by the normal equation shown in Expression (28). <formula>formula see original document page 81</formula>例如,同样表达式(28)的正规方程式可以通过使用消去法(高斯-乔丹消去法)来解算出种子数据|5m,n。 <Formula> formula see original document page 81 </ formula> e.g., the same expression (28) by using the normal equation elimination - seed data to be calculated by (Gauss Jordan elimination) | 5m, n.

接下来,图36说明学习设备的配置实例,其用于执行学习以通过给出并解算表达式(28)中的正规方程式来获得因数种子数据|3m,n。 Next, FIG. 36 illustrates a configuration example of a learning apparatus for performing learning and to give by solving Expression (28) in the normal equation to obtain the seed data factor | 3m, n. 请注意,与图8或32中相对应的那些部件以相同的参考标记表示,并且视情况省略了其中的描述。 Note that, with 8 or 32 corresponding to those in FIG components denoted with the same reference numerals, and the description is omitted as the case in which the.

有关类分类单元137输出的所关心的导师像素的分类代码和参数生成单元191输出的参数z被提供给加法单元138。 Tutor classification codes and parameters of interest related to the pixel output class classifying unit 137 generates the parameter z output from unit 191 is supplied to the addition unit 138. 加法单元138从导师数据存储单元132中读出所关心的导师像素,并为类分类单元137 提供的每个分类代码和参数生成单元191输出的参数z的每一个值执行有关所关心的导师像素和学生数据的相加,该学生数据构成相对于预测抽头提取单元135提供的所关心的导师像素设置的预测抽头。 Each parameter z value adding unit 138 reads from the supervisor data storage unit 132 the supervisor pixel of interest, and generating an output unit 191 for the class classification unit 137 provided for each classification code execution and parameters of interest related to the pixel tutor adding and student data, the student data constituting the prediction tap with respect to the prediction tap extracting unit 135 tutor provided a pixel of interest set.

也就是说,向加法单元138提供存储在导师数据存储单元132中的导师数据yk、预测抽头提取单元135输出的预测抽头xm,k、类分类单元137输出的分类代码,以及用于生成配置预测抽头Xnk的学生数 That is, a supervisor data stored in the supervisor data storage unit 132 YK, the prediction tap extracting unit 135 to the adding unit 138 outputs the prediction tap xm, k, outputted from the class classifying unit 137 classification code, and for generating predicted configuration the number of students tap Xnk

现在,让我们定义表达式(26)和(27)中的Xi,j和yi。 Now, let's define the expression (26) and Xi (27) in a, j and yi. Xi尸Ztitj (iH,2'…'M:j-1,2,…,M) Xi dead Ztitj (iH, 2 '...' M: j-1,2, ..., M)

' z=0 (26> 'Z = 0 (26>

5 y-据的参数z,该参数已由参数生成单元191输出。 5 y- data parameter z, which parameter by the parameter generating unit 191 outputs.

对于每个与类分类单元137提供的分类代码相对应的类和参数生成单元191输出的每个参数z值而言,加法单元138使用预测抽头(学生数据)Xn,k执行计算,该计算等于表达式(8)的左边矩阵中的学生数据的一个与另一个的相乘(xn,kxn,,k)和相加(S)。 Z values ​​for each parameter and for each class code provided by the class classification unit 137 and the class corresponding to the parameter generating unit 191 outputs, the addition unit 138 uses the prediction taps (student data) Xn, k performs calculation that is equal to a student data expression (8) to the left and the other matrix multiplication (xn, kxn ,, k) and the sum (S).

同样,对于每个与类分类单元137提供的分类代码相对应的类和参数生成单元191输出的每个参数Z值而言,加法单元138使用预测抽头(学生数据)Xn,k和导师数据yk执行计算,该计算等于于表达式(8)右边矢量中的学生数据Xn,k和导师数据yk的乘积(xn, kxn,k)和相加和(£)。 Similarly, for each class code provided by the class classification unit 137 and the class corresponding to each parameter in terms of parameter generation unit 191 outputs the value of Z, the addition unit 138 uses the prediction taps (student data) Xn, k and supervisor data yk performing calculation that is equal to the expression (8) to the right of the student data vectors Xn, k and supervisor data yk product (xn, kxn, k) and the addition and (£).

也就是说,加法单元138在它的存储器(未示出)中存储表达式(8)的所获得的将早先的作为所关心导师像素的有关导师数据的其左 That is, the adding unit 138 in its memory (not shown) stored in the expression (8) about the tutor data of the previous supervisor pixel of interest as obtained in the left

边矩阵分量(Sxn,kXn,k)和右侧分矢量(£xn,kyk),并加上矩阵分量(EXn,kxn,k)或分矢量(SXn,kyk)、有关作为所关心的导师像素获取新 Side matrix component (Sxn, kXn, k) and the right-side vector (£ xn, kyk), and adding the matrix component (EXn, kxn, k) or sub-vectors (SXn, kyk), supervisor pixel of interest as a relevant get new

的导师数据的相应分量或Xn,k-iyk-i,寸吏用导师数据yk-i Or mentor respective component data Xn, k-iyk-i, with officials inch supervisor data yk-i

和学生数据Xn,w计算的相应分量或Xn,k-iyk-l (即执行表达式 And student data Xn, Xn w or corresponding component calculation, k-iyk-l (i.e., executing the expression

(8)表示的求和的加法)。 Summing adder) (8). 加法单元138使用导师数据存储单元132 存储的所有导师数据作为所关心导师像素来执行这个加法,以便为每个类和参数z的每个值构成表达式(8 )给出的正规方程式,然后将正规方程式给抽头因数计算单元139。 The adding unit 138 using the supervisor data storage unit 132 stores all data as teacher tutors pixel of interest to perform this addition, for each value of the normal equation for each class and the parameters constituting the z expression (8) is given, then normal equations to the tap factor computation unit 139. 抽头因数计算单元139使用参数z 的每个值为每个类解算加法单元138提供的正规方程式,从而为每个 Each tap factor computation unit 139 provides the normal equation adding unit 138 using the values ​​for each type of parameter z solver to each

类获得并输出具有参数Z的每个值的最佳抽头因数Wn,然后将其提供 Obtaining and outputting the class tap factor Wn optimum value for each parameter having Z, and then provides

给加法单元201。 To the addition unit 201.

加法单元201为每个类执行有关参数z (或相应其的变量tm)和最佳抽头因数Wn的相加。 The addition unit 201 performs addition for each class of parameters z (or variable tm corresponding thereto) and the optimal tap factor Wn. 也就是说,加法单元201使用通过表达式(10)从参数z中获得的变量ti (tj)执行计算,该计算等于与参数z 相对应的变量与另一个变量ti(tj)的相乘(titj)以及它的相加,以获得定义在表达式(26)中的分量Xi,j,该表达式在表达式(28)中左侧的矩阵中。 That is, the addition unit 201 uses a variable obtained from the parameter z, ti (tj) performs the calculation by the expression (10), which is calculated by multiplying equal to ti (tj) is the variable corresponding to the parameter z another variable ( titj) and adding it to obtain the component Xi is defined in expression (26), j, the matrix (28) in the left of the expression in the expression. 应理解, 一旦充分的话,仅由参数Z确定分量Xi,j且不与类有关, 因此分量Xi,j的计算实际上不需要为每个类执行。 It should be understood, once sufficient if only the Z parameter is determined by the component Xi, j and not with the class, and therefore the component Xi, j is calculated for each class in fact, need not be performed.

此外,加法单元201使用通过表达式(10)从参数z获得的变量ti和最佳抽头因数Wii执行计算,该计算等于与参数z相对应的变量ti和最佳抽头因数的乘法(ti wn)以及它们的和,该参数z用于获得定义在表达式(28)中的右侧的矢量中的表达式(27)中的分量yi。 Further, the addition unit 201 by using the expression (10) obtained from the parameter variable z and the optimal tap factor ti Wii perform calculation that is equal to the corresponding parameter z and the optimal tap multiplication variable ti factors (Wn of ti) and their sum, z parameters for obtaining the component (27) as defined in the expression vector of the right side (28) of the expression yi.

加法单元201为每个类获得由表达式(26)表示的分量Xi,j和由表达式(27)表示的分量yi,并为每个类设置表达式(28)的正规方程式,以及将正规方程式提供给因数种子计算单元202。 The addition unit 201 is obtained for each component class Xi represented by the expression (26), j and the component represented by the expression (27) yi, for each class set and the expression (28) of the normal equation, and the regular seed is supplied to the equation factor calculation unit 202. 因数种子计算单元202为每个类解算加法单元201提供的表达式(28),藉此为每个类获得并输出因数种子数据|im,n。 Seed factor calculation unit 202 for each class solving Expression (28) adding unit 201, thereby obtaining for each class and the output factor seed data | im, n.

图30所的因数种子存储器183可以被安排为上述获得的类存储因数种子数据|5m,n。 FIG 30 is a factor seed memory 183 may be arranged to store class factor obtained above seed data | 5m, n.

此时,对于图30所示的因数输出单元124而言,可以对其进行安排,其中例如不向因数种子存储器183提供图36所示的抽头因数计算单元139输出的参数z每个值的已存储在存储器的最佳抽头因数wn, 和根据存储在参数存储器184中的参数z选择的存储在存储器中并设置在因数存储器181中的最佳抽头因数。 In this case, as shown in FIG. 30 factor output unit 124, the arrangement may be made wherein, for example, does not provide a tap 36 shown in FIG factor parameter z output unit 139 calculates the value of each factor is the seed memory 183 stored in the memory of the optimal tap factors wn, and the optimal tap factor according to parameters stored in the parameter memory 184 in the z-selected and stored in the memory 181 provided in the memory factor. 然而,在这种情况下,存储器具有与参数z可假定的值成比例的特性是必要的。 However, in this case, a memory having a characteristic parameter z may assume a value proportional is necessary. 相反地,对于提供因数种子存储器183以存储因数种子数据的安排中,因数种子存储器183的存储特性并不依赖于参数z可假定的值,从而可使用小特性的存储器作为因数种子存储器183。 Conversely, for providing factor seed memory 183 for storing seed data arrangement factor, factor seed memory 183 stores characteristic does not depend on the value of the parameter z can be assumed to be used as a small memory characteristic factor seed memory 183. 此外,在存储因数种子数据pm,n 时,通过表达式(9)从和参数z的值中生成的抽头因数wn,因此可 Further, in the memory PM factor seed data, when n, generated from the value of the parameter z and by the expression (9) taps Wn of factors, thus

以根据参数Z的值获得可以说是连续的抽头因数Wn。 To obtain the value of parameter Z according to a tap can be said to be continuous factor Wn. 因此,可以较少 Therefore, it is less

步骤的方式调整计算单元125输出的作为第二图像信号的高图像质量图像信号的图像质量。 Mode calculating step of adjusting the image quality of the output unit 125 as a second image signal of high image quality image signal.

请注意,对于上述方案而言,学习图像信号被作为与未加变化的第二图像信号相对应的导师数据,并且其中已经降低了学习图像信号的分辨率的低图像质量图像信号被作为与第一图像信号相对应的学生数据,根据此执行因数种子数据的学习,因此可以启动图像转换处理而获得因数种子数据,其中可以实现对第一图像信号进行分辨率提高处理从而将其处理为具有提高的分辨率的第二图像信号。 Note that for the above-described embodiment, the learning image and the second image signal is a signal corresponding to variation not added tutor data corresponding to, and in which the resolution has been reduced low image quality image signal of an image signal is taken as the learning of the first an image signal corresponding to the student data, learning is performed based on this factor seed data, so seed data can be obtained starting factor image conversion process can be implemented on a first image signal resolution enhancement process so as to be treated as having increased second image signal resolution.

在这种情况下,在图像转换单元431处,根据参数z可以提高图像信号的水平方向分辨率和垂直方向分辨率。 In this case, at the image conversion unit 431, the parameter z can be improved according to the resolution of the image signal in the horizontal direction and the vertical direction resolution. 因此,在这种情况下, 可以说参数z是与分辩率相对应的参数。 Thus, in this case, it can be said parameter z is a parameter corresponding to the resolution.

此刻,依赖于如何选择与第一图像信号相对应的学生数据的图像信号和与第二图像信号相对应的导师数据的图像信号,可以获得用于 At the moment, depending on how to select a first image signal and the student data corresponding to the image signal and the second image signal corresponding to the image signal tutor data can be obtained for

各种类型的图像转换处理的因数种子数据。 Factor seed data various types of image conversion processing.

也就是说,例如,对于其中高图像质量图像信号被作为导师数据 That is, for example, for which high image quality image signal is tutor data as

的方案中,与参数z相对应的噪音是被附加在导师数据高图像质量图 In the embodiment, corresponding to the parameter z and the noise is added to the image data of high quality supervisor FIG.

像信号上以产生作为学生数据的带有噪音的图像信号,执行学习处理, 藉此可以获得执行图像转换处理的因数种子数据,该图像转换处理是将笫一图像信号转换为已去除了(或减少)包含其中的噪音的第二图像信号的噪音去除处理。 The image signal to generate an image signal with the noise as student data, performing a learning process, thereby performing a factor may be obtained seed data image conversion process, the image conversion processing is converted into an image signal Zi has been removed (or second image signal to reduce noise) which contains the noise removing processing.

同样,例如,对于这样的方案而言,即其中所给出的图像信号作为导师数据以及减少将具有作为导师数据的图像信号所具有的像素数量的图像信号而产生作为学生数据的图像信号,或者其中所给出的图 Also, for example, for purposes of this embodiment, in which the image signal given as tutor data, and reducing the number of pixels having an image signal as an image signal having the tutor data generated as an image signal is student data, or wherein FIG given

信号所具有的像素数量的图像信号'以产生作'为导师数据图像信号,执行学习处理,藉此可以获得执行图像转换处理的因数种子数据,该图像转换处理为缩放处理,其将第一图像信号转换为被扩大或减小的第二图像。 The signal having the number of pixels of the image signal 'as to produce' is tutor data of the image signal, performing a learning process, thereby performing a factor may be obtained seed data image conversion process, the image conversion processing to the scaling processing, the first image which signal into a second image is enlarged or reduced.

当在因数种子存储器183中,为噪音去除处理存储因数种子数据, 或者为缩放处理存储因数种子数据时,可以在图像转换单元31处执行与参数z相对应的噪音去除或缩放(扩大或减少)。 When factor seed memory 183 for the noise removal process of storing factor seed data, or for the scaling processing stored factor seed data may be removed or scaling in the image converting unit at 31 executes the parameter z corresponding to the noise (enlarged or reduced) .

在上述情况中,抽头因数Wn通过P1^0 + + '" + PM'nZM—工定 In the above case, the tap factor Wn by P1 ^ 0 + + ' "+ PM'nZM- given work

义,如表达式(9)所表示那样,使用表达式(9)获得与参数z相对 Yi, as shown in Expression (9) as expressed using the expression (9) opposite the obtained parameter z

应的提高水平方向和垂直方向分辨率的抽头因数Wn,但是可以为抽头因数Wn作这样的安排,其中水平方向分辨率和垂直方向分辨率都与各 It should improve the resolution of the horizontal and vertical directions tap factor Wn, Wn but may be a factor to make such a tap arrangement in which the resolution in the horizontal direction and the vertical direction are associated with each resolution

自的参数Zx和Zy相对应而独立提高的。 Since the parameters corresponding Zx and Zy independently increased.

也就是说,抽头因数Wn是通过这样来定义的,例如三次表达式1"。 + P2,"xV + p3,nZx2Zy。 That is, such a tap factor Wn is defined by, for example, three expression 1 ". + P2," xV + p3, nZx2Zy. + p4,nZx3Zy0 + p5,nZx<V + P4, nZx3Zy0 + p5, nZx <V

而不是表达式(9),而且定义在表达式(10)中的变量U是通 Instead of the expression (9), and the definition of the variables in the expression (10) is a through U

Live

h - ZXV, t2 = Zx、。 h - ZXV, t2 = Zx ,. , t3 - ZxV, " = Zx3Zy。, t5 = ZxV, , T3 -. ZxV, "= Zx3Zy, t5 = ZxV,

t6 = zx0zy2, t7 = zx。 t6 = zx0zy2, t7 = zx. zy3, ts = zjzy1, t9 = "2&、 ti。 = Zx^y zy3, ts = zjzy1, t9 = "2 &, ti. = Zx ^ y

来定义的,而不是表达式(10)。 Defined, rather than the expression (10). 同样,在这种情况下,抽头因 Also, in this case, because the tap

数Wn最后可以表示为表达式(11),从而使用作为学生信号的图像信号的学习可以在学习设备(图32和36)处执行,其中导师信号的水平方向分辨率和垂直方向分辨率都已经与参数Z,和Zy相对应地降低, Finally, the number can be expressed as Wn Expression (11), so that an image signal as a student signal learning may be performed in the learning apparatus (Fig. 32 and 36) at which the signal level of teacher direction vertical resolution and the resolution have been parameters Z, and a corresponding decrease Zy,

藉此获得因数种子数据Pm,n,从而可以获得与各自参数Z,和Zy相对应 Thereby obtaining factor seed data Pm, n, can be obtained with the respective parameters Z, and a corresponding Zy

独自的来提高水平方向分辨率和垂直方向分辨率的抽头因数wn。 Alone to improve the horizontal resolution and vertical resolution of the tap factor wn.

其他实例除了与水平方向分辨率和垂直方向分辨率相对应的各自 Other examples in addition to the resolution in the horizontal direction and the vertical direction corresponding to the resolution of the respective

参数ZX和Zy之外还包括引入与时间序列分辨率相对应的参数Zt ,藉此能够获得用于与各自参数ZX、 Zy和Zt相对应的提高水平方向分辨率、 ZX Zy to the parameters and further comprising introducing a time series of parameters corresponding to the resolution Zt, whereby the respective parameters can be obtained for ZX, Zy and Zt corresponding to improve resolution in the horizontal direction,

垂直方向分辨率、时间序列分辨率的抽头因数Wn。 Vertical resolution, time resolution of the series of taps factor Wn.

同样,对于缩放处理而言,同样可以与分辩率提高处理相同的方式获得用于在水平方向或垂直方向上缩放与参数Z相对应的扩大百分比(减少百分比)的抽头因数Wn,或者获得用于在水平方向和垂直方向上独立的缩放与各自的参数Zx和Zy相对应的扩大百分比(减少百分比)的抽头因数Wn。 Similarly, for the scaling processing, the resolution can also be treated in the same manner to obtain improved tap factors Wn for the horizontal or vertical direction Z scaling parameter corresponding to the expansion percentage (percent reduction), or obtain a in the horizontal direction and the vertical direction with respective independent scaling parameter Zx and Zy corresponding expansion percentage (percent reduction) tap factor Wn.

此外,对于学习设备(图32和36)而言,可以通过与参数Zx相 Further, for the learning apparatus (Fig. 32 and 36), by the phase parameter Zx

对应地降低导师数据的水平方向和垂直方向分辨率来执行学习,并且将噪音增加到与参数Zy相对应的导师数据,以及将获得因数种子数据pm,n的图像信号作为作为学生数据,借此可以获得与参数Zx相对应的并且也与参数Zy相对应的执行噪音去除。 Correspondingly reduced horizontal and vertical resolution to perform the learning tutor data, and the noise increases with the parameters corresponding to the tutor data Zy, seed data, and the obtained factor pm, n as the image signal as the student data, whereby Zx can be obtained with the corresponding parameter and also performs noise removal corresponding to the parameters Zy.

图28所示的图像转换单元431R的因数种子存储器183 (图30 ) 存储因数种子数据,该因数种子数据是通过仅使用作为导师数据的图像信号的R信号和所有作为学生数据的图像信号的R、 G和B信号的学习获得的。 FIG image conversion unit 28 factor seed memory 183 (FIG. 30) 431R seed data storage factor, the factor seed data is generated by using only the R signal as the image signal and the teacher data as student data of all the image signals of R learning G and B signals obtained. 同样,图28所示的图像转换单元431G的因数种子存储器183 (图30)存储只使用作为导师数据的图像信号的G信号和所有作为学生数据的图像信号的R、 G和B信号的学习所获得的因数种子数据。 Similarly, as shown in FIG. 28 factor seed memory image converting unit 183 (FIG. 30) 431G stores only the learning image signal as the tutor data and all of the G signal as the image signal is student data R, G and B signals obtained factor seed data. 以同样的方式,图28所示的图像转换单元431B的因数种子存储器183 (图30)存储只使用作为导师数据的图像信号的B信号和所有学生数据的图像信号的R、 G和B信号的学习所获得的因数种子数据。 In the same manner, as shown in FIG. 28 in the image conversion unit 431B factor seed memory 183 (FIG. 30) stores only the R image signal of the image signal as a signal B tutor data and student data to all, G, and B signals learning factor seed data obtained.

接着,图37说明组成图27所示的组成信号处理单元404的信号处理单元411R、 411G和411B的另一配置实例。 Next, FIG. 37 illustrates the signal processing unit 404 is composed of the signal processing unit 27 shown in FIG composition 411R, 411G, and 411B of another configuration example. 请注意,相应于图28中的那些部件以相同的附图标记表示,并且视情况省略了其中的描述。 Note that, in FIG. 28 correspond to those components with the same reference numerals, and the description is omitted as the case in which the. 也就是说,图37所示的信号处理单元411R、 411G和411B是以图28所示的相同方式布置的,除了没有提供图像存储单元432R、432G 和4MB,而且提供控制单元211,该控制单元211代替评估单元433。 That same manner, the signal processing unit 37 shown in FIG. 411R, 411G, and 411B are arranged as shown in FIG. 28, except that the unit does not provide an image storage control unit 432R, 432G, and 4MB, but also provides a control unit 211, the evaluation unit 211 instead of 433.

在图37中,向控制单元211提供操作单元185输出的参数,而不是图像转换单元431G输出的第二图像信号。 In Figure 37, the parameter operation unit 185 provides an output to the control unit 211, instead of the second image signal output from the image conversion unit 431G. 控制单元211获得操作单元185输出的参数,并控制传感器单元401 (图20)的R感光器单元423R、 G感光器单元423G和B感光器单元423B的放置位置。 The control unit 211 obtains the parameter outputted from the operation unit 185, and controls the sensor unit 401 (FIG. 20) of the R photoreceptor unit 423R, G photoreceptor placement unit 423G and the B photoreceptor unit 423B.

图38说明图37所示的控制单元211的配置实例。 38 illustrates a configuration example of the control unit 211 shown in FIG. 37. 控制信号输出单元221获得操作单元185提供的参数,并识别偏移量PhG、 Pv(s、 PhB和Pvb,该等偏移量与从操作单元185获得的参数有关,该参数存储在参数表存储单元222的参数表中。此外,控制信号输出单元221 以与上述控制信号输出单元444相同的方式将向传感器单元401提供用于指定使用参数表识别的偏移量PhG、 PvG、 PhB和Pvb的控制信号, 藉此控制传感器单元401 (图20 )的R感光器单元423R、 G感光器单元423G和B感光器单元423B的放置位置。 Control signal output unit 221 obtains the parameter operation unit 185 is provided, and the offset identifying PhG, Pv (s, PhB and Pvb, these offset parameters obtained from the operation unit 185 related to the parameter stored in the parameter table storage parameter table 222 unit. Further, the control signal output unit 221 PhG offset to the sensor unit 401 will provide the same manner as the above-described control signal output unit 444 for specifying the parameter table identification, PvG, PhB and Pvb of control signal, thereby controlling the sensor unit 401 (FIG. 20) of the R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B of placement.

参数表存储单元222存储由操纵操作单元185输入的参数相关的参数表,以及在根据参数获得适合图像转换处理的图像信号时代表了传感器单元401的R感光器单元423R, G感光器单元423G和B感光器单元423B的放置位置的偏移量PhG, PvG, PhB,和PvB。 Parameter table storage unit 222 stores a parameter manipulating the operation unit 185 inputs the relevant parameter table, and represents a sensor unit R photoreceptor unit 401 when obtaining an image signal for the image conversion processing according to the parameters 423R, G photoreceptor unit 423G and PhG offset placement position B of the photoreceptor unit 423B, PvG, PhB, and PvB. 参数表通过后面描述的参数表学习被事先获得。 Parameter table parameter table by learning described later is previously obtained.

相应地,在控制信号输出单元221,向传感器单元401提供用于指定与从操作单元185获得的参数相关联的偏移量Phc, PvG, PhB, 和PvB的控制信号来控制传感器单元401 (图20)的R感光器单元423R, G感光器单元423G和G感光器单元423B的放置位置,因此与从操作单元185获得的参数相对应的适合于图像转换处理的图像信号是传感器单元401输出。 Accordingly, the control signal output unit 221 is provided to the sensor unit 401 for specifying the offset parameter associated with the operation unit 185 from the obtained Phc, PvG, PhB, and a control signal to control PvB sensor unit 401 (FIG. 20) R photoreceptor unit 423R, G photoreceptor unit 423G and the G photoreceptor unit placement position 423B, and thus the parameter 185 obtained from the operation unit corresponding to the adapted image signal from the image conversion process is the output of the sensor unit 401. 使这样的图像信号经受与从操作单元185 获得的参数相对应的图像转换处理,可以获得具有更高质量的图像信号。 Such that the image signal is subjected to image conversion processing and the parameters obtained from the operation unit 185 corresponding to the image signal can be obtained with higher quality.

接下来,参考图39中的流程图,图27中所示的图像拾取设备的操作将参考图37中所示的对信号处理单元411的配置进行描述,其组成了图27中所示的信号处理单元404。 Next, with reference to the flowchart of FIG. 39 in the image shown in FIG pickup operation device 27 will be described configuration of the signal processing unit 411 shown in FIG. 37 with reference to, the composition of the signal 27 shown in FIG. processing unit 404.

首先,在步骤S191中,控制单元211 (图38)的控制信号输出单元221获得操作单元185输出的参数,且流程进入步骤S192。 First, at step S191, the control unit 211 (FIG. 38) a parameter obtaining unit 221 outputs a control signal outputted from the operation unit 185, and the flow proceeds to step S192. 在步骤S192中,控制单元211识别从操作单元185处获得的与参数有关的偏移量PhG, PvG, PhB,和PvB,在参数表存储单元222里存储的参数表中为指定传感器单元401的偏移量PhG, Pvg, PhB,和Pvb提供控制信号,流程进入步骤S193。 In step S192, the control unit 211 identify the parameters associated with the shift amount obtained from the PhG operation unit 185, PvG, PhB, and PVB, the parameter in the parameter table stored in the table storage unit 222 is specified in the sensor unit 401 offset PhG, Pvg, PhB, Pvb and provides a control signal, the flow proceeds to step S193. 相应地,控制传感器单元401的R感光器单元423R, G感光器单元423G和B感光器单元423B的放置位置被。 Accordingly, the sensor control unit photoconductor unit 423R 401 R, G, and B photoreceptor unit 423G photoreceptor unit 423B is placed in the position.

在步骤S193中,传感器单元401接收物体光,并进行光电转换, 从而获得电信号形式的图像信号(即,使物体成像),并把图像信号提供给信号调整单元402。 In step S193, the sensor unit 401 receives the object light, and a photoelectric conversion, thereby obtaining an electric signal in the form of an image signal (i.e., an object image), and supplies the image signals to the signal adjusting unit 402. 信号调整单元402使传感器单元401提供的图像信号经受CDS处理并把这些提供给A/D转换单元403。 The sensor unit 401 provides the image signal adjustment unit 402 is subjected to CDS processing and provide them to the A / D conversion unit 403. A/D转换单元403使信号调整单元402提供的图像信号经受A/D转换,然后作为第一图像信号提供给信号处理单元411,且流程从步骤S193进入步骤S194。 A / D conversion unit 403 that the signal adjusting unit image signal 402 is subjected to A / D conversion, and then supplied as a first image signal to the signal processing unit 411, and the flow proceeds to step S193 from step S194.

就是说,这种情况下,传感器单元401 (图20)的R感光器单元423R, G感光器单元423G和B感光器单元423B放置位置的是与操作单元185输出的参数相关联的偏移量PhG, PvG, PhB,和PvB相对应的位置。 That is, in this case, the sensor unit 401 (FIG. 20) of the R photoreceptor unit 423R, G photoreceptor unit 423G and the B photoreceptor unit 423B is placed in a position offset parameter associated with the operating unit 185 output PhG, PvG, PhB, and a position corresponding to PvB. 相应地,在步骤S193中,与操作单元185输出的参数相对应的适合于图像转换处理的图像信号从传感器单元401输出,且向信号处理单元411提供该图像信号作为第一图像信号。 Accordingly, in step S193, the operation unit 185 outputs a parameter corresponding to an image signal suitable for image conversion processing from the output of the sensor unit 401, and supplies the image signal as a first image signal to the signal processing unit 411.

在步骤S194中,信号处理单元411 (图37)的图像转换单元431 (图29)使A/D转换单元403提供的第一图像信号经受作为与操作单元185输出的参数相对应的信号处理的图像转换处理,从而在笫一图像信号之上产生图像质量提高的第二图像信号,然后流程进入步骤S195。 In step S194, the signal processing unit 411 (FIG. 37) of the image converting unit 431 (FIG. 29) of the first image signal A / D conversion unit 403 provides an output of the parameters is subjected to the operation unit 185 corresponding to the signal processing image conversion processing to generate a second image signal of the image quality improvement over the undertaking of an image signal, and then the flow proceeds to step S195.

现在,如前面所提到的,提供给图像转换单元431的第一图像信号是与操作单元185输出的参数相对应的适合于图像转换处理的图像信号,相应地,在步骤S194中,使第一图像信号经受与操作单元185 获得的参数相对应的图像转换处理以便获得更高图像质量的图像信号。 Now, as previously mentioned, the first image signal supplied to the image converting unit 431 of the operation unit 185 is an output parameter corresponding to an image signal suitable for image conversion processing, and accordingly, in step S194, the first parameters of an image signal obtained is subjected to the operation unit 185 corresponding to the image signal conversion processing to obtain an image of higher image quality.

在步骤S195中,图像转换单元431向输出单元405输出所获得的图像转换处理的第二图像信号,从而完成但一个帧(或场)的处理。 Second image signal in the image conversion processing in S195, the step of outputting the image conversion unit 431 to the output unit 405 is obtained, thereby completing the process but a frame (or field). 采用图像拾取设备,重复根据图39的流程图,直到例如用户下达停止图像拾取的命令。 Using an image pickup apparatus, according to the flowchart of FIG. 39 is repeated until a stop command is issued, for example, a user of the image pickup.

接下来,图40阐明了学习设备的配置实例,用于执行图38中所示的存储在参数表存储单元222中的参数表的学习。 Next, FIG. 40 illustrates a configuration example of a learning apparatus for learning parameter table memory 38 shown in FIG performed in the parameter table storage unit 222.

传感器单元531,信号调整单元532,和A/D转换单元533与图27中所示的传感器单元401,信号调整单元402和A/D转换单元403 相同的方式配置。 A sensor unit 531, the sensor unit 532 as shown in signal adjusting unit, and A / D conversion unit 533 in FIG. 27 and 401, and a signal adjusting unit 402 configured in the same manner as A / D conversion unit 403. 然而,应注意,通过图27中所示的图像拾取设备, 传感器单元401 (图20)的R感光器单元423R, G感光器单元423G和B感光器单元423B的放置位置是由信号处理单元404 (或者说是, 构成处理单元404的信号处理单元411G)的控制单元211输出的控制信号进行控制的,通过图40中所示的学习设备,传感器单元531的每个与R感光器单元423R, G感光器单元423G和B感光器单元423B 相对应的感光器单元的放置位置(此后,视情况指代"传感器单元531 中的放置位置")由控制器537输出的控制信号所控制。 However, it should be noted that the image pickup apparatus shown in FIG. 27, the sensor unit 401 (FIG. 20) of the R photoreceptor unit 423R, G placement unit 423G and the B photoreceptor photoreceptor unit 423B is determined by the signal processing unit 404 (or, the signal processing unit 404 of the processing units 411G) of the control unit 211 outputs a control signal for controlling each of the R photoreceptor unit by the learning device, the sensor unit 40 shown in FIG. 423R 531, G photoreceptor unit 423G and placement B photoreceptor unit 423B corresponding to the photosensitive unit (hereinafter, refer optionally "sensor unit 531 is placed in position") is controlled by a control signal output from the controller 537. 图像转换单元534以与图29中所示的图像转换单元431 (431G) 相同的方式进行配置。 The image converting unit 534 in the same image conversion unit 431 (431G) illustrated in FIG. 29 arranged manner. 然而,图29所示的图像转换单元431执行与操作单元185输出的参数相对应的图像转换处理,图40中所示的图像转换单元534在A/D转换单元533输出的第一图像信号上执行与控制器537输出的参数相对应的图像转换处理。 However, on the first image signal shown in FIG. 29 and the image converting unit 431 performs the operation unit 185 outputs the parameter corresponding to the image conversion processing, image converting unit 534 shown in FIG. 40 in the A / D conversion unit 533 output 537 parameters with the controller output corresponding to the image conversion processing. 位置确定单元535获得控制器537输出的参数所指定的控制信号和偏移量PhG、 PvG、 PhB、和PvB (此后^L情况简称"偏移量P,,)。 另外,位置确定单元535从图像转换处理单元534获得第二图像信号, 该笫二图像信号使在与控制器537输出的控制信号相对应的传感器单元531的放置位置处(即,由控制信号指定的偏移量P代表的状态) 成像的第一图像信号经受与控制器537输出的参数相对应的信号转换处理(此后也可视情况称为"与控制信号和参数相对应的第二图像信号,,)。 Parameter determining unit 535 to obtain the position controller 537 outputs a control signal and a specified offset PhG, PvG, PhB, and PVB (hereinafter referred to as ^ L where "offset P ,,). Further, the position determination unit 535 from the image conversion processing unit 534 obtain a second image signal, the second image signal Zi is placed at a position so that the sensor unit 537 outputs a control signal corresponding to the controller 531 (i.e., specified by the control signal representative of the offset P state) imaged a first image signal subjected to the controller 537 and the parameter output signal corresponding conversion process (hereinafter also referred to as a second image signal depending on the circumstances "and the control signal and the corresponding parameters ,,). 然后位置确定单元535评估图像转换单元534提供的第二图像信号,与评估结果相对应,将控制器537输出的参数和控制信号指示的偏移量P相关联,并把这些提供给位置存储单元536。 Second image signal evaluation unit 535 then determines the position of the image converting unit 534 supplied with the corresponding evaluation results, and offset parameters indicative of the control signal output by the controller 537 P are associated, and provide them to the position storage unit 536. 位置存储单元536以参数和偏移量P组的形式存储从位置确定单元535提供的参数和偏移量P。 The storage unit 536 determines a position offset unit 535 and the parameter supplied from the parameter and a stored position offset group P. P 位置存储单元536存储控制器537输出的参数z的多个值中的每一个所相关的参数和偏移量组,并且参数表是参数和偏移量组的列表。 A plurality of values ​​of the parameter z output from the position controller 537 storage unit 536 stores each of the relevant parameters and offset groups, and the parameter table is a list of parameters and the set offset. 控制器537产生一些参数z可以假定的值,例如,zO, 1, 2, 等等直到z,这和图32中的参数生成单元191的方式一样。 The controller 537 generates the parameter z can assume a number of values, e.g., zO, 1, 2, and so on through z, and the manner in which the parameter generating unit 191 in FIG. 32 of the same. 另外,对于每个产生的参数值,控制器537产生一些偏移量P可以假定的值(P" P2,等等直到Pn,其中N是一个大于或等于2的值),控制器S37然后顺序将产生的参数值做为所关心的参数值,且把所关心的参数值Z , 和所产生的与所关心的参数值相对应的偏移量P的多个值中的每一个值提供给位置确定单元535。另外,控制器537向位置确定单元535 和传感器单元531提供指定偏移量P的控制信号。图41阐明了图40中所示的位置确定单元535的配置实例。位置确定单元535包括,存储单元541,相关性计算单元542,和确定评估单元543。存储单元541,相关性计算单元542和确定评估单元543每个都是与图23中所示的存储单元441,相关性计算单元442和确定评估单元443的相同的方式配置的。然而应注意,也向确定评估单元543提供参数(所关心的参数值) 和从控制器537 (图40)输出的偏移量的输入 Further, the parameter values ​​for each generated, the controller 537 generates an offset P may assume a number of values ​​(P "P2, etc. until Pn, where N is a value greater than or equal to 2), the controller then sequentially S37 the resulting parameter values ​​as parameter value of interest, and the value of each of a plurality of values ​​of interest parameter value Z, and the offset parameter value corresponding to the interest generated is supplied to the P position determining means in addition, the controller 537 to provide 535. the position determining unit 535 and the sensor unit 531 a control signal P is specified offset. FIG. 41 illustrates the configuration example shown in FIG 40 the position determining unit 535. the position determining unit 535 comprises storage unit 541, the correlation calculation unit 542, and determines the evaluation unit 543. the storage unit 541, and a correlation calculation unit 542 determines the evaluation unit 543 are each shown in FIG. 23 in the storage unit 441, the correlation and the calculation unit 442 determines the same manner as the evaluation unit 443 configured. It should be noted, however, also provides a parameter (parameter value of interest) to the evaluation unit determining the offset 543 and the controller 537 (FIG. 40) output from the input 与图23中所示的确定评估单元443相同,确定评估单元543对从图像转换单元534(图40) 输出的笫二图像信号进行评估,该评估基于从相关性计算单元542提供的相关值,并输出评估结果是第二图像信号的图像质量是高或低。 另外,确定评估单元543根据评估结杲把从控制器537提供的参数和偏移量相关联,并把关联的参数和偏移量组提供给位置存储单元536 (图40)。接下来,采用图40中所示的学习设备的参数表学习处理将参考图42中的流程进行描述。首先,在步骤S320中,控制器537从参数z所能假定的范围中选择一个值作为所关心参数值z,并把该值提供给位置确定单元535 (图41)的图像转换单元534和确定评估单元543。同样在步骤S320中, 图像转换单元534和确定评估单元543从控制器537获的所关心的参数值z,流程进入步骤S321。在步骤S321中,传感器单元531接收物体的光,并进 The same determination in the evaluation unit shown in FIG. 23 443, a determination evaluation unit 543 pairs Zi two image signals from the image converting unit 534 (FIG. 40) outputted assessment, which is supplied from the correlation value based on correlation calculation unit 542, and outputs the picture quality evaluation result of the second image signal is high or low. Further, the evaluation unit 543 determines based on the evaluation parameters and the junction Gao offset provided from the controller 537 is associated, and the associated parameters and the offset amount set to the position storage unit 536 (FIG. 40). Subsequently, using the parameter table learning apparatus shown in FIG. 40 in the learning process will be described with reference to FIG. 42 process. first, at step S320, the controller 537 selecting a value z as the image parameter values ​​of interest, and this value is supplied to the position determination unit 535 (FIG. 41) of the conversion unit 534 and determines the evaluation unit 543. Also in step S320 from the parameter z can be assumed range, determining image conversion unit 534 and evaluation unit 543 proceeds to step S321 from the value of the parameter z is eligible for the controller 537 of interest, the process at step S321, the sensor unit 531 receives light from a subject, and thus 行光电转换, 藉此获得电信号(即,使物体成像)形式的图像信号,并把该图像信号提供给信号调整单元532。信号调整单元532使传感器单元531提供的图像信号经受CDS处理并把这些提供给A/D转换单元533, A/D 转换单元533使信号调整单元532提供的图像信号经受A/D转换,然后作为第一图像信号提供给信号处理单元534,流程从步骤S321进入步骤S322。在步骤322中,图像转换单元534使A/D转换单元533提供的第一图像信号经受与控制器537获得的所关心参数值z相对应的图像转换处理,从而在第一图像信号之上产生图像质量提高的第二图像信号, 进而流程进入步骤S323。 Performs photoelectric conversion, thereby obtaining an electric signal (i.e., an object image) in the form of an image signal, and supplies the image signal to the signal adjusting unit 532. The signal adjusting unit 532 of the image signal provided by the sensor unit 531 is subjected to the CDS processing and these supplied to the a / D conversion unit 533, a / D conversion unit 533 of the image signal adjustment unit 532 provides a signal subjected to a / D conversion, and then supplied to the signal processing unit 534 as a first image signal, the flow proceeds to step S321 from step S322. in step 322, the image converting unit 534 the a / D conversion unit 533 is subjected to a first image signal supplied from the controller 537 to obtain the value of the parameter z of interest corresponding to the image conversion processing to the first image signals in generating a second image signal on the image quality improved, and thus the flow proceeds to step S323. 在步骤323中,位置确定单元535评估图像转换单元534提供的第二图像信号,流程进入步骤S324。 In step 323, the position of the second image signal is determined, the flow evaluation unit 535 provides the image converting unit 534 proceeds to step S324. 在步骤S323中所执行的评估过程将稍后参考图43进行详细的描述。 In the evaluation process executed in step S323 will be described later with reference to FIG. 43 described in detail. 在步骤324中,位置确定单元535 (图41)的确定评估单元543 确定是否获得第二图像信号的图像质量为高的评估结果为,如刚刚所述的步骤S323中的第二图像信号的评估结果。 In step 324, the position determination unit 535 (FIG. 41) of the evaluation determination unit 543 determines whether the second image signal to obtain an image quality is high as a result of the evaluation, evaluation of the second image signal as just described in step S323 result. 如果在步骤S324中,确定第二图像信号的图像质量为高的评估结果还没有获得,流程进入步骤S325,控制器537把指定偏移量P的控制信号提供给传感器单元531,由此改变(移动)传感器单元531的放置位置被改变。 If, in step S324, the image quality of the second image signal is determined to be high evaluation result is not yet obtained, the flow proceeds to step S325, the controller 537 specifies the control signal P is supplied to the offset of the sensor unit 531, thereby changing ( placement position) sensor unit 531 is changed. 注意,控制器537以图23中所示的控制信号输出单元444相同的方式来设置控制信号所估计的偏移量P,举例来说。 Note that the controller 537 in the same manner as shown in FIG. 23 control signal output unit 444 to set the shift amount control signal P is estimated, for example. 另外,在步骤324中,控制器537也把提供给传感器单元531的偏移量P提供给位置确定单元535的确定评估单元543,流程返回步骤S321。 Further, in step 324, the controller 537 also provides the offset to the sensor unit 531 is supplied to the P position determining unit 535 determines the evaluation unit 543, the flow returns to step S321. 在步骤S321中,以其放置位置在先前的步骤S325中已经被改变的传感器单元531来获得图像信号,随后,重复步骤S321到S325。 In step S321, its placement in the preceding step S325 has been changed in the sensor unit 531 obtains an image signal, then repeat steps S321 to S325. 由于步骤S321到S325的循环,图像转换单元534使由传感器单元531的多个放置位置的每一个获得的第一图像信号经受与所关心参数值z相对应的图像转换处理,由此产生作为与所关心参数值z相对应的图像转换处理结果的第二图像信号。 Since the loop to step S321, the image converting unit 534 S325 so that the first image signal obtained in each of the plurality of sensor placement unit 531 is subjected to image conversion processing corresponding to the parameter value z of interest, thereby generating as a z signal corresponding to the second image processing result of the image conversion parameter values ​​of interest. 另外,与有关所关心参数值z而获得的多个偏移量相对应的每个第二图像信号在步骤S323中被评估。 Further, each of the plurality of the second image signal and an offset value of the parameters of interest obtained by z corresponding to the step S323 is evaluated. 注意,如果是在步骤S320后第一次执行步骤S231,传感器单元531以默认的放置位置来获得图像信号。 Note that, if it is the first execution of step S231 after step S320, the sensor unit 531 is placed in a default position to obtain an image signal. 随后,如果在步骤S324中,确定已经获得笫二图像信号的图像质量为高的评估结果,流程进入步骤S326,并且当获得评估结果时,位置确定单元535的确定评估单元543把所关心参数值z和控制器537 提供的偏移量P相关联,即,以与所关心参数值z相关联的方式,向位置存储单元536提供并存储当获得表示已获得高质量评估结果的与第二图像信号相对应的第一图像信号时指示传感器单元531的放置状态的偏移量P,以及有关的所关心参数值z和偏移量P。 Subsequently, if in step S324, the determination has been obtained image quality Zi second image signal is high evaluation result, the flow proceeds to step S326, and when the results of an evaluation, the position determination of interest parameter value 543 to determine the evaluation unit cell 535 P z offset associated controller 537 and supplied, i.e., in a manner associated with parameter value z of interest, has been to provide high-quality evaluation result of the second image is obtained and stored when the memory cell 536 indicates the position of indicating the state of the sensor unit 531 is placed a signal corresponding to a first image signal shift amount P, and the associated parameter value and an offset z of interest P. 相应地,位置存储单元536存储了偏移量P,由此与所关心参数值z相对应的适合于图像转换处理的第一图像信号(此后简称为"最佳偏移量")。 Accordingly, the position of the storage unit 536 stores the shift amount P, whereby the value of the parameter z of interest corresponding to a first image signal for image conversion processing (hereinafter simply referred to as "optimum offset amount").

然后流程从步骤S326进入步骤S327,这里控制器537把参数z 可以假定的范围内的所有数值做为所关心的参数值z,并根据最佳偏移量P是否已被获得来完成确定。 The flow then proceeds to step S327 from step S326, where all numbers subsumed within the controller 537 of the parameter z can assume the value of z ranges as a parameter of interest, and determines whether to complete the optimum offset amount P has been obtained according to. 如果在参数z可假定的范围内的所有值都考虑的情况下,在步骤S327中确定没有荻得最佳偏移量P,则流程返回步骤S320,在这里控制器537从参数z可假定的范围内再挑选一个没有被做用作过所关心参数值的数值做为新的所关心参数值, 同样的处理重复进行。 If all the values ​​in the case where the parameter z can be assumed range are considered, it is determined in step S327 not Di was the optimum offset P, the flow returns to step S320, the controller 537 may be assumed where the parameter z then the selection is made within a range not used as a parameter value through the value of interest as a new parameter value of interest, similar processing is repeated.

同样,如果在参数z可假定的范围内的所有的值都被考虑的情况下,在步骤S327中确定获得了最佳偏移量P,即,如果参数表已经被存储在位置存储单元536中,该参数表是一些参数z可假定范围内多个数值中的每个数值和其最佳偏移量P组,则流程结束。 Similarly, in the case if all the values ​​are within the range of the parameter z can be assumed to have been considered to determine the optimum offset amount P obtained in step S327, the i.e., if the parameter table has been stored in the position storage unit 536 this parameter table is the parameter z can be assumed that some of the plurality of numerical values ​​within each range and optimum offset P group, the process ends.

如前所述,与参数z相对应的图像转换处理是关于传感器单元531 在与多个偏移量P的每一个相对应的位置上获得的每个第一图像信号来执行的,对于参数z的多个值中的每个值,通过图像转换处理获得的第二图像信号被评估,并且获得最佳偏移量P,该最佳偏移量P是在获得高图像质量的笫二图像信号时的偏移量;相应地,可以获得参数表,该参数表是在获得与参数z相对应的适合图像转换处理的第一图像信号时,参数z和最佳偏移量P的关联关系。 As previously described, corresponding to the parameter z is the image conversion processing with respect to each of the first sensor unit 531 in the image signal with a plurality of offset amount of P corresponding to each position to perform the obtaining, for the parameter z each value of the plurality of values, the second image signal obtained by the image conversion processing are evaluated, and the best offset P, P is the optimum offset amount is obtained in the undertaking of the second image signal of a high quality image when the offset; accordingly, may be obtained parameter table is the parameter table when obtaining a first image signal corresponding to the image conversion processing for the parameter z, z parameters and the relationship P of the optimum offset. 如图37至图39所示,第一图像信号,基于参数表与操作单元185输出的参数z相对应的偏移量所代表的位置上由传感器单元401在该放置位置进行成像, 从而,与参数z相对应的适合于图像转换处理的图像信号就能被获得,相应地,具有更高图像质量的第二图像信号就可获得了。 37 to 39, the first image signal, based on the imaging position parameter table parameter z output from the operation unit 185 corresponding to the shift amount represented by the sensor unit 401 is placed in this position, so that, with z parameter corresponding to the image conversion processing suitable for the image signal can be obtained, respectively, having a higher image quality of the second image signal can be obtained.

注意,通过图42中的学习过程,可以为参数z可假定范围内的一些值获得参数表,因此,存储在图38中所示的参数表存储单元222中的参数表可以不存储与操作单元185输出的参数一样的值。 Note that, through the learning process in FIG. 42, the parameter z can be assumed that some of the values ​​obtained within the range of the parameter table, and therefore, the parameter table stored in the parameter table storage unit 222 shown in FIG. 38 may not be stored in the operating unit as the value of the output parameter 185. 这种情况下,通过对存储在参数表存储单元222中的参数表中的参数和偏移量的线性内插或相似方法,控制信号输出单元221获得与操作单元185 输出的参数相对应的偏移量。 In this case, by linear parameters in the parameter table stored in the table storage unit 222 and the offset parameter interpolation or a similar method, the control unit 221 obtains a signal output unit 185 outputs the operation parameter corresponding to partial shift amount.

接下来,在图42中的步骤S323中的由图41所示的位置确定单元535执行的评估处理将参考图43中的流程图进行描述。 Next, the position 41 shown in FIG. 42 step S323 in FIG determination evaluation unit 535 performs the processing of the flowchart 43 described with reference to FIG.

对于该评估处理,首先,在步骤S330中,存储单元541存储由在前面步骤S322 (图42)图像转换单元534提供的第二图像信号,且相关性计算单元542接收这些第二图像信号。 A second image signal for the evaluation process, first, in step S330, the storage unit 541 stores provided by (FIG. 42) the image converting unit 534 in the previous step S322, and the correlation calculation unit 542 receives the second image signal. 另外,在步骤S330中,相关性计算单元542计算从图像转换单元534提供的第二图像信号和在前一步骤S330中由存储单元541存储的第二图像信号之间的相关值, 流程进入步骤S331。 Further, the second image signal in step S330, the correlation calculating unit 542 calculates the image converting unit 534 provides the previous step S330 and the correlation value between the second image signal stored in the storage unit 541, the flow proceeds to step S331.

在步骤S331中,确定评估单元543临时存储相关性计算单元542 提供的相关值,某种程度上,当用于获得相关值的两个第二图像信号中选择一个时,和偏移量P相关联,流程进入步骤S332。 In step S331, the evaluation unit 543 determines correlation values ​​temporarily stored correlation calculation unit 542, to some extent, when the two image signals for obtaining second correlation values ​​to select one, the offset P and Related joint, the flow proceeds to step S332. 现在,在从用于获得相关性计算单元542提供的相关值的两个第二图像信号中选择一个时,确定评估单元543从图40所示的控制器537获得偏移量P。 Now, when the two select a correlation calculation unit 542 is obtained from the correlation value for providing a second image signal, the evaluation unit determines the offset is obtained from the 543,537 controller shown in FIG. 40 P.

在步骤S332中,对于迄今为止在步骤S331中存储的相关值和偏移量之间的关系,确定评估单元543确定是否已经为相关值获得最大值。 In step S332, the relationship between the correlation value and the offset date stored in step S331, it is determined whether the evaluation unit 543 determines the maximum correlation value has been obtained. 如果步骤S332中确定没有为相关值获得最大值,流程进入步骤S3",确定评估单元543作出效果为第二图像信号是低图像质量的评估,流程返回图42中的步骤S324。 If step S332 determines that no maximum value is obtained, the flow proceeds to step S3 "is the correlation value, the evaluation unit 543 to determine the effect of the second image signal is low image quality evaluation, and the flow returns to step S324 in FIG. 42.

这种情况下,在图42的步骤S324中,确定评估单元543确定没有获得效果为图像质量为高的评估结果,流程进入步骤S325。 In this case, at step S324 in FIG. 42, determination evaluation unit 543 determines that no effect is obtained for the high image quality evaluation result, the flow proceeds to step S325. 在步骤S325中,控制器537向传感器单元531提供与评估结果相对应的用于指定新偏移量的控制信号,并把该偏移量P提供给确定评估羊元543。 In step S325, the controller 537 provides the sensor and the evaluation unit 531 corresponding to the result for designating a new offset control signal, and sends the P offset to the determination evaluation element 543 sheep. 返回图43中的步骤S332,如果在步骤S332中确定已经为相关值获得最大值,流程进入步骤S334,确定评估单元543作出效果为第二图像信号具有高图像质量的评估,流程返回图42中的步骤S324。 FIG 43 is returned in the step S332, if it is determined in step S332 the maximum correlation value has been obtained, the flow proceeds to step S334, determination evaluation unit 543 to evaluate the effect of having high image quality of the second image signal, the flow returns to FIG. 42 the step S324.

这种情况下,在图42的步骤S324中,确定有关其所获的评估结果是图像质量为高的第二图像信号已被获得,流程进入步骤S326。 In this case, in step S324 of FIG. 42, it is determined that the obtained evaluation results relating to the image of the second image signal of a high quality has been obtained, the flow proceeds to step S326. 在步骤S326中,确定评估单元543把所关心的参数值z和在获得评估结果时控制器537提供的偏移量P相关联,即,在有关其所获评估结果的效果为图像质量为高(最佳偏移量)的笫二图像信号相对应而获得的第一图像信号时,代表传感器单元401的放置状态的偏移量P,并且相关的有效参数值z和最佳偏移量被提供和存储在位置存储单元536中。 In step S326, the evaluation unit determines the parameter value z of interest 543 and an associated offset P when the controller 537 provides results of an evaluation, i.e., at about their evaluation results obtained for the effect of high image quality when (optimum offset amount) of the undertaking of the second image signal is obtained corresponding to a first image signal representative of the state of the sensor unit disposed offset 401 P, and the associated valid parameter values ​​and the optimum offset amount z providing and stored in the position storage unit 536.

在前面所述的情况中,根据下述安排进行描述,其中,如果在步骤S332中已经获得相关值的最大值,则做出效果为第二图像信号是高图像质量的评估,但是,也可以作另一种安排,其中如果在步骤S332 中获得一个等于或高于预定阈值的相关值的最大值,则做出效果为第二图像信号是高图像质量的评估。 In the case of the foregoing, according to the following arrangement will be described, wherein, if in step S332 the maximum value of the correlation values ​​have been obtained, the effect is to make the second image signal is a high image quality assessment, however, may be as another arrangement, wherein if in step S332 the maximum value of a correlation value equal to or higher than a predetermined threshold value, the effect is to make the second image signal is a high image quality evaluation.

同样,在前面所述的情况中,根据下述安排进行描述,其中,在基于相关值作出第二图像信号的评估,然而,可以作另一种安排,其中例如,基于有关偏移量PhG、 PvG、 PhB、和PvB的每个值而获得的第二图像信号的S/N等来进行评估。 Also, in the previous case, the arrangement according to the following description, wherein, in the assessment of the second image signal based on the correlation value, however, another arrangement may be made where, for example, based on the relevant offset PhG, PvG, PhB, S / N, etc. and the second image signal obtained PvB each value to be assessed. 另外,第二图像信号的评估可能从外部被输入。 Further, evaluation of the second image signal may be input from the outside. 就是说,例如,可能作一种安排,其中显示第二图像信号,并且例如通过观察所显示图像的用户输出第二图像信号的评估。 That is, for example, an arrangement may be made wherein the displaying the second image signal, and outputs an evaluation example of the user image of the second image signal by observation of the display.

前面描述的由信号处理单元404,图像转换单元534,位置确定单元535、控制器537,等等进行的一系列处理可以由专门的硬件或软件执行。 By the signal processing unit 404, the image converting unit 534 described above, the position determination unit 535, a controller 537, so a series of processing may be performed by dedicated hardware or software. 当用软件来执行该一系列的处理时,参考图17,如前所述,组成该软件的程序将被安装在微型计算机上, 一种通用计算机上,等等。 When the series of processes is performed by software, with reference to FIG. 17, as described above, a program constituting the software is installed on a microcomputer, on a general purpose computer, and the like.

同时注意到,除了前面所述的图像转换处理外,图像转换单元431 和534可以执行获得第二图像信号的处理,比如使第一图像信号经受数字钳位处理,白色均衡调整处理、伽马校正处理、线性内插处理,等等。 Also noted that in addition to the aforementioned image converting processing, image converting unit 431 and 534 may be performed to obtain a second image signal processing, such as the first image signal is subjected to digital clamping process, white balancing adjustment processing, gamma correction processing, linear interpolation processing, and the like.

同样,当现有实施例被描述为传感器单元401和531采用所谓的三-传感器装置,则单-传感器,二-传感器,或四或更多传感器系统可以被应用到传感器单元401和531上。 Similarly, when the embodiments are described conventional sensor units 401 and 531 as a so-called three - sensor means, the single - sensor, di - sensors, or four or more sensor system may be applied to the sensor unit 401 and 531.

此外,当在上述安排中,使用第二图像信号的G信号对该第二图像信号进行评估时,也可以使用R信号或B信号或R, G和B信号中的两个或多个对第二图像信号进行评估。 Further, when the above-described arrangement, using the second image signal, G image signal to the second signal evaluation may be used an R signal or B signal or R, G and B signals in two or more of the first evaluate the second image signal.

第四具体实施例 Fourth embodiment

接下来,本发明的第四具体实施例将参考图44进行描述。 Next, a fourth embodiment of the present invention will be described with reference to FIG. 44. 图44 说明了已应用本发明的图像拾取设备的第四具体实施例的配置实例。 FIG 44 illustrates a configuration example of an image pickup apparatus of the fourth embodiment has particular embodiment of the present invention is applied. 图44所示的图像拾取设备可以是例如数字式静态照相机或摄像机,同图18所示的图像拾取设备。 The image pickup apparatus shown in FIG. 44 may be, for example, a digital still camera or a video camera, an image shown in FIG. 18 with the pickup device.

传感器单元601包括,多个与像素相对应的光电转换元件,用于接收通过未示出的光学系统投射到其中的物体光,并向信号调整单元602提供与该物体光相对应的电信号形式的图像倌号。 The sensor unit 601 includes a plurality of pixels corresponding to the photoelectric conversion element for receiving the projection through the optical system (not shown) to which the object light, and providing an electrical signal in the form of light and the object corresponding to the signal adjusting unit 602 groom image number. 此外,传感器单元601根据信号处理单元604提供的控制信号改变其特性。 Further, the sensor unit 601 to change its characteristics in accordance with a control signal of the signal processing unit 604 is provided.

为消除包含在传感器单元601输出的图像信号中的复位噪音,信号调整单元602执行CDS处理,同图18中的信号调整单元402,并把获得的作为处理结果的图像信号提供给A/D转换单元603。 To eliminate the reset noise included in the image signal of the sensor unit 601 is outputted, the signal adjusting unit 602 performs CDS processing, signal adjusting means the same in FIG. 18 402, and supplies a processing result of an image signal obtained by the A / D converter 603 unit. A/D转换单元603对信号调整单元602提供的图像信号执行A/D转换,同图18中的A/D转换单元403,即,通过采样量化图像信号,并将作为其结果而获得的数字图像信号提供给信号处理单元604。 The image signal A / D conversion unit 603 provides a signal adjustment unit 602 performs the A / D converter, A in FIG. 18 with the A / D conversion unit 403, i.e., the image signal is quantized by the sampling, and as a result thereof obtained digital an image signal to the signal processing unit 604.

信号处理单元604将A/D转换单元603提供的数字图像信号(此后简称为"图像信号")当作第一图像信号,并使第一图像信号经受预定的图像转换处理,并向输出单元605输出做为其结果的数字图信号作为第二图像信号。 The signal processing unit 604 the digital image signal A / D conversion unit 603 is provided (hereinafter simply referred to as "image signal") as a first image signal, and the first image signal is subjected to predetermined image conversion processing to the output unit 605 do as output signal for the second digital image signal results in FIG. 同样,信号处理单元604对一屏的预定区域(一帧或场)中的第一图像信号进行评估,并把控制信号提供给与评估相对应的传感器单元601。 Similarly, a first predetermined region of the image signal processing unit 604 pairs of the signal of one screen (one frame or one field) is evaluated, and a control signal supplied to the evaluation unit 601 corresponding to the sensor. 输出单元605接收信号处理单元604输出的第二图像信号,同图18中的输出单元405,并输出这些第二图像信号。 The output unit 605 receives the second image signal output from the signal processing unit 604, in FIG. 18 with an output unit 405, and outputs the second image signal. 也就是说,输出单元605从未示出的外部终端输出来自信号处理单元604的第二图像信号,或显示在未示出的监视器上。 That is, the output unit 605 never shown external terminal of the second image signal output from the signal processing unit 604 or on a display monitor (not shown). 同样,输出单元605将第二图像信号存储在未示出的记录介质中,诸如光盘、磁盘、磁光盘、磁带,半导体存储器等等,或者通过像电话线、因特网、局域网或其他像电缆或无线传输介质发送这些图像信号。 Similarly, the output unit 605 the image signal stored in the second recording medium (not shown), such as optical disk, magnetic disk, optical disk, magnetic tape, semiconductor memory, etc., or the like via a telephone line, the Internet, LAN or other like wireless or cable a transmission medium transmitting the image signals.

对于上述配置的图像拾取设备来说,在传感器单元601处接收物体光,并通过信号调整单元602和A/D转换单元603将与所接收光量相对应的电信号形式的图像信号提供给信号处理单元604。 For the above-described configuration of the image pickup apparatus, the object light receiving sensor unit 601, and an A / D conversion unit 603 to the signal processing by the signal adjusting unit 602 and the image signal in the form of an electrical signal corresponding to the light amount of the received unit 604. 信号处理单元604使传感器601通过信号调整单元602和A/D转换单元603提供的图像信号作为第一图像信号经受诸如图像转换处理此类的信号处理,并向输出单元605输出藉此已提高图像质量的第二图像信号,该图像转换处理例如通过提高分辨率来提高图像质量。 The signal processing unit 604 as a first image sensor 601 such as an image signal is subjected to conversion processing by the image signal processing such signal adjusting unit 602 and A / D conversion unit 603 is supplied to the output unit 605 outputs the image has increased whereby quality of the second image signal, the image conversion processing, for example, to improve the image quality by improving the resolution. 在输出单元605 中,输出信号处理单元604提供的第二图像信号。 The second image signal output unit 605, an output signal processing unit 604 is provided.

同样,信号处理单元604以其一屏的预定的区域评估来自于传感器单元601的第一图像信号。 Similarly, the signal processing unit 604 in its predetermined area of ​​a screen of a first image signal from the evaluation unit to the sensor 601. 也就是说,信号处理单元604对来自传感器单元601的第一图像信号的每一屏进行评估。 That is, the signal processing unit 604 for each of the first screen image signal from the sensor unit 601 are evaluated. 另外,与该评估相对应,信号处理单元604向传感器单元601提供控制信号。 Further, the evaluation corresponding to the signal processing unit 604 provides a control signal to the sensor unit 601.

与预定区域的第一图像信号相对应,传感器单元601改变一屏(整个感光面)的每个像素的特性。 A first image signal corresponding to the predetermined region, the sensor unit 601 to change the characteristics (the entire photosensitive surface) of each pixel in a screen. 而后,传感器单元601输出从改变特性的像素获得的图像信号。 Then, the sensor unit 601 outputs an image signal obtained from the changing characteristics of the pixel.

接下来,将根据信号处理单元604输出的控制信号,描述传感器单元的特性变化。 Next, according to the control signal output from the signal processing unit 604, the change characteristic of the sensor unit is described. 如前所述,从传感器单元601输出的图像信号在A/C 转换单元603被量化。 As described above, the image signal outputted from the sensor unit 601 in the A / C conversion unit 603 is quantized. 相应地,如果一屏中的预定区域是平面的,相应地,预定区域的图像信号的信号级别的变化是足够小的以适合图45A所示的A/D转换单元603执行的量化中的量化步幅,预定区域中的图像信号在A/D转换单元603处都被量化为同样的值,滤掉微小的变化。 Accordingly, if a predetermined area of ​​the screen is planar, and accordingly, the signal level of the image signal changes in a predetermined region is sufficiently small to fit the quantization shown in FIG. 45A, A / D conversion unit 603 performs the quantization stride image signal, the predetermined region in the a / D conversion unit 603 are quantized to the same value, small changes filtered. 在信号处理单元604上被量化为相同值的数字图像信号上执行图像转换处理不可能产生高分辨率的图像。 Performing an image conversion process can not produce high resolution images on the digital image signal to the signal processing unit 604 is quantized to the same value.

相应地,信号处理单元604为改变传感器单元601的特性提供控制信号,从而改变传感器单元601的特性,以使合适的图像信号可以通过图像转换处理而被输出,即,以使通过图像转换处理能产生高分辨率图像的图像信号能被输出,举例来说。 Accordingly, the signal processing unit 604 to change the sensor cell characteristic 601 provides a control signal to change the sensor unit 601 characteristics, so that an appropriate image signal may be output by the image conversion processing, i.e., so that the image conversion process can high resolution image generated image signal can be output, for example.

也就是说,信号处理单元604对传感器单元601输出的预定区域的图像信号进行评估,并且如果图像信号的信号级别的变化被认为与图45A所示的一样小,传感器单元601的特性将被改变,以便从传感器单元601输出的图像信号的信号级别的变化是较大的,如图45B所示。 That is, an image signal of a predetermined area in the signal processing unit 604 outputs the sensor unit 601 are evaluated, and if the change in the signal level of the image signal is considered to be as small as shown in FIG. 45A, the characteristics of the sensor unit 601 will be changed so the change in the signal level of the image signal output from the sensor unit 601 is large, as shown in FIG 45B. 这种情况下,在其中信号级别的变化明显的图像信号被输入到信号处理单元604,且对此图像信号上进行图像转换处理,从而获得高分辨率的图像。 In this case, in which a significant signal level changes in the image signal is input to the signal processing unit 604, and performs image conversion processing on this image signal, thereby obtaining a high-resolution image.

图46阐明了一种采用变化特性的传感器单元601的配置实例。 Figure 46 illustrates example of a configuration using the characteristic variation of the sensor unit 601. 传感器单元601具有排列在水平和垂直方向大量像素,从而组成了一种感光面。 The sensor unit 601 having a large number of pixels arrayed in horizontal and vertical directions, thereby constituting a light receiving surface. 例如,每个像素都由感光器单元611和控制器单元612组成, 如图46所示。 For example, each pixel is composed of photoreceptor unit 611 and a controller unit 612, as shown in FIG 46.

感光器单元611被配置为例如光电二极管等光电转换设备,以便向控制单元612输出与所接收的光量相对应的电信号。 Photoreceptor unit 611 is configured, for example, a photoelectric conversion device such as a photodiode, so that an electric signal corresponding to the control unit 612 outputs an amount of light received. 控制单元612 是由晶体管等組成的,用于通过预定放大率把来自感光器单元611的电信号进行放大,并输出到信号调整单元602。 The control unit 612 is composed of a transistor, for converting the electric signal from the photosensitive unit 611 is amplified by a predetermined amplification factor, and outputs a signal to the adjustment unit 602. 同样,向控制单元612 提供来自信号处理单元604的控制信号,且控制单元612控制放大率, 由此来自感光器单元601的电信号根据控制信号进行放大。 Similarly, the control unit 612 to provide a control signal from the signal processing unit 604, and the control unit 612 controls the amplification factor, whereby the electric signal from the photosensitive unit 601 amplifies the control signal.

控制单元612根据来自信号处理单元604的控制信号改变放大率做为其特性,以便输出适于在信号处理单元604上进行图像转换处理的具有变化了的信号级别的图像信号。 The control unit 612 changes the amplification factor as its characteristics in accordance with a control signal from the signal processing unit 604 so as to output suitable for image conversion processing to the signal processing unit 604 having a signal level changed image signal.

现在,由像素组成的具有感光器单元611和控制单元612的传感器单元601可以通过在CMOS传感器上应用MEMS技术被配置,举例来说。 Now, the unit 611 is composed of pixels and a control unit 601 having a photosensitive sensor unit 612 may be configured by applying the MEMS technology on the CMOS sensor, for example. 然而,应该理解,传感器单元601决不限于CMOS传感器, 其也可以使用CCD,或HARP来替换,该HARP是利用发生在a-Se半导体的光电导靶中的电子雪崩现象的显象管。 However, it should be appreciated that the sensor unit 601 in no way limited to a CMOS sensor, which may be used the CCD, or replaced HARP, HARP is the kinescope electron avalanche phenomenon occurs in the use of a-Se photoconductive semiconductor target is. 同样,传感器单元601 也可以由具有放大单元的设备组成,该放大单元用于为整个的或者一 Similarly, the sensor unit 601 may be composed of a device having amplifying unit, the amplifying unit is used for the whole or a

个或更多像素的递增放大图像信号,以便根据控制信号改变放大单元的i文大率。 Or more pixels of the enlarged image signal increments to enlarge the text i magnification change unit based on the control signal.

接下来,图47阐明了一种对图44中所示的信号处理单元604的配置实例。 Next, FIG. 47 illustrates the configuration example of a signal processing unit 44 shown in FIG 604. 在图47中,信号处理单元604包括,图像转换单元621, 图像校正单元622,和级别评估单元623。 In Figure 47, the signal processing unit 604 comprises an image conversion unit 621, the image correction unit 622, and a level evaluating unit 623.

从传感器单元601输出的图像信号通过信号调整单元602和A/D 转换单元603提供给信号处理单元604作为第一图像信号。 Image signal output from the sensor unit 601 provided by the signal adjusting unit 602 and A / D conversion unit 603 to the signal processing unit 604 as a first image signal. 该笫一图像信号被提供给图像转换单元621和级别评估单元623。 The undertaking of an image signal is supplied to the image converting unit 621 and evaluation unit 623 levels.

图像转换单元621使第一图像信号经受图像转换处理以提高图像质量,例如诸如提高分辨率,并将提高质量的数字图像信号做为第二图像信号提供给图像校正单元622。 Image converting unit 621 causes the first image signal is subjected to image conversion processing to improve image quality, such as increase the resolution and improve the quality of the second digital image signal as an image signal to the image correction unit 622.

已经向图像校正单元622提供来自图像转换单元621的第二图像信号,以及来自级别评估单元623的放大率信息和区域信息。 The second image signal has been provided from the image converting unit 621 to the image correction unit 622, and the magnification information and area information from the level evaluating unit 623. 基于由级别评估单元623提供的放大率信息和区域信息,图像校正单元622 校正来自图像转换单元621的第二图像信号,并将校正后的第二图像信号提供给输出单元605。 Based on the magnification information and the area information supplied from the level evaluating unit 623, the image correction unit 622 corrects the second image signal from the image converting unit 621, and supplies the corrected second image signal to the output unit 605.

级别评估单元623通过一屏的一部分的预定区域来评估第一图像信号。 Level evaluating unit 623 evaluates the first image signal to a predetermined area of ​​a portion of a screen. 另外,级别评估单元623确定放大率,由此图46所示的控制单元执行放大操作,并且把指示放大率的放大信息,和指示执行评估的区域的区域信息提供给图像校正单元622。 Further, the evaluation unit 623 determines the magnification level, thereby performing the control unit shown in FIG. 46 amplification operation, and the zoom magnification information indicates, and the area information indicating the evaluation is performed to the image correction unit 622. 同样,做为控制信号,级别评估单元623把放大信息提供给控制单元612的组成预定区域的像素,其出自组成传感器单元601的像素。 Similarly, as the control signal, the evaluation unit 623 amplifies the level information of pixels to the predetermined region of the control unit 612, by which the sensor unit 601 is composed of pixels.

也就是说,级别评估单元623评估在一屏中的每个区域的第一图像信号是否适合图像校正单元621的图像校正处理。 That is, the level evaluating unit 623 evaluates the first image signals in each area of ​​a screen is suitable for image correction processing unit 621 of the image correction. 特别地,级别评估单元623识别每个预定区域的第一图像信号的信号级别(亮度或颜色),并评估信号级别变化是大还是小。 In particular, the signal level (brightness or color) of the first image signal level for each predetermined area evaluation unit 623 to identify and evaluate the signal level variation is large or small. 另外,在有关所获评估为信号级别的变化太小时,级别评估单元623为组成区域的像素的放大率制定一个较大值,并且同样在有关所获评估为信号级别的变化太大时, Further, in the evaluation of the signal obtained about the change in level is too small, the level of the evaluation unit 623 to develop a larger value as the amplification factor of the pixel region composed, and also obtained the relevant evaluation signal level is changed too much,

级别评估单元623为组成区域的像素的放大率制定一个较小值,并把代表放大率的放大信息提供给每个区域的像素的控制单元612(图46) 做为控制信号。 Level evaluating unit 623 to develop a small value of the amplification factor of the pixel region composed, and supplies information representing the zoom magnification to the pixels of each region of the control unit 612 (FIG. 46) as the control signal.

如图46中所示的控制单元612,感光器单元611的输出信号以来自级别评估单元623的控制信号的放大率进行放大,相应地,适合在图像转换单元621上进行图像转换处理的具有信号级别变化的图像信号从传感器单元601输出。 Amplification factor control unit 612 shown in FIG. 46, the output signal of the photoreceptor unit 611 to the level of the control signal from the evaluation unit 623 amplifies, accordingly, is suitable for image conversion processing on the image signal conversion unit 621 having a image signal level change in the output from the sensor unit 601.

另一方面,在级别评估单元623处,被做为控制信号提供给传感器单元601的控制单元612的放大率信息,和表示按由放大信息代表的放大率执行放大操作的像素所组成的区域的区域信息被相互关联, 并被提供给图像校正单元622。 On the other hand, at the level of the evaluation unit 623, a control signal is provided as the sensor unit to the amplification factor control unit 601 information 612, indicating the area according to the pixel information representing the magnification ratio of an enlarged performs amplification operations consisting of regional information are associated with each other, and is supplied to the image correction unit 622. 图像校正单元622,根据由级别评估单元623提供的放大率信息和区域信息,校正由图像转换单元621使第一图像信号经受图像转换处理而获得的第二图像信号。 The image correction unit 622, according to the magnification ratio information and the area information supplied from the level evaluating unit 623 corrects the first image signal by the image converting unit 621 is subjected to image conversion processing to obtain a second image signal.

也就是说,通过与和区域信息有关的放大率信息所表示的放大率相对应的增益,区域信息指示区域的第一图像信号的值和从传感器单元601的感光器单元611输出的信号的值不同。 That is, the value of the signal amplification factor by the magnification information and area information corresponding to the indicated gain values ​​of the first image signal and the region information indicating a region of the sensor unit 601 from the output of the photoreceptor unit 611 different. 相应地,图像校正单元622校正该区域的第二图像信号,该区域的区域信息由和区域信息有关的放大信息所指示的放大率所代表,以便产生能获得与图像信号本应获得的增益相同的第二图像信号,这通过对从传感器单元601的感光器单元611输出的信号进行图像转换处理而获得。 Accordingly, the image correction unit 622 corrects the second image signal of the area, the area information of the area represented by the area information and the magnification information about an enlarged as indicated, the gain can be obtained so as to generate an image signal obtained by the same should second image signal, which is obtained by performing image conversion processing on the signal output from the photoconductor unit 611 from the sensor unit 601. 特别地,通过和区域信息有关的放大信息指示的放大率成比例的值来衰减增益,图像校正单元622校正区域信息指示的区域的第二图像信号。 In particular, the gain is attenuated, the image correction unit area of ​​the second image signal 622 of correction region information indicating a value proportional to the magnification and the amplification related information indicated by the area information.

注意,通过级别评估单元623,做为评估增量的预定区域可以是这个屏幕(区域的帧),或由单个或多个像素组成的区域。 Note that, the evaluation unit 623 by a level of, as the predetermined increment regional assessment may be the screen (frame area), or by a single region or a plurality of pixels.

现在,在级别评估单元623处,如果做为评估增量的预定区域是一个像素或多个像素,但不是整个一屏,对第一图像信号的图像转换处理在图像转换单元621进行,该第一图像信号对每个预定区域有不同的放大率。 Now, at the level of the evaluation unit 623, as if a predetermined increment evaluation area is a pixel or a plurality of pixels, but not the entire one screen, the image processing converts the first image signal in the image conversion unit 621, the second an image signal for each different magnification predetermined area. 当在图像转换单元621实施不同类型的计算时,如果计算是对具有不同放大率的第一图像信号来执行,则在执行计算时有必要考虑放大率的不同。 When different types of computing embodiment in the image converting unit 621, if the calculation is performed on a first image signal having different magnifications, it is necessary to consider when performing calculations at different magnifications. 这里,为了简化描述,让我们假设在级别评估 Here, in order to simplify the description, let us assume that the level of assessment

单元623处将要做为评估增量的预定区域为整个屏幕。 Unit 623 at a predetermined regional assessment will be done for the entire screen increments.

接下来,图48阐明了图47中所示的级别评估单元623的第一配置实例。 Next, FIG. 48 illustrates a configuration example of a first level evaluation unit 623 shown in FIG. 47. 在图48中,级别评估单元623由评估像素提取单元631,占用程度计算单元632,和放大率确定单元633组成。 In Figure 48, the level of evaluation by the evaluation unit 623 extracts the pixel unit 631, the degree of occupancy calculation unit 632, determination unit 633, and the magnification composition.

向评估像素提取单元631提供来自传感器单元601的第一图像信号,经由信号调整单元602和A/D转换单元603到信号处理单元604。 Providing a first image signal from the sensor unit 601 to the evaluation pixel extraction unit 631, 603 via signal adjusting unit 602 and A / D conversion unit 604 to the signal processing unit. 评估像素提取单元631提取被用作评估笫一图像信号的一屏的像素做为评估像素,并把这些提供给占用程度计算单元632。 Evaluation pixel extraction unit 631 extracts a pixel is used to assess a screen image signal Zi as evaluation pixels and provide them to the level of occupancy calculation unit 632. 占用程度计算单元632计算作为评估增量的一屏上的评估像素的占用程度,并把这个提供给放大率确定单元633。 Occupancy calculation unit 632 calculates the degree of fullness as evaluation pixels on a screen of the evaluation increment, and this determination is supplied to the amplification unit 633.

在放大率确定单元633,根据占用程度计算单元632提供的占用程度,作为评估增量的一屏的第一图像信号被评估,且确定一个与评估相对应的放大率作为与传感器单元601的一屏的图像信号相对应的像素的控制单元612的放大率。 Magnification determining unit 633, the degree of occupancy calculation unit 632 provides the degree of occupancy, it is evaluated as Evaluation of the incremental first image signal of one screen, and determines a corresponding amplification and evaluation of the sensor unit 601 as a magnification screen image signals corresponding to the pixels of the control unit 612. 另外,放大率确定单元633把指示这个放大率的放大率信息提供给传感器单元601 (或其控制单元612 )做为控制信号。 In addition, the magnification unit 633 determines the magnification ratio information indicating the magnification provided to the sensor unit 601 (or a control unit 612) as the control signal. 另外,放大率确定单元633把放大率信息和代表一屏的区域信息相关联提供给图像校正单元622,该区域以由放大率信息所指示的放大率进行放大操作的像素组成(图47)。 Further, the magnification determining unit 633 represents a screen magnification ratio information and area information associated to the image correction unit 622, the pixel region to zoom magnification by the magnification ratio information in the indicated (Figure 47).

接下来,图44中所示的图像拾取设备的操作将参考图49中的流程图进行描述。 Next, operation of the image pickup apparatus shown in FIG. 44 with reference to the flowchart in FIG. 49 will be described.

对于该图像拾取设备,首先,在步骤S401中,传感器单元601 的感光器单元611接收物体光并进行光电转换,从而获得电信号信号形式的第一图像信号(使物体成像),控制单元612以预定的放大率放大该图像信号,被放大的信号提供给信号调整单元602,流程进入步骤S402。 For the first image signal of the image pickup apparatus, first, in step S401, the sensor unit 601 of the photosensitive unit 611 receives the object light and a photoelectric conversion to obtain a signal in the form of an electric signal (an object image), the control unit 612 to a predetermined amplification factor of the image signal, the amplified signal to the signal adjustment unit 602, the flow proceeds to step S402. 注意,如果是在打开图像拾取设备的电源后第一次采集图像,传感器单元601的控制单元612的放大率是一个默认值。 Note that, in the case of the first collected after power magnification image of the image pickup apparatus, the sensor unit 601 the control unit 612 is a default value.

在步骤S402中,信号调整单元602使传感器单元601提供的一屏图像信号经受信号调整,如CDS处理,然后把这些提供给A/D转换单元603,且流程进入步骤S403。 In step S402, the signal adjusting unit 602 so that the image signal of one screen is subjected to the sensor unit 601 provides signal conditioning, such as CDS processing, and then provide them to the A / D conversion unit 603, and the flow proceeds to step S403. 在步骤S403中,A/D转换单元603 使来自信号调整单元602的一屏图像信号经受图像转换,然后做为第一图像信号提供给信号处理单元604,且流程进入步骤S404。 In step S403, A / D conversion unit 603 so that a screen image signal from the signal adjusting unit 602 is subjected to image conversion, and the signal processing unit as a first image signal to 604, and the flow proceeds to step S404.

在步骤S404中,信号处理单元604 (图47)的级别评估单元623 对由A/D转换单元603提供的一屏第一图像信号进行评估,并为图46 中所示的控制单元612确定放大率。 In step S404, the signal processing unit 604 (FIG. 47) of the evaluation unit 623 pairs the level of a first screen image signal supplied from the A / D conversion unit 603 is evaluated, and the control unit 612 determines as shown enlarged in FIG. 46 rate. 另外,在步骤S404中,级别评估单元623把指示其放大率的放大信息,和指示与评估被执行有关的一屏的区域信息提供给图像校正单元622,并把放大率信息提供给组成传感器601的一屏的像素的控制单元612做为其控制信息,且流程进入步骤S405。 Further, in step S404, the level evaluating unit 623 information indicating the zoom magnification thereof, and evaluation is performed, and indicating a screen area information relating to the image correction unit 622, and supplies the information to the magnification of the sensor composition 601 pixels of one screen control unit 612 as its control information, and the flow proceeds to step S405. 现在,在步骤S404中进行的详细处理将稍后^^皮描述。 Will now be described in detail later ^^ skin processing performed in step S404.

在步骤S405中,传感器单元601中的每个像素的控制单元612 控制放大率,由此,根据在先前步骤S404中级别评估单元623提供的控制信号,感光器单元611的输出被放大了,且流程进入步骤S406。 In step S405, the sensor unit 601 in each pixel 612 controls the amplification factor of the control unit, whereby the control signal level in the previous step S404 the evaluation unit 623 provides the output of the photoreceptor unit 611 is magnified, and flow advances to step S406.

在步骤S406中,由信号处理单元604 (图47)的图像转换单元621执行关于A/D转换单元603提供的第一图像信号的图像转换处理, 具有在第一图像信号上提高了图像质量的第二图像信号被提供给图像校正单元622,且流程进入步骤S407。 In step S406, the signal processing unit 604 (FIG. 47) of the image converting unit 621 performs image conversion processing on a first image signal A / D conversion unit 603 is provided, with improved image quality on the first image signal, the second image signal is supplied to the image correction unit 622, and the flow proceeds to step S407.

在步骤S407中,基于在先步骤S404中的级别评估单元623提供的放大率信息和区域信息,图像校正单元622对图像转换单元621提供的图像信号进行校正,已被校正的第二图像信号被提供给输出单元605,且流程进入步骤S408。 In step S407, the magnification information and area information based on the previous level evaluating unit 623 provided in the step S404, the image correcting unit 622 on the image signal supplied image converting unit 621 corrects the second image signal has been corrected to the output unit 605, and the flow proceeds to step S408.

在步骤S408中,输出单元605输出由信号处理单元604的图像校正单元622提供的第二图像信号,因而,完成有关一屏图像的处理。 In step S408, the second image signal output unit 605 output provided by the image correction unit 622 of the signal processing unit 604, therefore, processing relating to a screen image is completed. 也就是说,对于图44中的图像拾取设备,重复根据图49中一个图像屏幕的处理的流程,直到例如用户下达停止图像拾取的命令。 That is, in FIG. 44 for an image pickup apparatus, according to the flow process is repeated in a screen image of FIG. 49, until the stop command is issued, for example, a user of the image pickup.

相应地,在接下来的步骤S401中,从传感器单元601的感光器单元611输出的图像信号以前面的处理的步骤S404中所控制的放大率进行放大,相应地,适合图像转换处理的笫一图像信号被提供给图像转换单元621。 Accordingly, at the next step S401, the image signal output from the photoreceptor unit 611 from the sensor unit 601 is amplified at the amplification factor of the foregoing process of step S404 is controlled, and accordingly, an image conversion process for the Zi the image signal is supplied to the image converting unit 621.

接下来,图49中的步骤S404的评估处理将参考图50中的流程图进行描述,首先,在步骤S421中的评估处理中,级别评估单元(图48)的评估像素提取单元631从作为评估增量的组成一屏的像素中提取像素作为评估像素,用于评估该屏的笫一图像信号的像素。 Next, in step S404 of FIG. 49 to evaluate the processing reference to the flowchart in FIG. 50 will be described, first, the evaluation process in step S421, the level evaluating unit (48) from the evaluation pixel extraction unit 631 as an evaluation pixel increments of one screen composed of pixels extracted as the evaluation pixels for an image signal pixel Zi evaluation of the screen. 这就是说,评估像素提取单元631从组成一屏的像素中提取例如具有比第一级别要高的第一图像信号级别的像素,和具有比第二级别要低的级别的像素做为评估像素。 That is, the evaluation pixel extraction unit 631 extracts, for example, a pixel having a level higher than the first level of a first image signal from pixels of a screen, and a pixel having a level higher than the second level as evaluation pixels .

现在,对于笫一级别, 一个接近和等于或比笫一图像信号可以假定的最大值要小的值可以被使用。 Now, for a level Zi, and a close or equal to a ratio of Zi can be assumed that the maximum value of the image signal to be a small value can be used. 同样,对于第二级别, 一个接近和等于或比第一图像信号可以假定的最小值要大的值可以被使用。 Similarly, for the second level, and nearly equal to a ratio of the first image signal or the minimum value can be assumed to be a large value can be used. 在下面的描述中,第一图像信号中具有比第一级别高的级别的像素将视情况称为"高级别像素,,,并且第一图像信号中具有比第二级别低的级別的像素视情况称为"低级别像素,,。 In the following description, the pixel, the pixel having the first image signal level higher than the first level will be optionally referred to as "high-level pixel signal ,,, and the first image having a lower level than the second level as the case known as "low-level pixel ,,.

在步骤S421中,评估像素提取单元631从做为评估增量的组成一屏的像素中,提取高级别像素和低级别像素做为评估像素,并把该评估像素提供给占用程度计算单元632,且流程进入步骤S422。 In step S421, the evaluation of pixels from the pixel extraction unit 631 as a screen composed of incremental evaluation, the extraction of high-level and low-level pixels as the pixel evaluation pixels and the pixel is provided to evaluate the level of occupancy calculation unit 632, and the flow proceeds to step S422.

步骤S422中,在作为评估增量的一屏中,占用程度计算单元632 计算由评估像素提取单元631在步骤S421提供的每个高级别像素和低级别像素的占用比率,作为高级别占用程度和低级别占用程度,把它们提供给放大率确定单元633,且流程进入步骤S423。 In step S422, it increments the evaluation as a screen, a high level of occupancy level is calculated for each pixel and the occupancy ratio of the low-level pixel by the evaluation unit 632 calculates the pixel extraction unit 631 provided in a step S421, and the high-level fullness low level of occupancy level, supplies them to the amplification factor determination unit 633, and the flow proceeds to step S423.

在步骤S423中,根据占用程度单元632提供的高级别占用程度和低级别占用程度,放大率确定单元633对作为评估增量的一屏第一图像信号进行评估,且依据该评估确定放大率做为与一屏图像信号相对应的像素的控制单元612的放大率。 In step S423, the degree according to the high-level and low-level occupancy fullness fullness unit 632 is provided, the amplification factor determination unit 633 performs the increment evaluation as an evaluation of the first image signal of one screen, and the magnification is determined according to the evaluation done a screen control unit and the image signal corresponding to pixels of 612 magnification.

也就是说,如果高级别占用程度足够大于低级别占用程度,这意味着在一屏中存在着大量的高级别像素,所以放大率确定单元633做出的评估为一屏的第一图像信号不适合于在图像转换单元621进行图像转换处理,且给放大率确定了一个比当前值低的值做为控制其单元612的放大率。 That is, if a sufficiently high level of fullness is greater than the low-level occupancy levels, which means there are a lot of high-level pixels in a screen, so the magnification is determined to make an evaluation unit 633 of the first image signals of one screen is not suitable for image conversion processing in the image converting unit 621, and determines the magnification to a magnification as a control unit 612 which is lower than the current value. 同样,如果低级别占用程度足够大于高级别占用程度, 这意味着在一屏中存在着大量低级别像素,所以放大率确定单元633 做出的评估为一屏的第一图像信号不适合于在图像转换单元621进行图像转换处理,且给放大率限定了一个比当前值高的值做为控制其单元612的放大率。 Similarly, if a sufficiently low level of fullness is greater than the occupancy level of the high-level, which means there are a lot of low-level pixels in one screen, the evaluation made by the magnification determining unit 633 as a first image signal of one screen is not suitable for image converting unit 621 performs image conversion processing, and to define a magnification as the magnification control unit 612 which is higher than the current value. 否则,放大率确定单元633做出的评估为, 一屏的第一图像信号适合于在图像转换单元621的图像转换处理,且给放大率确定了一个先前值做为控制其单元612的放大率。 Otherwise, the evaluation unit 633 magnification determination is made, the first image signal of one screen suitable for image conversion processing in the image converting unit 621, and determines a magnification to previous value as the amplification factor control unit 612 which .

在步骤S423中,放大率确定单元633提供指示预定放大率的放大信息给传感器单元601 (或其控制单元612)做为控制信号,并且把放大率信息和指示以一屏为区域的区域信息相关联,提供关联的放大率 In step S423, the determination unit 633 provides an amplified amplification factor information indicating a predetermined amplification factor to the sensor unit 601 (or a control unit 612) as the control signal, and the magnification ratio information indicating a region in a screen related information region Union, and provide the associated magnification

信息和区域信息给图像校正单元622 (图47),该区域以由放大率信息所指示的放大率进行放大操作的像素组成,且流程返回。 Pixel information and area information to the image correction unit 622 (FIG. 47), the region amplified by the amplification factor a magnification operation information indicated composition, and the flow returns.

这种情况下,在图像转换单元621处具有图像转换处理的合适级别的图像信号从传感器单元601被输出,接下来,具有更高图像质量的第二图像信号能从图像转换处理过程中得到。 Suitable levels of the image signal in this case, an image conversion process in the image converting unit 621 is outputted from the sensor unit 601, then, it has a higher image quality from the second image signal obtained by the image conversion processing. 应该注意,可以作一种安排,即仅为高级别像素确定一个低放大率时,和仅为低级别像素预定一个高放大率。 It should be noted, can make an arrangement that only high-level pixel to determine when a low magnification, and only low-level pixel is to be a high magnification.

如图49所示的安排,在步骤S401中,传感器单元601将感光器单元611输出的图像信号以在前面步骤S404控制的放大率进行放大, 所以传感器单元601的当前帧或场的图像信号以由被评估的当前帧或场的图像所确定的放大率进行放大。 Arrangement shown in FIG. 49, in step S401, the sensor unit 601 of the image signal outputted from the photoreceptor unit 611 to control the amplification factor in the previous step S404 is amplified, the sensor unit 601 of the image signal of a current frame or field to the image of the current frame or field to be evaluated on the determined amplification rate. 另一方面,可以作一种安排,其中在传感器单元601处以由被评估的当前帧或场的图像所确定的放大率放大当前帧或场的图像信号。 On the other hand, an arrangement may be made wherein the image sensor unit 601 imposed by the current frame or field is determined by evaluation of the image signal amplification factor of the current frame or field.

现在,图44中所示的图像拾取设备的操作,将参考一种情况被描述,该情况是传感器单元601处以由被评估的该帧或场的图像所确定的放大率放大当前帧或场的图像信号。 Now, the image shown in FIG pickup operation of the device 44, is described with reference to a situation, where the sensor unit 601 is imposed by the frame or field of the image is evaluated to determine the amplification factor of the current frame or field The image signal. 这种情况下,图51的步骤S431 到S435执行与图49步骤S401到S435相同的处理,且流程进入步骤S436。 In this case, the same processing as step S401 to S435 to S431 of FIG. 51 and FIG. 49 performs step S435, and the flow proceeds to step S436.

在步骤S436中,与图49中的步骤S401相对应的步骤S431,传感器单元601的感光器单元611接收物体光并执行光电转换,从而获得电信号形式的第一图像信号。 In step S436, the steps corresponding to FIG. 49 S401 step S431, the sensor unit 601 of the photosensitive unit 611 receives the object light and performs photoelectric conversion to obtain a first electrical signal in the form of an image signal. 另外,在步骤S636中,控制单元612 以在前步骤S635所控制的放大率来放大由感光器单元611获得的图像信号,并把放大的图像信号经由信号调整单元602和A/D转换单元603 提供给信号处理单元604,且流程进入步骤S437。 Further, in step S636, the control unit 612 to control the amplification factor of the previous step S635 to enlarge an image signal obtained by the photoreceptor unit 611, and the amplified image signal via signal adjusting unit 602 and A / D conversion unit 603 to the signal processing unit 604, and the flow proceeds to step S437.

流程由步骤S437按顺序进行到步骤S439,由此,执行和图49中的步骤S406到S408相同的处理过程,从而完成一帧或场的图像的处理。 Process by step S437 in order to step S439, whereby step S406 in FIG. 49 and performs the same processing to S408, thereby completing the processing image of one frame or field. 根据图51中的流程图,重复采用图44所示的图像拾取设备的处理,直到例如用户下达停止图像拾取的命令。 The flowchart in Figure 51, the processing is repeated use of the image pickup apparatus shown in FIG. 44, until the stop command is issued, for example, a user of the image pickup.

图51中的流程图的处理中,在步骤S431和S436中,传感器单元601在一帧或场的循环中执行两次图像拾取。 The process of the flowchart in FIG. 51, in step S431 and S436, the sensor unit 601 performs the image pickup twice in one cycle or in the field. 在步骤S434中,第一次拾取的图像信号被评估,基于评估结果在步骤S435确定第二次拾取的图像信号的放大率。 In step S434, the first picked up image signal is evaluated based on the evaluation result of the determination signal is the image magnification of the second picked up in the step S435. 相应地,在传感器单元601,由当前区域的帧的第二次成像获得的图像信号以通过对第一次成像所获得的图像信号进行评估来确定的放大率进行放大。 Accordingly, the magnification, the sensor unit 601, an image signal obtained by imaging a second region of the current frame to be evaluated by the first image signal obtained by imaging amplified determined.

注意,根据图49中的流程图的处理,对于单帧(场),传感器单元601只需要执行一次成像,但根据图51中的流程图的处理,对于单帧(场),传感器单元601需要执行至少两次成像。 Note that, according to the process of the flowchart in FIG. 49, for a single frame (field), the sensor unit 601 performs an image only, but the process according to the flowchart of FIG. 51, for a single frame (field), the sensor unit 601 need imaging performed at least twice.

接下来,图52阐明了图47中的级别评估单元623的另一种安排。 Next, FIG. 52 illustrates another arrangement level evaluating unit 623 in FIG. 47. 图52中,级别评估单元623包括一种活动性计算单元641和一种放大率确定单元642。 52, the level evaluating unit 623 comprises an activity computing unit 641 determination unit 642 and one magnification.

经过A/D转换单元603和信号调整单元602,由传感器单元601 提供到信号处理单元604的第一图像信号提供给活动性计算单元641。 After A / D conversion unit 603 and a signal adjusting unit 602, provided by the sensor unit 601 to the first image signal processing unit 604 is supplied to the activity calculating unit 641. 活动性计算单元641计算作为评估增量的一屏中的第一图像信号的活动性,并把算得的活动性提供给放大率确定单元642。 Activity calculation unit 641 calculates a first activity as a screen image signal of the evaluation increment, and the calculated activity determination unit 642 is supplied to the magnification.

现在, 一个可以采用的一屏的第一信号的活动性的一个实例可以是一屏(即,动态范围)的第一图像信号的最大和最小值的差,第一图像信号中的相邻像素的之差的绝对值的总和, 一屏中的第一图像信号的差值,等等。 Now, an example of the activity of a first signal may be employed a screen may be a screen (i.e., dynamic range) of the difference between the maximum and minimum values ​​of the first image signal, the image signal of adjacent pixels in the first sum of absolute values ​​of the difference, the difference between the first image signal of one screen, and the like. 放大率确定单元642对作为评估增量的一屏中的第一图像信号进行评估,并确定与其评估相对应的放大率作为与传感器单元601的一屏图〗象信号相对应的像素的控制单元612的i文大率。 Amplification factor determining unit 642 the first image signal of one screen in increments as the evaluation to assess and evaluate its amplification factor determined as the sensor unit corresponding to one screen 601 of FIG〗 image signal corresponding to the pixel control unit 612 i text magnification.

也就是说,例如如果从活动性计算单元641得到的活动性很大, 做出的评估为一屏的第一图像信号不适合于在图像转换单元621进行的图像转换处理,所以放大率确定单元642确定一个较当前放大率低的放大率作为控制单元612的放大率。 That is, if, for example, obtained from the activity computing unit 641 great activity, the assessments made of a first image signal of one screen is not suitable for image conversion processing performed in the image conversion unit 621, the amplification factor determination unit 642 determines a relatively low current amplification factor as the amplification control unit 612 of the amplification factor. 同样,例如如果从活动性计算单元641得到的活动性很小,做出的评估为一屏的第一图像信号不适合于在图像转换单元621进行图像转换处理,所以放大率确定单元642 确定一个较当前放大率高的放大率作为控制单元612的放大率。 Similarly, for example, if the activity resulting from the activity computing unit 641 is small, the evaluation was made in the first image signal of one screen is not suitable for image conversion processing in the image converting unit 621, the determination unit 642 determines a magnification amplifying the current amplification factor than the rate control unit 612 as amplification. 另外, 如果从活动性计算单元641得到的活动性既不大也不小,做出的评估为一屏的第一图像信号适合于在图像转换单元621进行图像转换处理,所以放大率确定单元642确定当前放大率作为控制单元612的i文大率。 Further, if the activity resulting from the activity computing unit 641 is neither large nor small, evaluation is made in the first image signal of one screen suitable for image conversion processing in the image converting unit 621, the amplification factor determination unit 642 determining a current amplification factor as described magnification control unit 612 i.

放大率确定单元642把所确定的放大率所指示的放大信息提供给传感器单元601 (其控制单元612 )做为控制信号,同样把放大信息和指示一屏的区域信息相关联,该区域由放大率信息所指示的放大率进行放大操作的传感器单元601的像素组成,且该关联的放大率信息和区域信息被提供给了图像校正单元622 (图47)。 Amplifying the determined information unit 642 magnification indicated by the magnification provided to the sensor unit 601 is determined (which is the control unit 612) as the control signal, the same information associated with an enlarged area information indicating a screen, by the amplification of the region the sensor unit 601 magnification rate information indicates amplifying operation of pixels, and the magnification ratio information and the associated information area is provided to the image correction unit 622 (FIG. 47).

这种情况下,同样,在图像转换单元621具有图像转换处理的合适级别的图像信号被从传感器单元601输出,而后,具有更高图像质量的第二图像信号就能从图像转换处理获得了。 Suitable levels of the second image signal the image signal in this case as well, the image conversion unit 621 converts an image processing unit 601 is outputted from the sensor, then, it has a higher image quality can be obtained from the image conversion processing.

接下来,图53阐明了图47所述的级别评估单元623的第三配置安排。 Next, FIG. 53 illustrates the configuration of the third-level arrangement of the evaluation unit 623 of FIG. 47. 在图53中,级别评估单元由比较单元651和放大率确定单元652配置。 In Figure 53, the evaluation unit determines the level of unit 652 is configured by a comparison unit 651 and the magnification.

经过A/D转换单元603和信号调整单元602,从传感器单元601 提供给信号处理单元604的第一图像信号被提供给比较单元651。 After A / D conversion unit 603 and the signal adjustment unit 602, the sensor unit 601 from the comparison unit 651 is supplied to a first image signal processing unit 604 is supplied to. 比较单元651把作为评估增量的一屏的第一图像信号和预定的阔值进行比较,并把比较结果提供给放大率确定单元652。 The comparison unit 651 compares the image signal of one screen as the first increment evaluation value and a predetermined width, and the comparison result to the determination unit 652 magnification. 和笫一图像信号进行比较的阈值的例子是第一阔值,它是为图像转换单元621的图像转 Examples of an image signal Zi and a threshold value to be compared is a first value width, which is transferred to the image converting unit 621 of the image

换处理目的的一个较小的值,第二阈值是对图像转换处理来说的较大的值。 Conversion processing purpose a small value, the second threshold value is a large value for the image conversion processing.

同样,在比较单元651中与第一和第二阈值进行比较的第一图像信号的例子包括,作为评估增量的一屏的任意第一图像信号,在一屏上拥有最大数量的像素数目的第一图像信号,第一图像信号在一屏上的平均值,等等。 Also, examples of the first image signal is compared in the comparison unit 651 with the first and second threshold comprises a screen as an arbitrary increment a first evaluation image signal has the maximum number of the number of pixels in a screen a first image signal, the first image signal on a screen of an average value, and the like.

根据与比较单元651提供的阈值进行比较的结果,放大率确定单元652评估作为评估增量的一屏第一图像信号,且确定与评估相对应的放大率作为与一屏图像信号相对应的像素的控制单元612的放大率。 The results were compared with a threshold value according to the comparison unit 651 is provided, the amplification factor determination unit 652 increments the evaluation as an evaluation of the first image signal of one screen, and the setting and evaluation as a magnification corresponding to the image signal corresponding to a screen pixel the amplification factor control unit 612.

也就是说,如果比较单元651的比较结果指示第一图像信号等于和低于第一阈值,放大率确定单元652做出评估为一屏的第一图像信号不适合图像转换单元621进行图像转换处理,并基于评估确定一个比当前值要高的放大率值做为控制单元612的放大率。 That is, if the comparison unit 651 of the comparison result indicates that the first image signal is equal to a first threshold value and below, to assess the amplification factor determination unit 652 is the first image signal is not suitable for a screen image converting unit 621 performs image conversion processing and a determination based on an evaluation value of the current amplification factor higher than the value as the amplification factor control unit 612. 同样,如果比较单元651的比较结果指示第一图像信号等于和高于第二阈值,放大率确定单元652做出评估为一屏的第一图像信号不适合图像转换单元621进行图像转换处理,并基于评估确定一个比当前值要低的放大率值做为控制单元612的放大率。 Similarly, if the comparison unit 651 indicates that the first comparison result and the image signal is equal to higher than the second threshold value, the amplification factor determining unit 652 to make a first evaluation image signals of one screen is not suitable for image conversion unit 621 performs image conversion processing, and a determination based on an evaluation value of the current amplification factor lower value as the control unit 612 magnification ratio. 另外,如果比较单元651的比较结果指示第一图像信号在第一阈值和第二阈值的范围内,放大率确定单元652做出评估为一屏的第一图像信号适合图像转换单元621进行图像转换处理,并基于评估确定当前值做为控制单元612的放大率。 Further, if the comparison unit 651 of the comparison result indicates that the first image signal within a first range threshold and the second threshold value, the amplification factor determination unit 652 adapted to assess the image converting unit 621 converts an image into a first image signal of one screen process, and as the value of the current amplification factor control unit 612 determines based on the evaluation.

然后放大率确定单元652把指示所确定的放大率的放大率信息提供给传感器单元601 (其控制单元612)做为控制信号,同样,把放大率信息和指示一屏的区域信息相关联,该区域由放大率由放大率信息指示的放大率进行放大操作的传感器单元601的像素所组成,且相关的放大率信息和区域信息被提供给图像校正单元622 (图47)。 Amplification factor determining unit 652 then the magnification ratio information indicating the determined magnification provided to the sensor unit 601 (which control unit 612) as the control signal, likewise, the area information associated with information indicating a magnification screen, the region by the pixel sensor cell to zoom magnification by the magnification of the magnification indicated by the information 601 composed of, and related to magnification information and area information is supplied to the image correction unit 622 (FIG. 47).

这种情况下,同样,图像转换单元621的图像转换处理的合适级别的图像信号从传感器单元601被输出,而后,具有更高图像质量的第二图像信号能从图像转换处理获得。 Suitable levels of the image signal in this case as well, the image converting unit 621 of the image conversion processing is outputted from the sensor unit 601, and then, an image having a higher quality second image signal obtained from the image conversion processing.

注意,可以作一种安排,其中在单像素增量中执行第一图像信号和阈值的比较,根据比较结果,确定每个像素的放大率。 Note that, an arrangement may be made wherein the first image signal and performs a comparison of the threshold value in single-pixel increments, according to the comparison result, the amplification factor is determined for each pixel.

图47中图像转换单元621的配置与图6中图像转换单元21的配置一样,相应地,其描述将省略(见图6至图10,和相应的描述)。 Like the configuration in FIG. 47 the image converting unit 621 in the configuration of FIG. 6 and the image conversion unit 21, and accordingly, description thereof will be omitted (see FIGS. 6 to 10, and the corresponding description). 同样,可以对图像拾取设备作一种安排,其中如图27所示的安排一样提供操作单元185,以便使图47中的图像转换单元621的配置和图29 (见图29至图36,和相应的描述)中的图像转换单元431的配置相同。 Also, the arrangement shown may be provided for the image pickup apparatus 27 as an arrangement in which the operation unit 185 as shown in FIG, so that the image converting unit 621 in the configuration of FIG. 47 and FIG. 29 (see FIGS. 29 to 36, and the same configuration corresponding description) the image converting unit 431. 如果采用了这种安排的情况下,信号处理单元604提供给传感器单元601做为控制信号的放大率信息所指示的放大率可以根据参数校正。 If the case of this arrangement, the signal processing unit 604 provided to the sensor unit 601 as the magnification parameters can be corrected in accordance with the magnification ratio information indicated by the control signal. 即,放大率可以被校正使得与参数相对应的分辨率越高,放大率的值越大。 That is, the magnification may be corrected such that the higher the resolution corresponding to the parameter, the larger the value of magnification.

同样,前面的描述已经参考一个例子进行了描述,其中,在图像转换处理中, 一帧或场的整体由第一图像信号转换为笫二图像信号, 但其中可以作一种安排,例如, 一帧或场的部分区域由第一图像信号转换为第二图像信号,如图54所示。 Also, the foregoing description has been described with reference to one example, wherein the image conversion process, an entire frame or field by the first image signal into an image signal Zi two, but an arrangement may be made, for example, a part of a frame or field of the first image signal is converted by the second image signal, as shown in FIG 54.

前面所述的信号处理单元604的一系列处理可由专门的硬件或软件实施。 The foregoing series of processes a signal processing unit 604 may be specialized hardware or software implementation. 如果以软件来实施这系列处理,参考图17,如前所述,组成软件的程序被安装在一种微型计算机上, 一种通用计算机中,等等。 If implemented in software, the series of processes, with reference to FIG. 17, as described above, a program making up the software is installed on a micro-computer, a general purpose computer, and the like.

第五具体实施例 Fifth embodiment

下面将描述本发明的第五具体实施例。 A fifth embodiment of the present invention will be described. 图55阐明了一种应用本发明的传感器系统的实施例。 Figure 55 illustrates an embodiment of the sensor system of the present invention is applied. 应该注意,在此术语"系统,,用以指代多个设备的一种逻辑配置,和组件设备是否在一个单一的实例中无关。 It should be noted that the term "system ,, regardless of whether a single example in to a logical configuration, and a plurality of component devices refer to devices.

所述传感器系统配置有CMOS成像器801和DRC (数字现实创建)电路802,和物体(物体光)的感测灯,并输出与物体相对应的高图像质量的图像信号。 The sensor system is configured with a CMOS imager 801 and the DRC (Digital Reality Creation) circuit 802, and the object (object light) sensing light, and outputs the object corresponding to the image signal of high image quality. 也就是说,CMOS成像器801接收物体光, 并向DRC电路802提供与所接收的光量相对应的电信号形式的图像信号。 That is, CMOS image 801 receives the object light, and the DRC circuit 802 in the form of an electrical signal corresponding to the amount of received light to provide an image signal. DRC电路802对CMOS成像器801提供的图像信号执行信号处理,并获得并输出具有更高图像质量的图像信号(此后视情况称为"高图像质量图像信号,,)。另外,DRC电路802基于CMOS成像器801 提供的图像倌号来控制CMOS成像器801。相应地,控制CMOS成像器801,以便于输出适于DRC电路802进行信号处理的图像信号。 DRC image signal processing circuit 802 performs signal pair of CMOS imagers 801 provided, and obtains and outputs an image signal having a higher image quality (hereinafter optionally referred to as "high image quality image signal ,,). Further, circuit 802 based on the DRC groom image resolution CMOS imagers 801 provided to control the CMOS imager 801. accordingly, the control CMOS imagers 801, so that an output image signal suitable DRC signal processing circuit 802.

相应地,对于图55中的传感器系统,CMOS成像器801输出适于DRC电路802进行信号处理的图像信号,所以,DRC电路802能通过在这些图像信号上进行信号处理来获得高图像质量的图像信号。 Accordingly, the sensor system of Figure 55, CMOS imager 801 is adapted to output an image signal DRC signal processing circuit 802, therefore, the DRC circuit 802 can perform signal processing on the image signals to obtain an image of high image quality signal.

图56阐明了一种图55所示的DRC电路802的第一配置实例。 FIG 56 illustrates a first configuration example of the DRC circuit 802 shown in FIG. 55 a. 在图56中,DRC电路802包括DRC单元811,用于对CMOS成像器801输出的图像信号进行信号处理,控制单元812,用于根据CMOS 成像器801提供的图像信号控制CMOS成像器801。 In Figure 56, circuit 802 includes a DRC DRC unit 811, for an image signal output from the CMOS imager 801 performs signal processing, the control unit 812, an image signal provided by the CMOS imagers 801 controls the CMOS imager 801.

DRC单元811进行多种信号处理,其中的一个例子是转换图像信号从第一图像信号到第二图像信号的图像转换处理。 DRC various signal processing unit 811, an example of which is the conversion image signal from the image converting a first image signal to the second image signal processing. 通过像前面所述的实现图像转换处理相同的配置,可以实现所述图像转换处理,然而, 此时,包括对CMOS成像器108的控制的应用CMOS成像器108的实例将被描述,应该注意的是,其中的部分描述和前面的描述相同。 As implemented by the image conversion processing same as the previously described configuration, the image conversion processing can be achieved, however, at this time, including the application examples will be described for controlling the CMOS imager 108 of the CMOS imagers 108, it should be noted It is the same as described in the foregoing description, and wherein the portion.

现在,例如,如果我们假设第一图像信号为低分辨率图像信号, 且第二图像信号为高分辨率图像信号,图像转换处理可以被说成是对分辨率提高处理。 Now, for example, if we assume that the first image signal is a low resolution image signal and the second image signal is a high resolution image signal, image conversion processing can be said to be on resolution enhancement process. 同样,例如,如果我们假设第一图像信号为低S/N Also, for example, if we assume that the first image signal of a low S / N

(信号/噪音)图像信号,且第二图像信号为高S/N图像信号,图像转换处理可以被说成是噪音去除处理。 (Signal / Noise) image signal, and the second image signal of high S / N image signal, image conversion processing can be said to be the noise removal processing. 另外,例如,如果我们假设第一图像信号为预定大小的图像信号,且第二图像信号比第一图像信号的信号要更大或者更小,图像转换处理可以被说成是一种图像缩放(扩大或缩小)处理。 Further, for example, if we assume that the first image signal is an image signal of a predetermined magnitude, and the second image signal to be greater than the signal of the first image signal or less, the image conversion processing can be said to be an image scaling ( expand or shrink) process. 相应地,通过图像转换处理,可以实现不同种类的处理,这取决于第一和第二图像信号是如何定义的。 Accordingly, by the image conversion processing, various kinds of processing can be achieved, depending on how the first and second image signals are defined.

DRC单元811将CMOS成像器108输出的图像信号做为第一图像信号,并把第一图像信号转换成高图像质量图像信号作为第二图像信号。 DRC unit 811 to the CMOS image signal output from the imaging device 108 as a first image signal, and converting the first image signal into a high image quality image signal as the second image signal. 现在,在DRC单元811,从CMOS成像器108提供的图像信号被做为第一图像信号提供给预测抽头提取单元821和分类抽头提取单元822。 Now, the DRC unit 811, is used as a first image signal is supplied to the prediction tap extracting unit 821 and the class tap extracting unit 822 CMOS image signal supplied from the imager 108. 预测抽头提取单元821顺序的将组成第二图像信号的像素做为所关心的像素,另外,提取一些用于构成第一图像信号的像素(或更恰当地说,其像素值)做为预测抽头用于预测所关心像素的像素值。 Prediction tap extracting unit 821 sequentially to the composition of a pixel of the second image signal as a pixel of interest, further extracts some of the pixels constituting the first image signal (or more properly, pixel values) as the prediction tap used to predict pixel values ​​of the pixel of interest.

更具体来说,预测抽头提取单元821从第一图像信号提取与所关心的像素相对应的第一图像信号中的某一像素(例如,第一图像信号中的最接近所关心的空间序列和时间序列像素的像素)的邻近空间序列或时间序列的多个像素,作为预测抽头。 More specifically, the prediction tap extracting unit 821 from a first image signal and extracting the first image signal corresponding to the pixel of interest in a certain pixel (e.g., the sequence space closest to the first image signal is of interest and pixel time series of pixels) of a plurality of pixels adjacent to the spatial sequence or time series, as a prediction tap.

分类抽头提取单元822提取组成第一图像信号的一些像素作为分类抽头,用以执行类分类从而将所关心的像素分到多个类中的一个。 Class tap extracting unit 822 extracts some pixels of the first image signal composed of a class tap for performing class classification so that the pixel of interest assigned to more than one class.

现在,预测抽头和分类抽头可以具有相同的抽头结构,或具有不同的抽头结构。 Now, the prediction taps and the class taps may have the same tap structure or different tap structures. 同样需要注意的是,分类抽头提取单元822与图6中的特征提取单元122相对应。 Also note that the class tap extracting unit 6 features extraction unit 822 and 122 corresponding to FIG.

预测抽头提取单元821获得的预测抽头被提供给预测计算单元825,且分类抽头提取单元822获得的分类抽头被提供给了分类代码生成单元823。 Prediction tap obtained prediction tap extracting unit 821 is supplied to the prediction computation unit 825, the class tap extracting unit 822 and the class tap obtained is supplied to a class code generation unit 823.

基于组成来自分类抽头提取单元822的分类抽头的像素的级別分布,分类代码生成单元823把所关心的像素分到到多个类中的一个, 并生成与作为其结果的类相对应的分类代码,然后该分类代码纟皮提供给因数生成单元824。 Level-based composition from the class tap pixel classification unit 822 extracts distribution taps, pixel classification code generating unit 823 of interest assigned to one of a plurality of classes, and generates as a result thereof corresponding to the class classification code, and then the classification codes Si hull factor generating unit 824 is supplied. 应该注意,分类代码生成单元823对应于图6 中的类分类单元123。 It should be noted that the classification code generation unit 823 in FIG. 6 corresponds to the class classifying unit 123.

如前所述,类分类可以通过采用例如ADRC或相似方法进行。 As described above, ADRC class classification or a similar method can be performed by using, for example. 通过使用ADRC的方法,组成分类抽头的像素的像素值经受ADRC处理,且所关心的像素的分类遵循合成ARC码而确定。 Pixel value of the ADRC method, the constituent pixels of the class tap is subjected to ADRC processing, and classification of the pixel of interest is determined to follow the synthesis ARC code.

此刻,对于K位ADRC而言,例如检测构成表示分类抽头的特征的矢量值的分量的最大值MAX和最小值MIN,并且使用作为一组的局部动态范围的DR=MAX-MIN, ^f艮据这个动态范围DR将构成分类抽头的特征的分量再次量化成K位。 At the moment, for the K-bit ADRC, for example, the detection component constituting MAX denotes the maximum value of the feature vector value and the minimum value MIN in the class tap, and is used as a local dynamic range DR of a group = MAX-MIN, ^ f Gen According to this dynamic range DR component constituting the class tap into K quantized feature bits again. 也就是说,最小值MIN被从构成分类抽头的特征的分量中减去,并且被减的值除(被量化)DR/2K。 That is, the minimum value MIN is subtracted from the characteristic component constituting the class tap, and the subtracted value other (quantized) DR / 2K. 在其中根据预定顺序排列构成分类抽头的特征的K位分量的一位串被作为ADRC代码输出。 An arrangement in which the K-bit string forming the class tap characteristic component according to a predetermined sequence is output as the ADRC code. 因此,在表示分类抽头的特征的矢量值经受1位ADRC处理的情况下,构成分类抽头的特征的每个分量除以最大值MAX和最小值MIN的平均值(舍入到小数),借此每个分量变为一个位(即,二进位化)。 Thus, the vector value representing a characteristic of the class tap is subjected to a case where the ADRC processing, each component constituting the class tap is characterized by dividing the maximum value MAX and the minimum value MIN is an average value (rounded to one decimal), whereby each component becomes a bit (i.e., binarized). 其中以预定顺序排列l位分量的位串被作为ADRC代码输出。 Arranged in a predetermined order wherein the ADRC code output bit string is used as component l bits. 类分类单元123输出例如通过对分类抽头的特征进行ADRC处理所获得的ADRC代码作为分类代码。 Class classifying unit 123, for example, ADRC code output by the class tap obtained by the ADRC processing characteristics as the class code.

现在,组成分类抽头的像素的级别分布模式,例如,可以被当作分类代码输出到分类代码生成单元823,不做任何改变。 Now, the level distribution pattern of the class tap composed of pixels, for example, may be classified as the class code generation code output unit 823, without any change. 但是,这种情况下,如果分类抽头包括,N个像素的像素值,并且为每个像素的像素值指派K位,由分类代码生成单元823输出的分类代码的个数应该为(2N) k, —个与像素的像素值位数K的数值成指数地成比例的非常大的数。 However, in this case, if the class tap including pixel values ​​of N pixels, and assigns the K-bit pixel value of each pixel, the number of classification codes by the class code generation unit 823 outputs be (2N) k , - a median pixel value of the pixel value K is exponentially proportional to the very large numbers.

相应地,在分类代码生成单元823上,类分类更适宜通过前面所述的ADRC处理,矢量量化或相似的方法来压缩分类抽头信息的数量来执行。 Accordingly, in the classification code generation unit 823, more suitably class classification by the previously described ADRC processing, vector quantization or similar methods to compress the information amount of the class tap is performed.

现在,在分类抽头提取单元822处分类抽头可以从CMOS成像器801输出的图像信号获得,从而分类代码是从分类代码生成单元823得到的。 Now, the class tap extracting unit 822 may obtain an image signal class tap CMOS imager 801 from the output, so that the classification codes are derived from the class-code generating unit 823. 相应地,可以说,分类抽头提取单元822和分类代码生成单元823组成了执行类分类的类分类单元。 Accordingly, it can be said, the class tap extracting unit 822 and the class code generation unit 823 constitute the class classifying unit performs class classification.

因数生成单元824为每个通过学习获得的类存储抽头因数,并从存储的抽头因数中提供(输出)抽头因数给预测计算单元823,该抽头因数存储在与来自分类代码生成单元823的分类代码相对应的地址中(具有从分类代码生成单元823提供的分类代码所表示的类的抽头抽头因数)。 For each factor generating unit 824, and supplies (outputs) by the tap factor storage class taps from the tap factor obtained by the learning factor stored to the prediction computation unit 823, the tap factor is stored in the classification code generation unit 823 from the classification code corresponding to the address (having a tap from the class tap factor of the code generating unit 823 to provide classification code represents the class). 现在,抽头因数等于在数字滤波器中的所谓抽头中的输入数据相乘的因数。 Now, a so-called tap-tap factor is equal to the input data in a digital filter in the multiplication factor.

预测计算单元825获得预测抽头提取单元821输出的预测抽头,和因数生成单元824输出的抽头因数,并采用预测抽头和抽头因数,为获得所关心像素的真值的预测值执行预定的预测计算。 Prediction tap prediction calculation unit 825 obtains a prediction tap extracting unit 821 output, and the factors generating the tap factor unit 824 outputs, and using the prediction taps and the tap factor calculation is performed a predetermined prediction to obtain the pixel of interest is the true value of the predicted value. 相应地,预 Accordingly, the pre-

测计算单元825输出所关心像素的像素值的预测值,即,组成第二图像信号的像素的像素值。 Pixel value prediction pixel value of the pixel value calculation unit 825 outputs the measurement of interest, i.e., the second image signal composed of pixels.

根据从CMOS成像器801输出的图像信号的级别分布,控制单元812控制CMOS成像器801。 The level of the image signal output from the CMOS imager 801 distribution control unit 812 controls the CMOS imager 801. 更确切地,从CMOS成像器801输出的图像信号中提取的分类抽头的分类代码从分类代码生成单元823提供给控制单元812。 Rather, extracted from the image signal output from the CMOS imager 801 in the class tap classification code to the control unit 812 from the class code generation unit 823. 在控制单元812, DL (延迟线)826临时存储从分类代码生成单元823提供的分类代码,并把所存储的分类代码提供给移动量控制单元827。 In the control unit 812, DL (delay line) 826 temporarily stores the class-code generating unit 823 to provide classification codes, and the stored classification code amount control unit provided to the mobile 827. 移动量控制单元827根据从DL 826提供的分类代码来控制CMOS成像器801。 Movement amount control unit 827 controls the CMOS imager 801 from the DL 826 to provide classification codes.

现在,如前所述,分类代码生成单元823通过使分类代码经受ADRC处理来产生分类代码。 Now, as described above, the class code generation unit 823 generates the class code class code by ADRC processing is subjected. 该分类代码是一个再次量化值的字符串,其中组成从CMOS成像器801输出的图像信号中提取的分类抽头的多个像素的像素值已被再次量化,相应地,可以说代表了组成分类抽头的多个像素,即,从CMOS成像器801输出的图像信号的级别分布。 The classification code string is again a quantized value, wherein the plurality of pixels consisting of the class tap extracted from the image signal 801 output from the CMOS imager in pixel values ​​have been quantized again, and accordingly, the composition can be said to represent the class taps a plurality of pixels, i.e., the level distribution of the image signal output from the CMOS imager 801. 相应地,可以说,根据分类代码控制CMOS成像器801的移动量控制单元827根据CMOS成像器801已输出的图像信号的级别分布控制CMOS成像器801 。 Accordingly, it can be said to control the amount of movement of the CMOS imager 801 of the control unit 827 controls the distribution of the CMOS imager 801 in accordance with an image signal level of a CMOS imager 801 is output according to the classification codes.

接下来,图57A和57B中分别地阐明了预测抽头和分类抽头的抽头结构的实例。 Next, FIGS. 57A and 57B respectively illustrate examples of the prediction taps and the class tap of the tap structure. 图57A阐明了一种分类抽头的抽头结构的实例。 FIG. 57A illustrate an example of a tap structure of a class tap. 图57A中所示的例子具有一种配置了九个像素的分类抽头。 In the example shown in FIG. 57A having an arrangement of nine pixels of the class tap. 就是说,釆用图57A中的例子,为与CMOS成像器801输出的图像信号中的所关心的像素相对应的像素配置一种十字型的分类抽头,且在其上,下,左和 That is, preclude the use of the FIG. 57A example, one kind of configuration is cross-shaped class tap of the pixel of interest in the image signal output from the CMOS imager 801 in the corresponding pixel, and on its upper, lower, left, and

右方向都有两个相邻的像素。 Right direction has two adjacent pixels.

图57B阐明了一种预测抽头的抽头结构的例子。 FIG 57B illustrates an example of a predictive tap of the tap structure. 图57B中所示的例子具有一种配置了13个像素的预测抽头。 In the example shown in FIG 57B has an arrangement of pixels of the prediction tap 13. 就是说,采用图57B所示的例子,为与CMOS成像器801输出的图像信号中的所关心的像素相对应的像素配置一种菱形的分类抽头,且在其上,下,左和右的方向都有两个像素,在四个对角线方向各有一个像素。 That is, using the example shown in FIG. 57B, with the image signal output from the CMOS imager pixel of interest 801 corresponding to a pixel arrangement of one kind of diamond class tap, and on its lower, left and right pixels has two directions, four diagonal directions in each pixel. 图56所示的预测计算单元825的预测计算和图6所示的计算单元125的处理过程一样,具体描述在此略去,因为预测计算中使用的抽头因数的学习可以采用和存储在图7中的因数存储器181中的抽头因数的学习方法同样的方式(见图8至图10)。 Prediction calculation unit 56 shown in FIG. 825 and FIG prediction calculation processing calculating unit 125 as shown in FIG. 6, the detailed description is omitted here, since the prediction tap factor used in the calculation of learning may be used and stored in FIG. 7 tap factor a factor in the memory 181 in the same manner as the learning method (see FIG. 8 to FIG. 10).

相应学习设备的配置和图8所示的学习设备的配置一样,然而,应该注意,特征提取单元136釆用和分类抽头单元822的抽头配置一样的方式配置分类抽头,它被提供给了类分类单元137。 The respective learning and configuration of the device configuration shown in FIG. 8 as the learning apparatus, however, it should be noted that the feature extraction unit 136 are arranged in the same configuration preclude the class tap and the class tap using the tap unit 822, which is supplied to the class classification unit 137. 然后类分类单元137产生和分类代码生成单元823 —样的分类代码。 Class classifying unit 137 and then generates the class-code generating unit 823-- kind of classification code.

接下来,图58A至图58C阐明了一种图55所示的传感器泉统的配置例子。 Next, FIGS. 58A to 58C illustrate a configuration example of a sensor system of springs 55 shown in an FIG. 图58A是图55的传感器系统的一种平面视图。 FIG 58A is a plan view of a sensor system 55 of FIG.

传感器系统通过半导体的处理被配置在一种单个的芯片上。 The sensor system is arranged on a single chip by one kind of semiconductor processing. 在图58A中,CMOS成像器801被构造在一个芯片的右上部分,DRC电路802和其它电路被配置在其他部分。 In FIG. 58A, CMOS image 801 is configured in the upper right portion of a chip, DRC circuit 802, and other circuits are arranged in other portions.

如图58B所示,CMOS成像器801具有大量在晶格布局中排列的所谓单元,这些单元等同于像素。 As shown in FIG. 58B, CMOS imager 801 having a large number of cells arranged in a so-called lattice layout, which is equivalent to the pixel unit. CMOS成像器801的每个像素具有光电二极管851,聚光镜852,和MEMS单元853,如图58C所示。 CMOS imagers of each pixel 801 has a photodiode 851, condenser lens 852, and the MEMS unit 853, as shown in FIG 58C.

光电二极管851接收入射光,并产生并输出与所接收光量相对应的电信号。 The photodiode 851 receives incident light, and generates and outputs the electric signal corresponding to the amount of light received. 光电二极管851输出的每个电信号都是单个像素的像素值。 Each electrical signal output from the photodiode 851 is a single pixel value.

聚光镜852是一种所谓的片上透镜,并被放置在面对光电二极管851的感光面的位置。 A condenser lens 852 is a so-called on-chip lens, and is placed in a position facing the photosensitive surface of the photodiode 851. 聚光镜852聚集光束,并把聚集的光束发射到光电二极管851上。 A condenser lens 852 collects a light beam, and to collect the emitted light beam to the photodiode 851. 在聚光镜852上聚集光束并发射到光电二极管851使在光电二极管852上的光束的使用效率可以被提高。 Light beams are collected on the condenser lens 852 and transmitted to the photodiode 851 makes efficient use of the light beam on the photodiode 852 may be improved.

MEMS单元853是一种配置有MEMS技术的可移动的部分,它容纳着聚光镜852。 MEMS unit 853 is a MEMS technology has a movable part of the configuration, which accommodates the condenser lens 852. 驱动MEMS单元853将聚光镜852的位置移动至光电二极管的感光面的位置。 MEMS driving unit 853 moves the position of the condenser lens 852 to the position of the photosensitive surface of the photodiode.

注意,虽然CMOS成像器801的每个像素都具有像放大器等一样的电路,但说明中略去了这些。 Note that, although each CMOS imager pixel 801 having the same circuit as amplifier, but the description is omitted.

图56中所示的控制单元812的移动量控制单元827通过驱动MEMS单元853来控制聚光镜852的位置。 Movement amount control unit 812 shown in FIG. 56 by the driving control unit 827 controls the position of the MEMS unit 853 of the condenser lens 852. 注意到这些,采用移动量控制单元827的聚光镜852的位置控制将参考图59A至图60B进行描述。 Noting this, the control unit 827 uses the amount of movement of the condensing mirror position control 852 will be described with reference to FIG 59A to FIG 60B.

现在,如图58A和59B所示,通过驱动MEMS单元853,聚光镜852的位置可以移动到接近光电二极管851的位置和远离光电二极管851的位置,即,两个位置。 Now, as shown in FIG. 58A and 59B, by driving the MEMS unit 853, the position of the condenser lens 852 may be moved to a position away from the photodiode 851 and the photodiode 851 is close to, i.e., two positions. 另夕卜,如图59A所示,如果聚光镜852的位置远离光电二极管851,将从聚光镜852向光电二极管851发射窄范围的物体光。 Another Bu Xi, shown in Figure 59A, if the position of the condenser lens 852 away from the photodiode 851, the condenser lens 852 from the light-emitting object to a narrow range of the photodiode 851. 同样,如图59B所示,如果聚光镜852的位置接近光电二极管851,将从聚光镜852向光电二极管851发射宽范風的物体光。 Similarly, as shown in FIG 59B, if the position of the condenser lens 852 is close to the photodiode 851, the condenser lens 852 from the object emit light of a wide range of the photodiode 851 to the wind. 同样,聚光镜852的位置和从聚光镜852发射到光电二极管851的物体光的范围的关系可能与前面所述内容是相反的。 Similarly, the relationship between the position of the condenser lens 852 and condenser lens 852 emitted from photodiode 851 to the object range of the content of the foregoing may be reversed.

从聚光镜852射出的物体光被光电二极管851接收,与所接收的光量的整数值近似成比例的电信号作为像素值输出。 Light emitted from the light condenser lens 852 object 851 is received by the photodiode, the amount of light received integer value is approximately proportional to the electrical signal as an output pixel value. 从而,所接收的光量在光电二极管851被整合并作为像素值,所以物体光的微小改变在像素值上被丟弃(即,量化)。 Thus, the amount of light received and is integrated as a pixel value in the photodiode 851, so that small changes are discarded object light (i.e., quantization) on the pixel value. 在像素值上被丢弃的物体光的微小改变将视情况称为"整合效应"。 A slight change in the pixel values ​​of the object light is discarded as the case called "integration effect." 光电二极管851接收的物体光范围越宽,整合效应越大,这表示物体光中的更多的微小变化被丢弃了,从 The wider the range of the object light received by the photodiode 851, the greater the integration effect, which means that small changes in objects more light to be discarded, from

而获得了具有低分辨率的图像(具有一些移动模糊的图像)。 To obtain an image having a low resolution (with some mobile blurred image).

如果与物体光相对应的图像是一种在级别上(平面部分)具有很 If the object light image corresponding to a (flat portion) on a level with a very

小变化的平面图像,噪音变的显著。 Small changes in the image plane, the noise becomes remarkable. 相应地,这种情况下,由于整合效应,采用光电二极管851在一个较大面积上接收物体光可以使从光电二极管851输出的像素值的图像中包含的噪音减少。 Accordingly, in this case, due to the effect of integration, a photodiode 851 receives the object light on a large area can make the noise image pixel values ​​output from the photodiode 851 included in the reduction.

同样,如果与物体光相对应的图像是在级别上(非平面部分)变 Similarly, if the object is an image corresponding to the light (the non-planar portion) becomes at the level

化很大的图像,由于整合效应,釆用光电二极管851在一个较大面积上接收物体光将减轻较大的级别变化并降低分辨率。 Of large images, since the integration effect, preclude the photodiode 851 receives the object light and reduce the large change in the level of the reduced resolution over a larger area. 相应地,这种情 Accordingly, this case

况下,采用光电二极管851在一个较窄面积上接收物体光可以使从光电二极管851输出的像素值的图像中的物体光的较大级别变化得到相对真实的反映。 Under conditions, a photodiode 851 receives object light in a narrow area of ​​the object can cause large changes in the light level image pixel values ​​output from the photodiode 851 opposite to give a true reflection.

另一方面,在DRC单元811执行的信号处理中(图像转换处理),由光电二极管851输出的像素值配置预测抽头,且所关心的像素(或其4象素值)通过使用该预测抽头的计算净皮预测出来。 On the other hand, in the signal processing performed by the DRC unit 811 (image conversion process), the pixel value output from the photodiode 851 is disposed prediction taps, pixels (pixel values ​​or 4) of interest and the prediction tap by using calculation of net leather predicted. 相应地,如果从平滑图像中配置(提取)的预测抽头中的像素中包含有噪音,则所关心像素的预测准确率下降了。 Accordingly, if the configuration of the smoothed image (extracted) in the prediction tap noise included in the pixel, the pixel of interest prediction accuracy decreased. 同样,如果预测抽头中的像素原本已经在级别上有了很大变化,但已被作为级别变化减小的图像像素,则所关心像素的预测准确率会下降。 Similarly, if the prediction tap pixel originally has made great changes in the level, but has been reduced as a pixel-level changes, the prediction accuracy pixel of interest will decline.

也就是说,对于平滑(平面)图像,为了执行合适的信号处理以 That is, for a smooth (planar) images, in order to perform appropriate signal processing to

便所关心像素可以以高准确率和从DRC单元811荻得的高图像质量图像信号进行预测,预测抽头需要采用具有很少噪音的像素进行配置。 It will be the pixel of interest with high accuracy and high image quality prediction image signal Di DRC unit 811 obtained from the prediction tap pixels need to be configured with little noise. 同样,对于级别上具有较大变化的图像,预测抽头需要由能如实反映级别变化的像素进行配置。 Similarly, for an image having a large variation in the level of the prediction tap pixels need to accurately reflect the varying levels can be configured.

如前所述,让光电二极管851在一种较宽的范围接收物体光可以减少光电二极管851输出的像素值的图像中所包含的噪音。 As previously described, so that the photodiode 851 receives the object In a wide range of light can reduce the noise of the image pixel values ​​output from the photodiode 851 included. 同样,让光电二极管851在一种较窄的范围接收物体光可以使物体光中的较大的级别变化在光电二极管851输出的像素值的图像中被如实反映。 Similarly, the object so that the photodiode 851 receives light In a narrow range can be made larger in the light level change in the object is faithfully reflected in the image pixel values ​​output from the photodiode 851.

相应地,为得到平滑的图像光电二极管851在一种较宽范围接收物体光,且对于物体光的级别变化较大的图像,光电二极管851在较窄范围接收物体光,从而DRC单元811可以以高的准确率预测所关心的像素,从而合适的图像处理可以被实施以便获得具有更高图像质量的图像信号。 Accordingly, to obtain a smooth image of a wide range of the photodiode 851 receives light In one object, and the object light is changed to the level of a larger image, the photodiode 851 receives light in a narrow range of the object, so that DRC unit 811 may the high accuracy of the prediction pixel of interest, so that appropriate image processing can be implemented so as to obtain an image signal having a higher image quality.

相应地,移动量控制单元827根据经由DL826从分类代码生成单元823提供的分类代码,控制聚光镜852的位置,如下。 Accordingly, the shift amount control unit 827 according to the classification codes via DL826 supplied from the class-code generating unit 823, 852 controls the position of the condensing lens, as follows.

图60A和60B阐明了从分类代码生成单元823输出的分类代码的例子。 FIGS 60A and 60B illustrate an example of a classification code from classification code generation unit 823 outputs. 图60A阐明了通过在图57A所示的十字型分类抽头上执行l位ADRC处理而获得的分类代码。 FIG 60A illustrates the classification code obtained by performing the l-bit ADRC processing on the cross-shaped class tap shown in FIG.'s 57A. 同样,图60B阐明了组成图57A中所示的分类抽头的九个像素的像素值Pl至P9,以从像素Pl至P9的顺序排列成一个单行。 Similarly, FIG. 60B illustrates the composition of the classification shown in FIG. 57A taps nine pixel values ​​of Pl to P9, in order from the pixels Pl to P9 are arranged in a single row.

对于1位ADRC处理,组成分类抽头的像素的像素值由平均值进行再次量化,该平均值为组成分类抽头的像素的最大值MAX(最大像素值)和其最小值MIN (最小像素值)的平均值。 For ADRC processing, the constituent pixels of the pixel values ​​of class taps of a quantized again by the average value, the average value of the constituent pixels of the class tap of the maximum value MAX (the maximum pixel value) and the minimum value MIN (minimum pixel values) average value. 也就是说,小于最大MAX和最小值MIN的平均值的像素值变为0,等于或大于此平均值的像素值变为1。 That is, less than the maximum MAX and the minimum value MIN of the pixel values ​​of the average of the pixel values ​​becomes 0, the average value is equal to or greater than this becomes 1.

相应地,对于从图^f象的平滑部分提取的分类抽头,组成分类抽头的像素Pl至P9的像素值的变化是很小的,所以在分类代码中相邻的位几乎没有位倒置,例如图60A中的"000000001"。 Accordingly, for the image f ^ smooth portion extracted from FIG class tap, the class tap is composed of pixels Pl to P9 of change in pixel values ​​is small, so that adjacent bits in the code classification little bit inversion, e.g. FIG 60A is "000000001."

另一方面,对于从具有较大变化的图像的一部分提取的分类抽头,组成分类抽头的像素Pl至P9的像素值的变化是很较大的,所以分类代码由相邻的位的位倒置的次数获得,例如图60B中的"1011010101"。 On the other hand, for the class tap from the extracted part of the image having a large change in the composition of the pixels Pl to a class tap changes in pixel values ​​P9 is very large, so that the inverted bit classification code bits of adjacent the number obtained, for example, FIG. 60B "1011010101."

相应地,对于分类代码,如果相邻位的位倒置的次数较少,可以识别该图像为为平滑图像,如果相邻位的位倒置的次数较大则可以识别级别上有较大变化。 Accordingly, for the class code, if a smaller number of adjacent bits inverted position, the image may be identified as the image is smoothed, larger changes may be greater if the number of levels of adjacent bits identifying bit inverted.

相应地,如果分类代码中的相邻位的位倒置的次数较小,由光电二极管851获得的像素值的图像是平滑的,所以移动量控制单元827控制聚光镜852的位置在图59B所示的接近光电二极管851的位置上,以便光电二极管851在一个较宽范围接收物体光。 Accordingly, if the adjacent bit inverted bit class code number is small, the pixel values ​​of the image obtained by the photodiode 851 is smooth, the shift amount control unit 827 controls the position of the condenser lens 852 shown in FIG. 59B the photodiode 851 close position, so that the photodiode 851 receives the object light in a wide range. 同样,如果分类代码中的相邻位的位倒置的次数较大,则光电二极管851将获得的像素值的图像具有较大的级别变化,所以移动量控制单元827控制聚光镜852的位置在图59A所示的远离光电二极管851的位置上,以便光电二极管851在一个较窄范围接收物体光。 Similarly, if the number of image pixel values ​​of adjacent bits inverted bit class code is large, the photodiode 851 will have a larger level of change, the shift amount control unit 827 controls the position of the condenser lens 852 in FIG 59A a position away from the photodiode 851 shown on the object so that the photodiode 851 receives light in a narrow range.

接下来,图56中所示的DRC电路802的信号处理过程将参考图61进行阐述。 Next, FIG DRC signal processing circuit 802 shown in FIG. 56 with reference to 61 are set forth. 这里需要注意,DRC电路811把第N+l个帧(或场)中的一种像素做为所关心的像素,并预测该所关心像素。 It should be noted, the DRC A pixel circuit 811 of the N + l th frame (or field) as the pixel of interest, and predicts the pixel of interest.

这种情况下,在从CMOS成像器801输出的第N个帧的图像信号上,在步骤S511中分类抽头提取单元822以CMOS成像器801输出的第N帧中的所关心像素的位置距离最近的位置上的像素为中心以十字型提取像素做为所关心的像素的分类抽头(图57A),并把提取的像素提供给分类代码生成单元823,且流程进入步骤S512。 In this case, the position nearest to the pixel of interest in CMOS imager 801 outputs the N-th frame from the image signal of N frames output from the CMOS imager 801, in step S511, the class tap extracting unit 822 the pixel center position of a cross-type pixels are extracted as the pixel of interest in the class tap (FIG. 57A), and provides the extracted pixels to a class-code generating unit 823, and the flow proceeds to step S512. 这就是说5在此,第N+l帧的图像信号的所关心像素的分类抽头是从第N个帧的图像信号中提取的,就是前面的一帧。 That 5 Here, the N + tap of the pixel of interest free of l-frame image signal is extracted from the image signal of the N-th frame, that is, the front one. 在步骤S512中,分类代码生成单元823通过对由分类抽头提取单元822提供的分类抽头执行1位ADRC处理来获得所关心像素的分类代码,并提供给因数生成单元824,同时经由DL 826提供给移动量控制单元827,且流程进入步骤S513。 In step S512, the class-code generating unit 823 by the classification extracting unit 822 from the class tap supplied tap 1-bit ADRC processing to obtain the pixel of interest classification code, and supplied to the factor generating unit 824, and is supplied to via the DL 826 a shift amount control unit 827, and the flow proceeds to step S513.

在步骤S513中,与经由DL826提供的分类代码相对应,移动量控制单元827为控制聚光镜852的位置产生控制信息,且流程进入步骤S514。 In step S513, the classification code provided via DL826 corresponding movement amount control unit 827 generates control information to control the position of the condenser lens 852, and the flow proceeds to step S514. 在步骤S514中,移动量控制单元827遵循在在先步骤S513中产生的控制信息来控制在组成所关心像素的预测抽头的像素的MEMS单元853,从而把像素的聚光镜852移动到接近光电二极管851的位置或远离光电二极管851的位置。 In step S514, the shift amount control unit 827 follows the control information the previous step S513 is generated to control the composition of the pixel of interest pixel prediction taps MEMS unit 853, so that the pixel condenser lens 852 moves close to the photodiode 851 position or a position remote from the photodiode 851.

接下来,在第N+l帧的成像定时处,当第N+l个帧的图像信号在CMOS成像器801成像并输出时,流程从步骤S514进行至步骤S515,并且预测抽头提取单元821以CMOS成像器801输出的第N+l个帧中的所关心像素的位置距离最近的位置上的像素为中心以菱形提取像素做为所关心像素的预测抽头(图57B),并把提取的像素提供给预测计算单元825,且流程进入步骤S516。 Subsequently, the N + l image frame at the timing when the image signal of the N + l th frame 801 forming the CMOS imager and output, the flow proceeds to step S515 from step S514, the prediction tap extracting unit 821 and to the position of the pixel of interest in frame N + l the output of the CMOS imager 801 in the distance between the pixel position closest to the center pixel as a prediction tap extraction diamond (FIG. 57B) is a pixel of interest, and the extracted pixel It is supplied to the prediction computation unit 825, and the flow proceeds to step S516.

就是说,在步骤S514中,做为所关心像素的预测抽头的像素的MEMS单元853被控制了,由此该像素的聚光镜852的位置也被控制。 That is, in step S514, the pixel of interest as a prediction tap of the pixel of the MEMS unit 853 is controlled, whereby the position of the pixel of the condenser lens 852 is also controlled. 相应地,在步骤S515中,所关心像素的预测抽头包括从像素的光电二极管851输出的像素值,据此方法来控制聚光镜852的位置。 Accordingly, in step S515, the prediction tap of the pixel of interest comprises the photodiode 851 from the pixel value output from the pixel, whereby the method to control the position of the condenser lens 852.

在步骤S516中,因数生成单元824输出由分类代码生成单元823提供的所关心像素的分类代码指示的抽头因数。 In step S516, the tap factor factor generating unit 824 outputs provided by the class code generation unit 823 pixel of interest indicated by the classification code. 也就是说,通过前面所述的学习设备中的学习,因数生成单元824为每个预先获得的类存储抽头因数,并相应地为每个类从抽头因数中读取出由所关心的像素的分类代码指示的类的抽头因数。 That is, the storage class taps by a factor in the learning device previously described learning factor generating unit 824 for each previously obtained, and accordingly reads out from the tap factor of the pixel of interest for each class classification code indicated by the tap factor class. 并输出抽头因数给预测计算单元825。 Factor and output taps to the prediction computation unit 825.

然后流程进入步骤S516至步骤S517,采用预测抽头提取单元821提供的预测抽头和因数生成单元824提供的抽头因数,预测计算单元825执行上面表达式(1)的计算,从而获得了所关心的像素值,且处理过程结束。 Then the flow proceeds to step S516 to step S517, the tap factor using the prediction tap extracting unit 821 and a prediction tap supplied factor generating unit 824 is provided, the prediction computation unit 825 performs calculating the above expression (1), thereby obtaining a pixel of interest value, and the process ends.

从而,上面所述的处理将第N+l帧中的每个像素当作所关心的像素来顺序执行,更进一步,关于第N+2个帧也是这样,等等。 Thus, the process described above the first frame N + l of each pixel as a pixel of interest to the execution order, further, on the frame of the N + 2, too, and the like.

注意,前面所述的安排包括从第N帧提取的所关心的像素的分类抽头,第N帧是第N+l前面的一帧,但是所关心的像素的分类抽头可能被布置从第N+l帧的图像信号中提取,该帧为所关心的像素的帧。 Note that, the foregoing arrangement includes a pixel of interest from the extracted class tap N-th frame, N-th frame is the first N + L in front of a pixel of interest but may be arranged in the class tap from the N + l frame image signal is extracted, the pixel of the frame is a frame of interest.

同样,在第N+l个帧中存在某些情况,其中在某一像素并A是所关心的像素的情况下以及在接近该像素的像素#B是所关心的像素情况下,CMOS成像器801的同一像素的聚光镜852被控制到不同的位置。 Also, there are some cases at the N + l th frame, and wherein a certain pixel A in the case where the pixel of interest and in the case of the pixel proximate the pixel of interest is #B, CMOS image device 801 of the same pixel condenser lens 852 is controlled to a different location. 这可以通过当像素弁A是所关心的像素的情况下在像素的聚光镜852的位置上和当像素弁B是所关心的像素的情况下在像素的聚光镜852的位置上以时间序列在CMOS成像器801处对第N+l帧的图像信号进行成像来解决。 This can be done when the pixel Bian A is a pixel of interest in the case where the position of a pixel of the condenser lens 852 of the upper and when the pixel Bian B is a pixel of interest in the case where the position of the condenser lens 852 pixels on a time series in the CMOS imaging is 801 pairs of frame N + l image signal imaged solved.

另外,在此所述的安排包括,通过在做为所关心的像素的预测抽头的像素上控制MEMS单元853来控制的聚光镜852的位置,但是也可以作出一种安排其中,例如,只控制有所关心的像素的最接近的像素的聚光镜852的位置,或者控制在所关心的像素的某一范围中的全部像素的聚光镜852的位置,等等。 Further, the arrangement herein comprises, in the position by the pixel of interest as prediction tap pixel control unit 853 controls the MEMS condenser lens 852, but an arrangement may be made wherein, for example, there is only control position of the condenser lens 852 closest to the pixel of interest, or controlled within a certain range of the pixel of interest in the positions of all the pixels of the condenser lens 852, and the like.

接下来,图61中的步骤S513中的处理过程(为生成与分类代码相对应的控制信息的控制信息生成处理)将被详细描述,参考图62中的流程图。 Next, the processing of step S513 in FIG. 61 (to generate a class code corresponding to the control information generation processing information) will be described in detail with reference to the flowchart of FIG. 62.

首先,在步骤S521中,移动量控制单元827计算所关心的像素的分类代码中的在相邻位的位倒置的次数,且流程进入步骤S522。 First, at step S521, the shift amount control means 827 calculates the number of adjacent bits inverted position, the pixel of interest and the flow classification code proceeds to step S522.

如果分类代码是,例如,如图60A所示的"000000001",这里只有在第8和第9位存在由0到1的倒置,所以计算得到的位倒置的次数是l。 If the classification code is, for example, as "000000001" shown in FIG. 60A, where only the presence of the eighth and the ninth bit inverted from 0 to 1, so the number of bits calculated is inverted l. 同样,如果分类代码是,例如,图60B所示的"101101010", 在第1和第2位存在从1到0的倒置,在第2和第3位存在从0到1 的倒置,在第4和第5位存在从1到0的倒置,在第5和第6位存在从0到1的倒置,在第6和笫7位存在从1到0的倒置,在笫7和笫8位存在从0到1的倒置,且在笫8和第9位存在从1到0的倒置, 所以计算得到的位倒置的次数是7。 Similarly, if the classification code, e.g., FIG. 60B "101101010" shown in the first and presence of two inverted from 1 to 0, the presence of inverted from 0 to 1 at position 2 and 3, the first 4 and 5 of the presence of the inverted 1 to 0, in the fifth and sixth, and the presence of the inversion from 0 to 1, the 7 bit 6 and Zi is present from the inverted 1-0 in and Zi 8 Zi 7 Invert the presence of from 0 to 1, and in the presence of 9 and 8 Zi inverted from 1 to 0, so the number of bits calculated 7 is inverted.

在步骤S522中,移动量控制单元827判断所关心的像素的分类代码中的位倒置的次数是否大于一预定的阈值。 In step S522, a shift amount control unit 827 determines whether the number of times the pixel of interest classification code bits inverted is greater than a predetermined threshold value. 如果分类代码是上面情况一样的9位(或如果组成分类抽头的像素的个数是九个像素),采用的预定阈值可以是3,等等,例如。 If the classification code is the same as the above case of 9 (or if the number of constituent pixels of the class tap is nine pixels), the predetermined threshold value 3 may be employed, like, for example.

如果所关心的像素的分类代码中的位倒置的次数被确定为大于预定的阈值,即,比如图60B中所示,如果分类代码是"101101010", 所以位倒置的次数为7,这比预定的阈值3大,流程进入步骤S523, 且移动量控制单元827把这个结果理解为接近由CMOS成像器801成像的图像的所关心的像素的位置的级别变化是较大的,且相应地产生控制信息将聚光镜852的位置控制在远离光电二极管851的位置上, 即, 一个窄范围的物体光射入光电二极管851的位置上,且流程返回。 If the number of the pixel of interest classification code bits inverted is determined to be greater than a predetermined threshold value, i.e., such as shown in FIG. 60B, if the classification code is "101101010", so the number of bits inverted to 7, which than a predetermined threshold 3 large, the flow proceeds to step S523, and the amount of movement of the control unit 827 of this result is understood to be close to the change-level location of the pixel of interest image CMOS imager 801 imaging is larger, and accordingly generates a control the location information condenser lens 852 is controlled to a position away from the photodiode 851, i.e., a narrow range of the position of the object light is incident on the photodiode 851, and the flow returns.

如果所关心的像素的分类代码中的位倒置的次数被确定为不大于预定的阈值,即,如图60B所示,如果分类代码是"000000001",所以位倒置的次数为1,这不大于预定的阈值3,流程进入步骤S524, 且移动量控制单元827把这个结果理解为接近由CMOS成像器801成像的图像的所关心的像素的位置级别是平滑的,且相应地产生控制信息将聚光镜852的位置控制在接近光电二极管851的位置上,即,一个宽范围的物体光射入光电二极管851的位置上,且流程返回。 If the number of the pixel of interest classification code bits inverted is determined not greater than the predetermined threshold, i.e., as shown in FIG. 60B, if the classification code is "000000001", so the number of inverted bits is 1, which is not greater than predetermined threshold value 3, the flow proceeds to step S524, and the amount of movement of the control unit 827 of this result is understood to be close to smooth the location of the level of the pixel of interest image CMOS imager 801 for imaging, and accordingly generates control information condenser lens 852 control the position of the photodiode 851 in close position, i.e., a wide range of object light incident on the position of the photodiode 851, and the flow returns.

然而根据另一种安排,这里已进行了描述,在这个安排中从分类抽头获得分类代码被用作指示接近由CMOS成像器801成像的图像的所关心的像素的位置的级别分布的信息,除了采用分类抽头的安排, 其他的安排也可以被制定,比如一种使用接近预测抽头或一种类似所关心的像素的多个任意像素的安排,做为指示接近所关心的像素的位置的级别分布的信息。 However, according to another arrangement, there has been described, the class tap from the class code obtained in this arrangement is used as information indicating the proximity of a level location distribution of the pixel of interest of the image forming CMOS imagers 801, except using the class tap arrangement, other arrangements can also be developed, such as using a prediction tap or close any more pixels an arrangement similar to the pixel of interest, the level of distribution as an indication of the position of the pixel of interest close Information.

同样,在上述情况中,通过控制MEMS单元853,对于聚光镜852 的控制被确定在两个位置中的一个上,即, 一种接近光电二极管851 的位置和一种远离它的位置,但聚光镜852的位置可以被控制在三个或更多的位置上。 Also, in the above case, the MEMS control unit 853 for controlling the condenser lens 852 is determined in one of two positions, i.e. a position close to the photodiode 851 and to a position away from it, but the condensing mirror 852 position can be controlled at three or more positions.

图63A至63C阐明了一种安排,其中聚光镜852的位置被控制在三个位置中的一个位置上,该三个位置是距光电二极管851有一定距离并被当作标准位置的位置, 一个接近光电二极管851的位置, 一个远离光电二极管851的位置。 Figures 63A to 63C illustrate an arrangement in which a position of the condenser lens 852 is controlled in three positions, the three positions which are away from the photodiode 851 and a distance from the standard position as the position of a close the position of the photodiode 851, a photodiode 851 away from the location.

应该理解,同样在这个安排中,聚光镜852距光电二极管851的位置越远,从聚光镜852射向光电二极管851的物体光的范围就越窄, 且聚光镜852距光电二极管851的位置越近,从聚光镜852射向光电二极管851的物体光的范围就越宽。 The narrower should be understood that, also in this arrangement, the condenser lens 852 from the position of the photodiode 851 farther toward the object photodiode 851 from the condenser lens 852 range, and the condenser lens 852 closer from the photodiode 851 position, from the wider the condenser lens 852 toward the photodiode 851 the object range.

如图63A至63C所示,当控制聚光镜852的位置到三个位置中的标准位置上,接近光电二极管851的位置和远离光电二极管851的位置时,移动量控制单元827仍然控制与分类代码相对应的聚光镜852 的位置。 As shown in FIG 63A to 63C, when the position of the condenser lens 852 to control the three positions on the standard position, close to the position away from the photodiode 851 and photodiode 851, the moving amount control unit 827 and the control remains with the class code corresponding to the position of the condenser lens 852.

就是说,如果分类代码中的位倒置的次数较小,且相应地,从CMOS成像器801输出的图像信号中的所关心的像素的位置的周围区域是平滑部分,移动量控制单元827控制聚光镜852的位置在接近光电二极管851的位置上,如图63C所示,以便在光电二极管851上投射一种宽范围的物体光。 That is, if the number of classification code bits inverted is small, and accordingly, the surrounding area of ​​the pixel of interest position from the image signal output from the CMOS imager 801 is a smooth portion of the movement control unit 827 controls the amount of the condensing lens position 852 is closer to the photodiode 851 in position, as shown in FIG 63C, so that the projected light of one object on a wide range of the photodiode 851. 同样,如果分类代码中的位倒置的次数较大, 从CMOS成像器801输出的图像信号中的所关心的像素的位置的周围区域的级别变化较大,移动量控制单元827控制聚光镜852的位置在原理光电二极管851的位置上,如图63A所示,以便在光电二极管851 上投射一种窄范围的物体光。 Similarly, if the number of classification code bit inversion is large, a large change in the level of the surrounding area from the position of the pixel of interest in an image signal output from the CMOS imager 801 in the position 852 of the control unit 827 controls the amount of movement of the condensing lens in principle the position of the photodiode 851, as shown in FIG. 63A, in order to project a narrow range of light of one object on the photodiode 851. 而且,如果分类代码中的位倒置的次数既不大又不小,从CMOS成像器801输出的图像信号中的所关心的像素的位置的周围区域的级别变化既不大又不小,即,居中,移动量控制单元827控制聚光镜852的位置在标准位置上,如图63B所示,以便在光电二极管851上投射一种范围不宽也不窄的物体光,即,居中。 Further, if the number of classification code bits inverted is neither large nor small, the level changes in the surrounding region of the pixel position from the image signal output from the CMOS imager 801 of interest is neither large nor small, i.e., center, the control unit 827 controls the amount of movement of the condensing lens in the standard position, as shown in FIG. 63B position 852 to project not wide-ranging nor narrow object light on the photodiode 851, i.e., center.

接下来,图61中的步骤S513中的控制信息生成处理中,如图63A 至图63C所示,聚光镜852的位置被控制在三个位置中的标准位置上、 接近光电二极管851的位置,和远离光电二极管851的位置5这将参考图64中的流程图进行详细的描述。 Next, in step S513 of FIG. 61 in the control information generation process, as shown in FIG. 63A to FIG. 63C, the standard position of the condenser lens 852 is controlled in three positions, the position of the proximity of the photodiode 851, and position away from the photodiode 851 to the flowchart in which 5 64 described in detail with reference to FIG.

首先,在步骤S531中,移动量控制单元827计算所关心的像素的分类代码中的相邻位的位倒置的次数,且流程进入步骤S532。 First, at step S531, the shift amount control means 827 calculates the number of bits neighboring the pixel of interest position classification code inverted, and the flow proceeds to step S532. 这里让我们假设组成分类代码码的位的数量是9,和图62中的例子一样。 Here let us assume that the number of component class code bit code is an example 9, and 62 are the same. 这种情况下,分类代码中的位倒置次数的最小值是O,且最大值是8。 In this case, the minimum number of classification code of an inverted bit is O, and the maximum is 8.

在步骤S532中,移动量控制单元827确定所关心的像素的分类代码中的位倒置次数是否相对较小,比如,在0到2次之间。 In step S532, the shift amount control unit 827 determines that the pixel of interest in the classification code bit inversion whether the number is relatively small, for example, between 0-2 times.

在步骤S532中,如果所关心的像素的分类代码中的位倒置次数被判定在0到2次之间,流程进入标准S533,移动量控制单元827认为在CMOS成像器801成像的图像中的所关心的像素的位置周围的级别变化的量较小,并相应地产生控制信息来控制聚光镜852的位置到接近光电二极管851的位置上,即, 一个宽范围的物体光射入光电二极管851的位置,且流程返回。 In step S532, the pixel of interest if the classification code is determined number of bits inverted between 0-2 times, the flow proceeds to S533 standards, the control unit 827 that the amount of movement of the CMOS imager 801 in the image imaged a smaller amount of change in position of the pixel level of interest around, and generates control information to control the position of the condenser lens closer to the photodiode 852 to a position 851, i.e., a wide range of object light incident on the photodiode 851 in position and the flow returns.

在步骤S532中,如果所关心的像素的分类代码中的位倒置次数被判定不在0到2次之间,流程进入步骤S534,移动量控制单元827判定所关心的像素的分类代码中的位倒置次数是否较大,比如,在6到8次之间。 Inverted bit number in step S532, the pixel of interest if the classification code is determined not to be between 0-2 times, the flow proceeds to step S534, the control unit 827 determines the movement amount of the pixel of interest classification code bits inverted whether large number, for example, between 6 to 8 times.

如果在步骤S534中,所关心的像素的分类代码中的位倒置次数被判定在6到8次之间,流程进入步骤S535,移动量控制单元827认为在CMOS成像器801生成的图像中的所关心的像素的位置周围的级别变化的量较大,并相应地产生控制信息来控制聚光镜852的位置到远离光电二极管851的位置上,即, 一个窄范围的物体光射入光电二极管851的位置,且流程返回。 If in step S534, the pixel of interest in the classification code bit inverted number is determined between 6 to 8 times, the flow proceeds to step S535, the control unit 827 that the amount of movement of an image in the CMOS imager 801 generated the a large amount of change in the level of position of the pixel of interest around, and generates control information to control the position of the condenser lens 852 to a position remote from the photodiode 851, i.e., a narrow range of object light incident on the photodiode 851 in position and the flow returns.

在步骤S534中,如果所关心的像素的分类代码中的位倒置次数被判定不在6到8次之间,流程进入步骤S536,移动量控制单元827判定所关心的像素的分类代码中的位倒置次数是否既不大又不小,比如, 在3到5次之间。 Inverted bit number in step S534, the pixel of interest if the classification code is determined not between 6 to 8 times, the flow proceeds to step S536, the control unit 827 determines the movement amount of the pixel of interest classification code bits inverted neither large nor small whether the number of, for example, between 3 to 5 times.

如果在步骤S536中,所关心的像素的分类代码中的位倒置次数被判定在3到5次之间,流程进入步骤S537,移动量控制羊元827认为在CMOS成像器801生成的图像中的所关心的像素的位置周围的级别变化的量既不大又不小,并相应地产生控制信息来控制聚光镜852的位置在参考位置上,即, 一个对于光电二极管851的中间位置,从而一个中间范围的物体光射入光电二极管851,且流程返回。 If in step S536, the pixel of interest in the classification code is determined number of bits inverted between 3 to 5 times, the flow proceeds to step S537, an amount of movement of the control element 827 that sheep image 801 generated in the CMOS imager amount level changes around the location of the pixel of interest is neither large nor small, and generates control information to control the position of the condenser lens 852 in the reference position, i.e., a intermediate position of the photodiode 851, so that an intermediate range of object light incident on the photodiode 851, and the flow returns.

同样,在步骤S536中,如果所关心的像素的分类代码中的位倒置次数被判定不在6到8次之间,移动量控制单元827把这种情况当作错误,并不产生控制信息而返回。 Similarly, in step S536, the pixel of interest if the classification code is determined between the number of bits is not inverted 6-8 times, the amount of movement of the control unit 827 of this situation as an error, generates control information is not returned . 这种情况下,聚光镜852的位置保持在以前的位置上,例如。 In this case, the condenser lens 852 is held in position on the previous position, for example.

如果分类代码具有9 -位并根据分类代码中的位倒置的次数来控制聚光镜852的位置,聚光镜852的位置可以有9个之多。 If the classification codes have a 9 - bit and controls the position of the condenser lens 852 based on the number of classification code inverted position, the position of the condenser lens 852 may be as many as nine.

接下来,图65阐明了图55所示的DRC电路802的第二配置的实例。 Next, FIG. 65 illustrates a second configuration example of a DRC circuit 802 shown in FIG. 55. 图65中的组件和图56中的组件是一样的,并被用相同的参考标记指示,且视情况将略去描述。 Components in FIG. 65 and FIG. 56 are the same components, and the same reference numerals, and description thereof will be omitted optionally. 就是说,图65所示的DRC电路和图56中的DRC电路的配置基本相同,除了用控制单元862替代了控制单元812。 That is, the configuration and the DRC circuit 56 shown in FIG DRC circuit 65 is substantially the same, except that instead of the control unit 812 by control unit 862. 控制单元862包括活动性检测单元876和运动量控制单元877。 The control unit 862 comprises a active motion amount detection unit 876 and control unit 877.

由分类抽头提取单元822输出的所关心的像素的分类抽头被提供给了活动性检测单元876。 The pixel of interest unit 822 outputs the extracted class tap from the class tap are provided to the active detection unit 876. 从来自分类抽头提取单元822的所关心的像素的分类抽头中,活动性检测单元876检测CMOS成像器801输出的图像信号中的所关心的像素位置附近的活动,并把活动提供给了移动量控制单元877。 From from the class tap extracting unit pixel of interest 822 of the class tap, the movable vicinity of the pixel position in the image signal activity detecting unit 876 detects a CMOS imager 801 outputted interest, and supplies activity to the amount of movement The control unit 877. 这里的活动的例子包括组成所关心的像素的分类抽头的像素的动态范围(组成分类抽头的像素的最大和最小值的差), 组成所关心的像素的分类抽头的相邻像素的之差的绝对值之和,组成所关心的像素的分类抽头的每个像素之差的绝对值之和及其平均值, 等等。 Examples here include constitutive activity of a pixel of interest of the pixel of the class tap of the dynamic range (consisting of the class tap of the pixel of the difference between the maximum and minimum values), the composition of the pixel of interest difference of adjacent pixels of the class tap of sum of absolute difference between each pixel of constituent pixels of interest in the class tap and the average sum of absolute values, and the like. 在这个安排中,组成所关心的像素的分类抽头的像素的动态范围,例如,将被用作活动。 In this arrangement, the constituent pixels of interest of the class tap of the pixel dynamic range, e.g., to be used as active.

根据活动性检测单元876提供的活动,移动量控制单元877以图56中移动量控制单元827 —样的方式控制CMOS成像器。 Activity based on the activity detecting unit 876 is provided, the amount of movement of the control unit 877 in FIG. 56 in an amount of movement of the control unit 827-- like is controlled CMOS imager. 就是说, 根据活动性检测单元876提供的活动,移动量控制单元877控制所关心的像素的预测抽头中的像素的聚光镜852的位置。 That is, according to the activity the activity detecting unit 876 is provided, the position of the 852 pixel prediction tap shift amount control unit 877 controls the pixel of interest in the condenser.

图66A和66B阐明了从分类抽头提取单元822输出的分类抽头的例子,组成图57A中的分类抽头的9个^象素的像素值Pl至P9以Pl 至P9的顺序被排列在了单一的行上。 FIGS 66A and 66B illustrate an example of the class tap extracting unit 822 is outputted from the class tap, the class tap in the composition of 57A of FIG. 9 ^ pixel values ​​of the pixel Pl Pl to P9 in order to P9 are arranged in a single row.

对于从图像的平滑部分提取的分类抽头,组成分类抽头的像素Pl 至P9的像素值的变化较小,所以动态范围DR如图66A所示为较小值,比如。 For the smooth portion extracted from the image of the class tap, the class tap is composed of pixel values ​​of the pixels Pl to P9 small change is, a small value so dynamic range DR as shown in FIG. 66A, for example.

另一方面,对于从具有较大的变化的图像的一部分中提取的分类抽头,组成分类抽头的像素值P1至P9的变化是较大的,所以,例如如图66B所示,动态范围DR是一个较大的值。 On the other hand, for a portion extracted from an image having a large change in the class tap, the pixel variation values ​​of P1 to P9 consisting of the class tap is large, so, as shown in FIG 66B, the dynamic range DR is a large value.

相应地,如果分类抽头的动态范围较小, 一种平滑的图像可以被认定,并且如果分类抽头的动态范围较大, 一种具有较大级别变化的图像可以被认定。 Accordingly, if a smaller dynamic range of the class tap, a smooth image can be identified, and if the class tap large dynamic range, an image having a large level variation can be identified.

从而,如果分类抽头的动态范围较小,且相应地由光电二极管851 获得的图像值的图像是平滑的,移动量控制单元877控制聚光镜852 的位置到接近光电二极管851的位置上,如图59B所示,以便在光电二极管851上投射一种宽范围的物体光。 Thus, if the smaller dynamic range of the class tap, and accordingly the value of the image obtained by the photodiode 851 is smooth, the control unit 877 controls the amount of movement of the position of the condenser lens 852 closer to the photodiode 851 to a position, as shown in FIG 59B shown to project light of one object on a wide range of the photodiode 851. 同样,如果分类抽头的动态范围较大,且相应地由光电二极管851提供的图像值的图像有较大的级别变化,移动量控制单元877控制聚光镜852的位置到远离光电二极管851的位置上,如图59A所示,以便在光电二极管851上投射一种窄范围的物体光。 Similarly, if the class tap large dynamic range, and accordingly the image values ​​supplied by the photodiode 851 have a greater level of variation, movement amount control unit 877 controls the position of the condenser lens 852 to a position remote from the photodiode 851, shown in Figure 59A, light of one object to project a narrow range in the photodiode 851.

接下来,图65中所示的DRC电路802的信号处理过程将参考图67中的流程图进行描述。 Next, the DRC signal processing circuit 802 shown in FIG. 65 with reference to the flowchart in FIG. 67 will be described. 这里,如图61中的情况,DRC单元811把的N+1个帧(或场)中的某一像素当作所关心的像素,并预测此所关心的像素。 Here, in the case of FIG. 61, the DRC unit 811 of the N + 1 frame (or field) of a certain pixel as the pixel of interest, and the prediction for this pixel of interest.

这种情况下,在从CMOS成像器801输出的第N个帧的图像信号上,步骤S541中,分类抽头提取单元822以CMOS成像器801输出的图像信号的第N个帧的所关心的像素的最近的位置上的像素为中心提取十字型像素作为分类抽头的所关心的像素(图57),并把它提供给分类代码生成单元823和活动性检测单元876,且流程进入步骤S542。 In this case, on the image signal of N frames output from the CMOS imager 801, in step S541, the class tap extracting unit 822 to the pixel of interest N frame of the image signal output from the CMOS imager 801 pixel position closest to the center of the cross-shaped pixels extracted as the class tap of the pixel of interest (FIG. 57), and supplies it to the classification code generation unit 823 and the activity detecting unit 876, and the flow proceeds to step S542. 这里同样,就是说,第N + l帧的所关心的像素的分类抽头是从前一帧也就是第N帧图像信号中提取的,如图61中的情况。 Here again, that is, the N + l of the pixel of interest is a frame where the class tap from the previous frame is the N-th frame image signal extracted, as shown in FIG 61.

在步骤S542中,分类代码生成单元823通过执行分类抽头提取单元822提供的分类抽头的1位ADRC处理来获得所关心的像素的分类代码,并把它提供给因数生成单元824,且流程进入步骤S543。 In step S542, 1-bit ADRC processing class tap unit 822 provides the obtained classification codes the pixel of interest in the class code generating unit 823 extracts by performing the class tap, and supplies it to the factor generating unit 824, and the flow proceeds to step S543.

在步骤S543中,活动性检测单元876检测来自分类抽头提取单元822的所关心的像素的分类抽头的动态范围作为活动,把它提供给移动量控制单元877,且流程进入步骤S544。 Classification of the pixel of interest in step S543, the activity detecting unit 876 detects the class tap from the tap extracting unit 822 as the dynamic range of activities, it is supplied to the shift amount control unit 877, and the flow proceeds to step S544.

在步骤S543中,移动量控制单元877产生(确定)控制信息,来根据从活动性检测单元876提供的分类抽头的动态范围控制聚光镜852的位置,且流程进入步骤S545,在步骤S545中,移动量控制单元877根据前一步骤S543中产生的控制信息,控制组成所关心的像素的预测抽头的像素的MEMS单元853,从而,把该像素的聚光镜852的位置移动到了预定位置。 In step S543, a shift amount control unit 877 generates (OK) control information to the tap according to the classification from the activity detecting unit 876 provides the dynamic range control position of the condenser lens 852, and the flow proceeds to step S545, at step S545, the mobile the control unit 877 controls the amount of information generated in the previous step S543, the control unit 853 composed of MEMS pixels of interest in the prediction tap pixel and thus, the pixel position of the condenser lens 852 is moved to the predetermined position.

接下来,在第N+l帧的成像定时处,当第N+l帧的图像信号被成像且在CMOS成像器801输出,流程从S545进入S546,且预测抽头提取单元821以CMOS成像器801输出的图像信号的笫N个帧的所关心的像素的最近的位置上的像素为中心以菱形提取像素作为分类抽头的所关心的像素(图57B),并把它提供给预测计算单元825, 且流程进入步骤S547。 Subsequently, the N + l image frame at the timing when the image signal of frame N + l are imaged and output on a CMOS imager 801, the flow advances from S545 to enter S546, the prediction tap extracting unit 821 and a CMOS imager 801 pixels in the closest position to the pixel of interest Zi N frames of the image signal output from the center rhombic pixels are extracted as the class tap of the pixel (FIG. 57B) of interest, and supplies it to the prediction computation unit 825, and the flow proceeds to step S547.

也就是说,在步骤S545中,做为所关心的像素的预测抽头的某一像素的MEMS单元853被控制了,由此该像素的聚光镜852的位置也被控制。 That is, in step S545, the pixel of interest as prediction taps of a certain pixel of the MEMS unit 853 is controlled, whereby the position of the pixel of the condenser lens 852 is also controlled. 相应地,在步骤S546中,所关心的像素的预测抽头包括从像素的光电二极管851输出的像素值,据此方法来控制聚光镜852的位置。 Accordingly, in step S546, the pixel of interest includes a prediction tap from the pixel value of the pixel output of the photodiode 851, whereby the method to control the position of the condenser lens 852.

在步骤S547中,因数生成单元824向预测计算单元825输出由分类代码生成单元823提供的所关心的像素的分类代码的分类抽头因数,且流程进入步骤S548,这里预测计算单元825采用从预测抽头提取单元821提供的预测抽头和因数生成单元824提供的抽头因数执行 Class tap factor of the pixel of interest in step S547, the factor generating unit 824 to the prediction computation unit 825 outputs a class code generating unit 823 to provide classification code, and the flow proceeds to step S548, where the prediction computation unit 825 uses the prediction tap factor prediction tap extracting unit 821 and provides the tap factor generating unit 824 provides execution

上面表达式(l)的计算,从而,获得了所关心的像素的像素值,且流程结束。 Calculating the above expression (l), thus obtained pixel values ​​of pixels of interest, and the flow ends.

将N+l帧中的每个像素都做为所关心的像素顺序执行前面所迷的处理过程,另外,对于的N + 2帧也是这样,等等。 The frame N + l of each pixel of interest as pixel order processing previously performed fans, further, for the N + 2 frame, too, and the like.

注意,前面所述的安排包括从作为第N+l帧前一帧的第N帧的图像信号中提取所关心的像素的分类抽头,但可能安排从作为所关心的像素的帧的第N + l帧的图像信号中提取所关心像素的分类抽头。 Note that the foregoing arrangement comprising a first pixel from the N + extraction image signal of the previous frame N-th frame as the frame of interest l class tap, but it is possible to arrange the N-th frame as the pixel of interest from the + l frame image signal to extract the pixel of interest classified taps.

同样,在第N+l帧中存在某些情况,其中在某一像素弁A是所关心的像素的情况下以及在接近该像素的像素#B是所关心的像素情况下,CMOS成像器801的同一像素的聚光镜852被控制到不同的位置。 Also, there is some case where the first frame N + l, where A Bian at a certain pixel is a pixel of interest and the case where the pixel near #B is a case where the pixel of interest, CMOS image 801 the same pixel condenser lens 852 is controlled to a different location. 这可以通过当像素弁A是所关心的像素的情况下在像素的聚光镜852的位置上和当像素#8是所关心的像素的情况下在像素的聚光镜852的位置上以时间序列在CMOS成像器801处对第N+l帧的图像信号进行成像来解决。 This can be done when the pixel Bian A is a pixel of interest in the case where the position of a pixel of the condenser lens 852 of the upper and when the pixel # 8 is a pixel of interest in the case where the position of the condenser lens 852 pixels on a time series in the CMOS imaging is 801 pairs of frame N + l image signal imaged solved. 或,将优先权交给与作为之前或之后作为所关心的像素的像素相对应的聚光镜852的位置。 Or, after or as the pixels of the pixel of interest before the priority corresponding to the position 852 as a focusing lens.

另外,在此所述的安排包括,通过在做为所关心的像素的预测抽头的像素上控制MEMS单元853来控制的聚光镜852的位置,但是也可以作出一种安排其中,例如,只控制有所关心的像素的最接近的像素的聚光镜852的位置,或者控制在所关心的像素的某一范围中的全部像素的聚光镜852的位置,等等。 Further, the arrangement herein comprises, in the position by the pixel of interest as prediction tap pixel control unit 853 controls the MEMS condenser lens 852, but an arrangement may be made wherein, for example, there is only control position of the condenser lens 852 closest to the pixel of interest, or controlled within a certain range of the pixel of interest in the positions of all the pixels of the condenser lens 852, and the like.

接下来,图67的步骤S544中的处理过程(为生成与分类抽头的活动相对应的控制信息的控制信息生成处理)将被详细描述,该描述参考了控制聚光镜的位置在两个位置的一个或另一个上,如图59所示的接近或远离光电二极管851的情况,参考图68中的流程图。 Next, the processing of step S544 in FIG. 67 (to generate a class tap and the activity corresponding to control information generation processing information) will be described in detail with reference to the description of the position control of a condenser lens in the two positions of or on the other, toward or away from where the photodiode 851 shown in FIG. 59, with reference to the flowchart of FIG. 68.

首先,在步骤S551中,移动量控制单元877以最大动态范围规格化所关心的像素的分类抽头的动态范围,且流程进入步骤S552。 First, at step S551, the shift amount control means 877 to classify the pixels of interest normalized maximum dynamic range of the dynamic range of the tap, and the flow proceeds to step S552. 也就是说,移动量控制单元877以最大动态范围分割分类抽头的动态范围, 最大动态范围是从CMOS成像器801输出的图像信号可假定的最大和最小值的差,从而规格化了分类抽头的动态范围。 That is, the maximum amount of movement of the control unit to the dynamic range of the class tap dividing the dynamic range 877, a maximum dynamic range of the image signal output from the CMOS imager 801 may be assumed that the difference between the maximum and minimum values, thus normalizing the class tap Dynamic Range. 此后,被规格化了的分类抽头的动态范围视情况将被引用为"已规格化的动态范围"。 Since then, the dynamic range is normalized classification tap as the case will be cited as "normalized dynamic range." 注意,规格化分类抽头的动态范围不一定是必要的。 Note that the class tap normalized dynamic range is not necessarily needed.

在步骤S552中,移动量控制单元877确定已规格化的动态范围是否大于一预定的阈值。 In step S552, the control unit 877 determines the amount of movement has been normalized dynamic range is greater than a predetermined threshold value. 采用的阈值可以是,例如,0.5等。 Threshold may be employed, for example, 0.5 and the like.

在步骤S552中,如果已规格化的动态范围被确定大于预定的阈值,流程进入步骤S553,且移动量控制单元877将此表示为在所关心的像素位置附近,由CMOS成像器801成像的图像级别的变化是很大的,且相应地生成控制信息将聚光镜852的位置控制到远离光电二极管851的位置上,即, 一种窄范围的物体光被投射在光电二极管851 的位置,且流程返回。 In step S552, if the normalized dynamic range is determined greater than a predetermined threshold value, the flow proceeds to step S553, the control unit 877 and the amount of this movement is represented in the vicinity of the pixel position of interest, by the CMOS imagers 801 of the image forming level change is large, and accordingly generates control information to control the position of the condenser lens 852 to a position away from the photodiode 851, i.e., a narrow range of the object light is projected at the position of the photodiode 851, and the flow returns .

在步骤S552中,如果已规格化的动态范围被确定不大于预定的阈值,流程进入步骤S553,且移动量控制单元877将此表示为在所关心的像素位置附近,由CMOS成像器801成像的图像级别的变化是平滑的,且相应地生成控制信息将聚光镜852的位置控制到接近光电二极管851的位置上,即, 一种宽范围的物体光被投射在光电二极管851 的位置,且流程返回。 In the step S552, if the normalized dynamic range is determined not greater than the predetermined threshold value, the flow proceeds to step S553, the control unit 877 and the amount of this movement is represented in the vicinity of the pixel position of interest, a CMOS imager 801 imaging image level variation is smooth, and accordingly generates control information, position of the condenser lens 852 is controlled to be closer to the photodiode 851 positions, i.e. a wide range of the object light is projected at the position of the photodiode 851, and the flow returns .

然而,在此描述一种安排,其中,分类抽头的已规格化的动态范围被用作指示由CMOS成像器801成像的图像中的所关心的像素位置附近的活动的信息,除了采用分类抽头的布置,其他布置也可被制定, 例如, 一种采用在预测抽头或类似所关心像素附近的多个任意像素的最大和最小值之差的作为指示所关心的像素位置附近的活动的信息的安排。 However, an arrangement described herein, wherein the class tap have been normalized dynamic range is used as the information indicating the pixel position near the image 801 imaged CMOS imager of interest in activities, except that class tap arrangement, other arrangements may also be developed, for example, an information prediction tap or the like in the difference between the maximum and minimum values ​​of a plurality of pixels near an arbitrary pixel of interest activities near the pixel position of interest as an indication arrangements adopted .

同样,在上述情况中,通过控制MEMS单元853,对聚光镜852 的在两个位置中的一个进行的控制,即,接近光电二极管851的位置和远离光电二极管851的位置,但聚光镜852可以被控制在三个或更多的位置上。 Also, in the above case, by controlling the MEMS unit 853, a condenser lens a 852 in the two positions is controlled, i.e., closer to the photodiode 851 in position and away from the photodiode 851, the condenser lens 852 may be controlled in three or more locations.

接下来,图67的步骤S544中的控制信息生成处理中,如图63A 至图63C所示,聚光镜852的位置被控制在三个位置中的一个,即,标准位置、接近光电二极管851的位置,和远离光电二极管851的位置,这将参考图69中的流程图进行详细的描述。 Next, the control information in step S544 of FIG. 67 in the generation process, as shown in FIG. 63A to FIG. 63C, the position of the condenser lens 852 is controlled to be one of the three positions, i.e., the standard position, a position closer to the photodiode 851 and a position away from the photodiode 851, this reference to a flowchart of FIG. 69 described in detail.

首先,在步骤S561中,通过规格化所关心的像素的分类抽头的动态范围,移动量控制单元877获得作为所关心的像素的分类抽头的动态范围比率的已规格化的动态范围作为最大动态范围,且流程进入步骤S562。 First, in step S561, the classification by the pixel of interest normalized dynamic range of the tap, the control unit 877 to obtain the amount of movement of the classification as a pixel of interest of the dynamic range of the ratio of the taps have been normalized dynamic range as the largest dynamic range and the flow proceeds to step S562.

在步骤S562中,移动量控制单元877确定已规格化的动态范围是否相对较小,例如,是个比0.3小的值。 In step S562, the control unit 877 determines the amount of movement has been normalized whether the dynamic range is relatively small, for example, a value smaller than 0.3.

在步骤S562中,如果已规格化的动态范围确定比0.3小,流程进入步骤S563,在此移动量控制单元877将由CMOS成像器801成像的图像在所关心的像素位置附近的级别变化量较小,并相应地产生控制信息将聚光镜852控制在标准位置上,即,让居中范围的物体光投射在光电二极管851的位置,且流程返回。 In step S562, if the normalized dynamic range is determined smaller than 0.3, the flow proceeds to step S563, the image forming unit 877 by the CMOS imaging device 801 in the mobile amount control in a small level variation near the pixel position of interest , and generates control information to control the condenser lens 852 in the standard position, i.e., so that the object at the center position of the light projection range of the photodiode 851, and the flow returns.

在步骤S562中,如果已规格化的动态范围被确定为不小于0.3, 流程进入步骤S564,且移动量控制单元877确定已规格化的动态范围既不大又不小,比如,大于等于0.3但小于0.6的值。 In step S562, if the normalized dynamic range is determined to be not less than 0.3, the flow proceeds to step S564, and the control unit 877 determines the amount of movement has been normalized neither large nor small dynamic range, such as, but not less than 0.3 value of less than 0.6. 在步骤S564中, 如果已规格化的动态范围被认定为大于等于0.3但小于0.6的值,流程进入步骤S565,移动量控制单元877确定由CMOS成像器801成像的图像在所关心的像素位置附近的级别变化量既不大又不小,并相应地产生控制信息来控制聚光镜852在远离距光电二极管851的位置上, 即, 一种让窄范围的物体光投射在光电二极管851的位置,且流程返回。 In step S564, if the normalized dynamic range is not less than 0.3 but identified value of less than 0.6, the flow proceeds to step S565, the control unit 877 determines the movement amount by the image near the CMOS imager 801 imaging pixel position of interest level change neither large nor small amounts, and generates control information to the condenser lens 852 at a position away from the photodiode 851, i.e. a narrow range so that the object light is projected at a position of the photodiode 851, and the flow returns.

在步骤S564中,如果已规格化的动态范围被认定为不是一个大于等于0,3但小于0.6的值,流程进入步骤S566,且移动量控制单元877 决定已规格化的动态范围是否相对较大,比如, 一个大于0.6的值。 In step S564, if the normalized dynamic range is not identified as a greater than or equal to 0.3 but less than 0.6 value, the flow proceeds to step S566,, and the amount of movement of the control unit 877 determines whether the dynamic range is normalized relatively large , for example, a value greater than 0.6.

在步骤S566中,如果已规格化的动态范围被认定为是一个大于0.6的值,流程进入步骤S567,移动量控制单元877认为由CMOS成像器801成像的图像在所关心的像素位置附近的级别变化量较大,并相应地产生控制信息将聚光镜852控制在远离光电二极管851的位置上,即, 一种让窄范围的物体光投射在光电二极管851的位置,且流程返回。 In step S566,, if the normalized dynamic range is identified as a value greater than 0.6, the flow proceeds to step S567, the control unit 877 that the amount of movement by the level of the image forming CMOS imagers 801 in the vicinity of the pixel position of interest a large amount of change, and generates control information to control the condenser lens 852 at a position remote from the photodiode 851, i.e., a narrow range of the object so that the light projection position in the photodiode 851, and the flow returns.

同样,在步骤S566中,如果已规格化的动态范围被认定为是一个不大于0.6的值,移动量控制单元877把这种情况当作错误处理,并不产生控制信息而返回。 Similarly, at step S566,, if the normalized dynamic range is identified as a value not greater than 0.6, the amount of movement of the control unit 877 as an error handling case, generates control information is not returned. 这种情况下,聚光镜852的位置保持在以前的位置上,例如。 In this case, the condenser lens 852 is held in position on the previous position, for example.

前面所述的布置包括图56和65中所示的因数生成单元824,它存储通过事先的学习而获得的每个类的抽头因数,但对于因数生成单元824,其为每个类从好似作为种子的抽头种子数据和预定参数中生成能够产生所希望质量的图像的抽头因数。 The foregoing arrangement includes a factor generating unit 65 shown in FIG. 56 and 824, which stores beforehand by learning to obtain tap factor for each class, but for a factor generating unit 824, from which a like for each class generating a tap seed data and predetermined parameters of seed capable of producing a tap factor desired image quality.

通过因数种子数据和预定的参数,为每个类生成抽头因数的因数生成单元的配置和图30所示的因数生成单元124的配置一样,所以详细的描述将#1略去(见图30至36和其描述)。 By a factor of a predetermined parameter and seed data, and the same configuration as the configuration factor generating unit 30 shown in factor generating unit 124 generates class taps for each factor, so the detailed description will be omitted # 1 (see FIG. 30 to 36 and the description thereof).

同样,与学习设备相对应的配置和图20中所示的学习设备的配置一样,但特征提取单元136配置和分类抽头提取单元822配置的抽头配置相同的分类抽头,并把这些提供给类分类单元137。 Similarly, the learning apparatus corresponding to the configuration and the configuration of the learning apparatus shown in FIG. 20 the same, but the feature extraction unit 136 configured tap and the class tap extracting unit 822 configured with the same configuration of the class tap, and provide them to the class classification unit 137. 类分类单元137生成与分类代码生成单元823配置相同的分类代码。 Class classifying unit 137 generates a class code generating unit 823 configured with the same classification code.

根据与图30所示的分辨率等相对应的参数,如果为每个类在因数输出单元124上生成抽头因数,CMOS成像器801可能根据参数而控制,而不是根据分类代码或分类抽头活动。 The parameter corresponding to the resolution and the like shown in FIG. 30, if the factor is generated in the tap coefficient output unit 124 for each class, CMOS image 801 may be controlled according to the parameter, rather than the class code class tap or activity.

图70阐明了DRC电路802的另一种配置的例子,它根据参数来控制CMOS成像器801。 FIG 70 illustrates an example circuit 802 DRC another configuration, it controls the CMOS imager 801 according to the parameters. 注意,与图56或65中相对应的组件由同样的参考标记指示,并视情况略去其描述。 Note that, with 65 or components corresponding to FIG. 56 the same reference numerals, and description thereof will be omitted optionally. 简单的说,图70中阐明的DRC电路802基本上和图56所示的一样,不同点在于移动量控制单元917被提供而不是控制单元812的DL 826和移动量控制单元827。 Briefly, a DRC forth in FIG. 70 is substantially the same as circuit 802 shown in Figure 56 and, except that the amount of movement of the control unit 917 is provided instead of the control unit 812 DL 826 and the moving amount of the control unit 827.

图70中,用户操作操作单元985,该单元根据其操作输出参数z 给因数生成单元824和移动量控制单元917。 FIG. 70, the user operates the operation unit 985, the unit z-factor to the generating unit 824 and the moving amount control unit 917 according to the operation output parameter. 因数生成单元824由图30的方法被配置,并基于从操作单元985提供的参数z来为每个类配置抽头因数,并把指示分类代码生成单元823提供的分类代码的抽头因数输出给预测计算单元825 。 Factor generating unit 824 is configured by the method of FIG. 30, and to configure the tap factor for each class based on the parameter z supplied from the operation unit 985, and outputs the tap factor indicating the class code generating unit 823 to provide classification codes to the prediction calculation unit 825.

移动量控制单元917控制与操作单元985提供的参数z相对应的CMOS成像器801。 Z movement amount of the control parameter control unit 917 provides the operation unit 985 corresponding to the CMOS imagers 801. 也就是说,如果参数z较大,因数生成单元824 产生抽头因数来极大的提高分辨率,并且如果参数z较小,因数生成单元824产生抽头因数来轻微的提高分辨率。 That is, if the parameter z large factor generating unit 824 generates a tap factor to greatly improve the resolution and the parameter z is small if the factor generating unit 824 generates a tap factor to slightly improve the resolution. 对于DRC单元811,如果极大的提高分辨率的抽头因数被使用,组成预测抽头的像素也应该具有高分辨率以适合在DRC单元811执行的信号处理。 For the DRC unit 811, if the tap greatly improve the resolution factor is used, the composition should pixel prediction taps adapted to a high resolution signal processing unit 811 performs the DRC. 同样,对于DRC单元811,如果轻微的提高分辨率的抽头因数被使用,组成预测抽头的像素也应该具有不高的分辨率以适合在DRC单元811执行的信号处理。 Similarly, the DRC unit 811, if a slight improvement of the resolution factor is the use of the tap, prediction tap pixel composition should not have to fit a high resolution signal processing unit 811 performs the DRC.

相应地,如果参数z较大且一个极大的提高分辨率的因数已经产生,移动量控制单元917控制聚光镜852在远离光电二极管851的位置上,以便一个窄范围的物体光射入光电二极管851中。 Correspondingly, if the parameter z factor is large and a greatly improved resolution has been generated, the control unit 917 controls the amount of movement of the condenser lens 852 at a position remote from the photodiode 851 to a narrow range of object light incident on the photodiode 851 in. 同样,如果参数z较小且一个轻微的提高分辨率的因数已经产生,移动量控制单元917控制聚光镜852在接近光电二极管851的位置上,以便一个宽范围的物体光射入光电二极管851中。 Similarly, if the parameter z is small and a slight increase factor of the resolution has been generated, the control unit 917 controls the amount of movement of the condensing lens 852 in proximity to the photodiode 851 in position for a wide range of object light incident on the photodiode 851.

DRC电路802可以通过专门的硬件实现,或通过一个计算机,例如一个包括CPU (中央处理器),(包括DSP (数字信号处理))和半导体存储器等和微型计算机,来执行如前面所述的处理的程序而实现。 DRC circuit 802 may be implemented by dedicated hardware or by a computer, for example, a CPU (Central Processing Unit), (including a DSP (digital signal processing)) and a semiconductor memory and a microcomputer, to perform the process as previously the program is realized.

程序可以被安装在计算机中,或被存储在可移动存储介质,如软盘,CD-ROM (压缩光盘只读存储器),MO (磁光盘)盘, 一种DVD (数字化通用光盘),磁盘,半导体存储器等等,并当作封装软件提供。 Program may be installed in a computer, or stored in a removable storage medium, such as floppy disks, CD-ROM (Compact Disc Read Only Memory), MO (magneto-optical) discs, a DVD (Digital Versatile Disc), a magnetic disk, a semiconductor memory, etc., and provided as package software.

除了从这种可移动记录介质相微型计算机安装程序之外,可以从下载站点通过卫星、诸如数字广播卫星无线地,或者通过诸如LAN(局域网)或因特网此类的网络有线地将该程序传送到计算机中,下载并安装。 In addition to the program with a microcomputer installed from such a removable recording medium, from a download site via satellite, such as a digital satellite broadcast wirelessly, or through a LAN (Local Area Network) or the Internet, a wired network such as the program is transferred to the computer, download and install.

现在,在本说明书中,在使计算机实现的多个处理的程序代码中描述的处理过程不一定要按流程图中给出时间顺序来处理,器可以并行或单独执行(比如,并行处理或面向对象的处理)。 Now, in the present specification, the processing implemented in a plurality of processing computer program code is described in the flowcharts are not necessarily to be given to process time-sequentially, may be parallel or individually (e.g., parallel processing or for to be processed). 另外,程序可以由单个或多个计算机处理。 Further, the program may be processed by a single or multiple computers.

如前所述,控制CMOS成像器801以便输出适于DRC单元811 进行信号处理的图像信号,所以具有提高图像质量的图像信号可以通过DRC单元811的信号处理而获得。 As described above, the CMOS imager 801 to control an output image signal suitable DRC unit 811 performs signal processing, the image signal with enhanced image quality can be obtained by the signal processing unit 811 of the DRC.

注意,虽然本实施例采用CMOS成像器(CMOS传感器)来拾取图像,其他的成像方法,比如CCDs,可以被替代使用。 Note that, while the present embodiment employs a CMOS imager (CMOS sensor) to pick up an image, the other image forming methods, such as CCDs, may be used instead.

同样,虽然本实施例中CMOS成像器801和DRC电路802被配置在了一个芯片上,CMOS成像器801和DRC电路802也可以被配置在分离的芯片上。 Similarly, while the present embodiment, the CMOS imaging device 801 and the DRC circuit 802 is disposed on a single chip, CMOS imagers 801 and DRC circuit 802 may be disposed on separate chips.

另外,本实施例中,虽然射到入光电二极管851的物体光范围是通过控制聚光镜852的位置来控制的,但控制射入到光电二极管851 的物体光范围的方法不局限于此。 Further, in this embodiment, although the photodiode 851 is irradiated into the object light range by controlling the position of the condenser lens 852 to control, but the control method of the object light incident on the photodiode 851 range is not limited thereto. 例如,可以作出一种安排,其中, 为CMOS成像器801的每个像素提供采用MEMS技术的膜片,以便射入到光电二极管851的物体光范围能通过调整膜片而被调节。 For example, an arrangement may be made wherein the MEMS technology to provide a diaphragm for each pixel of the CMOS imager 801, an object light incident to the range of the photodiode 851 is adjusted by adjusting the diaphragm. 同样, 除了控制射入到光电二极管851的物体光范围,光电二极管851接收光的时间量(曝光时间),等等,也可以被控制。 Similarly, in addition to the photodiode 851 controls incident object light range, the amount of time the photodiode 851 receives light (exposure time), and the like, it may also be controlled.

Claims (15)

  1. 1. 一种信号处理设备,包括:图像转换装置,用于使从成像装置的输出中获得的第一数字图像信号经受图像转换处理以获得并且输出第二数字图像信号,该成像装置具有第一传感器,用于获取图像信号的第一分量,第二传感器,用于获取图像信号的不同于第一分量的第二分量,和第三传感器,用于获取图像信号的第三分量,该第三分量不同于第一分量和第二分量,所述图像转换装置包括:特征提取装置,用于使用所述第一数字图像信号,提取所关心像素的特征;类分类装置,用于根据所关心像素的特征,对所关心像素进行分类;因数输出装置,用于输出与所关心像素的类相对应的因数;以及计算装置,用于通过使用与所关心像素的类相对应的因数和所述第一数字图像信号执行计算而获取所关心像素的第二数字图像信号;评估装置,用于评估所述第 1. A signal processing apparatus, comprising: image converting means for causing the first digital image signal output from the image forming apparatus is subjected to image conversion processing to obtain the second digital image signal and outputs, the image forming apparatus having a first a sensor for acquiring an image signal of a first component, a second sensor, a second component different from the first component of the acquired image signal, and the third sensor, a third component of the acquired image signal, the third component different from the first and second components, said image conversion apparatus comprising: feature extraction means for using the first digital image signal, extracting a feature pixel of interest; class classification means, according to the pixel of interest features, classifying the pixel of interest; factor output means for outputting the pixel of interest by a factor corresponding to the class; and calculating means for using the pixel of interest by a factor corresponding to the class and the second a calculation is performed and the digital image signal obtaining a second digital image signal of the pixel of interest; evaluating means for evaluating said second 数字图像信号,所述评估装置至少包括关联计算装置,用于获得在第一、第二或第三传感器在第一放置状态情况下获得的第二数字图像信号与在第一、第二或第三传感器在第二放置状态情况下获得的第二数字图像信号之间的关联,其中根据所述关联,所述第二数字图像信号的图像质量被评估;以及控制装置,用于根据评估装置的评估,控制所述第一、第二和第三传感器中的至少一个的放置状态。 A digital image signal, the associated evaluation device comprising at least computing means for obtaining a second digital image signal in the first, second or third sensor obtained in the first place in a state where the first, second or first three sensors placed in the second state of the case of obtaining a second correlation between the digital image signal, wherein according to the association, the image quality of the second digital image signal is evaluated; and a control means for evaluation device evaluation, control the first, at least one of the placement state of the second and third sensors.
  2. 2. 根据权利要求l的信号处理设备,因数输出装置包括存储装置, 用于为多个类的每个存储因数。 L The signal processing apparatus as claimed in claim, factor output means includes storage means for storing for each of a plurality of classes of factors.
  3. 3. 根据权利要求1的信号处理设备,因数输出装置还包括: 存储装置,存储种子数据作为所述因数的种子;生成装置,用于从通过操作单元(185)输入的预定参数和所述种子数据为多个类的每一个生成因数。 3. The signal processing apparatus as claimed in claim 1, further factor output apparatus comprising: storage means for storing data as a seed of the seeds factor; generating means for said predetermined parameter and seed input through the operation unit (185) from factor data generated for each of the plurality of classes.
  4. 4. 根据权利要求1的信号处理设备,其中所述第一、第二和第三传感器是互补金属氧化物半导体传感器或者电荷耦合器件。 4. The signal processing apparatus of claim 1, wherein said first, second and third sensors is a complementary metal oxide semiconductor sensor or a charge coupled device.
  5. 5. 根据权利要求1的信号处理设备,另外包括所述成像装置。 The signal processing apparatus 1, the imaging apparatus further comprises claims.
  6. 6. —种信号处理方法,包括:图像转换步骤,使从成像装置的输出中获得的第一数字图像信号经受图像转换处理以获得并输出第二图像信号,该成像装置具有笫一传感器,用于获取图像信号的第一分量, 第二传感器,用于获取图像信号的不同于第一分量的第二分量,和第三传感器,用于获取图像信号的第三分量,该第三分量不同于第一分量和第二分量,所述图像转换步骤包括:特征提取步骤,用于使用所述第一数字图像信号,提取所关心像素的特征;类分类步骤,用于根据所关心像素的特征,对所关心像素进行分类;因数输出步骤,用于输出与所关心像素的类相对应的因数;以及计算步骤,用于通过使用与所关心像素的类相对应的因数和所述第一数字图像信号执行计算而获取所关心像素的第二数字图像信号;评估步骤,用于评估所述第二数字图像 6. - Species signal processing method comprising: an image conversion step, the first digital image signal output from the image forming apparatus is subjected to image conversion processing to obtain a second image signal, and outputting, the image forming apparatus having a sensor Zi with acquiring a first image signal component, a second sensor, a second component different from the first component of the acquired image signal, and the third sensor, a third component of the captured image signal, which is different from the third component the first and second components, the image converting step comprises: a feature extraction step of using the first digital image signal, extracting a feature pixel of interest; class classification step of the pixel of interest in accordance with features, classifying the pixel of interest; coefficient output step of outputting the pixel of interest corresponding to the class factor; and a step of calculating, for the pixel of interest by using the factor corresponding to the class and the first digital image obtaining a second signal calculation is performed and the digital image signal of the pixel of interest; evaluating step of evaluating the second digital image 号,所述评估步骤至少包括关联计算步骤,用于获得在第一、第二或第三传感器在第一放置状态情况下获得的第二数字图像信号与在第一、第二或第三传感器在第二放置状态情况下获得的第二数字图像信号之间的关联,其中根据所述关联,所述第二数字图像信号的图像质量被评估;以及控制步骤,用于根据所述评估步骤的评估,控制所述第一、第二和第三传感器中的至少一个的放置状态。 Number, the evaluating step comprises at least a correlation calculation step for obtaining a second digital image signal of the first, second or third sensor obtained in the first case of the first state is placed, in the second or third sensor association between the second digital image signal obtained in the second case placed state, wherein according to the association, the image quality of the second digital image signal is evaluated; and a control step of the evaluation according to step evaluation, control the first, at least one of the placement state of the second and third sensors.
  7. 7. —种信号处理设备,包括: 参数获取装置,用于获取预定的参数;控制装置,根据所述预定的参数控制成像装置的至少第一传感器、 笫二传感器或第三传感器之一的放置状态,该成像装置具有第一传感器,用于获取图像信号的第一分量,和第二传感器,用于获取图像信号的不同于第一分量的第二分量3和第三传感器,用于获取图像信号的第三分量,该第三分量不同于第一分量和第二分量;以及图像转换装置,与预定的参数相对应,使从所述成像装置的输出中获得的第一数字图像信号经受图像转换处理,以获得并输出第二数字图像信号,所述图像转换装置包括:特征提取装置,用于使用所述第一数字图像信号,提取所关心像素的特征;类分类装置,用于根据所关心像素的特征,对所关心像素进行分类;存储装置,用于存储种子数据作为因数的种子 7. - kind of signal processing apparatus, comprising: a parameter acquisition means for acquiring predetermined parameters; control means, in accordance with the predetermined control parameters of the image forming apparatus at least a first sensor, second sensor disposed undertaking of one of the third sensor or state, the image forming apparatus having a first sensor for acquiring image signals of a first component and a second sensor, a second component different from the first component of the acquired image signal and the third sensor 3, for acquiring image the third component of the signal, the third component different from the first and second components; and an image converting means corresponding to predetermined parameters of the first digital image signal obtained from the output of said image forming apparatus is subjected to image conversion processing, to obtain and output a second digital image signal, said image conversion apparatus comprising: feature extraction means for using the first digital image signal, extracting a feature pixel of interest; class classification means, according to the feature of the pixel of interest, pixels of interest are classified; storage means for storing data as a seed to a seed factor 生成装置,用于从通过操作单元(185)输入的预定参数和所述种子数据为多个类中的每一个生成因数;以及计算装置,用于通过使用与所关心像素的类相对应的因数、所述生成装置生成的每个类的因数和所述第一数字图像信号执行计算而获取所关心像素的第二数字图像信号。 Generating means from a predetermined parameter and seed data input through said operation unit (185) to each of a plurality of classes generated factor; and calculating means for using the pixel of interest by a factor corresponding to the class , while the second acquired digital image signal for each pixel of interest factor generating means generates the class and the first digital image signal calculation is performed.
  8. 8.根据权利要求7的信号处理设备,另外包括存储装置,用于存储预定的参数与第一、第二或第三传感器的放置状态相关联的参数表,其中所述控制装置控制所述第一、 第二或第三传感器到与参数表中预定参数相关联的放置状态。 8. The signal processing apparatus as claimed in claim 7, further comprising a storage means for storing a predetermined placement state parameter table parameter of the first, second or third sensor is associated, wherein the control means controls the first First, second or third sensor to a predetermined placement state parameter table associated parameters.
  9. 9.根据权利要求7的信号处理设备,其中第一、第二和第三传感器是互补金属氧化物半导体传感器或者电荷耦合器件。 9. A signal processing apparatus according to claim 7, wherein the first, second and third sensors is a complementary metal oxide semiconductor sensor or a charge coupled device.
  10. 10. 根据权利要求7的信号处理设备,还包括所述成像装置。 10. A signal processing apparatus according to claim 7, further comprising said image forming means.
  11. 11. 一种信号处理方法,包括: 获取步骤,用于获取预定的参数;控制步骤,用于根据所述预定的参数控制成像装置的第一传感器、 第二传感器和笫三传感器中的至少一个的放置状态,该成像装置具有第一传感器,用于获取图像信号的第一分量, 第二传感器,用于获取图像信号的不同于第一分量的第二分量,以及第三传感器,用于获取图像信号的第三分量,该第三分量不同于第一分量和第二分量;以及图像转换步骤,与所述预定的参数相对应,使从成像装置的输出中获得的第一数字图像信号经受图像转换处理,以获得并输出第二数字图像信号,所述图像转换步骤包括:特征提取步骤,用于使用所述第一数字图像信号,提取所关心像素的特征;类分类步骤,用于根据所关心像素的特征,对所关心的像素进行分类;存储步骤,用于存储种子数据作为因 11. A signal processing method comprising: an acquisition step for acquiring predetermined parameters; control step, a first sensor for controlling the image forming apparatus according to the predetermined parameters, and the undertaking of the second sensor at least one of three sensors the placed state, the image forming apparatus having a first sensor for acquiring an image signal of a first component, a second sensor, a second component different from the first component for obtaining an image signal, and a third sensor for obtaining the third component of the image signal, the third component different from the first and second components; and an image conversion step, the predetermined parameter corresponds to the first digital image signal output from the image forming apparatus is subjected to image conversion processing, to obtain and output a second digital image signal, the image converting step comprises: a feature extraction step of using the first digital image signal, extracting a feature pixel of interest; class classification step, according to wherein the pixel of interest, the pixel of interest classified; storing step of storing data as a result of seed 数的种子;生成步骤,用于从通过操作单元(185)输入的预定参数和所述种子数据为多个类中的每一个生成因数;以及计算步骤,用于通过使用与所关心像素的类相对应的因数、在所述生成步骤生成的每个类的因数和所述第一数字图像信号执行计算而获取所关心像素的第二数字图像信号。 Seeds; a step of generating, from a predetermined parameter and seed data input through said operation unit (185) to each of a plurality of classes generated factor; and a calculation step of the pixel of interest by using the class corresponding factor, said factor for each class in the step of generating said first digital generated image signal and performs a second digital image signal acquired pixel of interest is calculated.
  12. 12. —种信号处理设备,包括:获取装置,用于获取预定的参数;图像转换装置,用于使从成像装置的输出中获得的第一数字图像信号经受图像处理以获得并输出第二数字图像信号,该成像装置具有第一传感器,用于获取图像信号的第一分量,以及第二传感器,用于获取图像信号的不同于第一分量的第二分量,以及第三传感器,用于获取图像信号的第三分量,该第三分量不同于第一分量和第二分量,所述图像转换装置包括:特征提取装置,用于使用所述第一数字图像信号,提取所关心像素的特征;类分类装置,用于根据所关心像素的特征,对所关心的像素进行分类;存储装置,用于存储种子数据作为因数的种子;生成装置,用于从预定的参数和所述种子数据为多个类中的每一个生成因数;以及计算装置,用于通过使用与所关心像素的类相对应的因数 12. - Species signal processing apparatus comprising: acquiring means for acquiring predetermined parameters; image conversion means, for the first digital image signal output from the image forming apparatus is subjected to image processing to obtain a second digital output and image signals, the image forming apparatus having a first sensor for acquiring a first image component signal and a second sensor, a second component different from the first component of the captured image signal, and a third sensor for acquiring the third component of the image signal, the third component different from the first and second components, said image conversion apparatus comprising: feature extraction means for using the first digital image signal, extracting the feature of interest pixels; class classification means for the feature pixel of interest, pixels of interest are classified; storage means for storing data as a seed to a seed factor; generating means for a predetermined parameter from the seed and multiple data each of the classes generation factor; and calculating means for using the pixel of interest by a factor corresponding to the class 、所述生成装置生成的每个类的因数和所述第一数字图像信号执行计算而获取所关心像素的第二数字图像信号;控制装置,用于控制第一、第二和第三传感器中的至少一个的放置状态;评估装置,用于评估第二数字图像信号,所述评估装置至少包括关联计算装置,用于获得在第一、第二或第三传感器在第一放置状态情况下获得的第二数字图像信号与在第一、第二或第三传感器在第二放置状态情况下获得的第二数字图像信号之间的关联,其中根据所述关联,所述第二数字图像信号的图像质量被评估;以及存储装置,与评估装置的评估相对应,以关联方式存储所述预定的参数和第一、第二或第三传感器的放置状态。 The factor of each class generated by the generating means and the second digital image signal acquired pixel of interest is calculated performing said first digital picture signal; and a control means for controlling the first, second, and third sensors at least one of the placement state; evaluation means for evaluating the second digital image signal, the associated evaluation device comprising at least computing means for obtaining a first place in the state where the first, second or third sensor a second digital image signal associated with the second digital image signal between the first, second or third sensor obtained in the second case the placed state, wherein according to the association, the second digital image signal, the image quality is evaluated; and evaluating storage means, corresponding to the evaluation device, disposed in an associated storage state of said predetermined parameters and the first, second or third sensor.
  13. 13. 根据权利要求12的信号处理设备,其中第一、第二和第三传感器是互补金属氧化物半导体传感器或者电荷耦合器件。 13. A signal processing apparatus according to claim 12, wherein the first, second and third sensors is a complementary metal oxide semiconductor sensor or a charge coupled device.
  14. 14. 根据权利要求12的信号处理设备,还包括所述成像装置。 14. A signal processing apparatus according to claim 12, further comprising said image forming means.
  15. 15. —种信号处理方法,包括: 获取步骤,用于获取预定的参数;图像转换步骤,用于使从成像装置的输出中获得的第一数字图像信号经受图像处理以获得并输出第二数字图像信号,该成像装置具有6第一传感器,用于获取图像信号第一分量,和第二传感器,用于获取图像信号的不同于第一分量的第二分量,以及第三传感器,用于获取图像信号的第三分量,该第三分量不同于第一分量和第二分量,所述图像转换步骤包括:特征提取步骤,用于使用所述第一数字图像信号,提取所关心像素的特征;类分类步骤,用于根据所关心像素的特征,对所关心的像素进行分类;存储步骤,用于存储种子数据作为因数的种子;生成步骤,用于从预定的参数和所述种子数据为多个类中的每一个生成因数;以及计算步骤,用于通过使用与所关心像素的类相对应的因数、 15. - Species signal processing method comprising: an acquisition step for acquiring predetermined parameters; an image conversion step, for the first digital image signal output from the image forming apparatus is subjected to image processing to obtain a second digital output and image signals, the image forming apparatus having a first sensor 6, the image signal for obtaining a first component and a second sensor, a second component different from the first component of the captured image signal, and a third sensor for acquiring the third component of the image signal, the third component different from the first and second components, the image converting step comprises: a feature extraction step of using the first digital image signal, extracting the feature of interest pixels; class classification step of the feature pixel of interest, pixels of interest are classified; storing step of storing data as a factor seed seed; generating step, a predetermined parameter and seed data from the multi- each of the classes generation factor; and a calculation step of the pixel of interest by using the factor corresponding to the class, 所述生成步骤生成的每个类的因数和所述第一数字图像信号执行计算而获取所关心像素的第二数字图像信号;控制步骤,用于控制第一、第二和第三传感器中的至少一个的放置状态;评估步骤,用于评估第二数字图像信号,所述评估步骤至少包括关联计算步骤,用于获得在第一、第二或第三传感器在第一放置状态情况下获得的第二数字图像信号与在第一、第二或第三传感器在第二放置状态情况下获得的第二数字图像信号之间的关联,其中根据所述关联,所述第二数字图像信号的图像质量被评估;以及存储步骤,与所述评估步骤的评估相对应,以关联方式存储所述预定的参数和第一、第二或第三传感器的放置状态。 Factor for each class of the first digital image signal and performing said generating step of generating a second calculating acquired digital image signal pixel of interest; control step for controlling the first, second, and third sensors at least one placement state; evaluation step for evaluating the second digital image signal, said evaluating step comprises at least a correlation calculation step for obtaining a first place in the state where the first, second or third sensor associated with the second digital image signal and the second digital image signal between the first, second or third sensor obtained in the second case the placed state, wherein according to the association, the second digital image signal, image quality is evaluated; and a storage step, evaluating step of evaluating the corresponding, placed in an associated storage state of said predetermined parameters and the first, second or third sensor.
CN 200710101005 2003-07-31 2004-07-30 Signal processing apparatus and signal processing method CN100525389C (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
JP2003283271A JP4281453B2 (en) 2003-07-31 2003-07-31 Signal processing device and signal processing method
JP283273/2003 2003-07-31
JP283271/2003 2003-07-31
JP283272/2003 2003-07-31
JP283274/2003 2003-07-31
CN200410095944.8 2004-07-30

Publications (2)

Publication Number Publication Date
CN101047788A true CN101047788A (en) 2007-10-03
CN100525389C true CN100525389C (en) 2009-08-05

Family

ID=34268204

Family Applications (3)

Application Number Title Priority Date Filing Date
CN 200710101004 CN100527787C (en) 2003-07-31 2004-07-30 Signal processing apparatus and signal processing method
CN 200710101006 CN100525390C (en) 2003-07-31 2004-07-30 Signal processing apparatus and signal processing method
CN 200710101005 CN100525389C (en) 2003-07-31 2004-07-30 Signal processing apparatus and signal processing method

Family Applications Before (2)

Application Number Title Priority Date Filing Date
CN 200710101004 CN100527787C (en) 2003-07-31 2004-07-30 Signal processing apparatus and signal processing method
CN 200710101006 CN100525390C (en) 2003-07-31 2004-07-30 Signal processing apparatus and signal processing method

Country Status (2)

Country Link
JP (1) JP4281453B2 (en)
CN (3) CN100527787C (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102271216B (en) * 2010-06-01 2013-09-04 格科微电子(上海)有限公司 Image sensor and signal processing method thereof
US8948338B2 (en) * 2011-11-03 2015-02-03 Medtronic Navigation, Inc. Dynamically scanned X-ray detector panel
JP2013239904A (en) * 2012-05-15 2013-11-28 Sony Corp Image processing apparatus and image processing method and program
JP2014126903A (en) 2012-12-25 2014-07-07 Toshiba Corp Image processing apparatus, image processing method, and program
US9262810B1 (en) * 2014-09-03 2016-02-16 Mitsubishi Electric Research Laboratories, Inc. Image denoising using a library of functions

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5552825A (en) 1994-11-08 1996-09-03 Texas Instruments Incorporated Color resolution enhancement by using color camera and methods
CN1175042A (en) 1996-08-22 1998-03-04 明;电脑股份有限公司 Method and system for adjusting position of charge coupled device and lens in scanning assembly
CN1192007A (en) 1996-12-25 1998-09-02 索尼株式会社 Position detection apparatus and remote control apparatus
US5852470A (en) 1995-05-31 1998-12-22 Sony Corporation Signal converting apparatus and signal converting method
CN1223050A (en) 1997-05-06 1999-07-14 索尼公司 Image converter and image conversion method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1245016C (en) 1999-03-12 2006-03-08 索尼公司 Image processing device and method, and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5552825A (en) 1994-11-08 1996-09-03 Texas Instruments Incorporated Color resolution enhancement by using color camera and methods
US5852470A (en) 1995-05-31 1998-12-22 Sony Corporation Signal converting apparatus and signal converting method
CN1175042A (en) 1996-08-22 1998-03-04 明;电脑股份有限公司 Method and system for adjusting position of charge coupled device and lens in scanning assembly
CN1192007A (en) 1996-12-25 1998-09-02 索尼株式会社 Position detection apparatus and remote control apparatus
CN1223050A (en) 1997-05-06 1999-07-14 索尼公司 Image converter and image conversion method

Also Published As

Publication number Publication date Type
JP2005051638A (en) 2005-02-24 application
CN100527787C (en) 2009-08-12 grant
CN100525390C (en) 2009-08-05 grant
CN101039383A (en) 2007-09-19 application
CN101047789A (en) 2007-10-03 application
CN101047788A (en) 2007-10-03 application
JP4281453B2 (en) 2009-06-17 grant

Similar Documents

Publication Publication Date Title
Nayar et al. High dynamic range imaging: Spatially varying pixel exposures
US6765611B1 (en) Method for compressing an image from a sparsely sampled extended dynamic range image sensing device
US6646246B1 (en) Method and system of noise removal for a sparsely sampled extended dynamic range image sensing device
US20100046906A1 (en) Image Processing Method, Image Recording Method, Image Processing Device and Image File Format
US20050265633A1 (en) Low latency pyramid processor for image processing systems
US20110096987A1 (en) Noise reduced color image using panchromatic image
US20050128312A1 (en) Imaging method and system for determining camera operating parameter
US20050057687A1 (en) System and method for increasing space or time resolution in video
US20040120606A1 (en) Imaging method and system for determining an area of importance in an archival image
US20040169747A1 (en) Image processing apparatus and method, recording medium, and program
US20090091645A1 (en) Multi-exposure pattern for enhancing dynamic range of images
US20060093233A1 (en) Ringing reduction apparatus and computer-readable recording medium having ringing reduction program recorded therein
US20080122953A1 (en) Image processing device, image processing method, and image sensing apparatus
US20070126921A1 (en) Adjusting digital image exposure and tone scale
US20110150280A1 (en) Subject tracking apparatus, subject region extraction apparatus, and control methods therefor
US20070110321A1 (en) Image processing apparatus, image processing method, program for image processing method, and recording medium which records program for image processing method
US7149262B1 (en) Method and apparatus for enhancing data resolution
US20060290796A1 (en) Digital image processing
US7009636B2 (en) Photocurrent estimation from multiple captures for simultaneous SNR and dynamic range improvement in CMOS image sensors
US20080063294A1 (en) System and Method for High Performance Image Processing
US20090067752A1 (en) Image-registration method, medium, and apparatus
US7068396B1 (en) Method and apparatus for performing tone scale modifications on a sparsely sampled extended dynamic range digital image
US20060072018A1 (en) Image processing device and method, recording medium, and program
US20120057070A1 (en) Digital image processing apparatus, digital image processing method, and recording medium storing the digital image processing method
US20100013948A1 (en) Multi-color image processing apparatus and signal processing apparatus

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C14 Grant of patent or utility model
EXPY Termination of patent right or utility model