JPH104559A - Image processing system and image data processing unit - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a transmission time in the case of sending color image data and to simplify an input output interface. SOLUTION: An image signal outputted from a CCD 11 is given to an A/D converter 12, where the signal is converted into digital image signal and it is stored in a memory 13. The image data stored in the memory 13 are sent to an input output interface 21 of an image data processing unit 20A mounted on a personal computer via an input output interface 14. The image data received via the input output interface 21 are written in a memory 22. A luminance signal generating means 23 applies arithmetic processing to the image data written in the memory 22 to generate a luminance signal, and a color difference signal generating means 24 applies arithmetic processing to the image data written in the memory 22 to generate a color difference signal. A basic color signal generating means 25 applies arithmetic operation to the luminance signal and the color difference to generate an RGB basic color signal.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image processing system and an image data processing apparatus for processing a video signal captured by a solid-state image sensor using a personal computer.

[0002]

2. Description of the Related Art In recent years, the processing capability of a microprocessor has been dramatically improved due to the advanced development of semiconductor technology. Along with this, it is becoming common practice to import voices and images into a personal computer called multimedia and process and edit the captured voices and images for use.

[0003] As a first conventional example, a method of taking an image into a general personal computer will be described below.

First, a hardware device for image capture (hereinafter referred to as an image capture board) is connected to an extension interface of a personal computer, and a standard television signal such as NTSC is input to the image capture board.

In the image capturing board, a luminance signal (Y) and a color difference signal (R-
Y, BY) are generated, and primary color signals (R, G, B) are created from the generated luminance signals and color difference signals. The created primary color signal is converted into a digital signal and stored in a storage device on the image capturing board.

The primary color signal stored in the storage device is read in response to a read request from a personal computer and processed as image data on the personal computer.

In the first conventional example, since the processing of writing image data to a storage device is performed using hardware, high-speed processing is possible and moving images can be generally handled. It is.

[0008] However, the first conventional example has a problem that dissemination is hindered because processing by hardware leads to an increase in system cost.

Therefore, there has been proposed an image input device for capturing image data into a personal computer without using an image capturing board. Hereinafter, the image input device will be described as a second conventional example with reference to the drawings.

FIG. 5 shows the configuration of an image input device according to a second conventional example. As shown in FIG. 5, the image input device 50 includes a solid-state image sensor (hereinafter referred to as a CCD) 51,
A signal processing unit 52, an A / D converter 53, a memory 54, an input / output interface 55, a timing generator 56, and a memory controller 57 are used to input image data to a personal computer 60 via the input / output interface 55. Do.

FIG. 6 shows a configuration in which the signal processing unit 52 processes a black and white signal. The signal processing unit 52 includes a noise removal unit 71, an automatic gain control unit (hereinafter, referred to as AGC) 72, It comprises a band-pass filter (hereinafter referred to as LPF) 73, a γ correction unit 74, and a contour enhancement unit 75.

The operation of the image input device 50 when the signal processing section 52 processes a black and white signal will be described below.

First, a CCD 51 is provided with a timing generator 56.
The read video signal is driven by the
2 and the signal processing unit 52 performs a monochrome signal process.

The video signal output from the CCD 51 is input to a noise removing unit 71, and the noise removing unit 71
The noise component included in the video signal output from 1 is removed. The video signal from which the noise component has been removed is the AGC 72
After the gain is controlled so that the signal level becomes a constant value, only the low frequency component is extracted by the LPF 73, and γ
Gamma correction, which is a non-linear process, is performed by the correction unit 74, and thereafter, the high-frequency component of the image is enhanced by the contour enhancement unit 75, and the image is output as a black-and-white video signal.

Next, the black-and-white video signal output from the signal processing section 52 is input to an A / D converter 53, which converts the black-and-white video signal into black-and-white image data which is a digital signal. 54. Memory 54
Is controlled by a memory controller 57, which reads monochrome image data from the memory 54 in accordance with a communication procedure with the personal computer 60 and transfers the read monochrome image data to the input / output interface 55.

The input / output interface 55 converts the input black-and-white image data into a standard communication procedure such as RS-232C and transfers it to the personal computer 60 through a connection means such as a cable. The personal computer 60 processes black-and-white image data input through an input / output interface on the personal computer 60.

FIG. 7 shows a configuration when the signal processing section 52 processes a color signal. The signal processing section 52 includes a noise removing section 71, an AGC 72, an LPF 73, and a γ correcting section 7.
4. Consists of an outline enhancing section 75, a color separating section 76, a white balance processing section 77, a γ correcting section 78, and a matrix 79.

The operation of the image input device 50 when the signal processing section 52 processes a color signal will be described below.

The operation of the image input device 50 for processing a color signal is the same as that for the processing of a monochrome signal except for the processing in the signal processing section 52. The video signal read by the CCD 51 is output to the signal processing section 52. After the color signal processing is performed in the signal processing section 52, the color signal is output from the input / output interface 55 to the personal computer 60.

First, as in the case of processing a monochrome signal, CC
The video signal output from the D51 is input to the noise removal unit 71, and the noise removal unit 71 removes a noise component included in the video signal output from the CCD 51. After the gain of the video signal from which the noise component has been removed is controlled by the AGC 72 so that the signal level becomes a constant value, only the low-frequency component is extracted by the LPF 73, and the gamma correction unit 74 performs gamma correction. The high-frequency component of the image is emphasized in the contour emphasizing unit 75 and output to the matrix 79 as a Y signal (luminance signal).

The image signal output from the AGC 72 is separated into two color signals r and b by a color separation unit 76, and then the two color signals r and b are sent to a white balance processing unit 77. The white balance processing section 77 performs white balance processing, and thereafter outputs the same to the γ correction section 78 as an RY color difference signal and a BY color difference signal. The RY color difference signal and the BY color difference signal are converted to a γ correction unit 78.
Are output to the matrix 79 after the gamma correction is performed.

As described above, the Y signal, the RY color difference signal, and the BY color difference signal are inputted to the matrix 79, and the Y signal, the RY color difference signal, and the BY color difference signal are processed by the arithmetic operation processing. After generating R, G, and B primary color signals from R, G, and B, they are output as RGB signals.

As described above, a color image can be obtained by replacing the monochrome signal processing unit with the color signal processing unit.

[0024]

However, the image input device according to the second conventional example can realize low cost because it does not require an image capturing board. However, when a color video signal is transmitted, the following problem occurs. Such a problem arises.

When a color image is to be obtained by the image input device according to the second conventional example, a color image signal is obtained by replacing the monochrome signal processing section with a color signal processing section as described above. A / D converter converts the signal into color image data which is a digital signal,
Subsequent processing may be performed, but since the color image data to be transmitted is the three primary color signals of R, G, and B, the information amount is three times as large as that of the monochrome image data. Therefore, transmission of color image data requires three times as long as transmission of black and white image data. Further, in order to transmit at the same time, it is necessary to triple the transmission speed, but this is not practical.

Further, the color signal processing circuit is not preferable because the circuit scale becomes much larger than that of the black and white data processing circuit, which leads to an increase in the cost of equipment.

In view of the above, it is an object of the present invention to reduce the transmission time when transmitting color image data and to simplify the input / output interface.

[0028]

Means for Solving the Problems In order to achieve the above object, a solution taken by the invention of claim 1 is to provide an image processing system having four types of color filters. 4 based on the intensity signal of the transmitted color
The first, second, and fourth video signals are generated, and the generated four video signals are combined two by two so as to be different from each other.
A solid-state imaging device for outputting as third and fourth image signals; and a first, second, third, and fourth image signal converting the first, second, third, and fourth image signals into digital signals. A / D conversion means for outputting as image data, first storage means for storing first, second, third and fourth image data output from the A / D conversion means; Data transmission means for transmitting the first, second, third and fourth image data stored in the first storage means to an image data processing device mounted on a computer; and A second storage unit for storing first, second, third, and fourth image data transmitted by the data transmission unit; and a second storage unit that is provided in the image data processing device. 1st, 2nd, 3rd and 3rd A luminance signal generating means for performing a calculation process on the image data of No. 4 to generate a luminance signal; and first and second means provided in the image data processing device and stored in the second storage means. , And a color difference signal generating means for performing arithmetic processing on the third and fourth image data to generate first and second color difference signals.

According to the first aspect of the present invention, the data transmitted by the data transmission means is a digital signal in which four types of video signals are combined so that two video signals are different from each other. 4 image data,
The amount of data to be transmitted is significantly reduced as compared with the case of transmitting the R, G, and B basic color signals as in the related art.

Further, a luminance signal generation device and a color difference signal generation device of an image data processing device mounted on a computer perform arithmetic processing on the first to fourth image data to generate luminance signals, first and second image data. To generate the color difference signal of
A complicated signal processing circuit for processing a color signal is not required.

According to a second aspect of the present invention, there is provided an image processing system comprising four types of color filters, and four types of video signals based on color intensity signals transmitted through the four types of color filters. And a solid-state imaging device that combines the four types of generated video signals so as to be different from each other and outputs first, second, third, and fourth image signals, and the first, second, and third image signals. The third and fourth image signals are converted into digital signals and converted into first, second, third and fourth signals.
A / D conversion means for outputting as image data of
First, second, third and fourth signals output from the / D conversion means.
Data transmission means for transmitting the image data to the image data processing device mounted on the computer, and the first, second, third and third data transmission means provided in the image data processing device and transmitted by the data transmission means. A luminance signal generating means for performing arithmetic processing on the fourth image data to generate a luminance signal; and a first, second, and third signal provided in the image data processing device and transmitted by the data transmitting means. The image processing apparatus includes a color difference signal generation unit that performs arithmetic processing on the third and fourth image data to generate first and second color difference signals.

According to the configuration of claim 2, the operation of the configuration of claim 1 is obtained, and the first, second, third, and fourth image data output from the A / D conversion means are stored. This eliminates the need for a first storage unit for storing the image data and a second storage unit for storing the first, second, third, and fourth image data transmitted by the data transmission unit.

According to a third aspect of the present invention, in the configuration of the first or second aspect, the chrominance signal generating means is configured to convert the first, second, third, and fourth image data transmitted by the data transmitting means. In addition, a configuration for generating the basic color signals of R, G, and B by performing an arithmetic process and then generating the first and second color difference signals is added.

According to a fourth aspect of the present invention, in the configuration of the first or second aspect, the image data processing device is provided with the luminance signal generated by the luminance signal generating means and the luminance signal generated by the color difference signal generating means. The configuration further includes a basic color signal generating means for generating R, G, B basic color signals from the first and second color difference signals.

According to a fifth aspect of the present invention, in the first or second aspect, the first, second, and third signals output from the solid-state image sensor are provided.
And performing at least one of a noise removal process and a gain control process on the fourth image signal,
This is to add a configuration further including a processing device for outputting to the D converter.

According to a sixth aspect of the present invention, in the configuration of the first or second aspect, the solid-state imaging device is provided with a communication procedure in which the data transmission means transmits the first, second, third, and fourth image data. The configuration further includes a driving unit that drives in synchronization with the configuration.

According to a seventh aspect of the present invention, in the configuration of the first or second aspect, the luminance signal generating means performs a low-pass transmission filter process on the first, second, third, and fourth image data. By doing so, a configuration for generating the luminance signal is added.

According to an eighth aspect of the present invention, in the configuration of the first or second aspect, the luminance signal generating means performs low-pass transmission filter processing on the first, second, third, and fourth image data. After that, at least one of gamma correction processing and contour emphasis processing is performed to add a configuration for generating the luminance signal.

According to a ninth aspect of the present invention, in the configuration of the first or second aspect, the color difference signal generating means includes the first and second generated color difference signals.
A configuration for performing a white balance process and a gamma correction process on the color difference signal is added.

The solution taken by the invention of claim 10 is 4
A first type of digital signal in which two types of video signals generated based on the intensity signals of the colors transmitted through the various types of color filters are differently combined two by two;
The present invention is directed to an image data processing apparatus that generates R, G, and B basic color signals from second, third, and fourth image data, and performs processing on the first, second, third, and fourth image data. A luminance signal generating means for performing a calculation process to generate a luminance signal;
A color difference signal generating means for performing arithmetic processing on the first, second, third and fourth image data to generate first and second color difference signals; and a luminance generated by the luminance signal generating means. A basic color signal generating means for generating R, G, B basic color signals from the signals and the first and second color difference signals generated by the color difference signal generating means.

According to the tenth aspect, only the first, second, third, and fourth image data, which are digital signals in which four kinds of video signals are combined so as to be different from each other, are transmitted. For good, R, G,
The amount of data to be transmitted is significantly reduced as compared with the case of receiving the transmission of the B basic color signal.

The luminance signal generation device and the color difference signal generation device perform arithmetic processing on the first to fourth image data to generate a luminance signal and first and second color difference signals. It is not necessary to provide a complicated signal processing circuit for processing a color signal in the device.

The solution taken by the invention of claim 11 is 4
A first type of digital signal in which two types of video signals generated based on the intensity signals of the colors transmitted through the various types of color filters are differently combined two by two;
The present invention is directed to an image data processing apparatus that generates R, G, and B basic color signals from second, third, and fourth image data, and performs processing on the first, second, third, and fourth image data. A luminance signal generating means for performing a calculation process to generate a luminance signal;
An arithmetic process is performed on the first, second, third, and fourth image data to generate R, G, and B basic color signals, and then a first and second color difference signals are generated. And a signal generating means.

According to the eleventh aspect of the present invention, only the first, second, third, and fourth image data, which are digital signals in which four kinds of video signals are combined so as to be different from each other, are transmitted. For good, R, G,
The amount of data to be transmitted is significantly reduced as compared with the case of receiving the transmission of the B basic color signal.

The luminance signal generation device and the color difference signal generation device perform arithmetic processing on the first to fourth image data to generate a luminance signal, a basic color signal, and first and second color difference signals. Therefore, it is not necessary to provide a complicated signal processing circuit for processing a color signal in the image input device.

[0046]

BEST MODE FOR CARRYING OUT THE INVENTION

(First Embodiment) Hereinafter, an image processing system according to a first embodiment of the present invention will be described with reference to the drawings.

FIG. 1 shows the overall configuration of an image processing system according to a first embodiment of the present invention. The image processing system according to the first embodiment includes an image data output device 10A for outputting image data. And an image data processing device 20A mounted on a personal computer and processing image data output from the image data output device 10A.

As shown in FIG. 1, the image data output device 1
0A is a CCD 11, an A / D converter 12, a memory 1
3, input / output interface 14, timing generator 1
5 and a memory controller 16, and the image data processing device 20A via the input / output interface 14.
To output image data. Also, the image data processing device 2
0A is an input / output interface 21, a memory 22,
It comprises a luminance signal generating means 23, a color difference signal generating means 24 and a basic color signal generating means 25.

The operation of the image data output device 10A will be described below.

The CCD 11, the A / D converter 12, and the memory controller 16 are controlled by a timing generator 15, and the image signal output from the CCD 11 is input to the A / D converter 12, and is subjected to A / D conversion. After being converted into image data which is a digital signal in the device 12, it is stored in the memory 13. The memory 13 is controlled by a memory controller 16. The memory controller 16 reads image data from the memory 13 in accordance with a communication procedure with a personal computer, and sends the read image data to the input / output interface 1.
Transfer to 4. The input / output interface 14 converts the image data into a standard communication procedure such as RS-232C,
The data is transmitted to the input / output interface 21 of the image data processing device 20A mounted on the personal computer through a connection means such as a cable.

Hereinafter, an image signal output from the CCD 11 will be described with reference to FIG.

FIG. 2A shows an example of a color filter array of the CCD 11, and FIG. 2B shows a two-dimensional address of an image signal output from the CCD 11.

FIG. 2A shows an arrangement of four color filters generally used in the CCD 11. The color filters include magenta (Mg), green (G), yellow (Ye), and cyan. (Cy). Regarding the operation of the CCD 11, see Japanese Patent Publication No. 6-284.
Since it is described in detail in No. 50, it will be briefly described here.

CCD 11 having four color filters
Performs interlaced driving in accordance with a standard television system such as NTSC, so that video signals of two pixels in the vertical direction are mixed and output as image signals by different combinations of the A field and the B field. For example, in the case of the A field, an odd line (hereinafter, referred to as an n line)
, The first image signal of Mg + Ye and the second image signal of G + Cy are sequentially output for each pixel, and the third image signal of G + Ye and the first image signal of Mg + Cy are output on even-numbered lines (hereinafter referred to as n + 1 lines). 4 are sequentially output for each pixel. In the B field, the third image signal of Ye + G and Cy + Mg
Are sequentially output for each pixel, and the first image signal of Ye + Mg and the second image signal of Cy + G are sequentially output for each pixel in the (n + 1) th line.

Considering the case of the A field, A = Mg + Ye (first image signal) B = G + Cy (second image signal) C = G + Ye (third image signal) D = Mg + Cy (fourth image signal) Signal), the image signal output from the CCD 11 is as shown in FIG.
It can be expressed as shown in (b).

The first to fourth image signals output from the CCD 11 are converted into digital signals by the A / D converter 12 and are converted into digital signals by the memory 13 as first to fourth image data.
Is written to. After the first to fourth image data are transmitted from the input / output interface 14 to the input / output interface 21 of the image data processing device 20A, the memory 2
2 is written.

Hereinafter, the operation of the image data processing device 20A will be described.

The image data input through the input / output interface 21 is written into the memory 22. The luminance signal generation unit 23 generates a luminance signal by performing an operation on the image data written in the memory 22, and the chrominance signal generation unit 24 performs an operation on the image data written in the memory 22. Generate a color difference signal. The basic color signal generation unit 25 performs an operation on the luminance signal generated by the luminance signal generation unit 23 and the color difference signal generated by the color difference signal generation unit 24, thereby performing RGB calculation.
Is generated.

Hereinafter, the luminance signal generating means 23
Next, a method of generating a luminance signal from the first to fourth image data written in No. 2 will be described.

First, when A + B processing is performed on the first image data (A) and the second image data (B), A + B = (Mg + Ye) (G + Cy) = (R + B + R + G) + (G + G + B) = 2R + 3G + 2B And a luminance signal Y (= 2R + 3G + 2B) is obtained.

Next, when C + D processing is performed on the third image data (C) and the fourth image data (D), C + D = (G + Ye) + (Mg + CY) = (G + R + G) + (R + B + G + B) = 2R + 3G + 2B, and the luminance signal Y (= 2R + 3G + 2B) is also obtained.

More specifically, the first to fourth image data stored in the memory 22 are compared with Japanese Patent Publication No. 6-284.
By performing low-pass filtering as shown in No. 50, a luminance signal of 2R + 3G + 2B is obtained. That is, H (z) = commonly used in digital signal processing is applied to the first to fourth image data in the horizontal direction.
A luminance signal is obtained by performing z-conversion of 1 + z ^-1 .

FIG. 3A shows the flow of processing in which the luminance signal generating means 23 performs arithmetic processing on the first to fourth image data written in the memory 22 to generate a luminance signal. .

First, in step A1, the memory 2
First, the first to fourth image data written in 2 are temporarily expanded in another memory space on the personal computer.

Next, in step A2, H (z) = 1 with respect to the image data expanded on another memory space.
By performing z-conversion of + z ⁻¹ , low-pass transmission filter processing is performed.

Next, in step A3, a gamma correction process, which is a non-linear process, is performed on the image data that has been subjected to the low-pass transmission filter process, based on a gamma value indicated in a separately designated table.

Next, in step A4, H (z) =-1+
By performing a filter process for performing z conversion of z ^-1 + z ^-2 -z ^-3 to perform a contour enhancement process for enhancing a high-frequency component of an image, a luminance signal (Y) can be obtained.

It should be noted that the gamma correction process may be performed after the outline emphasis process is performed by exchanging step A3 and step A4.

Further, the gamma correction processing and the outline emphasis processing can be omitted. If the gamma correction process is omitted, a normal image cannot be output to a normal TV monitor, but is useful for applications such as FA (factory automation). on the other hand,
When the outline emphasis processing is omitted, the sharpness of the image quality is reduced and the sharpness disappears, but the signal processing time can be reduced.

Hereinafter, the color difference signal generating means 24
2 from the first to fourth image data written in
And a method of generating the second color difference signal will be described.

First, when AB processing is performed on the first image data (A) and the second image data (B), AB = (Mg + Ye)-(G + Cy) = (R + B + R + G)- (G + G + B) = 2R−G, and the first color difference signal (2R−G) is obtained.

Next, when CD processing is performed on the third image data (C) and the fourth image data (D), CD = (G + Ye)-(Mg + Cy) = (G + R + G) − (R + B + G + B) = G−2B, and the second color difference signal (G−2B) is obtained.

FIG. 3B shows that the color difference signal generation means 24 performs arithmetic processing on the first to fourth image data written in the memory 22 to generate first and second color difference signals. The flow of the processing is shown.

First, in step B1, the memory 2
First, the first to fourth image data written in 2 are temporarily expanded in another memory space on the personal computer.

Next, in step B2, the difference between pixels adjacent in the horizontal direction with respect to the image data expanded in another memory space is calculated, and the first and second image data as described above are calculated.
Is generated.

Next, in step B3, white balance processing is performed on the first and second color difference signals.
This is a process for ensuring that the color difference signal is 0 even when the color temperature of the light source changes when an achromatic subject is imaged. Here, the first color difference signal (2R-G) and This is performed by adjusting the luminance signal (Y) with respect to the second color difference signal (G-2B).

Here, the case of RY will be described by way of an example. Note that, in the following mathematical expressions, “〜” means substantially equal.

RY to 2RG = (Mg + Ye)-(G
+ Cy), and Y〜2R + 3G + 2B = (Mg + Y)
e) + (G + Cy), and the luminance signal (Y) is multiplied by an appropriate coefficient to obtain a difference from the first chrominance signal (2R−G), whereby (R−Y) −αY = (1− α) (Mg + Ye)
− (1 + α) (G + Cy), and by adjusting the coefficient α, white balance processing can be performed so that the color difference signal becomes zero.

Next, in step B4, as in the case of the luminance signal, a gamma correction process, which is a non-linear process, is performed based on a gamma value indicated in a separately designated table.

The luminance signal obtained by the above method, the first
And the second color difference signal can be used as it is,
The basic color signal generation unit 25 performs arithmetic processing on the luminance signal and the first and second color difference signals,
R, G and B basic color signals can be obtained.

In the first embodiment, the RGB basic color signal is obtained after the color difference signal is generated. However, by changing the arithmetic expression, the RGB basic color signal is generated. It goes without saying that a color difference signal can be generated.

In the first embodiment, Mg,
Using four color filters of G, Ye, and Cy,
The case of generating the first to fourth image data including the combination of the video signals described above has been described. However, the color filter array and the method of generating the first to fourth image data are not limited. The first to fourth image data may be generated by another combination method using a color filter.

(Second Embodiment) Hereinafter, an image processing system according to a second embodiment of the present invention will be described with reference to the drawings.

FIG. 4 shows the overall configuration of an image processing system according to a second embodiment of the present invention. The image processing system according to the second embodiment includes an image data output device 10B for outputting image data. And an image data processing device 20B mounted on a personal computer and processing image data output from the image data output device 10B.

As shown in FIG. 4, the image data output device 1
OB includes a CCD 11, an A / D converter 12, an input / output interface 14, and a timing generator 15, and outputs image data to the image data processing device 20B via the input / output interface 14. The image data processing device 20B includes an input / output interface 21, a luminance signal generation unit 23, a color difference signal generation unit 24, and a basic color signal generation unit 25.

The operation of the image data output device 10B will be described below.

The video signal output from the CCD 11 is A
The signal is input to the / D converter 12 and is converted into image data which is a digital signal in the A / D converter 12. The image data is transferred from the A / D converter 12 to the input / output interface 14 and then transmitted to the input / output interface 21 of the image data processing device 20B mounted on the personal computer.

In the first embodiment, the memory 13 for adjusting the timing between the A / D converter 12 and the input / output interface 14 is provided. In the second embodiment, however, the timing generator 15 The CCD 11 causes the CCD 11 to output image data to the A / D converter 12 at a timing corresponding to a communication procedure between the image data output device 10B and the image data processing device 20B by the output CCD drive pulse. As a result, the memory 13 for adjusting the timing between the A / D converter 12 and the input / output interface 14 becomes unnecessary, so that the cost can be further reduced.

The processing speed of signal processing by a software program on a personal computer is as follows.
It depends on the capabilities of the personal computer, such as the capabilities of the CPU. However, when the processing speed is important, the image data processing devices 20A and 20B only generate the luminance signal to obtain a black-and-white image at a high speed. When a high-quality color image is obtained by performing all processes in the devices 20A and 20B, an appropriate process can be selected according to the application. Therefore, the processing speed of the signal processing by the software program is reduced by the capacity of the personal computer. Is not a problem.

In the first and second embodiments, the image data output from the CCD 11 is directly input to the A / D converter 12.
Performs pre-processing such as noise removal processing and AGC processing on the image data output from the A / D converter 1
2 may be output.

In the first and second embodiments, the communication procedure has been described using RS-232C, but instead of this, a USB (Universal S
serial bus), IEEE1394 (IEEE1)
394 High Performance Seri
al Bus) or a communication procedure such as infrared communication.

Further, in the first and second embodiments, the CCD has been described as the solid-state imaging device.
Instead, another type of solid-state imaging device such as a MOS sensor may be used.

[0093]

According to the image processing system according to the first aspect of the present invention, the data transmitted by the data transmission means is the first, second, third and fourth image data. , G and B, the amount of data to be transmitted is significantly reduced as compared with the case of transmitting the basic color signals, so that the transmission time can be greatly reduced and the input / output interface can be simplified.

Further, the luminance signal generation device and the color difference signal generation device of the image data processing device mounted on the computer generate the luminance signal and the first and second color difference signals by the arithmetic processing, so that the color signal is processed. Since the complicated signal processing circuit is unnecessary, the cost of the entire image processing system can be reduced.

According to the image processing system of the second aspect, the effects of the first aspect can be obtained, and
First storage means for storing the first, second, third and fourth image data output from the D conversion means, and first, second, third and third data transmitted by the data transmission means. 4th
This eliminates the need for the second storage means for storing the image data, thereby further simplifying the entire image processing system and further reducing the cost.

According to the first or second aspect of the present invention, the characteristics of the signal processing can be variously changed by changing the software program of the image data processing device mounted on the computer. A wide image can be obtained, and there is no distinction between a black-and-white system and a color system on the hardware. Therefore, the black-and-white system and the color system can be used properly by improving the functions of the software program. A black-and-white image or a color image can be obtained according to the capability, and the system can be easily upgraded to improve the processing capability of the personal computer device in the future.

According to the image processing system of the third aspect of the present invention, the color difference signal generating means performs arithmetic processing on the first, second, third and fourth image data transmitted by the data transmitting means. To generate R, G, B basic color signals, and then to generate first and second color difference signals,
Generation of basic color signals of R, G, and B is facilitated.

According to the image processing system of the present invention, R, G, B are obtained from the luminance signal generated by the luminance signal generating means and the first and second color difference signals generated by the color difference signal generating means. Since it is provided with the basic color signal generating means for generating the basic color signals of the above, it becomes easy to generate the basic color signals of R, G and B.

According to the image processing system of the present invention, the first, second, and third signals output from the solid-state image sensor are provided.
And a processing device that performs at least one of a noise removal process and a gain control process on the fourth image signal and outputs the processed signal to an A / D converter. Since noise components are removed from the first to fourth image signals or the signal levels of the first to fourth image signals become constant, the first to fourth image signals input to the A / D conversion means are output. As a result, the quality of the first to fourth image data input to the image data processing device is improved, and the image quality is improved.

According to the image processing system of the present invention, the solid-state imaging device is driven in synchronization with the communication procedure in which the data transmission means transmits the first, second, third, and fourth image data. Claim 1 because of the provision of the driving means.
In the image processing system of the first aspect, the storage capacity of the first and second storage means can be reduced, and in the image processing system of the second aspect, the transmission of the image data to the image data processing apparatus becomes smooth, and Processing speed is faster.

According to the image processing system of the present invention, the luminance signal generating means performs low-pass transmission filtering on the first, second, third, and fourth image data. Since a luminance signal is generated, a high-quality luminance signal can be obtained.

According to the image processing system of the present invention, the luminance signal generating means performs the low-pass transmission filter processing on the first, second, third and fourth image data. Since a luminance signal is generated by performing the gamma correction processing and the outline emphasis processing, a higher-quality luminance signal can be obtained.

According to the image processing system of the ninth aspect of the present invention, the color difference signal generating means generates the first and second generated color difference signals.
Since the white balance processing and the gamma correction processing are performed on the color difference signals of, the first and second color difference signals of high quality can be obtained.

According to the image data processing apparatus of the tenth aspect, it is only necessary to receive the transmission of the first, second, third and fourth image data.
Since the amount of data to be transmitted is significantly reduced as compared with the case where the basic color signal is transmitted, the transmission time can be greatly reduced and the input / output interface can be simplified.

Further, since the luminance signal generation device and the color difference signal generation device generate the luminance signal and the first and second color difference signals by arithmetic processing, a complicated signal processing circuit for processing the color signal to the image input device. It is not necessary to provide
The cost of the image input device can be reduced.

According to the image data processing apparatus of the eleventh aspect, it is only necessary to receive the transmission of the first, second, third and fourth image data.
Since the amount of data to be transmitted is significantly reduced as compared with the case where the basic color signal is transmitted, the transmission time can be greatly reduced and the input / output interface can be simplified.

Further, since the luminance signal generation device and the color difference signal generation device generate the luminance signal, the basic color signal, and the first and second color difference signals by the arithmetic processing, it is complicated to process the color signal to the image input device. Since there is no need to provide a simple signal processing circuit, the cost of the image input apparatus can be reduced.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an overall configuration of an image processing system according to a first embodiment of the present invention.

FIG. 2A is a diagram illustrating an example of an array of color filters of a CCD in the image processing systems according to the first and second embodiments of the present invention, and FIG. 2B is a diagram illustrating an image output from the CCD; FIG. 3 is a diagram illustrating a two-dimensional address of a signal.

FIG. 3A is a flowchart illustrating processing of a luminance signal generation device in an image processing system according to first and second embodiments of the present invention, and FIG. 3B is a flowchart illustrating first and second embodiments of the present invention. FIG. 11 is a flowchart illustrating processing of a color difference signal generation device in an image processing system according to a second embodiment.

FIG. 4 is a block diagram illustrating an overall configuration of an image processing system according to a second embodiment of the present invention.

FIG. 5 is a block diagram showing an overall configuration of an image input device according to a second conventional example.

FIG. 6 is a block diagram illustrating a configuration of a signal processing unit when an image input device according to a second conventional example processes a monochrome image.

FIG. 7 is a block diagram illustrating a configuration of a signal processing unit when an image input device according to a second conventional example processes a color image.

[Explanation of symbols]

 10A, 10B Image data output device 11 CCD 12 A / D converter 13 Memory 14 Input / output interface 15 Timing generator 15 16 Memory controller 20A, 20B Image data processing device 21 Input / output interface 22 Memory 23 Luminance signal generation means 24 Color difference signal Generation means 25 Basic color signal generation means

Claims (11)

[Claims] 1. A color filter having four types of color filters.
First, four types of video signals are generated based on the intensity signals of the colors transmitted through the four types of color filters, and the generated four types of video signals are combined two by two so as to be different from each other.
A solid-state imaging device that outputs as second, third, and fourth image signals; and converts the first, second, third, and fourth image signals into digital signals to convert the first, second, third, and fourth image signals into digital signals. A / D conversion means for outputting as fourth image data; first storage means for storing first, second, third and fourth image data output from the A / D conversion means; The first, second, and third stored in the first storage means.
And a data transmission means for transmitting the fourth image data to an image data processing device mounted on a computer; a first, a second, and a third data transmission device provided in the image data processing device and transmitted by the data transmission means. Second storage means for storing third and fourth image data, and first, second, and third means provided in the image data processing device and stored in the second storage means. And a luminance signal generation unit that performs an arithmetic process on the fourth image data to generate a luminance signal; and a first signal generation unit that is provided in the image data processing device and is stored in the second storage unit. An image processing system comprising: color difference signal generation means for performing arithmetic processing on second, third, and fourth image data to generate first and second color difference signals. 2. It has four kinds of color filters.
First, four types of video signals are generated based on the intensity signals of the colors transmitted through the four types of color filters, and the generated four types of video signals are combined two by two so as to be different from each other.
A solid-state imaging device that outputs as second, third, and fourth image signals; and converts the first, second, third, and fourth image signals into digital signals to convert the first, second, third, and fourth image signals into digital signals. A / D conversion means for outputting as fourth image data, and first, second, third and fourth image data output from the A / D conversion means to an image data processing device mounted on a computer. A data transmission means for transmitting; and an image processing apparatus which is provided in the image data processing device and performs arithmetic processing on the first, second, third and fourth image data transmitted by the data transmission means, and A luminance signal generating means for generating a signal; and a calculation signal processing means for the first, second, third and fourth image data provided in the image data processing device and transmitted by the data transmission means. Rows of first and second colors An image processing system comprising: a color difference signal generation unit that generates a difference signal. 3. The color-difference signal generating means includes a first, a second, a third, and a fourth signal transmitted by the data transmitting means.
R, G, B
3. The image processing system according to claim 1, wherein the first and second color difference signals are generated after generating the basic color signal. 4. The image processing apparatus according to claim 1, wherein the first and second color difference signals generated by the luminance signal generation unit and the first and second color difference signals generated by the color difference signal generation unit are R, G, and R. 3. The image processing system according to claim 1, further comprising a basic color signal generation unit configured to generate a basic color signal of B. 5. The method according to claim 1, wherein the first output from the solid-state imaging device is:
The image processing apparatus further includes a processing device that performs at least one of a noise removal process and a gain control process on the second, third, and fourth image signals and outputs the processed signal to the A / D converter. The image processing system according to claim 1. 6. A drive unit for driving the solid-state imaging device in synchronization with a communication procedure in which the data transmission unit transmits the first, second, third, and fourth image data. The image processing system according to claim 1, wherein: 7. The luminance signal generating unit generates the luminance signal by performing a low-pass transmission filter process on the first, second, third, and fourth image data. The image processing system according to claim 1. 8. The luminance signal generating means, after performing low-pass transmission processing on the first, second, third, and fourth image data, performs gamma correction processing and contour emphasis processing. By performing at least one process of
The image processing system according to claim 1, wherein the luminance signal is generated. 9. The apparatus according to claim 1, wherein the color difference signal generation means performs white balance processing and gamma correction processing on the generated first and second color difference signals.
Or the image processing system according to 2. 10. A first, second, and second digital signal obtained by combining two kinds of video signals generated based on color intensity signals transmitted through four kinds of color filters so as to be different from each other. An image data processing device for generating R, G, B basic color signals from third and fourth image data, wherein an arithmetic processing is performed on the first, second, third, and fourth image data. Signal generating means for generating a luminance signal by means of a color difference signal generating means for performing arithmetic processing on the first, second, third and fourth image data to generate first and second color difference signals Basic color signal generating means for generating R, G, B basic color signals from the luminance signal generated by the luminance signal generating means and the first and second color difference signals generated by the color difference signal generating means It is characterized by having An image data processing device. 11. A first, second, and second digital signal composed of two types of video signals generated based on color intensity signals transmitted through four types of color filters, two of which are different from each other. An image data processing device for generating R, G, B basic color signals from third and fourth image data, wherein an arithmetic processing is performed on the first, second, third, and fourth image data. A luminance signal generating means for generating a luminance signal by performing arithmetic processing on the first, second, third, and fourth image data to generate R, G, B basic color signals; An image data processing apparatus comprising: a color difference signal generation unit configured to generate first and second color difference signals.