JP3517564B2 - Imaging device and imaging system - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus and an image pickup system for outputting an image signal compression-coded by the JPEG system or the like to an external device such as a printer.

[0002]

2. Description of the Related Art Conventionally, for example, there is an image pickup system 500 as shown in FIG. The imaging system 500 has a configuration in which a personal computer (hereinafter referred to as a personal computer) 520 is provided between a digital camera 510 and a printer 530 (for example, a binary ink jet printer), and an image captured by the digital camera 510 is printed by a printer. It is possible to print out from 530.

That is, in the digital camera 510, the image signal obtained by picking up the image by the image pickup section 511 is controlled by the system controller 514, and the signal processing section 51 is controlled.
2 becomes compressed image data such as JPEG format, and the recording unit 5
At 13, the image is recorded on a recording medium (image recording medium) such as CF. The compressed image data recorded on this recording medium is taken into the personal computer 520 by some application. A general-purpose printer driver 521 is incorporated in the personal computer 520. The printer driver 521 includes a JPEG decompression unit 522, a gamma processing (linearization processing) unit 523, a LOG conversion processing (density conversion processing) unit 524, and a masking calculation. It is composed of a unit 525 and a binarization processing (error diffusion processing etc.) unit 526. Therefore, the compressed image data taken into the personal computer 520 is
Predetermined image processing such as decompression (expansion) processing is performed by the printer driver 521, and is printed out from the printer 530 according to a print request instruction from the user.

On the other hand, in contrast to the above-described image pickup system 500, for example, an image pickup system 600 as shown in FIG.
There is also an imaging system 700 as shown in FIG. In these imaging systems 600 and 700, the compressed image data obtained by the digital camera 510 is transferred to the personal computer 520.
It is possible to print out from the printer 530 without going through. That is, the imaging system 600 has a configuration in which an adapter (driver) 610 is provided between the digital camera 510 and the printer 530, and this adapter 610 has a function similar to that of the printer driver 521 described above (hereinafter referred to as a printer driver function). )have. Therefore, the compressed image data obtained by the digital camera 510 is subjected to predetermined image processing such as decompression processing by the adapter 610 and printed out from the printer 530. Further, the image pickup system 700 has a configuration in which the digital camera 510 and the printer 530 are directly connected and a printer driver function is added to the printer 530 side. Therefore, the compressed image data obtained by the digital camera 510 is subjected to predetermined image processing such as decompression processing by the printer 530, and then printed out.

[0005]

However, in the conventional image pickup system as shown in FIGS. 4 and 5 described above,
In order to print out an image taken by a digital camera with a printer, it is necessary to provide a device having a printer driver function such as a personal computer or an adapter. For this reason, unless a device having a printer driver function is prepared, it is not possible to print out an image taken by a digital camera, and the system configuration becomes complicated.
Further, in the conventional image pickup system as shown in FIG. 6, it is necessary to provide the printer with a function including printer image processing. Therefore, it is necessary to provide an arithmetic circuit and the like for implementing the printer driver function on the printer side, which complicates the configuration of the printer and makes it expensive.

Therefore, the present invention has been made to eliminate the above-mentioned drawbacks, and has a simplified structure and is inexpensive.
An object of the present invention is to provide an imaging device and an imaging system that can easily output a captured image with an external printer.

[0007]

A first invention is connectable to an external printer, and a compressed image signal obtained by compressing an image signal obtained from an image pickup signal by a predetermined compression method is a recording medium. An image pickup apparatus for recording the compressed image signal, and storing means for storing driver function information for performing image processing for decompressing the compressed image signal and printing out by the printer;
Predetermined signal processing on the image pickup signal by a plurality of processing circuits
If you do not have a signal processing means for performing the functions of the printer is equivalent to the driver function information in the storage means, based on the driver function information in said storage means, to decompress the compressed image signal by the signal processing means Te performs image processing for print output by the printer, a signal obtained by the image processing and an output means for output to the printer, the driver function information, of the plurality
Whether to operate one of the processing circuits
Information to control and software processing without using the above processing circuit
And information for execution .

A second invention is the same as the first invention,
The predetermined compression method includes a JPEG method.

A third invention is the same as the first invention,
A signal processing hard block for obtaining the image signal by subjecting the image pickup signal to predetermined signal processing is provided, and the signal processing hard block is divided into small calculation blocks, and an identifier is added to each small calculation block. The driver function information includes information describing a plurality of small calculation processes, and each of the plurality of small calculation processes has information indicating whether the corresponding calculation is performed by hardware processing or software processing. The information indicating the hard processing includes the identifier designating a small operation block on which the hard processing is performed.

A fourth invention is an imaging system including a printer and an imaging device connectable to the printer,
The image pickup device is the image pickup device according to any one of claims 1 to 3.

[0011]

[0012]

[0013]

[0014]

[0015]

[0016]

[0017]

[0018]

[0019]

[0020]

[0021]

[0022]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

The image pickup apparatus according to the present invention is applied to, for example, a digital camera 100 as shown in FIG.

The digital camera 100 comprises a CPU 110 for controlling the operation of the entire apparatus and an image pickup section 120 for performing a photographing operation under the control of the CPU 111.
Further, the digital camera 100 is configured to be connectable to the printer 200.

The image pickup section 120 is provided, for example, as shown in FIG. 2, with a lens 121 provided so that light from an object (not shown) is incident, and with light transmitted through the lens 121. Image sensor 122 and image sensor 1
22 analog / digital (A /
D) The converter 123, the memory 124 to which the output of the A / D converter 123 is supplied, the interpolation low-pass filter (LPF) circuit 125 to which the output of the memory 124 is supplied, and the output of the interpolation LPF circuit 125 are supplied. Color conversion matrix block (MAT) circuit 126 and color conversion MAT circuit 1
The gamma (γ) conversion circuit 127 to which the output of 26 is supplied
A notch LPF circuit 128 supplied with the output of the memory 124, an APC processing circuit 129 supplied with the output of the notch LPF circuit 128, a γ conversion circuit 131 supplied with the output of the APC processing circuit 129, and a γ conversion. The luminance / color difference signal generation circuit 132 to which the outputs of the circuits 127 and 131 are supplied, the compression / expansion processing circuit 136 to which the output of the luminance / color difference signal generation circuit 132 is supplied, and the output of the compression / expansion processing circuit 136 are The external recording medium 137 is supplied, the video signal processing circuit 134 to which the output of the luminance / color difference signal generation circuit 132 is supplied, and the liquid crystal monitor 135 to which the output of the video signal processing circuit 134 is supplied. The output of the memory 124 is also supplied to the external recording medium 137, and the output of the external recording medium 137 is also supplied to the interpolation LPF circuit 125 and the notch LPF circuit 128. Further, the video signal processing circuit 134 outputs the output of the external recording medium 137 to the compression / expansion processing circuit 1.
It is designed to be supplied via 36. The external recording medium 137 is an image writing medium such as a CF, and the external recording medium 137 stores information for implementing a printer driver function corresponding to the printer 200 in advance, which will be described in detail later. ing.

Further, the image pickup section 120 includes an external recording medium 13
7 is provided with an RGB conversion circuit 133 that is supplied via a compression / expansion processing circuit 136, and the output of this RGB conversion circuit 133 is supplied to the memory 124.

The image pickup section 120 further includes a binarization processing circuit 138 and a printer driver function section A to which the output of the memory 124 is supplied.

The image pickup unit 120 as described above includes the CPU 11
Controlled by 0, it operates as follows.

First, the light from a subject not shown is
The light passes through the lens 121 and is projected on the image pickup surface of the image pickup element 122. The image sensor 122 is, for example, a CCD (Charge
d Coupled Device), which converts the light from the lens 121 into an electric signal (photoelectric conversion), and A / D converter 123
Supply to. The A / D converter 123 digitizes the electric signal from the image sensor 122 to generate image data (RAW).
The data is temporarily stored in the memory 124.

Therefore, for example, the digital camera 100
Is set to the RAW data recording mode (a mode in which the image data obtained by the A / D converter 123 is directly recorded without compression), the image data accumulated in the memory 124 is directly recorded in the external recording medium. 137.

On the other hand, when the digital camera 100 is set to the normal recording mode, first, the chroma (RG)
B) system (interpolation LPF circuit 125, color conversion MAT circuit 12
6, γ conversion circuit 127) and luminance (Y) system (notch LP
F circuit 128, APC processing circuit 129, γ conversion circuit 13
1) and each processing is performed.

Here, in the image pickup section 120, the CPU 1
The hardware configuration is such that the operation in circuit units (processing block units) is possible under the control of 10. Therefore, for example, a label (identifier) L1 is defined in the interpolation LPF circuit 125, a label L2 in the color conversion MAT circuit 126, a label L3 in the γ conversion circuit 127, and an RG.
A label L4 is defined in the B conversion circuit 133, a label L5 is defined in the compression / expansion processing circuit 136, and a label L6 is defined in the binarization processing circuit 138, and an input / output terminal is provided for each circuit. . These labels 1-6 are
It is used at the time of print output by the printer 200 described later.

Therefore, in the chroma (RGB) system, the interpolation LPF circuit 125 (label L1) simultaneously performs the interpolation processing and the low-pass filter processing on the image data accumulated in the memory 124, and the image data subjected to those processings. Is supplied to the color conversion MAT circuit 126. The color conversion MAT circuit 126 (label L2) performs color conversion processing for converting the complementary color signal into a pure color signal on the image data from the interpolation LPF circuit 125, and performs γ conversion on the image data subjected to the color conversion processing. Supply to the circuit 127. γ conversion circuit 127
The (label L3) performs gamma processing on the image data from the color conversion MAT circuit 126, and supplies the gamma-processed image data as RGB data to the luminance / color difference signal generation circuit 132.

On the other hand, in the luminance (Y) system, the notch LP
The F circuit 128 performs a process of removing the luminance step by the color filter on the image data stored in the memory 124, and supplies the processed image data to the APC processing circuit 129. The APC processing circuit 129 has a notch L
Contour enhancement processing is performed on the image data from the PF circuit 128, and the image data subjected to the contour enhancement processing is supplied to the γ conversion circuit 131. The γ conversion circuit 131 performs gamma processing on the image data from the APC processing circuit 129, and uses the gamma-processed image data as Y data for luminance / luminance.
It is supplied to the color difference signal generation circuit 132.

The luminance / color-difference signal generation circuit 132 has the RGB data from the γ conversion circuit 127 and the γ conversion circuit 131.
The color difference data R-Y and B-Y are generated from the Y data from the above, and the color difference data R-Y and B-Y and the Y data (luminance data Y) are supplied to the compression / expansion processing circuit 136.

Compression / expansion processing circuit 136 (label L5)
Is the color difference data R from the luminance / color difference signal generation circuit 132.
-Y and BY and the luminance data Y are compressed by, for example, the JPEG method to generate compressed image data. Then, the compression / expansion processing circuit 136 records the generated compressed image data in the external recording medium 137.

At this time, the digital camera 100
In the case where the liquid crystal finder output is set to “ON” or the video output is set to “ON”, the compression / expansion processing circuit 136 outputs the compressed image data generated as described above. , Video signal processing circuit 1
Supply to 34. The video signal processing circuit 134
The compressed image data from the expansion processing circuit 136 is subjected to predetermined video signal processing such as resolution conversion processing to generate a video signal. Then, the video signal processing circuit 134
Supplies the generated video signal to the liquid crystal monitor 135 and a video output terminal (not shown). Therefore, the video signal generated by the video signal processing circuit 134 is
The image is displayed on the liquid crystal monitor 135 and is also output from the video output terminal.

The image data recorded in the external recording medium 137 as described above (JPEG compressed image data,
When the RAW data) is printed out by the printer 200, for example, the imaging unit 120 operates as follows.

For example, in the digital camera 100, when the liquid crystal finder output is set to "ON", a screen display based on the image data recorded on the external recording medium 137 is performed on the liquid crystal monitor 135. And The user selects an image to be printed out by the printer 200 on the display screen of the liquid crystal monitor 135.
This selection information is given to the CPU 110, and the CPU 11
0 controls the operation of the image pickup unit 120 as follows according to the given selection information.

First, when the image selected by the user is the image of the compressed image data of the JPEG system, the compression / expansion circuit 136 (label L5) selects the image data recorded on the external recording medium 137 by the user. The compressed image data corresponding to the selected image is decompressed (expanded) by the JPEG method. Then, the compression / expansion circuit 136 supplies the decompressed image data to the RGB conversion circuit 133. RGB
The conversion circuit 133 (label L4) includes a compression / expansion circuit 13
The image data from 6 is converted into RGB data, stored in the memory 124, and supplied to the video signal processing circuit 134. The video signal processing circuit 134 performs the above-described predetermined video signal processing on the RGB data from the RGB conversion circuit 133 to generate a video signal, and supplies the video signal to the liquid crystal monitor 135. Therefore, the selected image is displayed again (preview) on the liquid crystal monitor 135.

On the other hand, when the image selected by the user is the image of the RAW data, the RAW data corresponding to the image selected by the user among the image data recorded on the external recording medium 137 is interpolated LPF circuit 125. And notch LPF circuit 128 (Pass in the figure).
1), the same processing as in the normal recording mode described above is performed. That is, the RAW of the image selected by the user
The data is processed by chroma system and luminance system,
The output data of each system is supplied to the compression / expansion processing circuit 136 via the luminance / color difference signal generation circuit 132. At this time, the compression / expansion processing circuit 136 does not decompress the data from the luminance / color-difference signal generation circuit 132, and the RGB conversion circuit 133 and the video signal processing circuit 13 as they are.
4 to each. The RGB conversion circuit 133 converts the data from the compression / expansion processing circuit 136 into RGB data, stores it in the memory 124 in the memory 124, and supplies it to the video signal processing circuit 134. The video signal processing circuit 134 performs the above-described predetermined video signal processing on the RGB data from the RGB conversion circuit 133 to generate a video signal, and the video signal is processed by the liquid crystal monitor 1.
35. Therefore, the LCD monitor 135
The selected image is displayed again (preview).

The RGB data stored in the memory 124 as described above is stored in the printer driver function unit A described above.
Is supplied to. The printer driver function unit A includes a printer driver execution unit 142 including a rewritable memory such as a flash memory, and a file converter 143. The printer driver execution unit 142 and the file converter 143 are connected to the CPU 110.
Is controlled by.

Therefore, when the printer 200 is a sublimation printer or a printer with a built-in printer driver function, the file converter 143 converts the RGB data from the memory 124 into image data of a general-purpose image format under the control of the CPU 110. Then, the image data is supplied to the printer output port 144. The image data supplied to the printer output port 144 is the printer 2
00, and is printed out from the printer 200.

On the other hand, when the printer 200 is a printer requiring special signal processing such as an ink jet printer, the CPU 110 implements a printer driver function corresponding to the printer 200 stored in the external recording medium 137 in advance. Information (for example, a program for implementing the dedicated driver function of the printer 200, hereinafter referred to as dedicated driver function information) for the printer driver execution unit 1
By loading the program into the printer 42 and executing it, the operation control for performing special signal processing corresponding to the printer 200 is performed. At this time, the CPU 110 independently controls the operation of each circuit of the hardware in the imaging unit 120 by the labels L1 to L6 described above. In this way, each circuit of the image pickup unit 120 is effectively used to control the above operation, thereby improving the calculation speed.

Specifically, the CPU 110 preliminarily loads the dedicated driver function information from the external recording medium 137 into the printer driver execution unit 142 including a memory such as a flash memory. This dedicated driver function information is divided into a plurality of processing blocks, for example, as shown in FIG. 3, and includes a γ conversion unit 142a, a LOG conversion unit 142b, a masking processing unit 142c, and a binarization processing unit 142d. Composed. Then, in each processing block, calculation format information, that is, whether it is software processing or processing using each circuit of hardware in the imaging unit 120 (hereinafter, referred to as hardware processing)
In addition to the information for distinguishing whether or not it is, the execution module is described in the case of software processing, and the label (block label) indicating the circuit to be used in the case of hardware processing. And parameters necessary for the operation of the circuit, information on operation timing, and the like. For example, in the γ conversion unit 142a, the calculation format information indicating the “hard processing”, the label L3 (γ
A label indicating the conversion circuit 127) and a γ conversion table are described. In the LOG conversion unit 142b, operation format information indicating "software processing b" and its execution module b are described. Masking processing unit 14
2c includes calculation format information indicating "software processing c1", its execution module c1, calculation format information indicating "hard processing", label L2 (color conversion MAT).
A label indicating the circuit 126), matrix data, calculation format information indicating "software processing c2", its execution module c2, and a black generation table are described. Then, the binarization processing unit 142d displays the calculation format information indicating "hard processing" and the label L6.
(Label indicating the binarization processing circuit 138) is described.

Therefore, the above-mentioned dedicated driver function information fetched by the printer driver execution unit 142 is CP.
When read and executed by the U110, the following printer driver function is executed.

First, in the γ conversion unit 142a, the γ conversion circuit 127 defined by the label L3 is operated and controlled by the CPU 110, so that the R stored in the memory 124 is stored.
Inverse gamma processing is performed on the GB data by calculation using a γ conversion table, and as a result, the RGB data is returned to a linear signal.

Next, in the LOG conversion section 142b, the execution module b is executed by the CPU 110, so that the signal obtained in the γ conversion section 142a is converted into a CMY signal by the software operation processing.

Next, in the masking processing section 142c, the CMY signal obtained in the LOG converting section 142b is subjected to the following processing, whereby the CMY signal is converted into a CMYK signal. For example, first, the execution module c1 is executed by the CPU 110,
A K (black) signal is generated by the soft arithmetic processing. next,
The color conversion MAT circuit 126 defined by the label L2 is CP
By being controlled in operation by U110, matrix hardware arithmetic processing using matrix data is performed. Then, the execution module c2 is executed by the CPU 110, and the CMY signal obtained by the LOG conversion unit 142b is converted into the final CMYK signal by the software calculation process using the black generation table.

Next, regarding the binarization processing unit 142d, first, in a binary ink jet printer or the like, an error diffusion process is usually adopted as the binarization process.
If this processing is performed by software, a considerable amount of calculation time is required. Therefore, here, this error diffusion processing is performed by hardware processing. As a result, the calculation time is shortened. That is, the binarization processing circuit 138 defined by the label L6 is C
By the operation control by the PU 110, the CMYK signal obtained by the masking processing unit 142c is binarized. Then, this binarized signal is supplied to the printer 200 via the printer output port 144.

As described above, in this embodiment, when the JPEG compressed image data recorded on the external recording medium 137 is printed out by the printer 200, the compressed image data is compressed by the compression / expansion circuit 136. By decompressing (expanding) by the JPEG method and supplying it to the printer 200, it is not necessary to newly provide a decompressing device between the digital camera and the printer as in the conventional case, and the printer side is not required. There is no need to newly provide a processing circuit for decompressing.

Further, since the exclusive driver function information externally provided by the external recording medium 137 is fetched into the printer driver execution section 142 and executed by the CPU 110, the digital camera can be executed without providing the driver function on the printer side. It is possible to directly connect the camera and the printer and print out the image taken by the digital camera from the printer. Also, by always storing the latest dedicated driver function information in the external recording medium 137 in advance, it is possible to always print out from the printer with the latest driver. Furthermore, the external recording medium 137
By storing the dedicated driver function information corresponding to the printer in advance, it is possible to support printers of different models.

Further, each circuit of the image pickup section 120 is configured to be able to independently control the operation, and the dedicated driver function information externally provided by the external recording medium 137 is configured as shown in FIG. In addition, since each circuit of the image pickup unit 120 is configured to be used, it is possible to perform the processing (matrix calculation processing, error diffusion processing, etc.) that requires a considerable calculation time in the software processing in a short time by the hardware processing.

In the above-described embodiment, the dedicated driver function information externally provided by the external recording medium 137 is loaded into the printer driver execution unit 142, but the printer driver execution unit 142 can be replaced, for example. It may be configured by a (attachable) ROM interface, and the dedicated driver function information stored in advance in the ROM interface set in the digital camera 100 may be taken into the digital camera 100.

Further, in the above-mentioned embodiment, JPEG
Although the image data is compressed by the method, the compression method adopted is not limited to this JPEG method.

Further, the digital camera 100 in the above-described embodiment may be either a moving image compatible digital camera or a still image compatible digital camera.

The present invention can also be applied to flat bit scanners and the like.

[0058]

As described above, the image pickup apparatus of the present invention can perform image processing for print output, and it becomes easy to apply the driver function corresponding to the type of printer.

Since the driver function information includes information for controlling which one of the plurality of processing circuits is to be operated and information for executing software processing without using the processing circuit. Further, it is possible to cope with the future high functionality, such as selectively using an appropriate hardware resource in the imaging device or executing a process such as a new function that cannot be handled by the hardware process by software.

Furthermore, the signal processing means (signal processing hard block) of the image pickup device is divided into blocks for each small operation, an identifier (hard block label) is added to each small operation block (processing circuit), and each block is added. The hardware is designed so that it can be operated independently. Also, the driver function information is divided into small operation blocks and described, and each block is defined to be processed by software or hardware. When software processing is performed, an operation module is provided, and when hardware processing is performed, , An identifier on the side of the imaging device, and parameters necessary for its execution. As a result, the control means (CP
It is possible to execute the calculation of U) having a very large load in the hardware of the image pickup apparatus, and output in an external apparatus can be performed in a short time. In particular, since the matrix calculation and the error diffusion processing can be implemented in hardware, this has a great effect.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a digital camera to which an image pickup apparatus according to the present invention is applied.

FIG. 2 is a block diagram showing a configuration of an image pickup unit of the digital camera.

FIG. 3 is a diagram for explaining driver function information loaded into the digital camera.

FIG. 4 is a block diagram showing a first example of a conventional imaging system in which a digital camera and a printer are connected.

FIG. 5 is a block diagram showing a second example of the conventional imaging system.

FIG. 6 is a block diagram showing a third example of the conventional imaging system.

[Explanation of symbols]

120 Imaging unit 121 lens 122 image sensor 123 A / D converter 124 memory 125 interpolation LPF circuit 126 color conversion MAT circuit 127 γ conversion circuit 128 notch LPF circuit 129 APC processing circuit 131 γ conversion circuit 132 Luminance / color difference signal generation circuit 133 RGB conversion circuit 134 Video signal processing circuit 135 LCD monitor 136 compression / expansion circuit 137 External recording medium 138 binarization processing circuit 142 Printer driver execution unit 142a γ conversion unit 142b LOG converter 142c Masking processing unit 142d Binarization processing unit 143 file converter 144 printer output port A Printer driver function section

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI H04N 7/24 H04N 7/13 Z (58) Fields investigated (Int.Cl. ⁷ , DB name) H04N 5/76-5 / 956

Claims (4)

(57) [Claims] 1. An image pickup apparatus which is connectable to an external printer and which records a compressed image signal obtained by compressing an image signal obtained from the image pickup signal by a predetermined compression method on a recording medium. Storage means for storing driver function information for decompressing a compressed image signal and performing image processing for print output by the printer, and predetermined signal processing for the image pickup signal by a plurality of processing circuits.
Signal processing means for performing, if the printer does not have a function corresponding to the driver function information in the storage means, based on the gong <br/> driver function information in said storage means, said compressed by said signal processing means Extract the image signal subjected to image processing for print output by the printer, a signal obtained by the image processing and an output means for output to the printer, the driver function information, of the plurality Of the processing circuit
Information that controls whether to operate one of the processing circuits,
Information for executing software processing without using the above processing circuit
An image pickup device comprising: 2. The image pickup apparatus according to claim 1, wherein the predetermined compression method includes a JPEG method. 3. A signal processing hard block for obtaining the image signal by subjecting the image pickup signal to predetermined signal processing, wherein the signal processing hard block is divided into small calculation blocks and each of the small calculation blocks is provided. The driver function information includes information describing a plurality of sub-arithmetic processings, and each of the plurality of sub-arithmetic processings indicates whether the corresponding arithmetic operation is performed by hardware processing or software processing. The image pickup apparatus according to claim 1, further comprising: information indicating the hardware processing, wherein the information indicating the hardware processing includes the identifier for designating a small operation block for performing the hardware processing. 4. An imaging system including a printer and an imaging device connectable to the printer, wherein the imaging device is the imaging device according to any one of claims 1 to 3. And imaging system.