JP2003069838A - Data communication equipment, object reproducing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To promptly peruse a reproduction image that reproduces an object showing object color component data at a place different from the place where an image of the object is acquired. SOLUTION: A digital camera 1 photographs an image of the object and calculates, from the photographed image, the object color component data 63 that substantially correspond to the spectral reflection factor of the object (step ST21). The calculated object color component data 63 are transmitted from the digital camera 1 to a printer 2 (step ST22). A reproduction image that reproduces the colors of the object is obtained by combining the calculated object color component data 63 with illumination component data 64 corresponding to the spectral distribution of illuminating light in the printer 2, and the reproduction image is printed (step ST24 and ST25). Thus, it is possible to peruse the reproduction image at an early stage at a place different from the place where the image of the object is acquired.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a technique for reproducing a subject.

[0002]

2. Description of the Related Art Conventionally, image processing is performed on an image acquired as digital data by an image input device such as a digital camera or a scanner so as to correct the hue and mood of the image. A typical example of such processing is color correction based on white balance. White balance-based correction corrects an image so that white objects appear white based on the overall color balance of the image, which removes the effect of the color of the illumination light on the subject from the image to some extent. The image is modified to match the visual sense of.

On the other hand, there has been proposed a technique for obtaining an image when a subject is illuminated with various light sources by a calculation process. In this technique, data corresponding to the spectral reflectance of the subject (hereinafter referred to as “object color component data”) is obtained, and the data of the illumination light is combined with this data to obtain the subject under various illumination environments. Image is played.

[0004]

By the way, when the attendees discuss at a design-related meeting without gathering in one place, or when performing remote medical treatment in which the patient side and the doctor side are separated, the illumination light Technology that enables early viewing of images that remove the effects and reproduce the original color of the subject and images that reproduce the color of the subject in various lighting environments at a location other than the location where the image of the subject was acquired is available. It has been demanded. However, such a technique has not been proposed.

Therefore, an object of the present invention is to make it possible to quickly browse an image representing a subject represented by the object color component data at a place different from the place where the image of the subject was acquired.

[0006]

In order to solve the above-mentioned problems, the invention of claim 1 is a data communication device capable of communicating via a network, and an image acquisition means for acquiring image data of an object, From the image data
Object color component data generation means for obtaining object color component data corresponding to the image data from which the influence of the illumination environment on the object is removed, and reproduction image generation means for generating a reproduction image for reproducing the object indicated by the object color component data And transmitting means for transmitting the generated reproduction image to an external device connected to the network.

According to a second aspect of the present invention, there is provided a data communication device capable of communicating via a network, wherein image data obtained by removing an influence of a lighting environment on a subject is extracted from an external device connected to the network. Receiving means for receiving the corresponding object color component data, reproduction image generating means for generating a reproduction image for reproducing the subject indicated by the object color component data, and output means for outputting the generated reproduction image in a viewable manner. , Are provided.

According to a third aspect of the invention, in the data communication apparatus according to the second aspect, the output means includes a printing means for printing the reproduced image generated.

Further, the invention of claim 4 is the data communication apparatus according to claim 2, further comprising a transmitting means for transmitting the generated reproduced image to another external device coupled to the network. There is.

Further, the invention of claim 5 is the data communication apparatus according to any one of claims 1 to 4, further comprising: acceptance means for accepting designation of a reproduction condition for generating the reproduction image. The reproduction image generating means is characterized in that the reproduction image is generated based on the reproduction condition.

Further, in the data communication apparatus according to the present invention, the reproduction condition is the illumination component data indicating the influence of the illumination environment on the image, and the color used for color conversion based on the color adaptation. At least one of an adaptation formula and an adaptation coefficient for adjusting the degree of the influence of the illumination indicated by the illumination component data in the color conversion based on the chromatic adaptation is included.

According to a seventh aspect of the present invention, there is provided a method of reproducing an object, wherein an image acquisition step of acquiring image data of the object and the effect of the illumination environment on the object are removed from the acquired image data. Object color component data generation step of obtaining object color component data corresponding to the image data,
The method includes a reproduction image generation step of generating a reproduction image that reproduces the subject indicated by the object color component data, and a transmission step of transmitting the generated reproduction image to an external device connected to the network.

The invention of claim 8 is a method for reproducing an object, wherein object color component data corresponding to image data obtained by removing the influence of the illumination environment on the object from an external device connected to the network. A receiving step of receiving
A reproduction image generation step of generating a reproduction image that reproduces the subject indicated by the object color component data, and an output step of outputting the generated reproduction image so that the reproduction image can be viewed.

According to a ninth aspect of the present invention, there is provided a program, wherein the program is executed by a computer, in which an image acquisition step of acquiring image data of the object in the computer, and the object from the acquired image data is acquired. Object color component data generation step for obtaining object color component data corresponding to image data from which the influence of the illumination environment on the object is removed, and a reproduction image generation step for generating a reproduction image for reproducing the subject indicated by the object color component data. And a transmitting step of transmitting the generated reproduction image to an external device connected to a network.

Further, the invention of claim 10 is a program, and the computer executes the program,
A receiving step of receiving from the external device connected to the network, the object color component data corresponding to the image data obtained by removing the influence of the illumination environment on the object to the computer, and reproducing the object indicated by the object color component data. And a reproduction image generation step of generating a reproduction image and an output step of outputting the generated reproduction image so that the reproduction image can be browsed.

[0016]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

<1. First Embodiment><1-1. System Configuration> FIG. 1 is a diagram showing a schematic configuration of an image reproduction system according to a first embodiment of the present invention. As shown in FIG. 1, the image reproduction system 10 mainly includes a digital camera 1 serving as an image input device that captures an image of a subject and an image output device that prints an image received from the digital camera 1. It has and.

The digital camera 1 and the printer 2 each function as a data communication device, and various data communication can be performed between the devices via a network 5 such as a LAN or the Internet. The communication system of the digital camera 1 and the printer 2 may be wired or wireless, but in the present embodiment, a wired communication system is adopted.

Although a plurality of printers 2 are shown in FIG. 1, the image reproduction system 10 may include one printer 2, and in FIG. 1, one digital camera is provided. Only one is shown,
The image reproduction system 10 may include a plurality of digital cameras 1. Further, another data communication device may be connected to the network 5.

Any communication protocol may be used for data communication in the image reproduction system 10, but each data communication device connected to the network 5 has a unique address corresponding to the communication protocol used. It is assigned. In this embodiment, TCP / IP is used as a communication protocol, and the digital camera 1 and the printer 2 are assigned unique IP addresses in the network 5.
As a result, various data can be transmitted by designating an arbitrary data communication device as a transmission destination.

In the present embodiment, the digital camera 1
Is the object color component data corresponding to the data of the image in which the influence of the lighting environment at the time of shooting is removed, and generates an image (hereinafter referred to as a “reproduced image”) that reproduces the color of the subject under an arbitrary lighting environment. To do. On the other hand, the printer 2 receives the reproduced image from the digital camera 1 and prints the received reproduced image on a recording sheet.

<1-2. Configuration of Digital Camera> FIG. 2 is a perspective view showing the entire digital camera 1. The digital camera 1 includes a lens unit 11 that performs shooting, and
The lens unit 11 has a main body 12 that processes an image acquired as digital data.

The lens unit 11 has a lens system 111 having a plurality of lenses, and a CCD 112 for acquiring an image of a subject through the lens system 111. And
The image signal output from the CCD 112 is sent to the main body 12. Further, the lens unit 11 includes a finder 113 and a distance measuring sensor 11 for an operator to capture a subject.
4th grade is also placed.

The main body 12 is provided with a flash 121 and a shutter button 122. An operator captures an object through the finder 113 and operates the shutter button 122 to electrically capture an image with the CCD 112. It At this time, if necessary, the flash 121
Emits light. It should be noted that the CCD 112 is a three-band image pickup device that acquires values for each color of R, G, and B as the value of each pixel.

The image signal from the CCD 112 is the main body 12
The processing described below is performed inside the main body 1 as necessary.
Memory card 12 which is an external memory attached to
3 is stored. The memory card 123 can be taken out from the main body 12 by opening the lid on the lower surface of the main body 12 and operating the take-out button 124.

FIG. 3 is a diagram showing a state when the digital camera 1 is viewed from behind. A color liquid crystal display 125 is provided in the center of the back surface of the main body 12 for displaying a photographed image and a menu for the operator, and a display 125 is provided on the side of the display 125 according to the menu displayed on the display 125. An operation button 126 for performing an input operation is arranged. This allows the digital camera 1
The operation of, the setting of shooting conditions, the setting of image transmission, the setting of conditions for generating a reproduced image, and the like can be performed.

A communication unit 127 having a communication interface 127a for connecting to the network 5 is provided inside the main body 12. The communication unit 127 can send and receive various data to and from an external device such as the printer 2 connected to the network 5 via the communication interface 127a.

FIG. 4 is a block diagram showing the main structure of the digital camera 1. Of the configurations shown in FIG. 4,
A lens system 111, a CCD 112, an A / D converter 115,
The shutter button 122, the CPU 131, the ROM 132, and the RAM 133 realize the function of acquiring an image. That is, the image of the subject is transferred to the CCD 11 by the lens system 111.
When the image is formed on the image 2 and the shutter button 122 is pressed,
The image signal from the CCD 112 is digitally converted by the A / D converter 115. The digital image signal converted by the A / D converter 115 is stored in the RAM 133 of the main body 12 as image data. The control of these processes is performed by the CPU 131 operating according to the program 140 stored in the ROM 132.

The CPU 13 provided in the main body 12
1, ROM132 and RAM133 implement | achieve the function which processes an image. Specifically, according to the program 140 stored in the ROM 132, the CPU 131 performs image processing on the acquired image while using the RAM 133 as a work area. The image subjected to the image processing is displayed on the memory card 12 based on the input operation from the operation button 126.
3 and is appropriately transmitted to an external device connected to the network 5 via the communication unit 127.

The program 140 is read from the memory card 123, which is a recording medium, and stored in the ROM 132 in advance, but the network 5 can be accessed via the communication unit 127.
May be downloaded from a predetermined external storage device connected to and stored in the ROM 132.

The display 125 switches between displaying an image and displaying information to the operator based on a signal from the CPU 131. The flash 121 is the CPU 13
The light is emitted from 1 based on the light emission instruction signal. When emitting light, the CPU 131 controls so that the emission characteristics of the flash 121 do not vary from one image to another. Thereby, the spectral distribution (spectral intensity) of the light from the flash 121
Is controlled to be constant.

<1-3. Configuration of Printer> FIG. 5 is a perspective view showing the entire printer 2. As shown in FIG. 5, the printer 2 mainly includes an operation panel 21 that receives various instructions and data input by an operator's operation, and a printing unit 24 that prints an image or the like on a recording sheet.

Further, the printer 2 has a printing unit 2 on the upper surface of the main body.
4, a discharge unit 26 that discharges the recording sheet printed by 4, a paper feeding unit 27 that supplies the recording sheet to the printing unit 24 in the lower part, and a communication unit 25 that internally transmits / receives images and the like to / from an external device via the network 5. A fixed disk 28 for storing various data and a reading device 29 for reading information from a recording medium 92 such as a magneto-optical disk.

The operation panel 21 is composed of an input key 23 capable of inputting characters and numerals and a color liquid crystal display 22 having a function as a touch panel. A menu for the operator is displayed on the display 22, and the operator can input various instructions and data to the printer 2 through the input keys 23 and the display 22 as a touch panel while confirming the contents. is there.

The printing unit 24 prints on the recording sheet based on the image received from the external device via the communication unit 25. Further, the fixed disk 28 can store an image received via the communication section 25, and the printing section 24 can read out and print the image stored in the fixed disk 28 based on an instruction from the operation panel 21. It is possible.

The communication section 25 has a communication interface (not shown), and various data can be transmitted / received to / from an external device such as the digital camera 1 connected to the network 5 via this communication interface. ing.

FIG. 6 is a block diagram showing the main configuration of the printer 2. As shown in FIG. 6, the printer 2 internally has a CPU 231 that performs various arithmetic processes, and a RAM 233 that stores various data and serves as a work area for the arithmetic processes.
And a ROM 232 that stores a processing program. Each unit of the printer 2 is electrically connected to the CPU 231, and each unit of the printer 2 operates under the control of the CPU 231. Specifically, the CPU 231 performs arithmetic processing according to the program 240 stored in the ROM 232, thereby controlling the operation of each unit of the printer 2.

For example, when printing an image, the CPU 23
1 transmits a control signal to each unit, the image to be printed is read from the communication unit 25 or the fixed disk 28 to the RAM 233, is converted into a printable data format by the processing of the CPU 231, and is printed by the printing unit 24 as a recording sheet. Printed on.

The program 240 is read from the recording medium 92 via the reading device 29 and stored in the ROM 232 in advance, but is downloaded from a predetermined external storage device connected to the network 5 via the communication section 25. It may be stored in the ROM 232.

The RAM 233 and the fixed disk 2
Since 8 implements the function of storing various data, hereinafter, these will be collectively referred to as a “storage unit” 210.

<1-4. System Operation> FIG. 7 is a block diagram showing the functions realized by the arithmetic processing of the CPU and the like in accordance with the programs of the digital camera 1 and the printer 2 together with other configurations, showing the main functions of the image reproduction system 10. ing.

In the configuration shown in FIG. 7, the component data generation unit 141, the exposure calculation unit 142, the reproduction condition reception unit 143, the reproduction image generation unit 144, the transmission destination reception unit 145, and the data transmission unit 146 are included in the digital camera 1. The functions realized by the CPU 131 and the like are shown, and the data receiving unit 241 and the print processing unit 242 are the CPU of the printer 2.
231 and the like are shown.

FIG. 8 is a diagram showing a flow of operations of the image reproduction system 10. In FIG. 8, the step indicated by reference numeral S1 indicates the operation in the digital camera 1, and the step indicated by the reference numeral S2 indicates the operation in the printer 2. Hereinafter, the operation of the image reproduction system 10 will be described with reference to FIGS. 7 and 8.

First, the digital camera 1 captures an image of a subject and obtains object color component data and the like based on the obtained image (step ST1).
1). FIG. 9 is a diagram showing a flow of the operation (step ST11) at the time of shooting by the digital camera 1.

When the shutter button 122 is operated, a picture is taken with the flash turned on, and an image of the subject exposed to the flash light (hereinafter referred to as "first image").
Is obtained. That is, the flash 121 is turned on, an image is acquired by the CCD 112, and the obtained image (to be exact, an image signal) is output from the A / D converter 115 to RA.
It is sent to M133 and stored as the first image data 231 (step ST101).

Next, shooting is performed with the flash off, and an image of the subject (hereinafter referred to as "second image") in an illumination environment without flash light is obtained. That is, an image is acquired by the CCD 112 without using a flash, and the obtained image is output from the A / D converter 115 to RA.
It is sent to M133 and stored as the second image data 232 (step ST102).

These two photographings are performed quickly like continuous photographing. Therefore, the shooting ranges of the first image and the second image are the same. In addition, the shutter speed (the integration time of the CCD 112) and the aperture value (that is,
Shooting conditions regarding exposure) are performed under the same conditions.

The exposure condition is obtained by the exposure calculation section 142 based on the image (or the output of the photometric sensor) acquired by the CCD 112 immediately before the photographing. Specifically, first, the brightness of the subject is obtained based on the outputs of the CCD 112 and the photometric sensor, and the exposure value is determined in consideration of the sensitivity characteristic of the CCD 112. After that, the shutter speed and the aperture value are automatically determined according to a program diagram showing the relationship between the shutter speed and the aperture value prepared in advance in the digital camera 1.

Since the light emission of the flash 121 is controlled by the CPU 131, the light emission characteristics of the flash 121 do not vary from picture to picture. That is, flash 12
The spectral distribution of No. 1 is kept constant, and this spectral distribution is measured in advance and stored in the RAM 133 as flash spectral data. To be precise, the relative spectral distribution of flash light (referred to as the spectral distribution normalized with the maximum spectral intensity as 1, hereinafter referred to as “relative spectral distribution”) is used as the flash spectral data.

When the first image data 61 and the second image data 62 are stored in the RAM 133 by two times of photographing, the component data generation unit 141 subtracts the second image data 62 from the first image data 61 to obtain the difference. Obtain image data. Thereby, the R, G, B values of the corresponding pixels of the second image are subtracted from the R, G, B values of the pixels of the first image, respectively, and the difference between the first image and the second image is subtracted. An image is obtained (step ST103).

Next, the component data generation unit 141 obtains a component obtained by removing the influence of the illumination environment from the second image using the difference image data and the flash spectral data as object color component data 63, and stores it in the RAM 133 ( Step ST104). The object color component data 63 is data that substantially corresponds to the spectral reflectance of the subject. The principle of obtaining the spectral reflectance of the subject will be described below.

First, the spectral distribution of illumination light for illuminating a subject (which is referred to as illumination light in an illumination environment including direct light and indirect light from a light source) is E (λ), and this spectral distribution E (λ ) Using three basis functions E ₁ (λ), E ₂ (λ), E ₃ (λ) and weighting factors ε ₁ , ε ₂ , ε ₃ ,

[0053]

[Equation 1]

Similarly, the spectral reflectance S (λ) at a position on the subject corresponding to a certain pixel (hereinafter referred to as “target pixel”) is expressed by three basis functions S ₁ (λ) and S ₂ (λ), S
_{Using 3} (λ) and the weighting factors σ ₁ , σ ₂ , and σ ₃ ,

[0055]

[Equation 2]

The light I (λ) incident on the target pixel on the CCD 112 (incident light when the filter in the lens unit 11 is ignored) is expressed as follows.

[0057]

[Equation 3]

It is expressed as In addition, R, G, and
Assuming that the value relating to one of the colors of B (hereinafter referred to as “target color”) is ρ _c and the spectral sensitivity of the target color of the CCD 112 is R _c (λ), the value ρ _c is

[0059]

[Equation 4]

Is derived by

Here, when the value of the target color of the target pixel of the first image with flash ON is ρ _c1 and the corresponding value of the second image with flash OFF is ρ _c2 , the corresponding value ρ of the difference image _s is

[0062]

[Equation 5]

It becomes I ₁ (λ) is the light incident on the target pixel when the flash is ON, and ε ₁₁ , ε ₁₂ , and ε ₁₃ are the weighting coefficients of the basis function for the illumination light including the flash light. Similarly, I ₂ (λ) is the light that is incident on the target pixel when the flash is off, and ε ₂₁ , ε ₂₂ , and ε ₂₃ are the basis function weighting coefficients for the illumination light that does not include the flash light. Furthermore, ε _si (i = 1, 2, 3) is (ε _1i −ε _2i ).
Is.

In equation 5, the basis functions E _i (λ) and S _j (λ)
Is a predetermined function, and the spectral sensitivity R _c (λ) is a function that can be obtained in advance by measurement. These pieces of information are stored in the ROM 132 or the RAM 133 in advance. On the other hand, the shutter speed (or C
The difference image obtained by subtracting the second image from the first image, in which the integration time of CD 112) and the aperture value are controlled to be the same, that is, the image affected only by the change in the illumination environment, that is, only the flash light is used as the illumination light source. Since it corresponds to the image,
The weighting coefficient ε _si can be derived from the relative spectral distribution of the flash light by the method described later.

Therefore, in the equation shown in Equation 5,
There are three weighting factors σ₁, Σ₂, Σ ₃Only. Well
In addition, the equation shown in Equation 5 is for R, G, and B in the target pixel.
Can be determined for each of the three colors, these
By solving the three equations, the three weighting factors σ₁，
σ₂, Σ₃Can be asked. That is, for the target pixel
The spectral reflectance of the corresponding position on the subject is obtained.

Next, a method for _obtaining the weighting coefficient ε _si will be described. As described above, the difference image corresponds to an image in which only the flash light is used as the illumination light, and the relative spectral distribution of the illumination light in the difference image is known. On the other hand, the area on the subject far from the flash receives the flash light less than the area near the flash 121. Therefore, in the difference image, the position farther from the flash 121 appears darker.

Therefore, the three weighting factors ε_s1, Ε_s2, Ε_s3
The target image in the difference image while keeping the relative relationship of
The value of these weighting factors is increased or decreased in proportion to the brightness of the element.
That is, when the brightness of the target pixel in the difference image is small
Is the weighting coefficient ε_s1, Ε_s2, Ε_s3Value is determined as a small value
If the brightness is large, the weighting coefficient ε_s1, Ε_s2, Ε _s3
The value of is determined as a large value. It should be noted that the three weights
Number ε_s1, Ε_s2, Ε_s3Is based on three basis functions E
₁(λ), E₂(λ), E₃The weighted sum of (λ) is the flash light
Pre-determined to be proportional to the light distribution, it
Weighting coefficient ε_siThe proportional relationship with and is previously obtained by measurement.

The weighting coefficient ε _si is a value indicating the spectral distribution of the flash light emitted to the position on the subject corresponding to the target pixel, and is the amount of change of the illumination light by the flash 121 between the first image and the second image. It is a value indicating the spectral distribution. Therefore, the weighting factor ε
_The process of _{obtaining si} corresponds to the process of obtaining the spectral change amount of the illumination environment (illumination light) by the flash 121 from the relative spectral distribution of the flash light.

Based on the above principle, the component data generator 141 of the digital camera 1 obtains the spectral reflectance of the position on the object corresponding to each pixel while referring to the pixel value of the difference image data and the flash spectral data. The spectral reflectance of the subject corresponds to the image data from which the influence of the illumination environment has been removed, and is stored in the RAM 133 as the object color component data 63 (step ST104).

When the object color component data 63 is obtained, three equations relating to the weighting factors ε ₂₁ , ε ₂₂ and ε ₂₃ are obtained based on the values of R, G and B of each pixel of the second image from the equations 3 and 4. Can be asked. The component data generation unit 141 _{obtains the} weighting coefficient ε _2i for each pixel in the second image by solving these equations. The obtained weighting coefficient ε _2i of each pixel is a component indicating the influence of the illumination environment that does not include the flash light in the second image.

Here, the weighting coefficient ε _2i of each pixel may be used as the illumination component data 64 as it is, but in the case of an approximately uniform illumination environment of the illumination light, the weighting coefficient ε _{2i of} each pixel is used.
Variation is small. Therefore, the weighting factors ε ₂₁ , ε ₂₂ , ε
The average value of all pixels is obtained for each of the ₂₃ , and the obtained three weighting factors are the illumination component data 64 (step ST105). As a result, the illumination component data 64 has a value that does not depend on the pixel position.

When the object color component data 63 and the illumination component data 64 are obtained, these data are transferred to and stored in the memory card 123 (step ST10).
6). At this time, under the control of the CPU 131, the exposure data indicating the shooting conditions regarding the exposure is also transferred from the exposure calculation unit 142 to the memory card 123 and stored therein. As a result, as shown in FIG. 10, the object color component data 63, the illumination component data 64, and the exposure data 65 are stored as one file 66 (step ST106). Although these data are stored as the same file 66, they can be taken out independently.

It is preferable that the brightness of the subject used when the exposure value is determined is stored as the shooting condition for exposure, but other data can be used if the brightness of the subject at the time of shooting can be obtained. The shooting conditions of may be used. For example, since the exposure value can be obtained from the sensitivity of the CCD 112 and the brightness of the subject, the exposure value may be used as the exposure data 65 when the sensitivity of the CCD 112 is known. Instead of the exposure value, the shutter speed and the aperture value may be the exposure data 65. Also, C
The sensitivity and exposure value of the CD 112 may be the exposure data 65.

When the object color component data 63 and the like are stored as described above, the digital camera 1 performs a process of generating a reproduced image of the subject based on the acquired object color component data 63 (FIG. 8). : Step ST12). The process of generating the reproduced image is performed by receiving an instruction to generate the reproduced image from the operator. Therefore, the operator can repeat the photographing (step ST11) to store the plurality of object color component data 63, and then cause the digital camera 1 to generate the reproduced image.

FIG. 11 is a diagram showing the flow of processing for generating a reproduced image. First, the operator selects a file 66 for storing the desired object color component data 63 by giving an instruction via the operation button 126 while watching the display on the display 125. As a result, the subject at the time of shooting, which is the target object for color reproduction, is determined, and the selected object color component data 63 is stored in the RAM 1 by the reproduction condition receiving unit 143.
It is read by 33 (step ST201).

Subsequently, the selected object color component data 63
Conditions for generating a reproduced image of the subject shown by
It is called "reproduction condition". ) Is received by the reproduction condition receiving unit 143. Specifically, first, a list of lights (that is, the illumination component data 64) used to generate the reproduced image is displayed on the display 125. FIG. 12: is a figure which illustrates the screen of the display 125 at the time of selecting lighting. By operating the left and right buttons of the operation button 126,
"Selection number""OK""Cancel" items are temporarily selected,
In the item of "selection number", the number is selected by the up and down buttons. For other items, the selection is confirmed by the center button.

In FIG. 12, "CIE" prepared in advance in the digital camera 1 together with "illumination at the time of photographing" are shown.
D65 light source "(general standard light source)," CIE D50
Various types of illumination such as "light source" (standard light source related to printing), "incandescent lamp", "sunlight" can be selected. The operator selects and instructs any desired illumination through the operation button 126 while looking at the list on the screen of FIG. This selection instruction is accepted by the reproduction condition accepting unit 143, the illumination component data 64 corresponding to the selected illumination is determined as the illumination component data to be used for generating the reproduced image, and RA
The data is read by M133 (step ST202).

When "illumination at the time of shooting" is selected, the illumination component data 64 is read from the same file 66 as the object color component data 63 into the RAM 133, and the subject under the illumination at the time of shooting is subjected to the processing described later. An image is produced that reproduces the colors. On the other hand, when another illumination is selected, the illumination component data 64 stored in advance in the ROM 132 or the like is read into the RAM 133, and an image that reproduces the color of the subject under the illumination environment selected by the processing described later is displayed. Is generated. Since it is possible to select and specify various types of illumination in this way, it is possible to reproduce the color of an object under an arbitrary illumination environment, and especially when a standard light source such as "CIE D65 light source" is selected, The meaning is retained, and the original color of the subject can be reproduced.

In the screen of FIG. 12, the illumination component data 64 obtained when another image is taken may be selectable. According to this, another image is taken. It is possible to reproduce the color of the subject in the lighting environment when it is exposed. Alternatively, virtual light sources may be prepared so that they can be selected.

Next, a screen for selecting the color adaptation type is displayed on the display 125. FIG. 13 is a diagram exemplifying a screen of the display 125 when selecting the chromatic adaptation method.
In FIG. 13, it is possible to select a color adaptation formula based on a color appearance model of either "CIECAT94LAB" or "CIECAM97s".

In this embodiment, when a reproduced image is generated, color conversion is performed in consideration of human chromatic adaptation. Therefore, the screen of FIG. 13 is displayed to allow the operator to select an arbitrary chromatic adaptation formula to be applied to color conversion based on chromatic adaptation. A selection instruction from the operator via the operation button 126 is received by the reproduction condition receiving unit 143, and the color adaptation formula based on the selected color appearance model is determined as the color adaptation formula to be applied to the color conversion based on the color adaptation. (Step ST203).

Furthermore, a screen for selecting an adaptation coefficient used in color conversion based on chromatic adaptation is displayed on the display 125. FIG. 14: is a figure which illustrates the screen of the display 125 when selecting an adaptation coefficient. In FIG. 14, any one of “1.0”, “0.5”, and “0.0” can be selected as the chromatic adaptation coefficient.

This adaptation coefficient is used by substituting it into the chromatic adaptation formula in the color conversion based on chromatic adaptation, and is a coefficient for adjusting the degree of the influence of illumination indicated by the illumination component data 64.
Normally, "1.0" if the subject is an object that does not emit light,
If the subject itself is a display that emits light, etc., “0.
0 "is set, and when the subject is a screen on which light is projected like a color slide," 0.5 "is set.
The adaptation coefficient can also be used as a coefficient that reflects the intention of the operator. By specifying the adaptation coefficient by the operator, the degree of influence of illumination light is changed to reproduce a desired color. be able to. Operation button 1 from the operator
The selection instruction via 26 is accepted by the reproduction condition accepting unit 143, and the selected adaptation coefficient is determined as the adaptation coefficient to be substituted into the chromatic adaptation formula (step ST20).
4). The adaptation coefficient in FIG. 14 is “1.0”.
The value is selected from "0.5" and "0.0", but a specific numerical value may be input.

In this way, when the designation of the illumination component data 64, the chromatic adaptation formula and the adaptation coefficient is received as the reproduction condition, the chromatic adaptation formula and the adaptation coefficient are reproduced.
Entered in. After that, the reproduction image generation unit 144 performs a process of combining the selected object color component data 63 and the illumination component data 64. Specifically, the object color component data 6
3 and the illumination component data 64 are used as the weighting coefficients ε _i and σ _j of Equations 3 and 4, and these data are combined to obtain the R, G, B values ρ _r , ρ _g , ρ _{b of} each pixel. Is obtained as combined image data (step ST20).
5).

Next, the reproduced image generator 144 causes the tristimulus value X _{0 of} the illumination environment (illumination light) indicated by the illumination component data 64 to be obtained.
Y ₀ and Z ₀ are obtained by the calculation shown in Formula 6, and the chromaticity x ₀ and y ₀ of the illumination light are obtained from Formula 7 (step ST206).

[0086]

[Equation 6]

[0087]

[Equation 7]

In the equation 6, R _X (λ), R _Y (λ), R
_Z (λ) is a color matching function, E (λ) is a spectral distribution of illumination light derived from the illumination component data 64 by the equation 1, and λ is a wavelength in the visible region.

Exposure data 65 stored in the memory card 123 together with the object color component data 63 is also input to the reproduction image generating section 144 (step ST20).
7).

Thereafter, the selected chromatic adaptation formula is applied, and color conversion based on chromatic adaptation is performed on the combined image data using the chromaticity x ₀ , y ₀ and the exposure data 65 to reproduce the image.
Given by. As a result, the converted image data obtained by the color conversion based on the color adaptation is obtained as a reproduced image that reproduces the color of the subject (step ST208).

Here, the color conversion of the combined image data by the reproduction image generating section 144 will be described. In the following description, it is assumed that the CIECAT94LAB chromatic adaptation formula is selected (for details, see Yoshinobu Na
yatani et al., "Proposal of an Abridged Color-Appe
arance Model CIECAT94LAB and Its Field Trials ", COL
OR reserch and application, vol. 24, No. 6, Dec. 1
See 999. ).

First, the pixel value of each pixel of the combined image is converted into the tristimulus values X, Y, Z of the CIE standard color system using the determinant, and the tristimulus value of each pixel is calculated by the equation (8). X,
Y and Z are converted into tristimulus values R, G and B of the physiological primary color system.

[0093]

[Equation 8]

Next, the tristimulus value R _R ,
G _R and B _R are required. The various parameters of Equation 9 will be described later.

[0095]

[Equation 9]

Finally, the tristimulus value R after conversion by the equation 10
_R, G _R, B _R tristimulus values X _R, Y _R, returned to Z _R, is converted image data or the reproduced image is generated (step S
T208).

[0097]

[Equation 10]

Next, various parameters of the equation 9 will be described. Y ₀ is a parameter that gives the influence of the background in the subject to the _equation 9, and is set to 20 (%) here. n is a parameter considering the influence of noise, and is given 0.1 or 1.

Ξ _R , η _R , and ζ _R are relative chromaticities of reference illumination (for example, CIE standard D65, illuminance 1000 lux (lx)) that is a reference for color conversion based on chromatic adaptation, and is the color of the reference illumination. _Derived from the degrees x _R0 and y _{R0 by the} equation 11.

[0100]

[Equation 11]

<Ξ>, <η>, and <ζ> are relative chromaticities in consideration of adaptation with respect to chromaticity, and the colors of the illumination (hereinafter, referred to as “test illumination”) indicated by the illumination component data 64 by Expression 12. The relative chromaticities ξ, η, ζ are obtained from the degrees x ₀ , y _0, and the relative chromaticities ξ, η, ζ of the test illumination and the relative chromaticities ξ _R , η _R , ζ _{R of the} reference illumination are given by Equation 13 Required by.

[0102]

[Equation 12]

[0103]

[Equation 13]

It should be noted that α in equation 13 is obtained by equation 14.

[0105]

[Equation 14]

L ₀ in the _equation 14 is the adaptation luminance of the subject, and the unit is candela per square meter (cd / m ² ). The exposure data 65 is used to calculate the adaptation luminance L ₀ , and details thereof will be described later. Also, in Equation 14,
The pixel values of the composite image L ^* a ^* b ^* values when converting into color system L ^* is also used.

The adaptation coefficient selected above is substituted for D in the equation (14). Since α in Expression 14 is a coefficient with respect to the relative chromaticities ξ, η, and ζ of the test illumination in Expression 13, the adaptation coefficient D adjusts the degree of influence of the test illumination (illumination indicated by the illumination component data 64). Becomes In addition,
Since it is difficult to distinguish whether or not the subject represented by the combined image is a light emitting object, the adaptation coefficient D is not strictly distinguished for each pixel.

R _R0 , G _R0 , and B _R0 in the _equation 9 are effective adaptation responses under the reference illumination and are obtained by the equation 15.

[0109]

[Equation 15]

In Expression 15, L _R0 is the adaptation luminance of the reference illumination, and is obtained by Expression 16.

[0111]

[Equation 16]

In Expression 16, E _R0 is the illuminance of the reference illumination (E _R0 = 1000 (lx)).

R ₀ , G ₀ , and B ₀ in the equation 9 are effective adaptation responses under the test illumination, and are obtained by the _equation 17 using the adaptation luminance L _{0 of the} subject (described later).

[0114]

[Equation 17]

Power index functions β ₁ (C ₁ ) and β ₂ (C ₂ )
(C ₁ = R _R0 , G _R0 , R ₀ , G ₀ ; C ₂ = B _R0 , B ₀ )
It is shown by the number 18.

[0116]

[Equation 18]

Further, K in the equation 9 is obtained by the equation 19 using the above various parameters.

[0118]

[Formula 19]

However, in the case of the digital camera 1, Y ₀ =
Since it is 20, K becomes 1.

Next, a method of calculating the adaptation luminance L _{0 of the} subject using the exposure data 65 will be described.

The exposure data 65 is data indicating the brightness of the subject (or at least data capable of deriving the brightness of the subject). Specifically, the illuminance E ₀ when the subject is observed is the brightness of the subject.

In general, the brightness represents the radiation intensity per unit area when the radiation source (subject) is viewed from the observation direction,
The light flux is Φ, the solid angle is Ω, the cross-sectional area of the light flux is S, and the angle between the cross-section of the light flux and the direction of the light flux is θ.

[0123]

[Equation 20]

On the other hand, the illuminance is a radiant flux that is incident per unit area, and is represented by equation 21 with Φ being the luminous flux and A being the incident area.

[0125]

[Equation 21]

Here, when the subject is photographed by the digital camera 1, since the observation direction can be regarded as the direction directly facing the subject, θ is 0 ° (that is, cos θ = 1).
Can be Further, it can be considered that the degree of light incident on one pixel among the light emitted from the point on the subject is constant (that is, it is not necessary to consider the solid angle Ω), and k is a constant, It can be assumed that the number 22 is satisfied.

[0127]

[Equation 22]

In the digital camera 1, the constant k is obtained in advance by actual measurement, and the illuminance (brightness) of the subject is obtained by the exposure calculation unit 142 based on the output of the CCD 112 and the output of the photometric sensor before the main photographing. Has become. Then, the brightness of the subject is stored in the memory card 123 as one file together with the object color component data 63 as the exposure data 65.

The adaptation luminance L _{0 of the} subject used in the _equations 14 and 17 is derived by the _equation 23 using the illuminance E ₀ of the subject derived from the exposure data 65.

[0130]

[Equation 23]

As described above, when the reproduced image is generated based on the reproduction condition, the tristimulus values X _R , Y _R and Z _R (Equation 10) of each pixel of the reproduced image are values to be displayed on the display 125. And the converted image is displayed on the display 125 (FIG. 11: step ST20).
9). As a result, a reproduced image considering chromatic adaptation is displayed, and the operator can confirm the generated reproduced image.

The operator confirms the display on the display 125, and when the generated reproduced image does not meet the intention (FIG. 8: No in step ST13), the reproduced condition is changed to generate the reproduced image. The process can be executed again (step ST12). On the other hand, when the reproduced image generated is in line with the intention, the digital camera 1 is instructed via the operation button 126 to print the reproduced image by the printer 2 (Yes in step ST13).

When the digital camera 1 receives the print instruction, the display 125 displays a screen for selecting the printer 2 connected to the destination network 5. FIG. 15 is a diagram illustrating a screen of the display 125 when the printer 2 is selected. In FIG. 15, the destinations can be selected from the names of the three printers 2. The name of the printer 2 is registered in advance by the operator and is stored in the ROM 132 or the like of the digital camera 1. When registered, the IP address of the printer 2 is also registered and stored together with its name. The IP address corresponding to the name of the printer 2 is preferably displayed simultaneously on the screen for selecting the printer 2 as shown in FIG.

The selection instruction from the operator via the operation button 126 is accepted by the destination accepting section 145,
The IP address corresponding to the name of the selected printer 2 is input to the data transmission unit 146 as the destination IP address.

Further, the reproduction image generated by the reproduction image generation unit 144 is input to the data transmission unit 146, and the printer 2 (more accurately, the transmission destination IP address selected by the data transmission unit 146 via the communication unit 127). ) Is transmitted (step ST14).

The transmitted reproduced image is received by the data receiving unit 241 of the printer 2 having the destination IP address (step ST15). The data receiving unit 241
The received reproduction image is stored in the storage unit 210, and a print instruction is given to the print processing unit 242.

Upon receiving this print instruction, the print processing unit 242
Reads the reproduced image from the storage unit 210 and prints it on the printing unit 24.
The converted reproduced image is input to the printing unit 24. Then, the printing unit 24 prints the reproduced image whose data format has been converted on the recording sheet.
As a result, the reproduced image is output so that it can be browsed (step ST16).

Although the configurations and operations of the digital camera 1 and the printer 2 of the image reproduction system 10 have been described above, in the digital camera 1, the illumination environment is changed to the object color component data 63 indicating the spectral reflectance of the subject. The image can be easily obtained from the two images, and by appropriately combining the object color component data 63 with one selected from the plurality of illumination component data 64, a desired image to be captured under a desired illumination environment can be obtained. Can be generated.

Further, the digital camera 1 can perform color conversion based on chromatic adaptation on the combined image data based on the chromatic adaptation formula, which is more natural (suitable for human vision).
Reproduced images can be generated.

Furthermore, since the digital camera 1 can send the generated reproduced image to the printer 2 which is an external device connected to the network 5, the printer 2
By printing on the recording sheet by the method, the reproduced image of the subject represented by the object color component data can be browsed at a place other than the place where the image of the subject is acquired.

<2. Second Embodiment> Next, a second embodiment of the present invention will be described. In the image reproduction system 10 of the first embodiment, the reproduced image is generated by the digital camera 1 which is the image input device, but in the second embodiment, the printer 2 which is the image output device is used. The difference is that a reproduction image is generated.

The image reproduction system 10 according to the second embodiment.
The configuration is the same as that shown in FIG. Further, the configuration of the digital camera 1 is similar to that shown in FIGS. 2 to 4, and the configuration of the printer 2 is similar to those shown in FIGS. 5 and 6. Therefore, hereinafter, the same as the first embodiment. Those having a function will be described using the same reference numerals as appropriate.

FIG. 16 is a block diagram showing the functions realized by the arithmetic processing of the CPU and the like in accordance with the programs of the digital camera 1 and the printer 2 according to the present embodiment together with other components in a block diagram. It shows the main functions.

In the configuration shown in FIG. 16, the component data generator 141, the exposure calculator 142, the destination receiver 145 and the data transmitter 146 are the CPU 13 of the digital camera 1.
1 and the like, the data receiving unit 241, the print processing unit 242, and the reproduction condition receiving unit 24 are shown.
3 and the reproduction image generation unit 244 are CPUs of the printer 2.
231 and the like are shown.

FIG. 17 is a diagram showing a flow of operations of the image reproduction system 10 in the present embodiment. In FIG. 17, the step indicated by reference numeral S1 indicates the operation in the digital camera 1, and the step indicated by the reference numeral S2 indicates the operation in the printer 2. The operation of the image reproduction system 10 according to the present embodiment will be described below with reference to FIGS. 16 and 17.

First, the digital camera 1 captures an image of a subject and obtains the object color component data 63 and the like based on the obtained image (step ST
21). The flow of this operation is similar to the flow shown in FIG. 9 described above, and finally, the object color component data 63, the illumination component data 64, and the exposure data 65 are combined into one file 66.
(See FIG. 10) is stored in the memory card 123.

Next, when the operator of the digital camera 1 instructs the transmission of the file 66 to the printer 2 through the operation button 126, the transmission instruction is accepted by the destination accepting unit 145 and is shown in FIG. Screen is display 125
Is displayed in. When the printer 2 as the transmission destination is selected, the file 66 including the object color component data 63 is transmitted to the printer 2 selected by the data transmission unit 146 (step ST22).

When the photographing of the subject (step ST21) is repeated and a plurality of files 66 are stored in the memory card 123, the file 66 to be transmitted is designated and then transmitted to the printer 2. At this time, it is possible to designate a plurality of files 66 and send them to the printer 2 at the same time. The instruction to specify the file 66 is accepted by the destination accepting unit 145.

The transmitted file 66 is received by the data receiving unit 241 of the selected printer 2 (step ST23). The data receiving unit 241 stores the received file 66 in the storage unit 210.

The above processing (steps ST21 to ST2)
3) may be repeated, and by repeating this process, a plurality of files 66 are stored in the storage unit 210 of the printer 2.
Will be stored.

The printer 2 stores the file 66 including the object color component data 63 in the storage unit 210, and then when the generation of the reproduced image is instructed, the printer 2 executes the process of generating the reproduced image of the object indicated by the object color component data 63. Perform (step ST2
4). Since the flow of this processing is almost the same as the flow shown in FIG. 11 described above, the description will focus on the points that differ from the first embodiment with reference to FIG.

First, in step ST201, when the object color component data 63 is selected, the file 66 stored in the storage unit 210 is displayed on the display 22 of the operation panel 21. This allows the operator of the printer 2 to operate the operation panel 21 (display 22 as a touch panel).
Or desired input object color component data 63
It is possible to select the file 66 that stores the.
The selected object color component data 63 corresponds to the reproduction condition receiving unit 2
It is read out to the RAM 233 by 43.

Further, steps ST202 to ST204
At, the reproduction condition, that is, the illumination component data 64, the chromatic adaptation formula, and the adaptation coefficient are selected and accepted by the reproduction condition acceptance unit 243. At this time, a screen similar to that shown in FIGS. 12 to 14 is displayed on the display 22,
Desired reproduction conditions are selected via the operation panel 21. Various illumination component data 64 are prepared in advance on the fixed disk 28 of the printer 2, and various illumination component data 64 are selected as the illumination used to generate the reproduced image, as in the first embodiment. It is possible. The selected illumination component data 64 is read out to the RAM 233.

The selected chromatic adaptation formula and adaptation coefficient are input to the reproduction image generating section 244, and thereafter step ST20.
In 5 to ST208, the same processing as in the first embodiment is performed by the reproduced image generation unit 244, and a reproduced image is generated based on the reproduction condition. The generated reproduced image is displayed on the display 22 of the operation panel 21, and the operator can check the displayed reproduced image (step ST209).

The operator of the printer 2 confirms the display on the display 22 and selects again whether to generate a reproduced image or print the generated reproduced image (FIG. 17: step ST25).

When printing is instructed, the generated reproduction image is input to the print processing unit 242, converted into a printable data format, and printed by the printing unit 24.
As a result, the reproduced image is output so that it can be browsed (step ST26).

The image reproduction system 10 according to the second embodiment has been described above. The printer 2 according to the present embodiment has been described above.
Can receive the object color component data, generate a reproduced image, and print the reproduced image. Therefore, in the printer 2 different from the digital camera 1 in which the image of the object is acquired, the object represented by the object color component data is reproduced. Images can be made viewable early.

<3. Third Embodiment> Next, a third embodiment of the present invention will be described. In the image reproduction system 10 according to the present embodiment, the object color component data 63
An image server for storing the image is provided, and the reproduced image is generated by this image server.

FIG. 18 is a diagram showing a schematic configuration of the image reproduction system 10 according to the third embodiment. As shown in FIG. 18, the image reproduction system 10 includes a digital camera 1 as an image input device and a printer 2 as an image output device.
In addition, the image server 3 for accumulating the object color component data 63 and the user computer 4 for transmitting various requests to the image server 3 are provided.

Image server 3 and user computer 4
Also functions as a data communication device, and various types of data communication can be performed between the devices connected to the network 5 via the network 5. The image server 3 and the user computer 4 are also assigned unique IP addresses in the network 5.

The configuration of the digital camera 1 of the present embodiment is similar to that shown in FIGS. 2 to 4, the configuration of the printer 2 is similar to that shown in FIGS. 5 and 6, and
Components having the same functions as those in the first and second embodiments will be described using the same reference numerals as appropriate.

Image server 3 and user computer 4
The hardware configuration is similar to that of a general computer. Therefore, since the basic configurations of the image server 3 and the user computer 4 are the same, description will be given with reference to FIG. 19 which is the same schematic diagram. Image server 3
19 and the user computer 4, as shown in FIG.
U31, CPU 41 in user computer 4, the same applies hereinafter), ROM (32, 42) for storing basic programs
The RAM (33, 43) for storing various information is connected to the bus line. A fixed disk (34, 4) for storing various information is also provided on the bus line.
4), a display (35, 4) for displaying various information
5), a keyboard (36 that accepts input from the operator
a, 46a) and mouse (36b, 46b), optical disk, magnetic disk, magneto-optical disk, or other recording medium 93.
Reading device (37, 4) that reads various data from
7) and communication units (38, 48) for communicating with external devices via the network 5 are appropriately connected via an interface (I / F) or the like.

The image server 3 and the user computer 4 are
The program (340, 440) is read from the recording medium 93 via the reading device (37, 47), and the fixed disk (3
4, 44). Further, it can be downloaded from a predetermined external storage device via the network 5 and stored in the fixed disks (34, 44). Then, the CPU (31, 41) causes the fixed disk (3
Programs (340,440) stored in
According to the above, various operations are performed by executing arithmetic processing. That is, this program (34
0,440), the image server 3 operates as the image server 3, and
The user computer 4 operates as the user computer 4.

Since the RAMs (33, 43) and the fixed disks (34, 44) realize the function of storing various data, hereinafter, when these are collectively referred to, "storage section" (310, 410). ). In addition, a keyboard (36a, 46a) and a mouse (36
b, 46b) will be collectively referred to as an "operation unit" (36, 46).

FIG. 20 is a block diagram showing the functions realized by the arithmetic processing of the CPU and the like in accordance with the programs of the digital camera 1, printer 2, image server 3 and user computer 4 in the present embodiment together with other components. And shows the main function of the image reproduction system 10.

In the configuration shown in FIG. 20, the component data generation unit 141, the exposure calculation unit 142, the transmission destination reception unit 145 and the data transmission unit 146 are the CPU 13 of the digital camera 1.
1 is implemented by the data receiving unit 241 and the print processing unit 242. Functions implemented by the CPU 231 of the printer 2 are implemented by the data receiving unit 341, the reproduced image generating unit 342, the data transmitting unit 343, and the HTTP server 344. Is a function realized by the CPU 31 of the image server 3 and the browser 441 is a CPU of the user computer.
The functions realized by 41 and the like are shown.

The browser 441 of the user computer 4
Is a general WEB browser, and H of the image server 3
It is possible to send requests and commands for various contents to the TTP server 344, and display various contents received from the HTTP server 344 on the display 45. Also, the HTTP server 344 of the image server 3 is the browser 441 of the user computer 4.
Outputs various contents in response to requests from the browser 4
41, a reproduction condition reception unit 345, a reproduction image output unit 346, and a transmission destination reception unit 347.

FIG. 21 is a diagram showing an operation flow of the image reproduction system 10 in the present embodiment. In FIG. 21, the step indicated by the reference numeral S1 indicates the operation in the digital camera 1, the step indicated by the reference numeral S2 indicates the operation in the printer 2, and the step indicated by the reference numeral S3 indicates the operation in the image server 3. The operation of the image reproduction system 10 according to the present embodiment will be described below with reference to FIGS. 20 and 21.

First, the digital camera 1 captures an image of a subject and obtains the object color component data 63 and the like based on the obtained image (step ST
31). The flow of this operation is similar to the flow shown in FIG. 9 described above, and finally, the object color component data 63, the illumination component data 64, and the exposure data 65 are combined into one file 66.
(See FIG. 10) is stored in the memory card 123.

Next, when the operator of the digital camera 1 instructs the transmission of the file 66 via the operation button 126, the transmission instruction is accepted by the destination accepting unit 145 and includes the object color component data 63 and the like. The file 66 is transmitted to the image server 3 by the data transmission unit 146 (step ST32). Similar to the second embodiment, in the case where a plurality of files 66 are stored in the memory card 123 due to repeated photographing of the subject (step ST31), at least one file 66 is designated and then the printer 2 Sent to. The transmitted file 66 is received by the data receiving unit 341 of the image server 3 and stored in the storage unit 310 (step ST33).

The above processing (steps ST31 to ST3)
3) may be repeatedly performed, and by repeating this process, a plurality of files 6 are stored in the storage unit 310 of the image server 3.
6 will be stored. Also, the image reproduction system 1
If 0 includes a plurality of digital cameras 1, many files 66 are stored in the storage unit 310 of the image server 3 by performing the processing of steps ST31 to ST33 between each digital camera 1 and the image server 3. Will be accumulated in.

The image server 3 stores the file 66 including the object color component data 63 in the storage unit 310, and then the HTTP
When an instruction to generate a reproduced image is received via the server 344, a process of generating a reproduced image of the subject indicated by the object color component data 63 is performed (step ST34). The flow of this processing is almost the same as the flow shown in FIG. 11 described above, and therefore, the description will be centered on the parts that differ from the above-described embodiment with reference to FIG.

First, the operator of the user computer 4
The image server 3 via the operation unit 46 and the browser 441.
When the HTTP server 344 is instructed to generate a reproduced image, the reproduction condition receiving unit 345 receives the generation instruction. As a result, a list of files 66 that store the selectable object color component data 63 is displayed on the browser 441. The operator of the user computer 4 selects the file 66 in which the desired object color component data 63 is stored while referring to this list display. Selected file 6
The information of 6 is the HT of the image server 3 via the browser 441.
The object color component data 63 transmitted to the TP server 344, accepted by the reproduction condition acceptance unit 345, and included in the file 66 is read into the RAM 33 of the image server 3 (step ST201).

Next, the same display as in FIGS. 12 to 14 is displayed on the browser 441, and the reproduction condition desired by the operator, that is, the illumination component data 64, the chromatic adaptation formula and the adaptation coefficient are selected. The selected reproduction condition is received by the reproduction condition receiving unit 345. Various illumination component data 64 are prepared in advance on the fixed disk 34 of the image server 3, and various illumination component data 64 can be selected as the illumination used to generate the reproduced image, as in the above embodiment. Is. Selected illumination component data 64
Is read to the RAM 33 (step ST202-
ST204).

The selected chromatic adaptation formula and adaptation coefficient are input to the reproduction image generating section 342, and thereafter step ST20.
In 5 to ST208, the same processing as in the first embodiment is performed by the reproduced image generation unit 342, and a reproduced image is generated based on the reproduction condition.

The reproduced image generated is the HTTP server 3
44 from the reproduced image output unit 346 to the user computer 4
To the browser 441 of the user computer 4 and displayed on the display 45 of the user computer 4. That is, the reproduced image is output so that it can be browsed (step ST20).
9).

The operator of the user computer 4 confirms the reproduced image displayed on the browser 441 of the display 45, and selects again whether to generate the reproduced image or print the generated reproduced image (see FIG. 21: Step ST3
5).

When the print instruction is transmitted, the same display as in FIG. 15 is displayed on the browser 441. The operator of the user computer 4 selects the desired printer 2 for printing. This selection instruction is received by the transmission destination reception unit 347 of the image server 3, and the IP address of the selected printer is input to the data transmission unit 343. The name and IP address of the printer 2 that is a candidate for printing is registered and stored in advance.

Further, the reproduced image generated by the reproduced image generating section 342 is input to the data transmitting section 343, and the reproduced image is transmitted to the printer 2 selected by the data transmitting section 343 (step ST36).

The transmitted reproduced image is received by the data receiving unit 241 of the printer 2 (step ST37), and the first
Printing is performed on the recording sheet in the same manner as in the above embodiment (step ST38).

The image reproduction system 10 according to the third embodiment has been described above, but in the present embodiment,
It is possible to remotely specify a reproduction condition from the user computer 4 via the browser 441 and generate a reproduced image. In addition, the reproduced image of the subject indicated by the object color component data can be viewed early in the user computer 4 or the printer 2 different from the digital camera 1 from which the image of the subject is acquired.

<4. Modifications> Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications can be made.

In the above embodiment, the object color component data 63 and the illumination component data 64 are obtained using the first image obtained by using the flash and the second image obtained without using the flash in the digital camera 1. However, other methods may be used as a method for obtaining the object color component data 63 and the illumination component data 64 from the image data. For example, the digital camera 1 may be provided with a multi-band sensor for receiving illumination light, and the object color component data 63 may be obtained after the spectral distribution of the illumination light is acquired as the illumination component data 64.

Further, the image data may be acquired in an environment in which the spectral distribution of the illumination light is known, and the object color component data 63 and the illumination component data 64 may be obtained. For example, since the scanner device does not enter external illumination light during scanning, the spectral distribution of illumination light during scanning is known. Therefore, the object color component data 63 can be easily obtained by using the known spectral distribution as the illumination component data 64. Therefore, as the image input device for obtaining the object color component data 63, a scanner device, a color copying machine, an MFP device (multi-function peripheral), or the like can be applied.
It can be applied to any of the above-described embodiments.

On the other hand, in the above embodiment, the printer 2 is used as the image output device, but an output means for outputting a reproduced image generated by a general computer, a color copying machine, an MFP device or the like so that it can be viewed. Any device can be applied as long as it has For example, in the first embodiment, the reproduced image generated by the digital camera 1 is transmitted to the printer 2 and printed out, but it is transmitted to a general computer and displayed and output on a display. May be. Similarly, in the second embodiment,
The printer 2 receives the object color component data 63, generates a reproduced image and prints it out, but a general computer receives the object color component data 63, generates a reproduced image, and outputs it to the display. You may do it. Even in this case, the reproduced image of the subject represented by the object color component data 63 can be browsed at a place different from the place where the image of the subject is acquired.

Further, in the above-described embodiment, after the reproduced image is generated, the operator is allowed to confirm whether or not the reproduced image is intended, but until the confirmation step, the pixel is set to a predetermined size. It is also possible to generate and use a reproduced image of thumbnail images decimated by a ratio, and after confirming that the reproduced image matches the intention, generate a reproduced image in which pixels are not decimated. According to this, it becomes possible to confirm the reproduced image at an early stage.

Further, in the above-mentioned embodiment, the description is made assuming that the selection of the printer 2 as the transmission destination is accepted and the data is transmitted to the selected printer 2. However, the data may be transmitted to the predetermined printer 2. It may be.
With this arrangement, after the object color component data is obtained by the digital camera 1, the reproduced image can be immediately printed out by the printer 2.

Further, in the above embodiment, the converted image data obtained by performing the color conversion based on the color adaptation on the combined image data obtained by combining the object color component data 63 and the illumination component data 64 is used as the reproduced image. Alternatively, combined image data that is not subjected to color conversion based on color adaptation may be used as the reproduced image.

In the above embodiment, the description has been made assuming that the operator specifies all of the illumination component data 64, the chromatic adaptation formula, and the adaptation coefficient as the reproduction condition, but at least one is specified by the operator. It should be like this. For example, only the illumination component data 64 is designated with the chromatic adaptation formula as a predetermined formula and the adaptation coefficient as a predetermined value. The illumination component data 64 may be set to a predetermined light source and the adaptation coefficient may be set to a predetermined value to specify only the chromatic adaptation formula.

Further, in the above-described embodiment, various functions are realized by the CPU performing calculations according to programs, but all or part of the calculation processing may be realized by a dedicated electric circuit. Good. In particular, a high-speed operation can be realized by constructing a place where a repeated operation is performed with a logic circuit.

The specific embodiments described above include inventions having the following configurations.

(1) A data communication device capable of communicating via a network, wherein image acquisition means for acquiring image data of a subject, and the effect of the illumination environment on the subject are removed from the acquired image data. Data communication comprising object color component data generation means for obtaining object color component data corresponding to image data, and transmission means for transmitting the object color component data to an external device connected to the network. apparatus.

(2) A method of reproducing an object, which corresponds to an image acquisition step of acquiring image data of the object, and image data obtained by removing the influence of the illumination environment on the object from the acquired image data. A method for reproducing an object, comprising: an object color component data generating step of obtaining object color component data; and a transmitting step of transmitting the object color component data to an external device connected to a network.

(3) A program, which is executed by a computer,
An image acquisition step of acquiring image data of the subject; an object color component data generation step of obtaining object color component data corresponding to image data obtained by removing the influence of the illumination environment on the object from the acquired image data; And a transmitting step of transmitting the object color component data to an external device connected to a network.

According to the above configurations (1) to (3),
Since the object color component data corresponding to the image data from which the influence of the illumination environment on the subject is removed can be transmitted to the external device connected to the network, the reproduced image can be generated in the external device. At the same time, the reproduced image of the subject can be viewed early in a place different from the place where the image of the subject was acquired by displaying or printing on the external device.

[0196]

As described above, according to the first, seventh and ninth aspects of the present invention, the reproduction of the object indicated by the object color component data corresponding to the image data in which the influence of the illumination environment on the object is removed. Since an image can be generated and sent to an external device, it is possible to quickly view a reproduced image of the subject at a place different from the place where the image of the subject was acquired by displaying or printing on the external device. You can

According to the second, eighth and tenth aspects of the present invention, the object color component data corresponding to the image data obtained by removing the influence of the illumination environment on the subject acquired at another location is received, Since the reproduced image of the subject represented by the object color component data is generated, the reproduced image of the subject can be viewed early in a place different from the place where the image of the subject was acquired.

According to the third aspect of the present invention, the reproduced image of the subject can be easily viewed by printing the reproduced image of the subject.

Further, according to the invention of claim 4, the reproduced image of the object indicated by the received object color component data can be browsed in another place at an early stage.

Further, according to the inventions of claims 5 and 6,
Since the reproduction condition for generating the reproduced image can be designated, a desired reproduced image can be generated.

[Brief description of drawings]

FIG. 1 is a schematic diagram of an image reproduction system to which a data communication device according to the present invention is applied.

FIG. 2 is a perspective view showing the entire digital camera.

FIG. 3 is a rear view of the digital camera.

FIG. 4 is a block diagram showing a configuration of a digital camera.

FIG. 5 is a perspective view showing the entire printer.

FIG. 6 is a block diagram showing a configuration of a printer.

FIG. 7 is a block diagram showing functions of the image reproduction system according to the first embodiment.

FIG. 8 is a diagram showing a flow of operations of the image reproduction system according to the first embodiment.

FIG. 9 is a diagram showing a flow of operations at the time of shooting by a digital camera.

FIG. 10 is a diagram showing a data structure of a file including object color component data.

FIG. 11 is a diagram showing a flow of processing for generating a reproduced image.

FIG. 12 is a diagram illustrating a screen when selecting illumination component data.

FIG. 13 is a diagram showing an example of a screen when selecting a color adaptation formula.

FIG. 14 is a diagram exemplifying a screen when selecting an adaptation coefficient.

FIG. 15 is a diagram exemplifying a screen when selecting a destination printer.

FIG. 16 is a block diagram showing functions of the image reproduction system according to the second embodiment.

FIG. 17 is a diagram showing a flow of operations of the image reproduction system of the second embodiment.

FIG. 18 is a schematic diagram of an image reproduction system according to a third embodiment.

FIG. 19 is a block diagram showing configurations of an image server and a user computer.

FIG. 20 is a block diagram showing functions of the image reproduction system according to the third embodiment.

FIG. 21 is a diagram showing a flow of operations of the image reproduction system according to the third embodiment.

[Explanation of symbols]

1 digital camera 2 printer 3 image server 4 User computer 5 network 10 Image reproduction system 63 Object color component data 141 component data generation unit 143, 243, 345 Reproduction condition acceptance section 144, 244, 342 reproduction image generation unit

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) // H04N 101: 00 H04N 1/40 DF term (reference) 5B050 BA11 CA05 CA07 DA04 EA09 FA03 FA05 5C065 AA03 AA04 BB02 BB03 CC02 CC03 CC08 CC09 DD01 GG30 GG32 5C066 AA01 CA08 EA15 EA17 EB01 GA02 GA03 HA02 KM01 5C077 MM03 MP08 PP32 PP36 PQ12 PQ22 TT09 5C079 HA02 HB01 HB05 HB08 LA02 LA23 MA01 MA11

Claims (10)

[Claims] 1. A data communication device capable of communicating via a network, comprising: an image acquisition unit for acquiring image data of a subject; and an image obtained by removing the influence of a lighting environment on the subject from the acquired image data. Object color component data generating means for obtaining the object color component data corresponding to the data, reproduction image generating means for generating a reproduction image for reproducing the subject indicated by the object color component data, and the generated reproduction image for the network. And a transmitting means for transmitting to an external device coupled to the data communication device. 2. A data communication device capable of communicating via a network, wherein object color component data corresponding to image data from which an influence of an illumination environment on a subject is removed from an external device coupled to the network. Receiving means for receiving, reproduction image generating means for generating a reproduction image for reproducing a subject represented by the object color component data, and output means for outputting the generated reproduction image so that the reproduction image can be viewed. Data communication device. 3. The data communication device according to claim 2, wherein the output unit includes a printing unit that prints the generated reproduction image. 4. The data communication device according to claim 2, further comprising: a transmitting unit that transmits the generated reproduced image to another external device coupled to the network. . 5. The data communication device according to claim 1, further comprising: a reception unit that receives designation of a reproduction condition for generating the reproduction image, the reproduction image generation unit A data communication device, wherein the reproduced image is generated based on a reproduction condition. 6. The data communication device according to claim 5, wherein the reproduction condition is illumination component data indicating an influence of an illumination environment on an image, a chromatic adaptation formula used for color conversion based on chromatic adaptation, and the color. A data communication device comprising at least one of an adaptation coefficient for adjusting a degree of influence of illumination indicated by the illumination component data in color conversion based on adaptation. 7. A method of reproducing an object, which comprises an image acquisition step of acquiring image data of the object, and image data obtained by removing the influence of the illumination environment on the object from the acquired image data. An object color component data generation step of obtaining object color component data, a reproduction image generation step of generating a reproduction image that reproduces a subject indicated by the object color component data, and an external device that connects the generated reproduction image to a network. And a transmitting step of transmitting to the subject. 8. A method for reproducing a subject, the method comprising: receiving from an external device connected to a network, object color component data corresponding to image data from which the influence of the illumination environment on the subject has been removed, A subject reproduction method comprising: a reproduction image generating step of generating a reproduction image that reproduces a subject indicated by the object color component data; and an output step of outputting the generated reproduction image so that the reproduction image can be browsed. 9. A program, which is executed by a computer, wherein the computer executes an image acquisition step of acquiring image data of an object, and an influence of an illumination environment on the object from the acquired image data. An object color component data generation step of obtaining object color component data corresponding to the data of the removed image; a reproduction image generation step of generating a reproduction image that reproduces the subject indicated by the object color component data; and the generated reproduction image And a transmission step of transmitting the data to an external device coupled to the network. 10. A program for executing the program by a computer, wherein an object color component corresponding to image data obtained by removing an influence of an illumination environment on a subject from an external device connected to the network by the computer. Performing a reception step of receiving data, a reproduction image generation step of generating a reproduction image that reproduces a subject indicated by the object color component data, and an output step of outputting the generated reproduction image so that the reproduction image can be viewed. A program characterized by.