JP2003143538A - Device, method and system for processing image, imaging device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processor for performing the same image processing on a plurality of images having high relevancy. SOLUTION: This image processor for performing image processing of images is provided with a receiving part for receiving a plurality of images, a relevancy determining part for determining the relevance among the plurality of images, and an image processing part for performing image processing of the plurality of images on the basis of the relevancy determined by the relevancy determining part.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing device, an image processing method, a program, and an image processing system. In particular, the present invention relates to an image processing apparatus that performs the same image processing on a plurality of highly related images.

[0002]

2. Description of the Related Art Conventional image processing apparatuses such as printers perform image processing such as density correction processing, color balance correction processing and edge enhancement processing on an image for which a print request has been received. When a print request for a plurality of images is received, processing parameters used for image processing are determined for each of the plurality of images, and image processing is performed for each of the plurality of images using the determined processing parameters. ing.

[0003]

However, even when a moving picture is taken by a digital camera and a plurality of images constituting the moving picture are printed, a conventional image processing apparatus such as a printer does not operate on each of the plurality of images. Image processing is performed on each of the plurality of images using the processing parameters determined for. Therefore, even when a highly saturated subject passes through the image during shooting, or when the position of the cloud in the image changes every moment, the image processing device
Even though the main subject of multiple images is the same, color balance correction processing and density correction processing are performed using different processing parameters for each image, and the color balance and density of the main subject are different for each image. The problem arises that

Therefore, the present invention is directed to an image processing apparatus, an image processing method, a program, which can solve the above problems.
And an image processing system. This object is achieved by a combination of features described in independent claims of the invention. The dependent claims define further advantageous specific examples of the present invention.

[0005]

That is, according to a first aspect of the present invention, there is provided an image processing apparatus for performing image processing on an image, comprising: a receiving unit for receiving the plurality of images; A relevance determination unit that determines relevance and an image processing unit that performs image processing on a plurality of images based on the relevance determined by the relevance determination unit. The image processing unit may further include a degree-of-association calculating unit that calculates the degree of association, which is a value indicating the degree of association, and may perform the same image processing on a plurality of images when the degree of association is larger than a predetermined value.

The receiving unit receives the image classification information designated by the user in association with the image, and the relevance determining unit determines
The relevance of a plurality of images may be determined based on the image classification information. The receiving unit may receive time information, which is information indicating the time at which the image was captured, in association with the image, and the relevance determining unit may determine the relevance of the plurality of images based on the time information. . The receiving unit receives the image capturing condition information indicating the image capturing condition, which is a condition when the image was captured, in association with the image, and the relevance determining unit determines the relevance of the plurality of images based on the image capturing condition information. You may judge.

The receiving unit includes, as the imaging condition information, brightness information indicating the brightness of the subject, strobe information indicating whether or not the strobe was fired at the time of imaging, subject distance information indicating the subject distance, and focal length information indicating the focal length. At least one of
You may receive one.

An image analysis unit for analyzing the data distribution of the images may be further provided, and the relevance judgment unit may judge the relevance of the plurality of images based on the data distribution of the images. The relevance determination unit may determine the relevance of the plurality of images based on the chromaticity distribution of the images. The relevance determination unit may determine the relevance of the plurality of images based on the brightness distribution of the images. The relevance determination unit may determine the relevance of the plurality of images based on the spatial frequency of the subject in the images.

The image processing unit may further include a printing unit that prints the image subjected to the image processing.

According to a second aspect of the present invention, there is provided an image processing method for performing image processing on an image, comprising the step of receiving a plurality of images and the relevance judgment for judging the relevance of the plurality of images. And an image processing step of performing image processing on a plurality of images based on the relevance determined in the relevance determination step.

The receiving step includes a step of receiving a first image of the plurality of images and a step of receiving a second image of the plurality of images, and the image processing step is performed on the first image. , The step of performing predetermined image processing, the step of determining the relevance includes the step of determining the relevance between the first image and the second image, and the image processing unit determines the relevance determined in the relevance determination step. When is greater than a predetermined value, the method may further include performing predetermined image processing on the second image.

According to a third aspect of the present invention, there is provided a program for an image processing apparatus for performing image processing on an image, the receiving module causing the image processing apparatus to receive the plurality of images, and the program for receiving the plurality of images. A relevance determination module that determines relevance and an image processing module that performs image processing on a plurality of images based on the relevance determined by the relevance determination unit are provided.

According to the fourth aspect of the present invention, there is provided an image pickup apparatus for photographing an object, an image pickup section for obtaining an image of the object, an instruction receiving section for receiving an instruction for classifying the image,
A classification determination unit that determines the image classification information of the image based on the instruction, and a storage unit that stores the image classification information in association with the image.

According to a fifth aspect of the present invention, there is provided a program for an image pickup device for picking up an image of a subject,
An image pickup module that acquires an image of a subject, an instruction reception module that receives an instruction to classify an image, a classification determination module that determines image classification information of an image based on the instruction, and an image classification information that is associated with the image And a storage module for storing.

According to a sixth aspect of the present invention, there is provided an image processing system comprising an image pickup device for picking up an image of a subject and an image processing device for performing image processing on the image, wherein the image pickup device picks up an image of the subject. An image capturing unit to be acquired, an instruction receiving unit that receives an instruction to classify images, a classification determination unit that determines image classification information of images based on the instructions, and a storage unit that stores image classification information in association with images. And an image output device that outputs the image classification information associated with each of the plurality of images and the plurality of images in association with each other, and the image processing device includes an image associated with each of the plurality of images. Classification information, a receiving unit that receives a plurality of images in association with each other, based on the image classification information associated with each of the plurality of images, a relevance determination unit that determines the relevance of the plurality of images, The relevance judge Based on the cross-sectional and relevance, and an image processing unit for performing image processing for a plurality of images.

The above summary of the invention does not enumerate all the necessary features of the present invention, and a sub-combination of these feature groups can also be the invention.

[0017]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the claimed invention, and the features described in the embodiments Not all combinations are essential to the solution of the invention.

FIG. 1 shows an example of an image processing system according to an embodiment of the present invention. The image processing system includes a digital camera 10, a printer 12, and a personal computer 14. Digital camera 10, printer 1
2 and the personal computer 14 send and receive data to and from each other via a data transmission path. The data transmission path is, for example, a wired interface such as IEEE 1394 or USB, or a wireless interface such as IrDA, Bluetooth or wireless LAN. The data transmission path may be a network network using a plurality of wired interfaces and wireless interfaces, such as the Internet network.
Further, a recording medium such as a removable medium may be used to transfer data between the digital camera 10, the printer 12, and the personal computer 14.

The digital camera 10 picks up an image of a subject and sends the picked-up image data to the printer 12 or the personal computer 14. Further, the digital camera 10 attaches image pickup condition information, which is information indicating a condition when an image of a subject is picked up, to the image data, and the printer 1
2 or to the personal computer 14. The printer 12 or the personal computer 14 performs predetermined image processing on the received image data and outputs it. That is, the printer 12 prints and outputs the image data, and the personal computer 14 outputs the image data to the monitor. Further, the personal computer 14 transmits the setting information to the digital camera 10 or the printer 12 and changes the setting information of the digital camera 10 or the printer 12.

The digital camera 10 is an example of an image pickup device and / or an image processing device, and the printer 12 and the personal computer 14 are examples of an image processing device. Further, the imaging device may be a digital still camera that captures a still image or a digital video camera that captures a moving image. Further, the image processing apparatus may be a laboratory printing apparatus that automatically adjusts the image quality of an image captured by a digital camera and prints the image. Further, the image processing apparatus of the present invention may include a display device such as a CRT, a liquid crystal display, a plasma display, various kinds of electronic paper, an organic EL display, etc., and may perform image processing of an image output by the display device.

FIG. 2 shows an example of the functional configuration of the digital camera 10 according to this embodiment. The digital camera 10
An image capturing unit 20 that captures an image of a subject, a display unit 100 that displays the captured image, a storage unit 120 that stores image data indicating the captured image, and an instruction to accept an instruction to classify the captured image. A reception unit 150, a classification determination unit 160 that determines the image classification information of the image, and an output unit 170 that outputs the image data to an external device.

The instruction receiving unit 150 receives an instruction to classify images based on a user operation. The user may instruct, for example, the image classification information of the image to be captured before the image capturing. Further, at the time of shooting a moving image, the user may instruct the image classification information of the image being shot during the shooting of the moving image.
Specifically, the user may instruct to change the image classification information when changing the main subject while shooting a moving image. Further, the display unit 210 may display the image stored in the storage unit 120, and the user may confirm the image displayed on the display unit 120 and instruct the image classification information of the image.

The classification determining unit 160 determines image classification information, which is information for classifying images, for each image based on the instruction received by the instruction receiving unit 150. Then, the classification determination unit 160 stores the determined image classification information in the storage unit 120 in association with the image.

The image pickup condition detecting section 180 detects the luminance of the imaged subject, whether or not the strobe is fired at the time of image pickup, the distance from the digital camera 10 to the subject at the time of image pickup, the focal length at the time of image pickup, and the like. Then, the image pickup condition information indicating the detected image pickup condition is stored in the storage unit 120 in association with the image.

The storage unit 120 stores the image classification information determined by the classification determination unit 160 and the image capturing condition information indicating the image capturing condition detected by the image capturing condition detecting unit 180 in association with the image data. The output unit 170 associates the image data with
The imaging condition information and the image classification information are output to an external device such as the memory card or the printer 12.

FIG. 3 shows an example of the format of the data output by the output section 170. The data output by the output unit 170 includes imaging condition information 200, image classification information 210, supplementary information 220, and image data 230.

The image pickup condition information 200 includes luminance information indicating the luminance of the imaged subject, strobe information indicating whether or not the strobe is fired at the time of image pickup, and the digital camera 10 at the time of image pickup.
Object distance information indicating the distance from the subject to the object, focal length information indicating the focal length at the time of image capturing, and the like.

The supplementary information 230 includes maker information of the digital camera 10, model information, time information indicating the time when the image was taken, position information indicating the position where the image was taken, and the like. The image data 240 is data indicating an image, and is, for example, JPEG format data.

FIG. 4 shows an example of the functional configuration of the printer 12 according to this embodiment. The printer 12 has a receiving unit 30.
0, an image processing unit 310, a relevance determination unit 320, a relevance calculation unit 330, an image analysis unit 340, and a printing unit 350. The image processing unit 310 includes a density processing unit 312, an edge enhancement processing unit 314, and a color balance correction processing unit 31.
Have six.

The receiving section 300 receives the image data representing the image and the image classification information designated by the user in association with each other. Further, the receiving unit 300 further receives the imaging condition information and the additional information in association with the image data.
Specifically, the receiving unit 300 receives the brightness information, the flash information, the subject distance information, the focal length information, etc. as the imaging condition information, and the additional information as the maker information, the model information,
Receives time information, position information, etc.

The image processing section 310 performs a plurality of types of image processing on the image showing the image data received by the receiving section 300. Specifically, the density processing unit 312 performs image density processing. The edge enhancement processing unit 314 performs edge enhancement of the image. The color balance correction processing unit 316 performs correction processing of image color balance.

When the receiving unit 300 receives a plurality of images, the relevance determining unit 320 determines a plurality of images based on the image classification information, the image pickup condition information, the additional information, etc. attached to each of the plurality of images. Determine relevance. Specifically, the relevance determining unit 320 is based on at least one of the brightness information, the flash information, the subject distance information, the focal length information, the maker information, the model information, the time information, and the position information received by the receiving unit 300. And determine the relevance of a plurality of images.

Further, the image analysis section 340 includes a receiving section 300.
Analyze the data distribution of the image received by. Then, the relevance determination unit 320 determines the relevance of the plurality of images based on the data distribution of the images analyzed by the image analysis unit 340. Specifically, the image analysis unit 340 analyzes the chromaticity distribution, the lightness distribution, the spatial frequency, and the like of the image received by the reception unit 300. Then, the relevance determination unit 320 determines the relevance of the plurality of images based on at least one of the chromaticity distribution, the lightness distribution, and the spatial frequency of the images analyzed by the image analysis unit 340.

The information used by the relevance determining section 320 to determine the relevance of images may have a weight set in advance. For example, when the weight of the image classification information is set to be heavier than the imaging condition information or the analysis result of the image analysis unit 340 in order to respect the intention of the user who has added the image classification information, the relevance determination unit 320 determines As long as the image classification information is the same, it may be determined that the relationship is high even if the imaging condition information and the analysis result of the image analysis unit 340 are different.
When the weight of the analysis result of the image analysis unit 340 is set to be heavier than the imaging condition information and the image classification information,
If the chromaticity distribution and the lightness distribution are similar in the analysis result of the image analysis unit 340, the relevance determination unit 320 determines that the relevance is high even if the imaging condition information and the image classification information are different. Good.

The degree-of-association calculation unit 330 is connected to the relevance judgment unit 32.
The degree of association, which is a value indicating the association between two images, is calculated based on the association determined to be 0. Then, the image processing unit 3
Reference numeral 10 determines a processing parameter of image processing based on the degree of association, and performs image processing using the processing parameter. For example, the image processing unit 310 performs image processing on two images with the same processing parameter when the degree of association is larger than a predetermined value. That is, the image processing unit 310 performs the image processing of the first image, and then performs the image processing of the second image without resetting the processing parameters of the image processing. In addition, the image processing unit 310 performs the image processing on the two images with the same different processing parameter when the degree of association is not larger than the predetermined value. That is, the image processing unit 31
0 performs the image processing of the first image, then re-sets up the processing parameters of the image processing, and performs the image processing of the second image.

The printing unit 350 prints the image subjected to the image processing by the image processing unit 310.

FIG. 5 is a flow chart showing an example of the operation of the printer 12 according to this embodiment. First, the receiving unit 300 includes the first image, the imaging condition information of the first image, the image classification information of the first image, the additional information of the first image, the imaging condition information of the second image and the second image, and the second image. The image classification information of the image and the additional information of the second image are received (S10).
0). Then, the image analysis unit 340 analyzes the data distribution of the first image (S102). Then, the image processing unit 31
0 determines the processing parameter used for image processing based on the imaging condition information and the analysis result of the image analysis unit 340 (S104). Then, the image processing unit 310 uses S10.
Image processing is performed on the first image using the processing parameters determined in step 4 (S106). Then, the printing unit 350 converts the first image subjected to the image processing by the image processing unit 310 into a data format for printing and prints it (S108).

Next, the image analysis section 340 analyzes the data distribution of the second image (S110). Then, the relevance determination unit 320 determines the imaging condition information of the first image, the image classification information of the first image, the additional information of the first image, the analysis result of the image analysis unit 340 in S102, and the imaging condition of the second image. The information, the image classification information of the second image, the additional information of the second image, and the analysis result of the image analysis unit 340 in S110 are compared to determine the relevance between the first image and the second image (S1).
12). Then, the degree-of-association calculating unit 330 calculates the degree of association, which is a value indicating the degree of association determined by the degree-of-association determining unit 320 (S114). Then, the image processing unit 310 determines whether the degree of association calculated by the degree-of-association calculating unit 330 is larger than a predetermined value (S116).

When it is determined in S116 that the degree of association is not greater than the predetermined value, the image processing unit 310 determines the processing parameters used for image processing based on the imaging condition information and the analysis result of the image analysis unit 340 ( S11
8). Then, the image processing unit 310 performs image processing on the second image using the processing parameter determined in S118 (S120). If it is determined in S116 that the degree of association is larger than the predetermined value, the image processing unit 3
In step 10, the image processing is performed on the second image using the processing parameter determined in step S104 (step S120).
Then, the printing unit 350 converts the second image subjected to the image processing by the image processing unit 310 into a data format for printing and prints it (S122). Thus, the printer 1 of this example
The flowchart of the operation of 2 ends.

According to the printer 12 of this embodiment,
Since it is possible to perform image processing on the related images using the same processing parameters, it is possible to perform the following image processing on the related images and print. In addition, when receiving a request to print images with high relevance in succession, it is possible to print by continuously performing image processing without resetting the processing parameters of the image processing. The time can be reduced.

FIG. 6 shows an example of the hardware configuration of the personal computer 14 according to this embodiment. The personal computer 14 includes a CPU 700 and a ROM 70.
2, a RAM 704, a communication interface 706,
A hard disk drive 708, a database interface 710, a floppy (registered trademark) disk drive 712, and a CD-ROM drive 714 are provided. The CPU 700 operates based on programs stored in the ROM 702 and the RAM 704, and controls each unit. The communication interface 706 is the digital camera 1.
0 and the printer 12. The database interface 710 writes data to the database and updates the contents of the database.

Floppy disk drive 712 reads data or programs from floppy disk 720 and provides them to communication interface 706. CD-R
The OM drive 714 reads data or programs from the CD-ROM 722 and provides them to the communication interface 706. The communication interface 706 is a floppy disk drive 712 or a CD-ROM drive 714.
The data or program provided by the computer is transmitted to the digital camera 10 or the printer 12. The database interface 710 connects to various databases 724 to send and receive data.

The program provided to the printer 12 is
It is stored in a recording medium such as a floppy disk 720 or a CD-ROM 722 and provided by the user. The program stored in the recording medium may be compressed or uncompressed. The program is read from the recording medium, installed in the digital camera 10 or the printer 12 via the communication interface 706, and executed in the digital camera 10 or the printer 12.

The program stored in the recording medium and provided and installed in the digital camera 10 has, as functional configurations, an image pickup module, an image pickup condition detection module, a storage module, an instruction reception module, a classification determination module, It has a display module and an output module. The operation that each module works on the digital camera 10 to perform is the same as the operation of the corresponding member in the digital camera 10 described in FIGS. 1 to 5, and thus the description thereof is omitted.

Further, the program stored in the recording medium and provided and installed in the printer 12 has a receiving module, an image processing module, and a functional module.
It has a relevance determination module, a relevance calculation module, an image analysis module, and a printing module. The operations that each module causes the printer 12 to perform are as follows.
In the printer 12 described in FIGS. 1 to 5,
Since the operation is the same as that of the corresponding member, description thereof will be omitted.

A floppy disk 720 or a CD-ROM 722 as an example of the recording medium shown in FIG. 6 stores a part or all of the functions of the operation of the digital camera 10 or the printer 12 in the embodiment described in the present application. be able to.

Even if these programs are read from the recording medium directly by the digital camera 10 or printer 12 and executed, the programs are executed by the digital camera 10 or printer 12.
It may be executed in the digital camera 10 or the printer 12 after being installed in. Furthermore, the program may be stored in a single recording medium or a plurality of recording media. Further, it may be stored in an encoded form.

As the recording medium, a floppy disk,
In addition to the CD-ROM, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a magnetic recording medium, or a semiconductor memory such as an IC card or a miniature card can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium to provide the program to the digital camera 10 or the printer 12 via the communication network. Such a recording medium is used only for manufacturing the digital camera 10 or the printer 12, and the manufacture and sale of such recording medium as a business constitutes infringement of the patent right based on the present application. It is clear to do.

FIG. 7 shows an example of a detailed configuration of the digital camera 10 according to this embodiment. Digital camera 10
Is an imaging unit 20, an imaging control unit 40, a system control unit 6
0, display unit 100, operation unit 110, storage unit 120, external connection unit 130, and image processing unit 140.

The image pickup section 20 includes a photographing lens section 22 and a diaphragm 2.
4, a shutter 26, an optical LPF 28, a CCD 30, an image pickup signal processing unit 32, a finder 34, and a strobe 36.

The taking lens unit 22 takes in a subject image and processes it. The taking lens unit 22 includes a focus lens, a zoom lens, and the like, and forms a subject image on the light receiving surface of the CCD 30. The diaphragm 24 narrows the light that has passed through the taking lens unit 22, and the optical LPF 28 previously reduces spatial frequency components having a limit resolution or higher that depends on the pixel pitch of the CCD 30 and the like, and false signals such as aliasing that occur during image reproduction. To prevent the occurrence of. Each sensor element of the CCD 30 is
Electric charges are accumulated according to the amount of light of the formed subject image (hereinafter, the electric charges are referred to as “accumulated charges”).

The shutter 26 is a mechanical shutter,
It controls whether or not the light passing through the photographing lens unit 22 is imaged on the CCD 30. Further, the digital camera 10 may have an electronic shutter function instead of the shutter 26. In order to realize the electronic shutter function, the sensor element of the CCD 30 has a shutter gate and a shutter drain. By driving the shutter gate, the accumulated charge is swept out to the shutter drain. By controlling the shutter gate, the time for accumulating charges in each sensor element, that is, the shutter speed can be controlled. In the CCD 30, the accumulated charges are read out to the shift register by the read gate pulse and sequentially read out as a voltage signal by the register transfer pulse.

The image pickup signal processing section 32 color-separates a voltage signal indicating an object image output from the CCD 30, that is, an analog signal, into R, G and B components. Then, the imaging signal processing unit 32 adjusts the white balance of the subject image by adjusting the R, G, and B components. Imaging signal processing unit 32
Performs gamma correction on the subject image. Then, the imaging signal processing unit 32 A / D-converts the analog signal decomposed into R, G, and B components, and obtains the resulting digital image data of the subject image (hereinafter referred to as “digital image data”). Output to the system control unit 60.

The finder 34 may have a display means and may display various information from the main CPU 62 or the like which will be described later in the finder 34. The strobe 36 has a discharge tube 37 that discharges the energy stored in the capacitor, and the discharge tube 37 is supplied when the energy is supplied to the discharge tube 37.
Works by emitting light.

The image pickup control section 40 has a lens drive section 42, a focus drive section 44, an aperture drive section 46, a shutter drive section 48, an image pickup system CPU 50 for controlling them, a distance measuring sensor 52, and a photometric sensor 54. Imaging system CPU50
Is an example of the imaging condition detection unit 180.

Lens drive section 42, focus drive section 4
4, the diaphragm drive unit 46, and the shutter drive unit 48 each have drive means such as a stepping motor, and the image pickup unit 2
The mechanical members included in 0 are driven. When the release switch 114, which will be described later, is pressed, the distance measuring sensor 52 measures the distance to the subject and the photometric sensor 54 measures the subject brightness. Then, the distance measuring sensor 52 and the photometric sensor 54 respectively collect data of the measured distance to the subject (hereinafter simply referred to as “distance measuring data”) and subject brightness data (hereinafter simply referred to as “photometric data”). It is supplied to the CPU 50.

The image pickup system CPU 50 uses the lens driving section 42 based on the photographing information such as the zoom magnification designated by the user.
Also, the focus drive unit 44 is controlled to adjust the zoom magnification and focus of the taking lens 22. In addition, the imaging system CPU
Reference numeral 50 controls the lens drive unit 42 and the focus drive unit 44 to adjust the zoom magnification and focus based on the distance measurement data received from the distance measurement sensor 52 and / or the light measurement data received from the light measurement sensor 54. Good.

The image pickup system CPU 50 uses one image frame R
The aperture value and the shutter speed are determined based on the GB digital signal integrated value, that is, the automatic exposure information. According to the determined value, the diaphragm drive unit 46 and the shutter drive unit 48
The aperture amount of the aperture 24 and the opening / closing of the shutter 26 are controlled respectively.

Further, the image pickup system CPU 50 controls the light emission of the strobe 36 based on the photometric data, and at the same time, the aperture 24
Adjust the aperture of. When the user gives an instruction to capture an image, the CCD 30 starts charge storage, and outputs the stored charge to the imaging signal processing unit 32 after the shutter time calculated from the photometric data has elapsed.

The system control unit 60 includes the main CPU 6
2, a character generator 84, a timer 86, and a clock generator 88. The main CPU 62 controls the entire digital camera 10, particularly the system control unit 60. The main CPU 62 uses an image pickup system CP by serial communication or the like.
Transfer necessary information to and from U50.

The clock generator 88 is used by the main CPU 62.
The operation clock of is generated and supplied to the main CPU 62. The clock generation unit 88 also generates an operation clock for the image pickup system CPU 50 and the display unit 100. The clock generation unit 88 may supply operation clocks of different frequencies to the main CPU 62, the imaging system CPU 50, and the display unit 100.

The character generation unit 84 generates character information and graphic information to be combined with a photographed image such as photographing date and time and title. The timer 86 is backed up by, for example, a battery, always counts time, and supplies the main CPU 62 with time information such as information regarding the shooting date and time of the shot image based on the count value. It is desirable that the timer 86 count the time by the power supplied from the storage battery even when the power source of the digital camera body is off. Also,
The character generation unit 84 and the timer 86 are the main CPU
It is preferable to be installed at 62.

The storage section 120 has a memory control section 64, a non-volatile memory 66, and a main memory 68. The memory control unit 64 includes a nonvolatile memory 66 and a main memory 6
8 and control. The non-volatile memory 66 is an EEPROM
(Electrically erasable and programmable ROM) and FLAS
The H memory or the like stores data that should be held even while the power of the digital camera 10 is off, such as user setting information and factory adjustment values. The non-volatile memory 66 may store a boot program for the main CPU 62, a system program, and the like.

The main memory 68 is preferably composed of a relatively inexpensive memory having a large capacity such as a DRAM. The main memory 68 has a function as a frame memory for storing the data output from the imaging unit 20, a function as a system memory for loading various programs, and a function as a work area. The nonvolatile memory 66 and the main memory 68 exchange data with each unit inside and outside the system control unit 60 via the bus 82.
The non-volatile memory 66 may further store digital image data.

The image processing section 140 has a YC processing section 70, an encoder 72, and a compression / expansion processing section 78. Further, the external connection unit 130 includes an optional device control unit 74,
And a communication I / F unit 80. The encoder 72, the option device controller 74, and the communication I / F unit 80 are an example of the output unit 170.

The YC processing section 70 performs YC conversion on the digital image data to generate a luminance signal Y and color difference (chroma) signals BY and RY. The main memory 68 is
The luminance signal and the color difference signal are stored under the control of the memory control unit 64.

The compression / expansion processing section 78 has a main memory 68.
The luminance signal and the color difference signal are sequentially read from and compressed. Then, the option device controller 74 writes the compressed digital image data (hereinafter simply referred to as “compressed data”) to a memory card, which is an example of the option device 76.

The encoder 72 converts the luminance signal and the color difference signal into a video signal (NTSC or PAL signal) and outputs it from the terminal 90. When a video signal is generated from the compressed data recorded in the option device 76, the compressed data is first given to the compression / expansion processor 78 via the option device controller 74. Subsequently, the data subjected to the necessary expansion processing by the compression / expansion processing unit 78 is converted into a video signal by the encoder 72.

The optional device controller 74 generates necessary signals between the bus 82 and the optional device 76, performs logical conversion, and / or voltage conversion according to the signal specifications permitted by the optional device 76 and the bus specifications of the bus 82. And so on. The digital camera 10 may support, for example, a standard PCMCIA-compliant standard I / O card as the optional device 76, in addition to the memory card described above. In that case, the optional device control unit 74 determines the PCMCIA bus control LS.
You may comprise by I etc.

The communication I / F unit 80 is used for the digital camera 10
Supported communication specifications, such as USB, RS-23
Controls such as protocol conversion according to specifications of 2C, Ethernet (registered trademark), and the like. The communication I / F unit 80 may output the compressed data or the digital image data to an external device including a network via the terminal 92. Communication I / F
The unit 80 includes a driver IC as needed, and communicates with an external device via a terminal 92. The communication I / F unit 80 may be configured to exchange data with an external device such as a printer, a karaoke machine, a game machine, or the like through a unique interface.

The display unit 100 includes an LCD monitor 102, L
It has a CD panel 104, a monitor driver 106, and a panel driver 108. The monitor driver 106 is L
Control the CD monitor 102. Also, the panel driver 1
08 controls the LCD panel 104. The LCD monitor 102 is provided on the back surface of the camera, for example, with a size of about 2 inches, and has a screen for current shooting and playback modes, zoom magnification for shooting and playback, battery level, date and time, mode setting,
Display the subject image, etc. The LCD panel 104 is, for example, a small black-and-white LCD provided on the upper surface of the camera, and has an image quality (FI
NE / NORMAL / BASIC, etc.), strobe emission /
Displays information such as flash off, standard number of possible shots, number of pixels, battery capacity / remaining amount.

The operation unit 110 includes a power switch 112,
It has a release switch 114, a function setting unit 116, and a zoom switch 118. The power switch 112 is
The power of the digital camera 10 is turned on / off based on a user's instruction. The release switch 114 has a two-step pushing structure of half-push and full-push. As an example, when the release switch 114 is half pressed, the imaging control unit 40 performs automatic focus adjustment and automatic exposure adjustment, and when the release switch 114 is fully pressed, the imaging unit 20 captures a subject image.

The function setting section 116 is, for example, a rotary type mode dial, a cross key, or the like, and has "file format", "special effect", "print", "decide / save",
Settings such as "display switching" are accepted. Zoom switch 1
18 receives the setting of the zoom magnification of the subject image acquired by the imaging unit 20.

The main operation of the above configuration is as follows. First, the power switch 112 is pressed to supply power to each unit of the digital camera 10. Main CPU
Reference numeral 62 reads the state of the function setting section 116 to determine whether the digital camera 10 is in the shooting mode or the reproduction mode.

When the digital camera 10 is in the photographing mode,
The main CPU 62 monitors the half-pressed state of the release switch 114. When the half-pushed state of the release switch 114 is detected, the imaging system CPU 50 obtains photometric data and distance measurement data from the photometric sensor 54 and the distance measuring sensor 52, respectively. The imaging control unit 40 adjusts the focus, diaphragm, etc. of the imaging unit 20 based on the photometric data and the distance measurement data obtained by the imaging system CPU 50. When the adjustment is completed, the LCD monitor displays a character such as "standby" to inform the user.

Subsequently, the main CPU 62 monitors the fully pressed state of the release switch 114. When the fully pressed state of the release switch 114 is detected, the shutter 26 is closed after a predetermined shutter time, and the charge accumulated in the CCD 30 is swept out to the image pickup signal processing section 32. The digital image data generated as a result of the processing by the imaging signal processing unit 32 is output to the bus 82. The digital image data is once stored in the main memory 68, and thereafter the YC processing unit 7
0 is processed by the compression / expansion processing unit 78 and is recorded in the optional device 76 via the optional device control unit 74.
The captured image based on the recorded digital image data is displayed on the LCD monitor 102 for a while in a frozen state, and the user can confirm the captured image. This completes a series of shooting operations.

On the other hand, when the digital camera 10 is in the reproduction mode, the main CPU 62 reads out the taken image from the main memory 68, the non-volatile memory 66, and / or the option device 76, and the LCD of the display unit 100 reads it.
Display on the monitor 102.

In this state, when the user instructs "forward feed" and "reverse feed" in the function setting section 116, the main CPU 6
2 is a main memory 68, a non-volatile memory 66, and / or
Alternatively, another captured image stored in the option device 76 is read out and displayed on the LCD monitor 102 of the display unit 100.

Although the present invention has been described using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments. Various changes or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

[0080]

As is apparent from the above description, according to the present invention, it is possible to provide an image processing apparatus that performs the same image processing on a plurality of highly related images.

[Brief description of drawings]

FIG. 1 is a diagram showing an image processing system according to an embodiment of the present invention.

FIG. 2 is a diagram showing an example of a functional configuration of a digital camera 10 according to the present embodiment.

FIG. 3 is a diagram showing an example of a format of data output by an output unit 170.

FIG. 4 is a diagram showing an example of a functional configuration of the printer 12 according to the present embodiment.

FIG. 5 is a flowchart showing an example of the operation of the printer 12 according to this embodiment.

FIG. 6 is a personal computer 14 according to the present embodiment.
3 is a diagram showing an example of the hardware configuration of FIG.

FIG. 7 is a diagram showing an example of a detailed configuration of a digital camera 10 according to the present embodiment.

[Explanation of symbols]

10 digital camera 12 Printer 14 personal computer 20 Imaging unit 40 Imaging control unit 60 System control unit 100 display 110 Operation part 120 storage 130 External connection 140 Image processing unit 150 instruction reception section 160 Classification determination unit 170 Output section 180 Imaging condition detector 200 Imaging condition information 210 Image classification information 220 Additional information 230 image data 300 Receiver 310 Image processing unit 312 Concentration processing unit 314 Edge enhancement processing unit 316 Color balance correction processing unit 320 Relevance judgment unit 330 Relevance calculator 340 Image analysis unit 350 Printing department 700 CPU 702 ROM 704 RAM 706 Communication interface 708 hard disk drive 710 database interface 712 floppy disk drive 714 CD-ROM drive 720 floppy disk 722 CD-ROM 724 Various databases

Continued front page    F term (reference) 5B057 AA20 BA02 CA01 CA08 CA12                       CA16 CB01 CB08 CB12 CB16                       CE03 CE11 CE17 DA12 DB02                       DB06 DB09 DC25 DC34 DC36                 5C022 AA13 AB12 AB15 AB22 AC03                       AC42 AC52                 5C052 AA01 AA11 AA17 CC11 DD02                       FA01 FA03 FA04 FB05 FB06                       FC08 FD01 FD04 FD13 FE01                 5C053 FA04 FA08 FA23 GA11 GB21                       KA03 LA01 LA03 LA06 LA11                       LA15                 5L096 AA02 AA06 CA04 FA34 FA35                       GA08 GA41 HA02

Claims (15)

[Claims] 1. An image processing apparatus that performs image processing on an image, comprising: a receiving unit that receives a plurality of the images; a relevance determining unit that determines a relevance of the plurality of images; An image processing apparatus, comprising: an image processing unit that performs image processing on the plurality of images based on the association determined by the determination unit. 2. The image processing unit further comprises an association degree calculation unit that calculates an association degree that is a value indicating the association, and the image processing unit is the same for the plurality of images when the association degree is larger than a predetermined value. The image processing apparatus according to claim 1, wherein the image processing is performed. 3. The receiving unit receives image classification information specified by a user in association with the image, and the relevance determining unit receives the association of the plurality of images based on the image classification information. The image processing apparatus according to claim 1, wherein the image processing apparatus determines the sex. 4. The receiving unit receives time information, which is information indicating the time at which the image was captured, in association with the image, and the relevance determining unit receives the time information based on the time information. The image processing apparatus according to claim 1, wherein the relevance of the image is determined. 5. The receiving unit receives, in association with the image, image capturing condition information indicating an image capturing condition that is a condition when the image was captured, and the relevance determining unit stores in the image capturing condition information. The image processing apparatus according to claim 1, wherein the relationship between the plurality of images is determined based on the image processing apparatus. 6. The receiving unit, as the imaging condition information, brightness information indicating the brightness of the subject, strobe information indicating whether or not a strobe is fired at the time of imaging, subject distance information indicating a subject distance, and a focal length. The image processing apparatus according to claim 4, wherein at least one of the focal length information indicated is received. 7. An image analysis unit that analyzes a data distribution of the image is further provided, and the relevance determination unit determines the relevance of the plurality of images based on a data distribution of the image. The image processing apparatus according to claim 1. 8. The image processing apparatus according to claim 7, wherein the relevance determining unit determines the relevance of the plurality of images based on the chromaticity distribution of the images. 9. The image processing apparatus according to claim 7, wherein the relevance determining unit determines the relevance of the plurality of images based on a lightness distribution of the images. 10. The image processing apparatus according to claim 7, wherein the relevance determination unit determines the relevance of the plurality of images based on a spatial frequency of the subject in the image. 11. The image processing apparatus according to claim 1, further comprising a printing unit that prints the image subjected to the image processing by the image processing unit. 12. An image processing method for performing image processing on an image, comprising: a receiving step of receiving a plurality of the images; a relevance determining step of determining a relevance of the plurality of images; An image processing step of performing image processing on the plurality of images based on the relevance determined in the determination step. 13. The receiving step includes a step of receiving a first image of the plurality of images and a step of receiving a second image of the plurality of images, and the image processing step includes: The step of performing predetermined image processing on the first image, the step of determining the relevance includes the step of determining relevance between the first image and the second image, and the image processing unit The image according to claim 12, further comprising performing the predetermined image processing on the second image when the relevance determined in the relevance determining step is larger than a predetermined value. Processing method. 14. A program for an image processing device that performs image processing on an image, the program causing the image processing device to judge the relationship between a receiving module for receiving the plurality of images and the plurality of images. A program comprising: a relevance determination module; and an image processing module for performing image processing on the plurality of images based on the relevance determined by the relevance determination unit. 15. An image processing system comprising: an image pickup device for picking up an image of a subject; and an image processing device for performing image processing on the image, wherein the image pickup device includes an image pickup unit for obtaining an image of the subject. An instruction receiving unit that receives an instruction to classify the image, a classification determining unit that determines image classification information of the image based on the instruction, and a storage unit that stores the image classification information in association with the image. An output unit that outputs the image classification information associated with each of the plurality of images and the plurality of images in association with each other, and the image processing device corresponds to each of the plurality of images. Based on the image classification information associated with each of the plurality of images, the receiving unit that receives the associated image classification information and the plurality of images in association with each other, the plurality of images And an image processing unit that performs image processing on the plurality of images based on the relevance determined by the relevance determination unit. Processing system.