JP2001145018A - Photographed image processor, and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a photographed image processor and a storage medium that can obtain a clean image without halation and black fullness through simple photographing. SOLUTION: When halation or black fullness is in existence in an original photographed image, a CPU 101 controls photographing of an image (dark image) with a decreased gain of a CCD 213 or of an image (blight image) with an increased gain of the CCD 213 so that the image without halation or black fullness can be photographed. In the case that new halation or black fullness takes place in the dark image or the blight image, or both the halation and black fullness take place in the original image, a new dark image or a new blight image is photographed so as to eliminate the halation and black fullness. That is, three images as the original image, the dark image, and the blight image are photographed and the lightness is corrected on the basis of the three images.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to a photographed image processing apparatus for correcting the brightness of a photographed image, and a storage medium.

[0002]

2. Description of the Related Art In recent years, as devices capable of capturing images, such as digital cameras and scanners, have become widespread together with computers, catalogs and the like in which images are displayed in a list can be easily created. When creating these catalogs etc., shoot products with a digital camera,
It was convenient to take the image of the photographed product into a computer and process it.

In general, a digital camera is a CCD (Char
ge Coupled Device), and the dynamic range for brightness is narrower than that of silver halide photography due to the characteristics of the CCD. Therefore, for example, when a white subject is photographed, the state where the white limit is reached (blown out)
On the contrary, when a dark subject is photographed, the subject may reach the limit of black (closed black). Conventionally, in order to prevent such overexposure and underexposure, adjust the exposure with a lens aperture, etc.
The brightness of the image was adjusted.

[0004]

However, one subject often includes both a white portion and a dark portion. Therefore, for example, if you try to eliminate the overexposure of the white part and narrow down the lens aperture and shoot at a low exposure, on the contrary, the dark part may cause underexposure, In some cases, blackout and blackout may occur at the same time, and it is very difficult to capture a clear image without whiteout or blackout.

[0005] Further, in an image in which overexposure or underexposure occurs, the image of the overexposure or underexposure is processed and removed. Since they are in the same state, there is also a problem that machining of that part is very difficult.

SUMMARY OF THE INVENTION An object of the present invention is to provide a photographed image processing apparatus and a storage medium which can more easily photograph a clear image without overexposure and underexposure.

[0007]

According to the first aspect of the present invention,
In a photographed image processing apparatus (for example, a photographing system 1 shown in FIG. 1) for photographing an image and processing the photographed image, determining whether or not the brightness of the photographed image falls within a predetermined lightness range. Means (for example, C shown in FIG. 2)
PU101) and a brightness adjusting means (for example, CPU 101 shown in FIG. 2 and FIG. 3 shown in FIG. 3) for adjusting the brightness when the brightness of the photographed image is determined not to be within a predetermined brightness range. A CCD 213); a photographing unit (for example, a photographing device 40 shown in FIG. 1) for photographing an image according to the brightness adjusted by the brightness adjusting unit;
An image creation unit (for example, an image creation unit that corrects the brightness of a captured image whose brightness is determined not to be within a predetermined brightness range based on the image captured by the imaging unit and creates an image of appropriate brightness) CPU 10 shown in FIG.
1) A photographed image processing apparatus comprising:

According to the first aspect of the present invention, in the photographed image processing apparatus for photographing an image and processing the photographed image, the determining means determines whether the brightness of the photographed image falls within a predetermined lightness range. Whether the brightness adjustment means is
If it is determined by the determination unit that the brightness of the captured image is not within a predetermined brightness range, adjust the brightness,
The photographing means captures an image in accordance with the brightness adjusted by the brightness adjusting means, and the image creating means determines, based on the image captured by the photographing means, that the brightness is not within a predetermined brightness range by the determining means. Then, the brightness of the photographed image is corrected to create an image with appropriate brightness.

Therefore, since the brightness of the photographed image can be corrected and an image having the proper brightness can be created, a clear image free from overexposure and underexposure can be obtained. As a result, there is no need to make adjustments to prevent overexposure and underexposure when photographing, and the burden on the photographer can be further reduced.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a photographing system to which the present invention is applied will be described below in detail with reference to FIGS. First, the configuration will be described.

FIG. 1 is an external perspective view showing the overall configuration of a photographing system 1 as an embodiment to which the present invention is applied. 1, the photographing system 1 includes an image processing device 10 and a photographing device 40.

In FIG. 1, an image processing apparatus 10 includes a main body 11 having various functions of a control system related to image processing, and a CRT (Cath) for displaying various screens related to the image processing contents.
odeRay Tube)
And a keyboard 1 for entering various commands and instructions
3 and a mouse 14 for instructing and operating various instructions on various screens displayed on the display 12.

A photographing device 40 is provided with a case 401 for storing various functions for setting a photographing environment by setting a subject, and a camera tilt table which is rotatably mounted on an opening of the case 401 on the near side in the drawing. A hood 402 for setting a photographing direction of the digital camera unit 20 set to 403 and blocking external light, and a digital camera unit rotatably mounted and set in an opening of the hood 402 on the near side in the drawing. The camera includes a camera tilt base 403 for setting a tilt angle of 20, and a digital camera unit 20 set on the camera tilt base 403 and having a digital camera set rotatably on a horizontal plane.

Further, an emergency stop button 404 for emergency stop attached to a hood drive unit 407, which will be described later, and a subject pedestal housed inside the case 401 are provided on the front side of the case 401 of the photographing device 40 in FIG. A side door 406 that opens and closes when a subject (product) is set on the 405, and a hood driving unit 407 that rotationally drives the hood 402 are provided.

On the front side of the case 401 of the photographing device 40 in the figure, each driving unit of the photographing device 40 is driven in accordance with a control signal for controlling each driving unit input from the image processing device 10. A photographing control device 30 having a built-in photographing control system for outputting a control signal is attached.

A cable C for transmitting and receiving various control signals and various detection signals related to photographing is connected between the image processing device 10, the digital camera unit 20, and the photographing control device 30.

Next, the control system 1 inside the image processing apparatus 10
00 will be described with reference to the block diagram shown in FIG. 2, the control system 10 of the image processing apparatus 10
0 indicates a CPU 101, an input device 102, a RAM 103,
It comprises an I / F 104, a display device 105, a storage device 106, and a storage medium 107, and the storage medium 107
Are connected to the bus 108.

CPU (Central Processing Unit) 10
1 develops a system program and an application program corresponding to the system stored in the storage device 106 in a program storage area (not shown) in the RAM 103, and stores various instructions or data input from the input device 102 in the RAM 103. Temporarily store the image data, execute various image processing on the image data stored in the storage device 106 in accordance with the input instruction and the input data,
The processing result is stored in the RAM 103 and displayed on the display device 105. Then, the processing result stored in the RAM 103 is stored in a storage destination in the storage device 106 which is instructed to be input from the input device 102.

The CPU 101 executes a photographing editing process (see FIG. 7) described later when photographing a subject with the photographing device 40. When automatic photographing is designated by an instruction from the input device 102, the photographing condition is designated. A display screen 105 is displayed on the display device 105 to specify the shooting conditions, the shooting surface (full surface, top surface, bird's-eye view) of the subject (product), etc., and to shoot the shooting surface of the specified subject.
When the photographing device 40 outputs various instruction signals to the photographing control device 30 via the I / F 104 so as to adjust each photographing condition, and confirms that the photographing device 40 has been adjusted to each photographing condition by a response from the photographing control device 30, The photographing processing of the photographing surface of the designated subject is performed (see FIGS. 8 and 9), and the photographed image data is acquired from the photographing control device 30 and stored in the storage device 106 together with the file name and the photographing condition value.

On the other hand, when manual shooting is designated by an input instruction from the input device 102, each device is manually moved and adjusted, and when a shooting instruction is input, a shooting process (see FIGS. 8 and 9). Is performed, and the captured image data is acquired from the imaging control device 30 and stored in the storage device 106 together with the file name, imaging conditions, and the like. Also, the input device 1
When the image editing is designated by an input instruction from 02, the image editing processing of the image data stored in the storage device 106 is performed.

Further, when executing the above photographing processing (see FIGS. 8 and 9), the CPU 101 stores the first photographed image in the RAM 103 as an original image, and the original image has overexposure and underexposure. It is determined whether or not there is overexposure. If there is overexposure, an image without overexposure is taken by lowering the gain of the CCD 213 (output from the CCD 213), and the image is stored in the RAM 103 as a dark image. Store. In the case where there is underexposure, an image without underexposure is photographed by increasing the gain of the CCD 213, and the image is taken as a bright image in the RAM 103.
Store in.

If the black image is lost in the dark image due to the decrease in the gain of the CCD 213, the CC
An image is taken with the gain of D213 raised from the initial value, the image is stored in the RAM 103 as a bright image, and correction processing (see FIG. 10) is executed based on the dark image and the bright image. CC
In the case where overexposure occurs due to imaging with the gain of D213 increased, the imaging of the CCD 213 is reduced with the gain lower than the initial value, the image is stored in the RAM 103 as a dark image, and the dark image and the bright image are used as the basis. Next, the correction process (FIG. 10)
See). Then, the corrected image is stored in the RAM 103 as a main image.

The input device 102 includes the keyboard 13 and the mouse 14 shown in FIG.
Output to PU101.

RAM (Random Access Memory) 103
The CPU 101 forms a program storage area for developing various programs when the CPU 101 executes the various application programs, and a memory area (dark image) for developing various image data processed when the CPU 101 executes the various processes. Area, bright image area, original image area,
And a memory area for developing various data.

The I / F 104 is connected to the photographing control device 30 via the cable C, transmits various instruction signals input from the CPU 101 to the photographing control device 30,
Various detection signals and image signals transmitted from the imaging control device 30 are received and output to the CPU 101.

The display device 105 is the display 12 shown in FIG. 1, and displays various display data (such as a screen for specifying a photographing condition and image data) input from the CPU 101.

The storage device 106 has a storage medium 107 in which programs, data, and the like are stored in advance, and the storage medium 107 is constituted by a magnetic or optical recording medium or a semiconductor memory. The storage medium 107 is fixedly provided in the storage device 106 or is detachably mounted. The storage medium 107 includes the system program, a shooting / editing processing program, a shooting processing program, It stores a correction processing program, data processed by various processing programs, and the like.

The program, data, and the like stored in the storage medium 107 may be received and stored from another device connected via a communication line or the like.
A storage device having the above storage medium may be provided on another device connected via a communication line or the like, and the program and data stored in the storage medium 107 may be used via the communication line. .

Next, the configuration of the digital camera (not shown) in the digital camera section 20 and the control systems 200 and 300 in the photographing control device 30 will be described with reference to the block diagram shown in FIG.

In FIG. 3, the control system 2 of the digital camera
Reference numeral 00 denotes an I / F 201, a camera control unit 202, an image memory 203, motors 204 to 206, a zoom 207, a focus 208, an aperture 209, and a potentiometer 210.
212 and a CCD 213.

The I / F 201 is an I / F 201 in the photographing control device 30.
/ F301, receives various photographing control signals, and outputs the signals to the camera control unit 202.
Each of the detection signals input from 10 to 212 is output to the camera control unit 202, and the I / O
The data is transmitted to the image processing apparatus 10 via F301.

The camera controller 202 controls the motors 204 to 2 according to various photographing control signals input from the I / F 201.
06, a drive control signal is output and drive control is performed, the zoom 207, the focus 208, and the aperture 209 are moved to predetermined positions so as to correspond to predetermined shooting conditions, and zoom positions fed back from the potentiometers 210 to 212; After confirming that the zoom 207, the focus 208, and the aperture 209 have been adjusted to predetermined positions based on the detection signals of the focus position and the aperture position,
The photographing operation of the image pickup unit (not shown) is controlled, and the photographed image data is stored in the image memory 203.

Further, the camera control unit 202 includes an I / F 20
CCD 213 according to the shooting control signal input from
A control signal for adjusting the gain of is output to the CCD 213. Then, based on the image pickup signal input from the CCD 213, the image pickup unit creates photographed image data, and stores the photographed image data in the image memory 203.

The CCD 213 adjusts the output gain of the image signal in accordance with the control signal input from the camera control unit 202, and outputs an image signal according to the brightness of the sensed light to the camera control unit 202.

The image memory 203 is composed of a magnetic or optical recording medium or a semiconductor memory, and stores image data input from the camera control unit 202.

The motors 204 to 206 respectively drive the zoom 207, the focus 208, and the aperture 209 to move to predetermined positions according to drive control signals input from the camera control unit 202.

Each of the potentiometers 210 to 212 is constituted by a variable resistor or the like,
6, a zoom 207, a focus 208,
And each drive position in the diaphragm 209 is detected, and each detection signal is output to the I / F 201.

In FIG. 3, a control system 300 of the photographing control device 30 includes an I / F 301, a stop switch 302, a camera direction detection switch 303, a tilt base drive control unit 304,
Subject pedestal drive control unit 305, hood drive control unit 30
6 and an illumination control unit 307.

The I / F 301 receives various instruction signals transmitted from the image processing apparatus 10 via the cable C and outputs the signals to the I / F 201 in the digital camera unit 20, and outputs the potentiometers 403b, 405b, 407b and the potentiometer 23b. Each detection signal input from the
, And the detection signals of the potentiometers 210 to 212 input from the I / F 201 are transmitted to the image processing apparatus 10 via the cable C.

The stop switch 302 is connected to the emergency stop button 404 shown in FIG. 1. When the emergency stop button 404 is operated, a stop signal for stopping the operation of each drive unit is transmitted to the tilt base drive control unit. 304, the pedestal drive control unit 305, the hood drive control unit 306, and the illumination control unit 307 are simultaneously output to immediately stop the operation of each drive unit and output the stop signal to the I / F.
A reset signal is output to the CPU 101 in the image processing apparatus 10 via 301 to cause the CPU 101 to perform a reset process.

The camera orientation detection switch 303 is a switch for detecting whether or not the digital camera set in the digital camera section 20 has been correctly set at a predetermined fixed position. When it is detected that the operation has not been performed, the detection signal is output to the I / F 301.

The tilt base drive control unit 304 includes an I / F 30
1 outputs a tilt base drive control signal to the motor 403a in accordance with the tilt base drive instruction signal input from
3a to drive and control the tilt angle of the camera tilt table 403, and the potentiometer 4 via the I / F 301.
The tilt angle is adjusted to a desired value based on the tilt angle detection signal fed back from 03b.

Further, the tilt base drive control section 304 controls the I / O
In accordance with the turntable driving instruction input from F301, a turntable drive control signal is output to the motor 23a to drive and control the motor 23a, thereby driving and controlling the rotation angle of the turntable (not shown) in the digital camera unit 20, The rotation angle of the turntable is adjusted to a desired position based on the rotation angle detection signal fed back from the potentiometer 23b via the I / F 301.

The subject pedestal drive control unit 305 includes an I / F 3
In response to a subject pedestal drive instruction signal input from the control unit 01, a subject pedestal drive control signal is output to the motor 405a to drive and control the motor 405a to control the height of the subject pedestal 405 to drive up and down, and the potentiometer 405b via the I / F 301. The elevating position is adjusted to a desired position based on the elevating position detection signal fed back from.

The hood drive control unit 306 includes an I / F 301
A hood drive control signal is output to the motor 407a in accordance with the hood drive instruction signal input from the CPU, and the motor 407a is drive-controlled to drive and control the rotational position of the hood 402,
The rotational position is adjusted to a desired position based on the rotational position detection signal fed back from potentiometer 407b via / F301.

The illumination control unit 307 outputs an illumination drive control signal to an illumination device (not shown) mounted in the case 401 according to an illumination instruction signal input from the I / F 301 to control the illuminance of the illumination device.

The potentiometer 23b includes a motor 23a
And outputs the rotation angle detection signal (voltage signal) to the I / F 301.

The potentiometer 403b is connected to the motor 40
3a, the tilt angle of the camera tilt table 403 controlled by driving is detected, and the tilt angle detection signal (voltage signal) is set to I
/ F301.

The potentiometer 405b is connected to the motor 40
5a detects the elevation position of the subject pedestal 405 that is driven and controlled, and outputs the elevation position detection signal (voltage signal) to the I / F.
Output to 301.

The potentiometer 407b is connected to the motor 40
7a detects the rotational position of the hood 402 whose drive is controlled, and outputs the rotational position detection signal (voltage signal) to the I / F 30.
Output to 1.

Next, image data processed in this embodiment will be described. Generally, when an image processed by a digital camera is, for example, 24-bit full color, each pixel in the image is represented by R (Red), G
(Green: green) and B (Blue: blue) are each represented by 8 bits, that is, numerical data of 0 to 255. FIG.
FIG. 2 is a diagram showing an example of image data processed in the photographing system 1.

In one pixel 503 in the image data shown in FIG. 4, the values of R, G, and B are all 0, and this is a blackout state. In other words, the brightness is darker than 0, but the brightness is 0 because the digital camera cannot take brightness lower than 0. The pixel 501 includes R, G, B
Are 255 in all cases. In other words, the brightness is brighter than 255, but cannot exceed 255.
The state is 55. In a normal state like the pixel 502, the brightness value of each of R, G, and B is 1
~ 254.

In the image data shown in FIG. 5 (a), each pixel on the dotted line XX 'in FIG.
FIG. 5B shows a graph in which the values of the average lightness are taken. As described above, the average brightness of the pixel 501 in which whiteout occurs is 255, and the average brightness of the pixel 503 in which blackout occurs is 0.
Since the actual image data is two-dimensional, the graph showing the average brightness of RGB for all the pixels of the image data shown in FIG. 5A is a graph as shown in FIG.

Next, the operation will be described. The photographing and editing processing executed by the CPU 101 in the image processing apparatus 10 will be described with reference to the flowchart shown in FIG.

First, in accordance with the power-on operation of the photographing device 40 or the instruction operation to instruct the start of the photographing process in the input device 102, the CPU 101 controls the motor 403a and the motor 403a by the tilt base drive control unit 304 and the subject drive control unit 305. 407a and the motor 23a are drive-controlled to move the camera to the initial position (step S1).
01).

Subsequently, the CPU 101 sets the input device 102
It is determined whether or not image editing has been instructed by the instruction operation in (step S102). If image editing has been instructed, image editing processing is executed (step S10).
3), end the process. If image editing has not been instructed, it is determined whether or not automatic shooting has been instructed (step S104).

In step S104, when the automatic photographing is instructed, a photographing condition designation screen for designating the photographing condition is displayed on the display device 105, and the photographing condition and the photographing surface are designated (steps S105 and S10).
6) The user is prompted to set a subject (product) on the subject base 405.

Then, the CPU 101 moves each device according to the photographing conditions corresponding to the photographing surface designated when the user sets the subject on the subject pedestal 405.
Adjustment is performed (Step S107), and a photographing process (FIGS. 8 and 9) is executed (Step S108), and it is determined whether or not photographing completion is instructed (Step S109). If the photographing completion is instructed in this step S109, the process is terminated as it is, and if the photographing completion is not instructed, the process returns to step S106 to perform another photographing.

On the other hand, if automatic photographing is not instructed in step S104, that is, if manual photographing is instructed, the CPU 101 executes processing for manually moving and adjusting each device, and in each case, The photographing device 4 according to an instruction operation performed by the input device 102
0 is moved (step S11).
0). Then, a photographing process (FIGS. 8 and 9) is executed (step S111), and it is determined whether or not photographing completion is instructed (step S112). If the photographing completion is instructed, the process is terminated as it is. If the photographing completion is not instructed, step S is executed to execute another photographing.
Return to 110.

Next, a photographing process executed by the CPU 101 of the image processing apparatus 10 (FIG. 7: steps S108 and S108).
111) will be described based on the flowcharts shown in FIGS.

First, the CPU 101 transmits a photographing instruction signal to the digital camera unit 20 to photograph an image of a subject (step S121), receives the image, and stores it in the original image area in the RAM 103 as an original image. It stores and saves (step S122), and checks for overexposure and underexposure by checking the average value of the R, G, and B lightness of each pixel of the original image (step S12).
3).

Then, the CPU 101 determines whether or not there is overexposure, that is, whether or not there is any pixel whose average brightness of R, G and B has reached 255 (step S1).
24) If it is determined that there is overexposure, an instruction to lower the gain of the CCD 213 in the digital camera is transmitted to the digital camera unit 20, and the gain of the CCD 213 is lowered (step S125), and An image is captured (step S126), and the image is
It is stored and stored in the dark image area in the AM 103 (step S127).

Next, the CPU 101 checks the dark image for overexposure and underexposure (step S12).
8) It is determined whether there is still whiteout (step S129). If there is overexposure, step S125
And further lowers the gain of the CCD 213, and proceeds to step S
Steps 126 to S129 are repeated. If it is determined in step S129 that there is no overexposure,
It is determined whether or not the dark image has underexposure (step S130).

If there is no blackout, the dark image is stored as a main image in the main image area in the RAM 103 (step S131), and the process is terminated. If there is an underexposure, the process proceeds to step S141, and the gain of the CCD 213 is returned to the initial value (the value at the time of capturing the original image).
13 (step S142), and an image is captured (step S143).

Then, the CPU 101 determines in step S
The image captured in 143 is used as a bright image in the RAM 1
03 and stored in the bright image area (step S14).
4), check for overexposure and underexposure of the bright image (step S145), and determine whether there is an underexposed pixel (step S146). If there is a blackout, the process returns to step S142, and furthermore, the CCD2
The process of steps S143 to S146 is repeated by increasing the gain of No. 13. If there is no underexposure, the dark image saved in step S127, step S144
The correction process (see FIG. 10) is performed using the bright image stored in step S122 and the original image stored in step S122 (step S147), and the process ends.

On the other hand, if there is no overexposure in the original image in step S124, the CPU 101 determines whether or not the original image has underexposure (step S1).
32). If there is no blackout in the original image, the image stored as the original image in step S122 is stored in the main image area as the main image (step S140), and the process ends. If there is blackening, the CCD 21
By increasing the gain of 3 (step S133), an image is captured (step S134), and the image is stored and saved as a bright image in the bright image area in the RAM 103 (step S135). Check for underexposure (step S136).

Then, the CPU 101 determines whether or not the bright image has lost black (step S13).
7) If there is underexposure, the process returns to step S133, and the gain of the CCD 213 is further increased.
The processing of 134 to S137 is repeated. If there is no underexposure, it is determined whether or not there is overexposure in the bright image at that time (step S138). If there is no overexposure, the bright image is stored as a main image in the main image area (step S139), and the process ends.

If there is overexposure in step S138, the flow shifts to step S148, where the CCD 21
The gain of 3 is returned to the initial value (the value at the time of shooting the original image). Then, the gain of the CCD 213 is further reduced (step S14).
9), an image is captured (step S150), and the image is stored as a dark image in a dark image area in the RAM 103 (step S151).

Next, the CPU 101 checks the dark image for overexposure and underexposure (step S).
152), it is determined whether there is overexposure or not (step S).
153). If there is overexposure, step S149 is performed.
And the gain of the CCD 213 is further reduced.
The processing from 150 to S153 is repeated. If there is no overexposure, the dark image saved in step 151, the bright image saved in step S135, and step S1
22 using the original image stored in FIG.
Reference) (step S154), and the process ends.

Next, the correction processing (FIG. 9: steps S147 and S154) executed by the CPU 101 of the image processing apparatus 10 will be described with reference to the flowchart shown in FIG.

First, the CPU 101 sets the original image, the dark image,
The RGB of a bright image has an average brightness of 1 to 254, and the RGB values of an original image, a dark image, and a bright image of one pixel on an image.
The difference between the brightness in the original image and the brightness in the dark image and the difference are calculated from the average brightness of B (step S161).
Then, the first pixel data of the image data is read out (step S162), and the average brightness of RGB in the original image of the pixel is calculated (step S163).

Then, the CPU 101 determines whether or not the calculated average brightness of RGB in the original image is 128 or more (step S164). If it is 128 or more, the brightness of each of R, G, and B is corrected using the brightness difference a between the original image and the dark image (see FIG. 12A) (step S165), and the next pixel The data is read (step S167). If the brightness is 128 or less, the brightness of each of R, G, and B is corrected using the brightness difference b between the original image and the bright image (see FIG. 12B) (step S166). The pixel data is read (step S167).

Next, the CPU 101 determines whether or not the correction has been completed for all the pixels (step S16).
8) If not completed, the process returns to step S163, and the processes of steps S163 to S167 are repeated for the pixel read in step S167.
If the correction has been completed for all the pixels, the corrected image is stored as the main image, and the process ends.

Next, a correction method for executing the correction processing (FIG. 10) will be described with reference to FIGS.

FIG. 11 is a graph showing the average brightness of RGB for pixels on a certain straight line on the image data. In FIG. 11, a dotted line 120 is a graph for a bright image, a dashed line 121 is a graph for a dark image, a solid line 122 is a graph for the original image, and a thick line 123 is a graph after the correction processing. It is a graph about an image.

FIG. 12 is an enlarged view of the graph shown in FIG. 11 divided into an upper half and a lower half. However, for the portion exceeding 255 in the solid line 122,
In actual data, the value is 255, but a value obtained by adding the lightness difference a to the lightness of the dark image (dashed-dotted line 121) is taken. In addition, the value below 0 is 0 in actual data, but the value obtained by subtracting the brightness difference b from the brightness of the bright image (dotted line 120) is taken.

In the original image, the average brightness of RGB is 12
As shown in FIG. 12A, correction is performed for a portion having a value of 8 or more using a dashed line 121 indicating the brightness of the dark image and a solid line 122 indicating the brightness of the original image. First, the difference between the solid line 122 and the dashed-dotted line 121, that is, the lightness difference a between the original image and the dark image, is calculated using pixels having a solid line 122 (lightness of the original image) of 254 or less.
Difference y between the value of dot-dash line 121 (lightness of dark image) and 128
Find d. Then, the calculation formula y = (yd + a) × 128
Y is obtained according to / (128 + a). The value of y is 1
The lightness is corrected to a value obtained by adding 28. By similarly obtaining y for each pixel and correcting the lightness according to y, the corrected lightness becomes the lightness as shown by the graph of the thick line 123, and the whiteout is eliminated.

In the original image, the average brightness of RGB is 12
For the portion less than 8, correction is performed using a graph of a dotted line 120 indicating a bright image and a graph of a solid line 122 indicating an original image, as shown in FIG. First, the difference between the dotted line 120 and the solid line 122, that is, the lightness difference b between the bright image and the original image, is determined using pixels having a solid line 122 (lightness of the original image) of 1 or more. The difference yl from the image brightness is calculated, and the calculation formula y = (yl +
b) y is obtained from x128 / (128 + b). Then, the brightness is corrected to a value obtained by subtracting the value of y from 128. By similarly obtaining y for each pixel and correcting the brightness, the brightness after the correction becomes the brightness as shown by the graph of the bold line 123, and the blackout disappears.

Here, in FIG. 11 and FIG.
The method of the correction process for the average brightness is described above. In steps S165 and S166 of the correction process shown in FIG. 10, the brightness of R, the brightness of G, and the brightness of B are respectively corrected. When correcting the brightness of R, the average brightness of RGB of the original image is 128
For the above pixels, the calculation formula R = Rd × y / (y
Using d + a), for pixels less than 128, correction is performed using the calculation formula R = Rl × (128−y) / (128−yl).

When correcting the lightness of G, the calculation formula G = Gd × y / (yd + a) is used for pixels whose average lightness of RGB of the original image is 128 or more.
For pixels less than 8, the equation G = Gl × (12
Correction is performed using (8-y) / (128-yl). When correcting the brightness of B, the RGB values of the original image
For pixels having an average brightness of 128 or more, the calculation formula B = Bd × y / (yd + a) is used. For pixels less than 128, the calculation formula B = Bl × (128−y) /
Correction is performed using (128-yl). Where Rd,
Gd and Bd are the differences between the brightness of R, G and B in the dark image and 128, respectively, and Rl, Gl and Bl are the differences between the brightness of 128 and the R, G and B in the bright image, respectively. is there.

As described above, the CPU 101 executes the photographing process, and when there is overexposure or underexposure in the original image, an image (dark image) with the gain of the CCD 213 reduced,
Alternatively, an image in which the gain of the CCD 213 is increased (bright image)
To capture an image in which there is no overexposure or underexposure. Then, it is determined whether or not a new overexposure or underexposure has occurred by lowering or increasing the gain of the CCD 213. If no overexposure or underexposure has occurred, the dark image or bright image is stored as the main image. I do.

New whiteouts and blackouts have occurred.
Alternatively, in the case where both overexposure and underexposure occur in the original image, a dark image or a bright image is further photographed so as to eliminate the overexposure and underexposure. That is, three images of an original image, a bright image, and a dark image are photographed. Then, the average of the brightness of RGB of each pixel is obtained,
For pixels having an average lightness of 128 or more, R = Rd × y / (yd + a) using the original image and the dark image.
G = Gd × y / (yd + a), B = Bd × y / (yd +
a) is obtained, and the brightness of the image data is corrected in accordance with the R, G, and B values.

On the other hand, for a pixel whose average brightness of RGB is less than 128, using the original image and the bright image, R = R
1 × (128−y) / (128−yl), G = Gl ×
(128-y) / (128-yl), B = Bl × (12
8-y) / (128-yl) is obtained, and the brightness of the image data is corrected in accordance with the values of R, G, and B, respectively.

Therefore, by correcting the image data having the overexposure and underexposure, a clear image free from overexposure and underexposure can be obtained. As a result, it is possible to save the time and effort required to make adjustments to prevent overexposure and underexposure when photographing.

In the above embodiment, the CCD
Although the dark image and the bright image are photographed by adjusting the gain of 213, the present invention is not limited to this. For example, it is possible to adjust the shutter speed of a digital camera or adjust the aperture. Thus, a dark image and a bright image may be shot by changing the exposure. Further, a dark image and a bright image may be shot by adjusting the illuminance of the lighting device. In this case, the shutter speed, the aperture, the exposure, and the illumination device are configured to be automatically adjusted under the control of the CPU 101.
Replace each step of increasing the CCD gain with the steps of slowing down the shutter speed, opening the iris, increasing the exposure, increasing the illuminance of the illumination, and replacing each step of decreasing the CCD gain with increasing the shutter speed and closing the iris. , The exposure may be shortened, and the illuminance of the illumination may be reduced. Further, other detailed configurations can be appropriately changed without departing from the spirit of the present invention.

In the present embodiment, the overexposure and underexposure of the image data in the photographing system 1 are corrected. However, the present invention can be applied to image data of a general digital camera. .

[0087]

According to the first to seventh aspects of the present invention, since the brightness of a photographed image can be corrected and an image having an appropriate brightness can be created, a clear image free from overexposure and underexposure can be obtained. it can. As a result, there is no need to make adjustments to prevent overexposure and underexposure when photographing, and the burden on the photographer can be further reduced.

[Brief description of the drawings]

FIG. 1 is a perspective view showing an overall configuration of a photographing system 1 according to an embodiment to which the present invention is applied.

FIG. 2 is a block diagram showing a configuration of a control system 100 inside the image processing apparatus 10 of FIG.

FIG. 3 shows a digital camera included in the photographing system 1 shown in FIG.
FIG. 2 is a block diagram showing a configuration of a 00.

FIG. 4 is a diagram showing an example of image data processed in the photographing system 1 of FIG.

FIG. 5 is a diagram showing a specific example of image data processed in the photographing system 1 of FIG. 1 and its RGB average brightness.

6 is a diagram showing RGB average brightness of the entire image data of FIG. 5;

FIG. 7 is a flowchart showing a shooting and editing process executed by a CPU 101 in the image processing apparatus 10 of FIG. 1;

FIG. 8 is a flowchart illustrating a photographing process executed by a CPU 101 in the image processing apparatus 10 of FIG. 1;

FIG. 9 is a flowchart illustrating a photographing process executed by a CPU 101 in the image processing apparatus 10 of FIG. 1;

FIG. 10 is a flowchart illustrating a correction process executed by a CPU 101 in the image processing apparatus 10 of FIG.

FIG. 11 is a diagram showing the average brightness of RGB of each image for pixels on a certain straight line on image data.

FIG. 12 is a diagram showing the average brightness of RGB of each image for pixels on a certain straight line on the image data. FIG.
2A shows the average brightness of RGB of a dark image having a brightness of 128 or more, the original image, and the corrected image, and FIG.
FIG. 7 is a diagram showing average brightness of RGB of a bright image having a brightness of 128 or less, an original image, and an image after correction.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Imaging system 10 Image processing device 11 Main body 12 Display 13 Keyboard 14 Mouse 100 Control system 101 CPU 102 Input device 103 RAM 104 I / F 105 Display device 106 Storage device 107 Storage medium 108 Bus 20 Digital camera section 23a Motor 23b Potentiometer 200 Control System 201 I / F 202 Camera control unit 203 Image memory 204 to 206 Motor 207 Zoom 208 Focus 209 Aperture 210 to 212 Potentiometer 213 CCD 30 Imaging control device 300 Control system 301 I / F 302 Stop switch 303 Camera direction detection switch 304 Tilt table Drive control unit 305 Subject pedestal drive control unit 306 Hood drive control unit 307 Illumination control unit 40 Imaging device 401 Case 402 Hood 403 Camera tilt base 403a Motor 403b Potentiometer 404 Emergency stop button 405 Subject pedestal 405a Motor 405b Potentiometer 407 Hood drive 407a Motor 407b Potentiometer 501-503 Pixel

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B047 AA07 AB02 AB04 DA01 DC02 5B057 BA02 CA01 CA08 CA13 CA16 CB01 CB08 CB13 CB16 CC01 CE11 CE20 CH11 5C022 AA13 AB01 AB15 AB17 AB21 AB62 AB66 AC27 AC42 AC69 AC74

Claims (7)

[Claims] 1. A photographing image processing apparatus for photographing an image and processing the photographed image, comprising: a discriminating means for discriminating whether or not the brightness of the photographed image falls within a predetermined lightness range; When it is determined that the brightness of the captured image is not within a predetermined brightness range, a brightness adjustment unit that adjusts the brightness, a shooting unit that shoots an image according to the brightness adjusted by the brightness adjustment unit, Based on the image taken by the photographing means, image creating means for correcting the brightness of the captured image determined that the brightness is not within a predetermined brightness range by the determining means, to create an image of appropriate brightness, A photographed image processing apparatus comprising: 2. The method according to claim 1, wherein the brightness adjustment unit performs brightness adjustment so as not to exceed an upper limit of the predetermined brightness range and brightness adjustment so as not to exceed a lower limit of the predetermined brightness range. Performing, the imaging means, according to the brightness adjusted by the brightness adjustment means, to shoot a plurality of images with different brightness, the image creating means, based on the plurality of images with different brightness taken by the shooting means, 2. The photographed image processing apparatus according to claim 1, wherein the lightness of the photographed image for which the brightness is determined not to be within the predetermined lightness range is corrected, and an image having an appropriate lightness is created. 3. The photographed image processing apparatus according to claim 1, wherein said brightness adjusting means adjusts brightness by adjusting an output from an image pickup device of said photographing means. 4. The photographed image processing apparatus according to claim 1, wherein said brightness adjusting means adjusts brightness by adjusting exposure of said photographing means. 5. The photographed image processing apparatus according to claim 1, wherein said brightness adjusting means adjusts brightness by adjusting a shutter speed of said photographing means. 6. The photographed image processing apparatus according to claim 1, wherein said brightness adjusting means adjusts the brightness by adjusting the brightness of an illumination device of said photographing means. 7. A storage medium storing a computer-executable program for photographing an image and processing the photographed image, wherein a brightness of the photographed image falls within a predetermined lightness range. A computer-executable program code for determining whether the brightness of the captured image is not within a predetermined brightness range, and a computer-executable program code for adjusting the brightness And a computer code that can be executed by a computer to capture an image according to the adjusted brightness; and an imaging process that determines that the brightness is not within a predetermined brightness range based on the image captured according to the adjusted brightness. A computer-executable program code for correcting the brightness of the image and creating an image of appropriate brightness. Storage medium characterized by storing a ram.