JP2011250071A - Image processing apparatus, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an apparatus and a method, preventing flickers due to luminance inversion of an L-image and a R-image of a three-dimensional image.SOLUTION: In display processing of a three-dimensional image, an image processing apparatus enables prevention of flickers generated by inverting luminance intensities of a left-eye image (L-image) and a right-eye image (R-image). That is, the image processing apparatus detects frames that the luminance intensities of the left-eye image (L-image) and the right-eye image (R-image) are inverted, controls the luminance intensities of the left-eye image (L-image) and the right-eye image (R-image) during a fixed period from the detected point, and prevents generation of rapid luminance inversion. By the luminance control processing, since there is no instantaneous luminance inversion of the left-eye image (L-image) and the right-eye image (R-image), an image display without the flickers can be provided to a viewer.

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program. In particular, the present invention relates to an image processing apparatus, an image processing method, and a program for performing display processing of a three-dimensional image (3D image).

  Recently, display devices such as televisions capable of reproducing three-dimensional images are rapidly spreading. The display of the three-dimensional image is performed by the following process. That is, the left-eye image and the right-eye image are displayed on the display device, and the observer controls to observe the left-eye image only with the left eye and to observe the right-eye image only with the right eye. Realizes observation of stereoscopic images.

  There are various display methods for displaying a three-dimensional image. As a typical method, a left-eye image and a right-eye image are displayed on a display device by switching them at high speed. Some of them are mounted and the shutter is opened and closed in accordance with image switching.

  That is, while the left-eye image is displayed on the display unit, the left-eye shutter of the shutter-type glasses is opened and the right-eye shutter is closed. On the other hand, while the right-eye image is displayed on the display unit, the left-eye shutter of the shutter-type glasses is closed and the right-eye shutter is opened. By such control, the images for the left and right eyes are respectively observed with one eye of the observer. There are various three-dimensional image display methods such as a polarization method using glasses having different polarization directions in addition to the shutter method.

  As described above, in the display process of the three-dimensional image, the left-eye image and the right-eye image are displayed on the display unit. The left eye image and the right eye image are images taken from different viewpoints. For example, as shown in FIG. 1, a left-eye image is captured at the left-eye image capturing position 21 and a right-eye image is captured at the right-eye image capturing position 22 for the subject 10.

Since the left-eye image and the right-eye image are captured from different positions as described above, the brightness of the left-eye image and the right-eye image may differ depending on the shooting environment.
When the brightness of the left-eye image and the right-eye image is different, the observer feels that the screen flickers when the brightness level is switched between the left-eye image and the right-eye image. That is, a flicker phenomenon occurs.

  FIG. 2 is a diagram illustrating a transition example of the average luminance of the left-eye image and the right-eye image displayed on the display unit. The horizontal axis represents time, and the vertical axis represents average luminance. The average luminance is the average luminance for each image frame unit.

In the example shown in FIG. 2, the average luminance of the left-eye image is higher than the average luminance of the right-eye image before frame n. However, after frame n + 1, the average luminance of the right eye image is switched to a state higher than the average luminance of the left eye image.
In other words, between the frames n and n + 1, the average brightness of the left eye image and the right eye image is reversed. When the brightness levels of the left-eye image and the right-eye image are reversed in this way, the observer feels flickering of the screen, that is, flicker.

  Such a phenomenon is likely to occur particularly when images are edited and images that are not continuously shot are joined together. Or, it occurs more frequently when the source of 3D content is switched or fast-forward playback is performed.

  For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2003-60947) describes a method for adjusting the difference in luminance between the left and right images that occurs when a 3D image is captured. The method described in Patent Document 1 discloses a configuration in which adjustment processing is performed to reduce a difference in image quality between a left-eye image and a right-eye image when a 3D image is captured. However, the control in the image display process after being photographed is not shown at all, and it is not a configuration that can deal with a process such as a case where images having different luminances are connected by editing the image.

  Further, in Patent Document 2 (Japanese Patent Application Laid-Open No. 2007-167675), when changing to a greatly different image such as a scene change, an image in a low luminance state, for example, a black or gray image is inserted and output. A configuration for alleviating the viewer's uncomfortable feeling in the change is shown. However, the method described in Patent Document 2 inserts and outputs a black or gray low-luminance image, and the observer may detect a black or gray image. In such a case, You will feel uncomfortable.

JP 2003-60947 A JP 2007-167675 A

  The present invention has been made in view of, for example, the above-described problems, and in a configuration for displaying a three-dimensional image (3D image), even when a change in luminance occurs between the left-eye image and the right-eye image, the observer An object of the present invention is to provide an image processing apparatus, an image processing method, and a program for realizing display control in which flickering or the like is unlikely to occur.

The first aspect of the present invention is:
An average luminance calculation unit that calculates an average luminance of each image unit for the left-eye image (L image) and the right-eye image (R image) constituting the three-dimensional image;
It is determined whether the brightness level state of the new LR image that is the new input frame and the brightness level state of the previous LR image that is the immediately previous input frame are reversed, and the brightness control of the new LR image is performed using the determination information A brightness control execution determination unit that determines whether or not to execute
An addition value calculation unit that calculates an addition value as a luminance control value for each of the new LR images according to the determination result of the luminance control execution determination unit;
The image processing apparatus includes a luminance control unit that performs luminance adjustment of a new LR image by adding or subtracting the addition value calculated by the addition value calculation unit to each new LR image.

  Furthermore, in an embodiment of the image processing apparatus of the present invention, the addition value calculation unit calculates an addition value in which the average luminances of the new LR images substantially match and outputs the addition value to the luminance control unit.

  Furthermore, in an embodiment of the image processing apparatus of the present invention, the addition value calculation unit adds the average luminance of each of the new LR images to an intermediate value between the average luminance of the L image and the average luminance of the R image. The value is calculated and output to the luminance control unit.

  Furthermore, in an embodiment of the image processing apparatus of the present invention, the addition value calculation unit calculates an addition value in which the average luminances of the new LR images substantially coincide with each other, and outputs the addition value to the luminance control unit. After this period, control is performed so that the added value gradually approaches 0.

  Furthermore, in an embodiment of the image processing apparatus of the present invention, the brightness control execution determination unit reverses the brightness high / low state of the new LR image that is the new input frame and the brightness high / low state of the previous LR image that is the previous input frame. In addition, the difference between the L image frames, which is the difference in average luminance between the L image of the new LR image and the L image of the immediately preceding LR image, the R image of the new LR image, and the immediately preceding LR image is determined. A difference between R image frames, which is a difference in average brightness with the R image, is calculated, a reversal of the brightness high / low state occurs, and the difference between the L image frames is equal to or greater than a predetermined threshold, and the difference between the R image frames Is determined to execute the brightness control of the new LR image on the condition that it is equal to or greater than the specified threshold.

Furthermore, the second aspect of the present invention provides
An image processing method executed in an image processing apparatus,
An average luminance calculating unit that calculates an average luminance of each image unit for the left-eye image (L image) and the right-eye image (R image) constituting the three-dimensional image;
The luminance control execution determination unit determines whether the luminance high / low state of the new LR image that is the new input frame and the luminance high / low state of the previous LR image that is the previous input frame are reversed, and uses the determination information Brightness control execution determination step for determining whether or not to execute the brightness control of the new LR image;
An addition value calculating step in which an addition value calculation unit calculates an addition value as a luminance control value for each of the new LR images according to a determination result of the luminance control execution determination unit;
In the image processing method, the luminance control unit includes a luminance control step of performing luminance adjustment of the new LR image by adding or subtracting the added value calculated by the added value calculating unit to each new LR image.

Furthermore, the third aspect of the present invention provides
A program for executing image processing in an image processing apparatus;
An average luminance calculation step for causing the average luminance calculation unit to calculate the average luminance of each image unit for the left-eye image (L image) and the right-eye image (R image) constituting the three-dimensional image;
The brightness control execution determination unit determines whether or not the brightness level state of the new LR image that is the new input frame and the brightness level state of the previous LR image that is the immediately previous input frame are reversed, and uses the determination information A luminance control execution determination step for determining whether or not to execute the luminance control of the new LR image;
An addition value calculation step of causing the addition value calculation unit to calculate an addition value as a luminance control value for each of the new LR images according to the determination result of the luminance control execution determination unit;
The brightness control unit causes the brightness control step to execute brightness adjustment of the new LR image by adding or subtracting the added value calculated by the added value calculating unit to each new LR image.

  The program of the present invention is, for example, a program that can be provided by a storage medium or a communication medium provided in a computer-readable format to an information processing apparatus or a computer system that can execute various program codes. By providing such a program in a computer-readable format, processing corresponding to the program is realized on the information processing apparatus or the computer system.

  Other objects, features, and advantages of the present invention will become apparent from a more detailed description based on embodiments of the present invention described later and the accompanying drawings. In this specification, the system is a logical set configuration of a plurality of devices, and is not limited to one in which the devices of each configuration are in the same casing.

  According to the configuration of one embodiment of the present invention, flickering that occurs when the brightness levels of the left-eye image (L image) and the right-eye image (R image) are reversed during display processing of a three-dimensional image. It becomes possible to prevent. That is, a frame in which the brightness levels of the left-eye image (L image) and the right-eye image (R image) are reversed is detected, and the left-eye image (L image) and the right-eye image are detected for a certain period from the detection point. The luminance of the image (R image) is controlled to prevent a sudden luminance reversal. By this luminance control processing, the luminance of the left-eye image (L image) and the right-eye image (R image) is not instantaneously reversed, and an image display that does not cause the viewer to flicker is realized. The

It is a figure explaining the acquisition structural example of the image which comprises a three-dimensional image. It is a figure which shows the transition example of the average brightness | luminance of the image for left eyes displayed on a display part, and the image for right eyes. It is a figure explaining the outline | summary of the image display control which the image processing apparatus of this invention performs. It is a figure explaining the video signal of a frame sequential system. It is a figure explaining the structural example of the image processing apparatus of this invention. It is a figure explaining the specific structure and process of the brightness | luminance control execution determination part 203. FIG. It is a figure which shows the correspondence of the setting of the flag which the addition value flag output part 254 outputs, and the luminance change of the L image and R image which are output. FIG. 10 is a diagram illustrating a process for generating a luminance adjustment frame based on an addition value calculated by an addition value calculation unit 204. It is a figure explaining the structure of the addition value calculation part 204, and the specific example of a process. It is a figure explaining the structure and process of the low-pass filter. It is a figure which shows the flowchart explaining the brightness | luminance control processing sequence which the image processing apparatus of this invention performs. It is a figure which shows the hardware structural example of the image processing apparatus of this invention.

The details of the image processing apparatus, image processing method, and program of the present invention will be described below with reference to the drawings. The description will be made according to the following items.
1. 1. Outline of processing executed by image processing apparatus of the present invention 2. Specific embodiments of the image processing apparatus of the present invention Example of hardware configuration of image processing device

[1. Description of Outline of Processing Performed by Image Processing Apparatus of Present Invention]
First, an overview of image display control executed by the image processing apparatus of the present invention will be described with reference to FIG.

  As described above with reference to FIG. 2, flicker that occurs when observing a three-dimensional image (3D image) occurs when the average brightness of the left-eye image and the right-eye image is reversed between high and low. appear. In the present invention, brightness adjustment as shown in FIG. 3 is performed in the vicinity of a frame where such a reverse phenomenon occurs.

FIG. 3 is a diagram illustrating a transition example of the average luminance of the left-eye image and the right-eye image displayed on the display unit, similarly to FIG. 2 described above. The horizontal axis represents time, and the vertical axis represents average luminance. The average luminance is the average luminance for each image frame unit.
The example shown in FIG. 3 is a transition example of the average luminance of the left-eye image and the right-eye image after luminance adjustment according to an embodiment of the present invention.

  The input image before the luminance adjustment is the same as the example of FIG. 2 described above, and before the frame n, the average luminance of the left eye image is higher than the average luminance of the right eye image, and after the frame n + 1 Is an image in which the average luminance of the right-eye image is switched to be higher than the average luminance of the left-eye image.

The image processing apparatus of the present invention sets the brightness adjustment frame output period 100 shown in FIG. 3 for an image in which such a change in brightness occurs.
The luminance adjustment frame output period 100 shown in FIG. 3 is set as, for example, the number of output frames = 1 to a plurality of frames (k frames), and in these periods, adjustment of the average luminance of the left-eye image and the right-eye image is performed. Execute.

Specifically, in the luminance adjustment frame output period 100, as shown in FIG. 3, the luminance adjustment is performed so that the average luminances of the left-eye image and the right-eye image substantially coincide.
By setting such a brightness adjustment period,
Before frame n: Left eye image = high luminance, right eye image = low luminance,
Frames n + 1 to n + k: Left eye image = medium luminance, right eye image = medium luminance,
Frame n + k + 1 and later: left eye image = low luminance, right eye image = high luminance,
With such a transition, a luminance change occurs between the left-eye image and the right-eye image.

By performing such processing, the luminance of the left-eye image and the right-eye image is not interchanged immediately before and after the frame, and the k-frame adjustment period set as the luminance adjustment frame output period 100 is interposed and is smooth. Thus, the luminance is switched, and the user (observer) is less likely to flicker.
The display control executed by the image processing apparatus of the present invention performs such control.

[2. Specific Examples of Image Processing Apparatus of the Present Invention]
A specific embodiment of the configuration and processing of the image processing apparatus of the present invention that performs display control described with reference to FIG. 3 will be described below.

  The image processing apparatus of the present invention executes display control of a three-dimensional image (3D image). For example, the image processing apparatus inputs a frame sequential video signal as shown in FIG. 4 and executes display control. That is, the left-eye image (L image) signal for the left eye and the right-eye image (R image) signal for the right eye are alternately transmitted via the transmission path and are input.

  A configuration example of the image processing apparatus of the present invention is shown in FIG. For example, the image signals shown in FIG. 4 are sequentially stored in the frame memory 201. The average luminance calculation unit 202 is also supplied in parallel. The average luminance calculation unit 202 may be configured to supply an image signal stored in the frame memory 201.

  For example, when obtaining the left eye image signal (L image), the average luminance calculating unit 202 calculates the average luminance of one entire frame of the left eye image signal (L image). The calculated average brightness of the L image frame is recorded in the memory 220. This is the L image average luminance 221 in the memory 220 shown in FIG.

  Next, the average luminance calculation unit 202 calculates the average luminance of one entire frame of the right-eye image signal (R image) to be subsequently input. The calculated average brightness of the R image frame is also recorded in the memory 220. This is the R image average luminance 222 in the memory 220 shown in FIG.

The L image average luminance 221 and the R image average luminance 222 calculated by the average luminance calculating unit 202 are specifically calculated according to the following calculation formula, for example.
Average brightness Lm (n) of L image
Lm (n) = ΣLin (x, y) / (image size)
Lin (x, y) is the luminance at the pixel position (x, y) of the input L image.
Average brightness Rm (n) of R image
Rm (n) = ΣRin (x, y) / (image size)
Rin (x, y) is the luminance at the pixel position (x, y) of the input R image.

The L image average brightness 221 and the R image average brightness 222 stored in the memory 220 are input to the brightness control execution determination unit 203.
The luminance control execution determination unit 203 compares the L image average luminance 221 of the LR image pair (latest pair) stored in the memory 220 with the R image average luminance 222. That is, it is determined which of the following states.
(A) L image average luminance 221 ≧ R image average luminance 222,
(B) L image average luminance 221 <R image average luminance 222,
It is determined whether the state is (a) or (b).

The brightness control execution determination unit 203 holds the height difference information of the brightness of the LR image pair (immediate pair) immediately before the LR image pair (latest pair) stored in the memory 220,
It is determined whether or not the brightness level difference of the latest pair and the brightness level difference of the previous pair are reversed.
That is, it is determined whether or not the state transition of the average luminance of the L image pair is the following state transition.
The average brightness of the previous pair is L> R and the latest pair is changed to L <R, or
The average brightness of the previous pair is L <R, and the latest pair is changed to L> R.
It is determined whether or not such a luminance reversal phenomenon has occurred.

When it is detected that such a reverse phenomenon has occurred, the luminance adjustment process in which the luminance adjustment frame output period described above with reference to FIG. 3 is set is executed.
The luminance control execution determination unit 203 outputs a flag (addition value flag) according to whether or not such a luminance reversal phenomenon has occurred to the addition value calculation unit 204.
That is, for example, the flag value = 1 when the luminance reversal phenomenon occurs, the flag value = 0 when the luminance reversal phenomenon does not occur, and the addition value flag that makes it possible to identify the presence or absence of such a luminance reversal phenomenon. Generated and output to the added value calculation unit 204.

  When a flag value (for example, 1) indicating that a luminance reversal phenomenon has occurred is input, the addition value calculation unit 204 adds a luminance value to be added to the L image and a luminance to be added to the R image. Calculate the value. That is, an addition value for adjusting to the luminance level of the luminance adjustment frame output period 100 described above with reference to FIG. 3 is calculated.

  This luminance addition value is output to the luminance control unit 205. The luminance addition value output to the luminance control unit 205 is two addition values of an L image luminance addition value that is an addition value for the L image and an R image luminance addition value that is an addition value for the R image. . These are output alternately. These two added values are set to a positive value, a negative value, and various values.

  In the luminance control unit 205, the L image and the R image that are input images stored in the frame memory 201 are sequentially transferred and stored, and after the luminance addition value calculated in the addition value calculation unit 204 is added, Will be output.

  During the period in which the addition value calculated by the addition value calculation unit 204 is added to the image frame input to the luminance control unit 205, the value of the addition value flag output from the luminance control execution determination unit 203 executes the addition process. This is the period set to the value shown (for example, flag value = 1). This is a period corresponding to the luminance adjustment frame output period 100 shown in FIG. 3 and is a preset period such as several frames to several tens frames. The brightness adjustment frame output period 100 can be set in various modes such as an output period of a specified number of frames or a specified time (several seconds).

A specific configuration and processing of the luminance control execution determination unit 203 will be described with reference to FIG.
As illustrated in FIG. 6, the average luminance comparison unit 251 of the luminance control execution determination unit 203 inputs the L image average luminance 221 and the R image average luminance 222 of the LR image pair (latest pair) from the memory 220, The average brightness of this latest pair of LR images is compared. The comparison result is
(A) L image average luminance 221> R image average luminance 222,
(B) L image average luminance 221 <R image average luminance 222,
In either state (a) or (b) above, this comparison result information is output to the LR luminance inversion determination unit 252.

The LR luminance reversal determination unit 252 acquires the latest pair of luminance level information input from the average luminance comparison unit 251 and the luminance level information of the LR image immediately before it from the memory 253, and reverses the average luminance level of the LR image. Whether or not has occurred is determined.
That is, it is determined whether or not the state transition of the average luminance of the L image pair is the following state transition.
The average brightness of the previous pair is L> R and the latest pair is changed to L <R, or
The average brightness of the previous pair is L <R, and the latest pair is changed to L> R.
It is determined whether or not such a luminance reversal phenomenon has occurred.

  Note that the memory 253 stores luminance level information (L> R or L <R) of the previous LR image frame pair (previous pair) for which the luminance level comparison unit 251 has compared the luminance level. . This data is updated sequentially.

The LR luminance inversion determination unit 252 performs the following luminance inversion phenomenon, that is,
The average brightness of the previous pair is L> R and the latest pair is changed to L <R, or
The average brightness of the previous pair is L <R, and the latest pair is changed to L> R.
When it is determined that such a luminance reversal phenomenon has occurred, a control signal for causing the addition value flag output unit 254 to output a flag for enabling the addition processing (for example, flag value = 1). Is output. Further, the count process of the counter 255 is started.

  The counter 255 is a counter for determining the start to end of the luminance adjustment frame output period 100 shown in FIG. For example, the luminance adjustment frame output period 100 is set in advance as an output period of a specified number of frames or a period of a specified time (about 1 to several seconds).

  When the luminance adjustment frame output period 100 is set as an output period of a specified number of frames, the counter 255 performs counting of the specified number of frames. Specifically, when the luminance adjustment frame output period 100 is set as a period for outputting k frames with the number of frames = k, the counter 255 adds an addition value flag (for example, a flag indicating a start of addition processing). The number of output frames after the time when value = 1) is output is counted. When the count value of the counter 255 reaches k, a flag value reset signal is output to the addition value flag output unit 254. In response to the input of the reset signal, the addition value flag output unit 254 resets a flag that validates the addition process (for example, flag value = 1), and flags the flag that stops the addition process (for example, flag value = 0). Change the setting.

  The flag output from the added value flag output unit 254 is input to the added value calculation unit 204 shown in FIG. When the flag input from the addition value flag output unit 254 is an effective value indicating execution of addition processing (for example, flag value = 1), the addition value calculation unit 204 is for the L image that is a luminance value to be added to the L image. An addition value and an R image addition value that is a luminance value to be added to the R image are calculated.

  That is, the addition value calculation unit 204 calculates the L image addition value and the R image addition value when a flag value (for example, 1) indicating that the luminance reversal phenomenon has occurred is input. That is, an addition value for adjusting to the luminance level of the luminance adjustment frame output period 100 described above with reference to FIG. 3 is calculated.

  These added values are added to the L and R images input to the luminance control unit 205 and output. By this processing, the L image / R image whose luminance is adjusted in the luminance adjustment frame output period 100 shown in FIG. 3 is output.

  FIG. 7 shows a correspondence diagram between the setting of the flag output by the added value flag output unit 254 and the luminance change of the output L image and R image. The luminance adjustment frame output period 100 shown in FIG. 7 is an output period of the L image and the R image whose luminance is adjusted by adding the luminance addition values calculated by the addition value calculation unit 204.

  This period is controlled by the value of the flag shown at the bottom of FIG. That is, only in a period in which the flag output from the added value flag output unit 254 is an effective value (for example, flag value = 1) indicating execution of the addition process, the added value calculated by the added value calculating unit 204 is Each is added to the R image and output.

A process for generating a luminance adjustment frame based on the addition value calculated by the addition value calculation unit 204 will be described with reference to FIG.
In FIG.
(A) Processing for L image,
(B) Processing for R image;
These processes are shown.

In the process for (a) L image shown in FIG. 8, the following signals are shown from the top.
(A1) L image input (average luminance),
(A2) L image luminance addition value (a3) L image output (average luminance)
In the process for (b) R image shown in FIG. 8, the following signals are shown from the top.
(B1) R image input (average luminance),
(B2) R image luminance addition value (b3) R image output (average luminance)

  In FIG. 8, the occurrence of luminance inversion occurs between frame n and frame n + 1, and the luminance adjustment period is an example of an output period of k frames with k frames. In the example illustrated in FIG. 8, the frame number is an example set in units of one set of L / R images. That is, the same frame number is set for each pair of LR images. Therefore, when the number of output frames of individual LR images in the luminance adjustment period is k, the total number of output frames of LR images on the display unit is 2k frames.

The addition value calculation unit 204 shown in FIG. 5 executes calculation of addition values shown in the middle stages (a2) and (b2) of FIG. A specific example of the configuration and processing of the added value calculation unit 204 will be described with reference to FIG.
FIG. 9 is a diagram illustrating a configuration example of the addition value calculation unit 204.

  9, the LR image average luminance intermediate value calculation unit 301 inputs the L image average luminance 221 and the R image average luminance 222 from the memory 220, and the added value calculation unit 204 includes two of the latest pairs. An intermediate value (average luminance) of the luminance of the image is calculated.

The L image average luminance 221 of frame n stored in the memory 220 is
Lm (n)
And the R image average luminance 222 is
Rm (n)
, The LR image average luminance intermediate value calculation unit 301 calculates an average value M (n) of these two image luminance average values. N in M (n) indicates an LR image of frame n, and M (n) indicates an intermediate value (average) between the L image luminance average value and the R image luminance average value of frame n.
That is,
LR image luminance intermediate value M (n) = (Lm (n) + Rm (n)) / 2
The luminance intermediate value of the LR image is calculated according to the above formula.

  The value calculated by the LR image average luminance intermediate value calculation unit 301 is output to the selection unit 302. The selection unit 302 selectively outputs the intermediate value M (n) calculated by the LR image average luminance intermediate value calculation unit 301 or the input value [0] to the low-pass filter 303. The output flag of the added value flag output unit 254 is used as the selection signal.

  As described above with reference to FIG. 7, the added value flag output unit 254 outputs a set flag value (for example, flag value = 1) indicating execution of addition processing in the luminance adjustment frame output period 100.

  When the flag input from the addition value flag output unit 254 is a flag value that indicates the execution of addition processing (for example, flag value = 1), the selection unit 302 calculates the intermediate value calculated by the LR image average luminance intermediate value calculation unit 301. When the value M (n) is output to the low-pass filter 303 and the flag input from the addition value flag output unit 254 is a flag value that indicates that the addition process is stopped (for example, flag value = 0), [0] is selected. And output to the low-pass filter 303.

The configuration and processing of the low-pass filter 303 will be described with reference to FIG.
As shown in FIG. 10, the low-pass filter 303 includes a plurality of registers (delay elements) 321 that set the output value of the selection unit 302, and a multiplication process of the outputs from the respective registers (delay elements) and preset filter coefficients. And a adder 323 that inputs and adds the outputs of the multipliers 322.

  The output of the adder 323 is output as the added value A (n). The addition value A (n) is an addition value for the frame n, and is used as an addition value for the L image and the R image of the nth frame. In this example, a common addition value A (n) is generated for one LR image pair (n) in the nth frame, and the addition value A (n) is added to one image having a low average luminance. Then, a process of subtracting the added value A (n) from the other image having a high average luminance is executed. This corresponds to the processing shown in FIGS. 8 (a) and 8 (b).

Processing of the low pass filter 303 shown in FIG. 10 will be described. In the initial state, all the registers (delay elements) 321 are set to 0.
As described above, when the selection unit 302 inputs a flag value (for example, flag value = 1) indicating execution of the addition process from the addition value flag output unit 254, the selection unit 302 of the LR image average luminance intermediate value calculation unit 301 The calculated intermediate value M (n) is output to the low pass filter 303.

  When this intermediate value is output, the intermediate value M (n) is set in all the registers (delay elements) 321. The intermediate value M (n) is multiplied by a preset filter coefficient in the multiplier 322, and the output of each multiplier 322 is added in the adder 323 to calculate and output an added value A (n). . The filter coefficient is set to a value that is an intermediate value of the average luminance of the input LR image when an addition value A (n) obtained by adding all the outputs of each multiplier 322 is added to the input image.

The added value output from the low-pass filter 303 shown in FIG. 10 corresponds to the added value A (n) shown in FIG. 8, and the initial output timing corresponds to t0 shown in FIG.
Thereafter, the selection unit 302 continuously outputs the intermediate value M (n). That is, the intermediate value M (n) is output until the flag input from the addition value flag output unit 254 is changed to a flag value set to indicate non-execution of addition processing (for example, flag value = 0). During this period, the low-pass filter 303 continuously outputs the addition value A (n). This is a period of time t0 to t1 shown in FIG.

  Since the average luminance of the LR image pair changes with the progress of the frame, the average value M (n) output from the selection unit 302 also changes with the progress of the frame. With this change, the added value A (n) also changes. In FIG. 8, the added value during the period of time t0 to t1 is shown constant, but this is shown in a simplified manner, and the added value actually fluctuates. However, the added value varies so that the output LR image is set to an intermediate value of the average luminance value of the input LR image.

  The added value flag output unit 254 inputs the reset signal from the counter 255 as the luminance adjustment frame output period 100 (see FIG. 7) set in advance as described above with reference to FIG. In response to the input of the reset signal, the addition value flag output unit 254 outputs a setting flag value (for example, flag value = 0) indicating non-execution of the addition process to the selection unit 302 illustrated in FIG.

  The selection unit 302 switches the output to [0] according to the input of the reset signal. The value [0] output from the selection unit 302 is input to the register (delay element) Z (0) on the left side of the plurality of registers (delay elements) 321 shown in FIG. The intermediate value M (n) remains stored in the other registers (delay elements) Z (1) to Z (k).

  The selection unit 302 inputs the value [0] to the low-pass filter 303 according to the clock timing of the system clock possessed by the image processing apparatus. The value [0] input to the low-pass filter 303 is transferred to the register (delay element) Z (0) → Z (1) → Z (2)... At every clock timing.

That is, when the first [0] is input from the selection unit 302 to the low-pass filter 303, the register (delay element) Z (0) = 0, and the registers (delay elements) Z (1) to Z (k) = intermediate value M ( n)
At the next clock timing,
Registers (delay elements) Z (0), Z (1) = 0, registers (delay elements) Z (2) to Z (k) = intermediate value M (n),
At the next clock timing,
Register (delay element) Z (0) to Z (2) = 0, register (delay element) Z (3) to Z (k) = intermediate value M (n),
Thus, the stored value of the register (delay element) 321 is sequentially switched from the intermediate value to 0.

This process is sequentially executed according to the clock timing. As a result, the output of the adder 323 gradually approaches zero.
This processing period corresponds to the period of time t1 to t2 shown in FIG.
As shown in the period t1 to t2 in FIG. 8, the added value is set to gradually decrease with time.

  When all the stored values of the register (delay element) 321 shown in FIG. 10 are switched from the intermediate value to 0, the added value A (n) output from the adder 323 becomes 0. This time corresponds to time t2 shown in FIG. After time t2, the luminance adjustment using the added value is not performed.

A specific algorithm example for the above-described luminance control based on the added value will be described.
First, the average luminance calculation unit 202 illustrated in FIG. 5 calculates the L image average luminance 221 and the R image average luminance 222 according to the following calculation formula, for example.
Average brightness Lm (n) of L image
Lm (n) = ΣLin (x, y) / (image size)
Lin (x, y) is the luminance at the pixel position (x, y) of the input L image.
Average brightness Rm (n) of R image
Rm (n) = ΣRin (x, y) / (image size)
Rin (x, y) is the luminance at the pixel position (x, y) of the input R image.

The L image average luminance (Lm (n)) 221 and the R image average luminance (Rm (n)) 222 are stored in the memory 220 and input to the luminance control execution determination unit 203.
The luminance control execution determination unit 203 compares the L image average luminance 221 of the LR image pair (latest pair) stored in the memory 220 with the R image average luminance 222. That is, it is determined which of the following states.
(A) L image average luminance 221 ≧ R image average luminance 222,
(B) L image average luminance 221 <R image average luminance 222,
It is determined whether the state is (a) or (b).

As the comparison result, the following value is recorded in, for example, a memory (register) (not shown) as a magnitude comparison result: C (n).
C (n) = 1 when Lm (n) ≧ Rm (n)
C (n) = 0 when Lm (n) <Rm (n)

As described above, the brightness control execution determination unit 203 holds the difference in brightness of the LR image pair (immediate pair) immediately before the LR image pair (latest pair) stored in the memory 220,
It is determined whether or not the brightness level difference of the latest pair and the brightness level difference of the previous pair are reversed.
In this determination process, for example, when C (n) = 1, if C (n−1) = 0, it is determined that reverse rotation has occurred.
In the case of C (n) = 0, if C (n−1) = 1, it is determined that reverse rotation has occurred.
This determination process can be executed.

This determination process is a process for determining whether or not the state transition of the average luminance of the L image pair is the following state transition.
The average brightness of the previous pair is L> R and the latest pair is changed to L <R, or
The average brightness of the previous pair is L <R, and the latest pair is changed to L> R.
It is determined whether or not such a luminance reversal phenomenon has occurred.

  When such a luminance reversal phenomenon occurs, the addition value flag is set and the counter starts to operate. The generated size information of the current frame is stored in the next frame because it is used as the size information of the previous frame. When the size information of the previous frame is different from the size information of the current frame, the flag output from the addition value flag output unit 254 of the luminance control execution determination unit 203 shown in FIG. 6 is an effective value (for example, flag value = 1) and the counter 255 starts counting.

  As shown in FIG. 9, the LR image average luminance intermediate value calculation unit 301 receives the L image average luminance (Lm (n)) 221 and the R image average luminance from the memory 220, as shown in FIG. (Rm (n)) 222 is input, and an intermediate value (luminance average) M (n) of the luminances of the two images constituting the latest pair is calculated.

Specifically, for example, an intermediate value (luminance average) M (n) of the luminance of the LR image pair is calculated according to the following calculation formula.
M (n) = (Lm (n) + Rm (n)) / 2

  Further, the value calculated by the LR image average luminance intermediate value calculation unit 301 of the addition value calculation unit 204 shown in FIG. 9 is output to the selection unit 302. The selection unit 302 selectively outputs the intermediate value M (n) calculated by the LR image average luminance intermediate value calculation unit 301 or the input value [0] to the low-pass filter 303. The output flag of the added value flag output unit 254 is used as the selection signal.

  As described above, the low pass filter 303 of the addition value calculation unit 204 inputs the intermediate value M (n) or 0 to the register 321 to generate and output the addition value A (n). The addition value A (n) is an addition value for the frame n and is used as an addition value for the L image and the R image of the nth frame. In this example, a common addition value A (n) is generated for one LR image pair (n) in the nth frame, and the addition value A (n) is added to one image having a low average luminance. Then, a process of subtracting the added value A (n) from the other image having a high average luminance is executed. This corresponds to the processing shown in FIGS. 8 (a) and 8 (b).

  The added value calculation unit 204 shown in FIG. 5 calculates the added value A (n) and provides it to the luminance control unit 205. The luminance control unit 205 adds the added value A (n) to the L image and R image input from the frame memory 201 and outputs the result.

The luminance value at the pixel position (x, y) of the L image input from the frame memory 201 by the addition value calculation unit 204 is Lin (x, y), the addition value is A (n), and the pixel position (x, y) of the output L image When the luminance value of y) is Lout (x, y), the pixel luminance value of the L image output from the luminance control unit 205 is as follows.
(A) Lout (x, y) = Lin (x, y) −A (n) whenC (n) == 0
(B) Lout (x, y) = Lin (x, y) + A (n) whenC (n) == 1

In the above equation, C (n) is the luminance magnitude comparison result of the LR image pair of frame n described above. That is, it is as follows.
C (n) = 1 when Lm (n) ≧ Rm (n)
C (n) = 0 when Lm (n) <Rm (n)

That is, if the L image average luminance (Lm) is equal to or higher than the R image average luminance (Rm), the luminance is obtained by subtracting the addition value A (n) from the input L image (Lin) according to the equation shown in (a) above. Decrease the luminance value of the pixel of the output L image (Lout).
On the other hand, if the L image average luminance (Lm) is less than the R image average luminance (Rm), the addition value A (n) is added to the input L image (Lin) according to the equation shown in (b) above to obtain the luminance. The luminance value of the pixel of the output L image (Lout) is determined by raising.
In this example, the addition value A (n) has a positive value.

Similarly, the luminance value at the pixel position (x, y) of the R image input from the frame memory 201 by the addition value calculation unit 204 is Rin (x, y), the addition value is A (n), and the pixel position of the output L image When the luminance value of (x, y) is Rout (x, y), the pixel luminance value of the R image output from the luminance control unit 205 is as follows.
(C) Rout (x, y) = Rin (x, y) + A (n) whenC (n) == 0
(D) Rout (x, y) = Rin (x, y) −A (n) whenC (n) == 1

That is, if the L image average luminance (Lm) is equal to or higher than the R image average luminance (Rm), the luminance value is obtained by adding the added value A (n) to the input R image (Rin) according to the equation shown in (a) above. The luminance value of the pixel of the output R image (Rout) is determined by raising.
On the other hand, if the L image average luminance (Lm) is less than the R image average luminance (Rm), the luminance is obtained by subtracting the addition value A (n) from the input R image (Rin) according to the equation shown in (b) above. Decreasing the luminance value of the pixel of the output R image (Rout) is determined.
In this example, the addition value A (n) has a positive value.

By these processes, as described with reference to FIG. 3, FIG. 7, and FIG. 8, output of the L image / R image whose luminance is adjusted in the luminance adjustment frame output period 100 is performed.
With this control, when there is a frame transition that causes a luminance reversal of the LR image, a configuration in which a sudden luminance reversal is prevented and a gentle luminance transition is generated to generate a reversal of luminance over multiple frames. Therefore, visual flicker can be reduced.

In the above-described embodiment, the description has been made on the setting that the brightness control is performed by the addition value A (n) when the frame transition in which the brightness reversal of the LR image occurs is detected.
This determination process is executed, for example, as the following determination process in the LR luminance inversion determination unit 252 (see FIG. 6) of the luminance control execution determination unit 203 shown in FIG.
In the case of C (n) = 1, if C (n−1) = 0, it is determined that reverse rotation has occurred.
In the case of C (n) = 0, if C (n−1) = 1, it is determined that reverse rotation has occurred.
This determination process can be executed.

  However, with such a setting, switching of control is frequently repeated, the original luminance information of the input image is changed excessively, and there is a possibility that the control cannot follow.

  In order to prevent such a situation, the LR luminance inversion determination unit 252 (see FIG. 6) of the luminance control execution determination unit 203 shown in FIG. You may perform the process which considered the change state of the brightness | luminance.

The difference Ld () between the L image average brightness (Lm (n)) of the nth frame to be processed and the L image average brightness (Lm (n-1)) of the (n−1) th frame which is the previous frame. n) is calculated.
Similarly, the R image average luminance (Rm (n)) of the nth frame to be processed and the R image average luminance (Rm (n−1)) of the n−1th frame which is the previous frame. The difference Rd (n) is calculated.

That is, the L image difference Ld (n) and the R image difference Rd (n) are calculated according to the following equations.
Ld (n) = abs (Lm (n) −Lm (n−1))
Rd (n) = abs (Rm (n) −Rm (n−1))
Note that abs (x) means the absolute value of x.

  Furthermore, control is performed by applying the added value A (n) only when both the L image difference Ld (n) and the R image difference Rd (n) are equal to or greater than a predetermined threshold value (Th). To do.

That is, when the frame transition in which the luminance inversion of the LR image occurs is detected, the luminance control by the addition value A (n) is not executed, but the frame transition in which the luminance inversion of the LR image occurs is detected, and L image difference Ld (n) ≧ Th
R image difference Rd (n) ≧ Th
Only when each of these formulas is satisfied, luminance control to which the added value A (n) is applied is performed.
By adopting such a control configuration, stable control is possible.

An example of a brightness control sequence executed by the image processing apparatus of the present invention will be described with reference to the flowchart shown in FIG.
First, the average luminance calculation unit 202 shown in FIG. 5 determines whether the input image is an L image or an R image in step S101. As the input image, for example, LR images are alternately input as shown in FIG.

If it is determined in step S101 that the input image is an L image, the process proceeds to step S102, and the average luminance of the L image is calculated. This calculation process is performed according to the following equation as described above.
Average brightness Lm (n) of L image
Lm (n) = ΣLin (x, y) / (image size)
Lin (x, y) is the luminance at the pixel position (x, y) of the input L image.

On the other hand, if it is determined in step S101 that the input image is an R image, the process proceeds to step S103, and the average luminance of the R image is calculated. This calculation process is performed according to the following equation as described above.
Average brightness Lm (n) of L image
Rm (n) = ΣRin (x, y) / (image size)
Rin (x, y) is the luminance at the pixel position (x, y) of the input R image.

Next, the luminance control execution determination unit 203 obtains comparison information C (n) between the average luminance Lm (n) of the L image and the average luminance Rm (n) of the R image in step S104.
As described above, as the comparison information, the following value C (n) is calculated.
C (n) = 1 when Lm (n) ≧ Rm (n)
C (n) = 0 when Lm (n) <Rm (n)

Next, in step S105, the luminance control execution determination unit 203 compares the comparison information C (n-1) of the frame (n-1) immediately before the processing target frame (n) to compare the average luminance of the LR image. It is determined whether or not the reversal of the high and low occurs.
This process is executed, for example, as the following determination process in the LR luminance inversion determination unit 252 (see FIG. 6).
In the case of C (n) = 1, if C (n−1) = 0, it is determined that reverse rotation has occurred.
In the case of C (n) = 0, if C (n−1) = 1, it is determined that reverse rotation has occurred.

That is,
C (n) = C (n-1)
If so, it is determined that there is no reversal in brightness between LR images. In this case, the determination in step S105 is Yes, and the process proceeds to step S112.
on the other hand,
C (n) ≠ C (n-1)
If so, it is determined that a reversal of brightness between the LR images has occurred. In this case, the determination in step S105 is No, and the process proceeds to step S106.

In step S106, in the LR luminance inversion determination unit 252 (see FIG. 6) of the luminance control execution determination unit 203, the L image average luminance (Lm (n)) of the nth frame to be processed and the previous frame. A difference Ld (n) from the L image average luminance (Lm (n-1)) of the (n-1) th frame is calculated.
That is, the L image difference Ld (n) is calculated according to the following equation.
Ld (n) = abs (Lm (n) −Lm (n−1))

In step S107, the L image difference Ld (n) is compared with a predetermined threshold value (Th).
L image difference Ld (n) ≧ Th
It is determined whether or not the above equation holds.
If the above equation does not hold, that is, if the difference between the average luminance Lm (n) of the L image of the nth frame and the average luminance Lm (n−1) of the previous n−1 frame is small, the step The determination in S107 is No and the process proceeds to step S112. In this case, the currently executed control is continued.

Next, in step S107,
L image difference Ld (n) ≧ Th
When it is determined that the above equation holds, that is, when the difference between the average luminance Lm (n) of the L image of the nth frame and the average luminance Lm (n−1) of the previous n−1 frame is large. The determination in step S107 is Yes, and the process proceeds to step S108.

In step S108, in the LR luminance inversion determination unit 252 (see FIG. 6) of the luminance control execution determination unit 203, the R image average luminance (Rm (n)) of the nth frame to be processed and the previous frame. A difference Rd (n) with the R image average luminance (Rm (n-1)) of the (n-1) th frame is calculated.
That is, the R image difference Rd (n) is calculated according to the following equation.
Rd (n) = abs (Rm (n) −Rm (n−1))

In step S109, the R image difference Rd (n) is compared with a predetermined threshold value (Th).
L image difference Rd (n) ≧ Th
It is determined whether or not the above equation holds.
If the above equation does not hold, that is, if the difference between the average luminance Rm (n) of the R image of the nth frame and the average luminance Rm (n−1) of the previous n−1 frame is small, the step The determination in S109 is No, and the process proceeds to step S112.

On the other hand, in step S109,
L image difference Rd (n) ≧ Th
When it is determined that the above equation holds, that is, when the difference between the average luminance Rm (n) of the R image of the nth frame and the average luminance Rm (n−1) of the previous n−1 frame is large. The determination in step S109 is Yes, and the process proceeds to step S110.

In step S110, the addition value flag is set to a flag value (for example, flag value = 1) indicating the execution of addition processing, and output from the addition value flag output unit 254 (see FIG. 6).
Further, in step S111, the count process of the counter 255 is started. As described above, the counter 255 is a counter for determining the start and end of the luminance adjustment frame output period 100 shown in FIGS. 3 and 7, for example. For example, the luminance adjustment frame output period 100 is set in advance as an output period of a specified number of frames or a period of a specified time (about 1 to several seconds).

Next, in step S112, it is determined whether or not the counter value is zero. When the value of the counter is 0, it means that it is not the luminance control period to which the added value A (n) is applied.
When the process proceeds from step S111 to step S112, the counter has already started counting, the determination in step S112 is No, and the process proceeds to step S114.

On the other hand, when the process proceeds from step S105 to step S112, if the brightness control is not performed, the value of the counter is 0. In this case, the determination in step S112 is Yes, and the process proceeds to step S113.
In step S113, the addition value flag is cleared. That is, the flag value is set to a setting value indicating non-execution of the addition process (for example, flag value = 0) and output from the addition value flag output unit 254 (see FIG. 6). Thereafter, the process proceeds to step S114.

In step S114, it is further determined whether or not the addition value flag is a setting flag value indicating execution of the addition process (for example, flag value = 1).
This determination process corresponds to a determination process as to whether or not the luminance control period is within the added value A (n).

  If it is determined in step S114 that the addition value flag is a flag value that indicates execution of addition processing (for example, flag value = 1), the process proceeds to step S115.

In step S115, the LR image average luminance intermediate value calculation unit 301 (see FIG. 9) of the addition value calculation unit 204 inputs the L image average luminance 221 and the R image average luminance 222 from the memory 220, and the two that constitute these latest pairs. An intermediate value (average luminance) of the luminance of the image is calculated.
LR image luminance intermediate value M (n) = (Lm (n) + Rm (n)) / 2
The luminance intermediate value of the LR image is calculated according to the above formula.

  In step S116, the intermediate value M (n) calculated by the LR image average luminance intermediate value calculation unit 301 is output to the register (delay element) 321 of the low-pass filter 303 described with reference to FIG.

Next, in step S119, the addition value A (n) is calculated from the low-pass filter 303 described with reference to FIG.
In step S120, the luminance control unit 205 shown in FIG. 5 adds the addition value A (n) to the L image and R image input from the frame memory 201 and outputs the result.

  On the other hand, if it is determined in step S114 that the addition value flag is a flag value set to indicate non-execution of addition processing (for example, flag value = 0), the process proceeds to step S117.

  In steps S117 to S118, the value [0] output from the selection unit 302 of the addition value calculation unit 204 shown in FIG. 9 is used as the registers (delay elements) Z (in the plurality of registers (delay elements) 321 of the low-pass filter 303 shown in FIG. 0) to Z (k) are sequentially input.

Thereafter, in step S119, the addition value A (n) is calculated from the low pass filter 303 described with reference to FIG.
In step S120, the luminance control unit 205 shown in FIG. 5 adds the addition value A (n) to the L image and R image input from the frame memory 201 and outputs the result.

The processes in step S115, step S116, step S119, and S120 correspond to the process in the period of time t0 to t1 shown in FIG. That is, it is a luminance control period by the addition process of the addition value A (n). This is a period set to the intermediate value of the average luminance of the LR image.
On the other hand, the process of S117, step S118, step S119, and S120 is equivalent to the process of the period of time t1-t2 shown in FIG. That is, it is a process of a period in which the addition value A (n) is decreased and the luminance of the input image is gradually set from the setting of the average luminance of the LR image to the intermediate value.

[3. Example of hardware configuration of image processing apparatus]
Finally, a specific hardware configuration example of the image processing apparatus of the present invention will be described with reference to FIG. FIG. 12 illustrates an example of a personal computer (PC) as an example of the image processing apparatus of the present invention. However, the image processing apparatus of the present invention may be any device that can output an image to an external display device connected via the display unit of the own device or the output unit. The image processing apparatus of the present invention is not limited to a PC, and can be realized in various apparatuses such as an imaging apparatus, a TV, and a player.

  A CPU (Central Processing Unit) 501 executes various processes according to a program stored in a ROM (Read Only Memory) 502 or a storage unit 508. For example, the brightness control process described in the above embodiments is executed. A RAM (Random Access Memory) 503 appropriately stores programs executed by the CPU 501 and data. The CPU 501, ROM 502, and RAM 503 are connected to each other by a bus 504.

  The CPU 501 is connected to an input / output interface 505 via a bus 504, and an input unit 506 including a keyboard, a mouse, and a microphone, and an output unit 507 including a display and a speaker are connected to the input / output interface 505. The CPU 501 executes various processes in response to a command input from the input unit 506 and outputs a processing result to the output unit 507, for example. The output unit 507 includes a display, a speaker, and the like, and a 3D image or the like whose luminance is controlled by the above-described processing is displayed on the display.

  A storage unit 508 connected to the input / output interface 505 includes, for example, a hard disk, and stores programs executed by the CPU 501 and various data. A communication unit 509 communicates with an external device via a network such as the Internet or a local area network.

  A drive 510 connected to the input / output interface 505 drives a removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and acquires recorded programs and data. The acquired program and data are transferred to and stored in the storage unit 58 as necessary.

  The present invention has been described in detail above with reference to specific embodiments. However, it is obvious that those skilled in the art can make modifications and substitutions of the embodiments without departing from the gist of the present invention. In other words, the present invention has been disclosed in the form of exemplification, and should not be interpreted in a limited manner. In order to determine the gist of the present invention, the claims should be taken into consideration.

  The series of processing described in the specification can be executed by hardware, software, or a combined configuration of both. When executing processing by software, the program recording the processing sequence is installed in a memory in a computer incorporated in dedicated hardware and executed, or the program is executed on a general-purpose computer capable of executing various processing. It can be installed and run. For example, the program can be recorded in advance on a recording medium. In addition to being installed on a computer from a recording medium, the program can be received via a network such as a LAN (Local Area Network) or the Internet and can be installed on a recording medium such as a built-in hard disk.

  Note that the various processes described in the specification are not only executed in time series according to the description, but may be executed in parallel or individually according to the processing capability of the apparatus that executes the processes or as necessary. Further, in this specification, the system is a logical set configuration of a plurality of devices, and the devices of each configuration are not limited to being in the same casing.

  As described above, according to the configuration of the embodiment of the present invention, the brightness level of the left-eye image (L image) and the right-eye image (R image) is reversed in the display process of the three-dimensional image. This makes it possible to prevent flickering that occurs. That is, a frame in which the brightness levels of the left-eye image (L image) and the right-eye image (R image) are reversed is detected, and the left-eye image (L image) and the right-eye image are detected for a certain period from the detection point. The luminance of the image (R image) is controlled to prevent a sudden luminance reversal. By this luminance control processing, the luminance of the left-eye image (L image) and the right-eye image (R image) is not instantaneously reversed, and an image display that does not cause the viewer to flicker is realized. The

DESCRIPTION OF SYMBOLS 10 Subject 21 Left-eye image capturing position 22 Right-eye image capturing position 100 Brightness adjustment frame output period 201 Frame memory 202 Average brightness calculation unit 203 Brightness control execution determination unit 204 Addition value calculation unit 205 Brightness control unit 220 Memory 221 L image Average luminance 222 R image average luminance 251 Average luminance comparison unit 252 LR luminance inversion determination unit 253 Memory 254 Addition value flag output unit 255 Counter 301 LR image average luminance intermediate value calculation unit 302 Selection unit 303 Low pass filter 321 Register (delay element)
322 Multiplier 323 Adder 500 Image processing device 501 CPU
502 ROM
503 RAM
504 Bus 505 I / O interface 506 Input unit 507 Output unit 508 Storage unit 509 Communication unit 510 Drive 511 Removable media

Claims (7)

An average luminance calculation unit that calculates an average luminance of each image unit for the left-eye image (L image) and the right-eye image (R image) constituting the three-dimensional image;
It is determined whether the brightness level state of the new LR image that is the new input frame and the brightness level state of the previous LR image that is the immediately previous input frame are reversed, and the brightness control of the new LR image is performed using the determination information A brightness control execution determination unit that determines whether or not to execute
An addition value calculation unit that calculates an addition value as a luminance control value for each of the new LR images according to the determination result of the luminance control execution determination unit;
An image processing apparatus comprising: a luminance control unit that performs luminance adjustment of a new LR image by adding or subtracting the addition value calculated by the addition value calculation unit to each new LR image. The added value calculation unit includes:
The image processing apparatus according to claim 1, wherein an added value in which the average luminances of the new LR images substantially coincide with each other is calculated and output to the luminance control unit. The added value calculation unit includes:
The image processing apparatus according to claim 1, wherein an addition value for setting an average luminance of each of the new LR images to an intermediate value between an average luminance of the L image and an average luminance of the R image is calculated and output to the luminance control unit. . The added value calculation unit includes:
4. The addition value in which the average luminance of each of the new LR images substantially coincides is calculated and output to the luminance control unit, and the addition value is controlled to gradually approach 0 after a preset period. An image processing apparatus according to 1. The brightness control execution determination unit
It is determined whether or not the brightness level state of the new LR image that is the new input frame and the brightness level state of the previous LR image that is the immediately previous input frame are reversed,
further,
An L image inter-frame difference that is a difference in average luminance between the L image of the new LR image and the L image of the immediately preceding LR image;
Calculating an R image inter-frame difference that is a difference in average luminance between the R image of the new LR image and the R image of the immediately preceding LR image;
Reversal of the brightness high and low state occurs, and
The difference between the L image frames is equal to or greater than a predetermined threshold;
5. The image processing apparatus according to claim 1, wherein execution determination of luminance control of a new LR image is performed on the condition that the difference between the R image frames is equal to or greater than a predetermined threshold. An image processing method executed in an image processing apparatus,
An average luminance calculating unit that calculates an average luminance of each image unit for the left-eye image (L image) and the right-eye image (R image) constituting the three-dimensional image;
The luminance control execution determination unit determines whether the luminance high / low state of the new LR image that is the new input frame and the luminance high / low state of the previous LR image that is the previous input frame are reversed, and uses the determination information Brightness control execution determination step for determining whether or not to execute the brightness control of the new LR image;
An addition value calculating step in which an addition value calculation unit calculates an addition value as a luminance control value for each of the new LR images according to a determination result of the luminance control execution determination unit;
An image processing method comprising: a luminance control step in which a luminance control unit performs luminance adjustment of a new LR image by adding or subtracting the addition value calculated by the addition value calculation unit to each new LR image. A program for executing image processing in an image processing apparatus;
An average luminance calculation step for causing the average luminance calculation unit to calculate the average luminance of each image unit for the left-eye image (L image) and the right-eye image (R image) constituting the three-dimensional image;
The brightness control execution determination unit determines whether or not the brightness level state of the new LR image that is the new input frame and the brightness level state of the previous LR image that is the immediately previous input frame are reversed, and uses the determination information A luminance control execution determination step for determining whether or not to execute the luminance control of the new LR image;
An addition value calculation step of causing the addition value calculation unit to calculate an addition value as a luminance control value for each of the new LR images according to the determination result of the luminance control execution determination unit;
A program for causing a luminance control unit to execute a luminance control step of performing luminance adjustment of a new LR image by adding or subtracting the addition value calculated by the addition value calculating unit to each new LR image.

Images