JP5201238B2 - Image processing program, recording medium thereof, image processing method, and image processing apparatus - Google Patents

Description

  The present invention provides an image processing program for a computer capable of accurately determining the presence / absence of flicker or the like and correcting image data with respect to an unnecessary change in brightness or saturation such as flicker, and a recording recording the same. The present invention relates to a medium, an image processing method, and an image processing apparatus.

  Generally, a moving image shot by a digital camera or the like under an environment illuminated by a lighting device such as a fluorescent lamp may cause an unnecessary change in brightness or saturation, such as flicker, depending on the shooting conditions. . Note that flicker is an undesirable phenomenon in which the brightness, saturation, and the like of a moving image change periodically because the frequency of the illumination characteristic change of the lighting fixture and the frame rate of the moving image do not synchronize. In addition, here, “unnecessary” does not mean that it is not necessary, but means that it is not preferable or should be removed.

  Thus, for example, Patent Document 1 discloses an image processing apparatus in which moving image data is corrected based on image data of several past frames to prevent or suppress the occurrence of flicker.

JP 2000-324365 A

  However, the conventional flicker prevention / suppression method disclosed in, for example, Japanese Patent Application Laid-Open No. 2000-324365 has a problem that the presence / absence of flicker is not determined or the accuracy of image correction for eliminating the flicker is not sufficient.

  In addition to flicker, if there is an unnecessary change in brightness or saturation due to other causes, such as when the brightness or saturation fluctuates over a long period due to inappropriate automatic exposure of the digital camera, etc. The lightness change or saturation change includes a plurality of superimposed change patterns. However, the conventional flicker prevention / suppression method has a problem that in such a case, an unnecessary change in brightness or saturation cannot be effectively prevented or suppressed.

  The present invention has been made to solve the above-described conventional problems, and can automatically and accurately determine whether or not there is an unnecessary brightness change or saturation change such as flicker in a moving image, Furthermore, it is an object to be solved to provide means that can effectively prevent or suppress the occurrence of unnecessary brightness change or saturation change in a moving image.

An image processing program according to the present invention, which has been made to solve the above-described problems, is provided with reference data for lightness or saturation based on the step of inputting a moving image and the image data on the lightness or saturation of the moving image. In the step of creating and the relationship to the reference data, when the image data has a predetermined change in brightness or saturation, and the change in the brightness or saturation of the image data includes a plurality of change patterns having different periods, A step of causing the computer to perform data correction on the moving image so that the change is reduced in order from the shortest cycle with respect to the change pattern is characterized.

The recording medium according to the present invention includes a step of inputting a moving image, a step of creating reference data about lightness or saturation based on image data about lightness or saturation of the moving image, and a relationship to the reference data. If the image data has a change in brightness or saturation and the change in brightness or saturation of the image data includes multiple change patterns with different periods, the period is short for each change pattern. The image processing program for making a computer perform the step which performs data correction with respect to a moving image so that this change may reduce in order from is recorded.

An image processing method according to the present invention includes a step of inputting a moving image, a step of creating reference data about lightness or saturation based on image data about lightness or saturation of the moving image, and a relationship to the reference data When the image data has a predetermined change in brightness or saturation, and the change in brightness or saturation of the image data includes a plurality of change patterns having different periods, the period is short for each change pattern. And a step of performing data correction on the moving image so that the change is reduced in order from the first one.

An image processing apparatus according to the present invention includes a moving image input unit that inputs a moving image, and a reference data generation unit that generates reference data about lightness or saturation based on image data about lightness or saturation of the moving image. When the image data has a predetermined change in brightness or saturation and the change in brightness or saturation of the image data includes a plurality of change patterns with different periods, the change to the reference data On the other hand, it is characterized by comprising data correction means for performing data correction on a moving image so that the change is reduced in order from the shortest cycle.

According to the present invention, an unnecessary lightness change or saturation change determination or lightness or saturation correction is performed using an arbitrary frame including a future frame from the correction target frame by utilizing the characteristics of the nonlinear correction, It can be performed with high accuracy.
Further, it is possible to cope with an unnecessary change in brightness or saturation of a moving image having a plurality of different periodicities.
Furthermore, the correction is used not only for correction but also for determining whether there is a change in lightness or saturation such as flicker, and by correcting only when it is determined that there is flicker, the correction can be performed at high speed. It can be performed with high accuracy.

It is a flowchart which shows the determination procedure of the unnecessary brightness change concerning Embodiment 1 of this invention. It is a flowchart which shows the correction procedure of the brightness concerning Embodiment 2 of this invention. It is a flowchart which shows the correction procedure of the brightness concerning Embodiment 3 of this invention. It is a flowchart which shows the correction | amendment procedure of the brightness concerning Embodiment 4 of this invention. It is a flowchart which shows the determination procedure of the unnecessary brightness change concerning Embodiment 5 of this invention. It is a graph which shows an example of the change characteristic with respect to time of an average brightness and a transfer average brightness. It is a graph which shows an example of the change characteristic with respect to time of the difference of average brightness and a transition average brightness. It is a graph which shows the gamma correction characteristic of a gamma correction table. It is a graph which shows the gamma correction characteristic of another gamma correction table. It is a graph which shows an example of the change characteristic with respect to time of the average brightness and the transition average brightness when the correction of the brightness is performed only within the time range specified by the user. It is a graph which shows an example of the change characteristic with respect to time of the average brightness and the transition average brightness when the brightness correction is performed twice. (A)-(c) is a graph which shows an example of the change characteristic with respect to time of an average brightness and a transition average brightness, when the number of terms of a transition average differs mutually, respectively. (A) And (b) is a graph which shows an example of the change characteristic with respect to time of the average brightness and the case where the number of terms of a transition average is respectively small, and the case where there are many. 1 is a block diagram showing a schematic configuration of an image processing apparatus according to the present invention. It is a block diagram which shows the more detailed structure of the image processing apparatus shown in FIG.

Several embodiments of the present invention will be described below. In any of the embodiments, whether or not there is an unnecessary brightness change such as flicker is determined, or the brightness is corrected, or the brightness is corrected by the same method. Judgment or saturation can be corrected.
In each embodiment, the hardware configuration is substantially the same and only the software is different. First, the hardware configuration of the image processing apparatus according to the present invention common to each embodiment will be described.

  As shown in FIG. 14, the image processing apparatus S according to the present invention includes a host computer 1 that performs various data processing for determining presence / absence or form of unnecessary brightness change such as flicker in a moving image or correcting brightness. (Hereinafter referred to as “computer 1” for short). The computer 1 includes an external storage device 2 for storing various data, a monitor 3 for displaying various information on a display, and a mouse 4 and a keyboard 5 for a user (operator) to operate the computer 1. It is connected.

  As shown in FIG. 15, the computer 1 is provided with a storage device 11, an input / output interface 12, and a CPU / memory 13. The storage device 11 is substantially composed of a processing operation unit 14 and an OS section 15. Here, the monitor 3, the mouse 4 and the keyboard 5 are connected to the input / output interface 12, respectively. An image data input / output device 16 is also connected to the input / output interface 12.

Each embodiment will be specifically described below.
(Embodiment 1)
In the first embodiment, using the image processing apparatus S shown in FIG. 14 and FIG. 15, reference brightness data is automatically created according to the data processing procedure shown in the flowchart of FIG. Or the aspect is determined. The program of the data processing procedure shown in this flowchart is recorded in the storage device 11 or the external storage device 2 (recording medium) of the computer 1 (the same applies to the second to fifth embodiments).

The data processing procedure or image processing procedure according to the first embodiment will be described below with reference to the flowchart shown in FIG.
When a moving image is input from the image data input unit 16 to the computer 1, the computer 1 starts the moving picture data processing, first calculates the average brightness L _i of each frame (step S11). Here, the subscript i represents a frame number. Note that this data processing can be speeded up by sampling every two pixels, for example.

Subsequently, the computer 1 takes a transition average (or moving average) in the time axis direction with respect to the average brightness L _{i of} each frame, and creates reference brightness data (step S12). Here, for example, the transition average is calculated using the following equation 1 using a certain frame (subscript i), the preceding n frame, and the subsequent n frame. That is, the reference lightness L ′ _i represents the average lightness of each frame after the transition average is taken (hereinafter referred to as “transition average lightness L ′ _i ”).
L ′ _i = {L _in + L _{i− (n−1)} +... + L _i−1 + L _i
+ L _{i + 1} + ... + L _{i + (n-1)} + L _{i + n} } / (2n + 1) ………………………… Equation 1

However, when the transition average brightness L ′ _i is calculated using Equation 1 for the first frame or its neighboring frame or the last frame or its neighboring frame in a series of frames, it is used for calculation before and after that. There is a case where a power frame does not exist, but such a frame is not a target for taking a transition average.
FIG. 6 shows the temporal change (solid line) of the average brightness L _i for each frame and the temporal change (dotted line) of the transition average brightness L ′ _i calculated using Equation 1. As is clear from FIG. 6, the transition average lightness L ′ _i is averaged or smoothed.

Next, the computer 1, using the following formula 2, for each frame, the average lightness L _i the difference D _i between the transition average brightness L _{'i (hereinafter,} referred to as "brightness difference D _i".) Is calculated Then, difference data is created (step S13).
D _i = L _i −L ′ _i ………………………………………………………… Formula 2
7 shows an example of a change with time of the brightness difference D _i. As is clear from FIG. 7, in this example, the lightness difference _Di is periodically changed with respect to time. That is, there is an unnecessary brightness change.

Thereafter, the computer 1 extracts an unnecessary brightness change portion from the data of a series of luminosity difference D _i. That is, the data of the lightness difference Di is grouped based on the sign (step S14), and the presence or absence or the mode of the unnecessary lightness change is determined (step S15). Specifically, it is determined that the periodicity of the brightness difference D _i is detected (checked), it is unnecessary brightness change if there is periodicity.

Hereinafter, with reference to Table 1 to Table 4, the case where data of the lightness difference D _i shown in Table 1 or Table 3 was obtained, illustrating the periodicity determining technique of unwanted brightness variation.
That is, first, the signs of a certain lightness difference D _i and the next lightness difference D _{i + 1} are compared, and the frame number (i + 1) when the sign changes from minus or 0 to plus is sequentially extracted (checked). . Then, the brightness difference data of the extracted frame (hereinafter referred to as “extracted frame”) is set as the first group, and the brightness of the frame behind the extracted frame (however, the one ahead of the next extracted frame). The difference data is sorted after the extracted frame, and the second group, the third group,. Then, the number of members for each group and the average value of the brightness differences in each group are calculated.

Tables 2 and 4 are obtained by grouping the lightness difference data shown in Tables 1 and 3 in this way, respectively.
For example, in Table 2, the lightness difference data of frame 2, which is the first extracted frame in Table 1, is set as the first group, and the lightness difference data of frames 3 and 4 subsequent thereto are the second group and third, respectively. It is a group. In this case, since there is no frame corresponding to the fourth group and the fifth group, no data is described in the column (described as “none”).

Table 1. Example of brightness difference data with integer periodicity

注：１巡目は、うまくグループに振り分けられない場合がある
ので、計算から省いても良い。上記の例では省いている。 Table 2 Grouping of brightness difference data shown in Table 1

Note: The first round may not be assigned to groups well
So it can be omitted from the calculation. It is omitted in the above example.

Table 3 Example of brightness difference data with decimal periodicity

注：１巡目は、うまくグループに振り分けられない場合がある
ので、計算から省いても良い。上記の例では省いている。 Table 4 Grouping of brightness difference data shown in Table 3

Note: The first round may not be assigned to groups well
So it can be omitted from the calculation. It is omitted in the above example.

  Thus, in Table 2 or Table 4, where the number of members of the second (next next) group suddenly decreases with respect to the number of members of a certain group (in the example of Table 4, the third group And the fifth group), it is determined that there is a possibility of having periodicity.

  Specifically, for example, the first threshold Th1 and the second threshold Th2 are set based on the number of members of the first group (for example, 6 in Table 4). For example, the first threshold Th1 is 80% of the number of members (4.8 in the example of Table 4), and the second threshold Th2 is 20% (1.2 in the example of Table 4). Then, a group in which the number of members is smaller than the first threshold Th1 is found (in the example of Table 4, the fourth group). Then, when the number of members of the next group after the found group (the fifth group in the example of Table 4) is smaller than the second threshold Th2, it is determined that there is a possibility of having periodicity.

  In that case, the number of groups having members whose average value is greater than the first threshold Th1 (in the example of Table 4, the first to third groups) is the integer part of the cycle, and the number of members of the next group is the first group. The value divided by the number of members (2/6 = 0.33 in the example of Table 4) is the decimal part of the period. For example, in the example shown in Table 4, it is determined that there is a possibility of having a periodicity of about 3.33 (3 + 0.33 = 3.33). This is also true when it has an integer period. For example, in the example shown in Table 2, it is determined that there is a possibility of having a periodicity of 3.

  Next, when it is determined that there is a possibility of having periodicity, the maximum value (Table 4) of the average value of each group corresponding to the integer part of the periodicity (1st to 3rd groups in the example of Table 4). In this example, the difference between 6.17) and the minimum value (-3.67 in the example of Table 4) (9.84 in the example of Table 4) is larger than the third threshold Th3 (for example, 3). For example, it is determined that there is an unnecessary brightness change.

  Thus, according to the image processing apparatus or the image processing method according to the first embodiment, the image processing is performed using the computer 1 and the recording medium on which the program for executing the procedure shown in the flowchart of FIG. 1 is recorded. In addition, it is possible to automatically determine whether or not there is an unnecessary change in brightness, such as flicker, in the moving image or the manner.

(Embodiment 2)
The second embodiment of the present invention will be described below.
In the second embodiment, using the image processing apparatus S shown in FIGS. 14 and 15, reference brightness data (transition average brightness) is automatically created according to the data processing procedure shown in the flowchart of FIG. It is possible to effectively prevent or suppress the occurrence of unnecessary brightness changes such as flicker.

  The data processing procedure according to the second embodiment will be described below with reference to the flowchart shown in FIG. However, the data processing procedure in steps S21 to S22 in the flowchart shown in FIG. 2 is the same as the data processing procedure in steps S11 to S12 in the flowchart (Embodiment 1) shown in FIG. In order to avoid duplication, the description of steps S21 to S22 is omitted.

  In the second embodiment, the computer 1 creates reference lightness data (transition average lightness) in the same procedure as in the first embodiment, and then corrects the lightness to remove unnecessary lightness changes. That is, the computer 1 creates a conversion table for gamma correction (step S23), and uses this gamma correction table to perform gamma correction on the brightness data (or moving picture data) of the moving picture (step S24).

  The gamma correction table has a gamma correction graph (gamma correction curve) or a gamma correction characteristic as shown in FIG. 8, for example, and shows the correspondence between the actual brightness (horizontal axis) and the corrected brightness (vertical axis). It is a table. The brightness gamma correction takes a point indicating the actual brightness on the horizontal axis (X-axis), stretches this point upward to obtain a point that intersects the gamma correction graph, and extends this intersection to the left to vertically A procedure is performed in which a point that intersects the axis (Y-axis) is obtained, and the value of this intersection is used as the lightness after correction.

As apparent from FIG. 8, the gamma correction graph, point real brightness and brightness after the correction are both 0 (minimum brightness) and (0,0), a real brightness average brightness L _i corrected Connect the point (L _i , L _i ′) whose brightness is the transition average brightness L ′ _i and the point (255, 255) where the actual brightness and the corrected brightness are both 255 (maximum brightness) with a straight line It is a broken line. That is, the gamma correction graph in FIG. 8 has conversion characteristics such that when the actual brightness is the average brightness L _i , it is converted into the transition average brightness L ′ _i , and in other cases, linear interpolation is performed. Yes.

As shown in FIG. 9, a curve (for example, a quadratic curve) passing through the point (0, 0), the point (L _i , L ′ _i ), and the point (255, 255) is used as the gamma correction graph. Then, gamma correction (interpolation) of brightness change may be performed. In this case, gamma correction (interpolation) can be performed more smoothly than in the case of using a broken line (straight line) gamma correction graph shown in FIG.

  In the lightness correction in the second embodiment, it is not always necessary to use the transition average (formula 1) used in the determination of the unnecessary lightness change in the first embodiment. However, when the transition average shown in Equation 1 is not used, it is necessary to regenerate the reference lightness data (transition average brightness), so that the calculation time is extra. However, the brightness correction amount can be controlled by using the number of terms in the transition average as a parameter.

For example, as shown in FIG. 13A, when the number of terms in the transition average is small, long-period components in the change in average brightness (solid line) for each frame are not so much averaged.
On the other hand, as shown in FIG. 13B, when the number of transition average terms is large, long-period components in the change in average brightness (solid line) for each frame are considerably averaged. Thus, by changing the number of terms in the transition average, it is possible to correct the brightness with an arbitrary correction characteristic. Note that the correction characteristics can be changed by a user instruction.

  Thus, according to the image processing apparatus or the image processing method according to the second embodiment, the image processing is performed using the computer 1 and the recording medium on which the program for executing the procedure shown in the flowchart of FIG. 2 is recorded. Thus, it is possible to effectively prevent or suppress the occurrence of unnecessary brightness change such as flicker in the moving image automatically.

(Embodiment 3)
The third embodiment of the present invention will be described below.
In the third embodiment, reference lightness data (transition average lightness) is automatically created according to the data processing procedure shown in the flowchart of FIG. 3 using the image processing apparatus S shown in FIGS. It is possible to effectively prevent or suppress the occurrence of unnecessary brightness change.

  The data processing procedure according to the third embodiment will be described below with reference to the flowchart shown in FIG. However, the basic method of the data processing procedure according to the third embodiment is the same as that of the data processing procedure according to the second embodiment, except that the user specifies a time range for performing data correction and corrects the brightness. Only. Therefore, in order to avoid duplication of explanation, portions different from the second embodiment will be mainly described below.

  When a moving image is input to the computer 1 from the image data input / output unit 16, the computer 1 starts moving image data processing. At that time, the user first designates a time range to be corrected (step S31). Next, the computer 1 automatically creates reference lightness data (transition average lightness) within a designated time (step S32). The procedure for creating the reference brightness data is the same as that in the second embodiment. Thereafter, as in the case of the second embodiment, the computer 1 creates a conversion table for gamma correction (step S33) and performs gamma correction on the brightness (step S34).

In this type of moving image, when the brightness fluctuates due to a cause other than flicker, for example, due to inappropriate automatic exposure of a digital camera, the brightness changes slowly with time. In such a case, it is often only necessary to correct the brightness in a specific time range, not in the entire time range.
Therefore, in the third embodiment, as shown in FIG. 10, by designating a time range to be corrected by the user, reference lightness data is created only for that time range, and the lightness is corrected.

In this case, by using the lightness reference data (transition average lightness) by several frames more than the correction time range, it is possible to smooth the temporal change in lightness as follows.
That is, in the vicinity of the boundary between the correction time range and the other range, the value obtained by the transition average (the transition average brightness) is not used as the reference brightness data as it is, but the average brightness L _{i of} each frame and the transition average brightness L From “ _i” , the corrected transition average brightness Lc ′ _i is calculated by using the following expression 3, and this is used as reference brightness data. In Equation 3, a is a correction coefficient (modification amount) or an annealing coefficient that is 0 or more and 1 or less.
Lc ′ _i = (1−a) · L _i + a · L ′ _i …………………………………………

  Here, as shown in Table 5, the correction of the actual brightness is smoothed by smoothly changing the correction coefficient a in the vicinity of the boundary from 0 to 1 or from 1 to 0. be able to. In Table 5, frames within the time range specified by the user are frames having frame numbers 7-17.

注） ＊：指定された時間範囲内のフレーム Table 5 Correction coefficient setting method

Note) *: Frame within the specified time range

  Thus, according to the image processing apparatus or the image processing method according to the third embodiment, the image processing is performed using the computer 1 and the recording medium on which the program for executing the procedure shown in the flowchart of FIG. 3 is recorded. In the time range specified by the user, it is possible to effectively prevent or suppress the occurrence of unnecessary brightness changes in the moving image.

(Embodiment 4)
Embodiment 4 of the present invention will be described below.
In the fourth embodiment, reference brightness data is automatically created using the image processing apparatus S shown in FIGS. 14 and 15 according to the data processing procedure shown in the flowchart of FIG. Is effectively prevented or suppressed.

  The data processing procedure according to the fourth embodiment will be described below with reference to the flowchart shown in FIG. However, the basic method of the data processing procedure according to the fourth embodiment is the same as that of the data processing procedure according to the second embodiment, and an unnecessary brightness change having a plurality of periodicities is corrected a plurality of times. Is only different. Therefore, in order to avoid duplication of explanation, portions different from the second embodiment will be mainly described below.

  As shown in FIG. 4, in the fourth embodiment, the computer 1 first corrects an unnecessary brightness change in a short period (step S41), and then corrects an unnecessary brightness change in a long period (step S42). Other points are the same as those in the second embodiment.

For example, even if the short-period unnecessary brightness change due to flicker is corrected in the procedure according to the first embodiment or the procedure according to the second embodiment, it is slowly slowed in time due to inappropriate automatic exposure or the like. In some cases, an unnecessary change in brightness with a long period may remain (see the top graph in FIG. 11).
However, as shown in FIG. 11, even in such a case, the moving image is almost completely corrected by correcting the brightness change a plurality of times according to the procedure shown in steps S41 and S42 according to the flowchart shown in FIG. be able to.

  Thus, according to the image processing apparatus or the image processing method according to the fourth embodiment, the image processing is performed using the computer 1 and the recording medium on which the program for executing the procedure shown in the flowchart of FIG. 4 is recorded. Even when the unnecessary brightness change has a plurality of periodicities, it is possible to effectively prevent or suppress the occurrence of the unnecessary brightness change in the moving image automatically.

(Embodiment 5)
The fifth embodiment of the present invention will be described below.
In the fifth embodiment, reference lightness data is automatically created using the image processing apparatus S shown in FIGS. 14 and 15 according to the data processing procedure shown in the flowchart of FIG. Or the aspect is determined.

  The data processing procedure according to the fifth embodiment will be described below with reference to the flowchart shown in FIG. However, the basic method of the data processing procedure according to the fifth embodiment is the same as the data processing procedure according to the first embodiment, and the accuracy of the determination is improved by using a plurality (a plurality of types) of reference lightness data. Only the point is different. Therefore, in order to avoid duplication of explanation, portions different from those of the first embodiment will be mainly described below.

  As shown in FIG. 5, in the fifth embodiment, the computer 1 first automatically creates reference lightness data (transition average lightness) in the same procedure as in the first embodiment (step S51). Next, the computer 1 determines whether or not there is an unnecessary brightness change (step S52). Here, if there is no unnecessary lightness change, the reference lightness data is recreated to determine whether or not there is an unnecessary lightness change (step S53). When the determination is performed again, steps S51 to S53 are repeatedly executed. If it is determined in step S52 that there is an unnecessary change in brightness, or if it is determined in step S52 that there is no unnecessary change in brightness, this data processing routine ends if the determination is not made again.

When an unnecessary change in brightness occurs in a short period, the number of terms in the transition average may affect the determination accuracy. For example, in the case of a flicker image generated by a combination of 50 Hz illumination and a frame rate of 15 fps, the calculated brightness change has a periodicity of every three frames.
For this reason, for example, as shown in FIG. 12A, accuracy may be improved if the number of terms is a multiple of 3 and the transition average is taken.
On the other hand, as shown in FIG. 12B, when there is a periodicity for every three frames, if the number of terms is set to 4 and a transition average is taken, the periodicity will remain somewhat.
As shown in FIG. 12C, when the number of transition average terms is large, long-period components are also considerably averaged.

In addition, as the number of terms in the transition average increases, the long period component in the brightness change is also averaged or smoothed, so depending on the length of the period of the original video, the transition average may affect the judgment accuracy. is there.
Therefore, since the determination accuracy may actually vary depending on the method of creating the reference brightness data, even if it is determined that there is no flicker using a certain reference brightness data, if another reference brightness data is used The flicker may be determined. However, when the determination is performed according to the procedure shown in the flowchart of FIG. 5, the determination is performed using a plurality of reference lightness data, so that the determination accuracy can be improved without missing such flicker.

  Thus, according to the image processing apparatus or the image processing method according to the fifth embodiment, the image processing is performed using the computer 1 and the recording medium recording the program for executing the procedure shown in the flowchart of FIG. Thus, it is possible to automatically determine the presence / absence or the mode of unnecessary brightness change with high accuracy.

  In the first to fifth embodiments, as described above, it is determined whether or not there is an unnecessary lightness change or a mode, or the lightness is corrected. However, the unnecessary lightness change determination method or lightness correction method according to the first to fifth embodiments can be applied almost directly to the unnecessary saturation change determination or saturation correction. Therefore, in Embodiments 1 to 5, by replacing “lightness” with “saturation” (for example, “reference lightness data” is replaced with “reference saturation data”), whether or not there is an unnecessary saturation change or The aspect can be determined with high accuracy, or the saturation can be corrected with high accuracy.

Furthermore, the unnecessary lightness change determination method or the lightness correction method according to the first to fifth embodiments is almost the same as the determination of both the unnecessary lightness change and the unnecessary saturation change or the correction of the lightness and saturation. Can be applied.
For example, the data processing according to the first or second embodiment determines that there is an unnecessary lightness change based on the reference lightness data, and after correcting the lightness, further creates reference saturation data, It is also possible to correct both the lightness and the saturation by determining the presence or mode or the mode of unnecessary saturation change and correcting the saturation if necessary. It should be noted that after the determination of saturation change or correction of saturation, the determination of brightness change or correction of brightness may be performed. Further, only one of the reference lightness data or the reference saturation data may be used for the determination of the lightness change and the saturation change.

As described above, in the first to fifth embodiments or the modification examples and modifications thereof, all determinations and corrections are automatically performed. Therefore, the user obtains a good determination result or correction result without doing anything. be able to.
Further, the computer may automatically perform the correction only when the user instructs to correct the lightness or saturation without automatically determining unnecessary lightness change or saturation change by the computer.

Further, a weighted transition average calculated using the following equation 4 may be used as the transition average.
L ′ _i = {L _i−1 + 2L _i + L _{i + 1} } / 4 …………………………………………
In this case, it is possible to create reference brightness data that leaves some changes in the original brightness. In lightness or saturation correction, it is preferable to leave the original lightness change or saturation change to a certain extent, for example, for long-period lightness change or saturation change, because excessive correction can be prevented. In some cases, results can be obtained.

(Embodiment)
1. A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
For causing the computer to execute a step of determining that the moving image has an unnecessary lightness change or saturation change if the image data has a predetermined lightness change or saturation change in relation to the reference data. Image processing program.
2. A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
Image processing for causing a computer to perform data correction on the moving image so that if the image data has a predetermined brightness or saturation change in relation to the reference data, the change is reduced. program.
3. The image processing program according to claim 1 or 2, wherein the reference data is created by taking a moving average of the image data in a time axis direction.
4). The image processing according to claim 1, wherein a plurality of types of reference data are created, and whether or not the image data is accompanied by an unnecessary change in brightness or saturation is determined using the plurality of types of reference data. program.
5. 3. The image according to item 2, wherein when the change in brightness or saturation of the image data includes a plurality of change patterns having different periods, the data correction is performed in order from the shortest period for each change pattern. Processing program.
6). A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
For causing the computer to execute a step of determining that the moving image has an unnecessary lightness change or saturation change if the image data has a predetermined lightness change or saturation change in relation to the reference data. A recording medium on which an image processing program is recorded.
7). A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
Image processing for causing a computer to perform data correction on the moving image so that if the image data has a predetermined brightness or saturation change in relation to the reference data, the change is reduced. A recording medium that records the program.
8). A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
An image processing including a step of determining that the moving image has an unnecessary lightness change or saturation change if the image data has a predetermined lightness change or saturation change in relation to the reference data Method.
9. A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
An image processing method including a step of performing data correction on the moving image so that the change is reduced if the image data has a predetermined brightness or saturation change in relation to the reference data.
10. A moving image input means for inputting a moving image;
Reference data creation means for creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
A change determination unit that determines that the moving image has an unnecessary lightness change or saturation change if the image data has a predetermined lightness change or saturation change in relation to the reference data; Image processing device.
11. A moving image input means for inputting a moving image;
Reference data creation means for creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
An image processing apparatus comprising: a data correction unit that performs data correction on the moving image so that if the image data has a predetermined brightness or saturation change in relation to the reference data, the change is reduced. .

  DESCRIPTION OF SYMBOLS S ... Image processing apparatus, 1 ... Host computer (computer), 2 ... External storage device, 3 ... Monitor, 4 ... Mouse, 5 ... Keyboard, 11 ... Storage device, 12 ... Input / output interface, 13 ... CPU / memory, 14 ... processing operation part, 15 ... OS section, 16 ... image data input / output part.

Claims (4)

A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
In the relationship to the reference data, when the image data has a predetermined lightness or saturation change, and the lightness or saturation change of the image data includes a plurality of change patterns having different periods, each change pattern On the other hand, an image processing program for causing a computer to execute data correction on the moving image so that the change is reduced in order from the shortest cycle. A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
In the relationship to the reference data, when the image data has a predetermined lightness or saturation change, and the lightness or saturation change of the image data includes a plurality of change patterns having different periods, each change pattern On the other hand, a recording medium on which an image processing program for causing a computer to execute data correction on the moving image so that the change is reduced in order from the shortest cycle is recorded. A step of inputting a moving image;
Creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
In the relationship to the reference data, when the image data has a predetermined lightness or saturation change, and the lightness or saturation change of the image data includes a plurality of change patterns having different periods, each change pattern On the other hand, an image processing method including a step of performing data correction on the moving image so that the change is reduced in order from the shortest cycle. A moving image input means for inputting a moving image;
Reference data creation means for creating reference data for lightness or saturation based on image data for lightness or saturation of the moving image;
In the relationship to the reference data, when the image data has a predetermined lightness or saturation change, and the lightness or saturation change of the image data includes a plurality of change patterns having different periods, each change pattern On the other hand, an image processing apparatus comprising data correction means for performing data correction on the moving image so that the change is reduced in order from the shortest cycle.

Images