JP2000339488A - Picture processor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a picture processor for automatically controlling the luminance of a picture in accordance with the change of the luminance of a picture. SOLUTION: In a picture processor updating the picture of one frame at every prescribed period, a generation part 25 for sequentially generating the picture of one frame in accordance with a program that is previously given and a control part 26 controlling the luminance of the picture of a next second frame based on the luminance of the picture of the first frame are installed. Thus, the luminance of respective pixels displayed on a screen can automatically be controlled in a stage where the picture is generated. Thus, luminance control work using the plotting command of a programmer in the program generation stage of a computer game like a formed case is not required. Then, natural luminance control fitted to man's eye can be executed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an image processing apparatus for automatically adjusting the brightness (luminance) of an image generated by three-dimensional computer graphics (CG).

[0002]

2. Description of the Related Art Three-dimensional computer graphics (C)
In G), for example, when image processing is performed using polygons, coordinates and luminance are set for a plurality of pixels forming each polygon. The coordinates of each pixel are obtained from the vertex coordinates of the polygon in the viewpoint coordinate system set in the virtual three-dimensional space where the polygon is arranged. In the case of color display, the luminance of each pixel is set for each of red (R), green (G), and blue (B) colors, and is given, for example, as a digital value of 8 bits for each color. Conventionally, the luminance of each pixel is set when a program is created. FIG.
Will be described specifically with reference to FIG. FIG. 10 illustrates the case of monochrome display. Therefore, when the luminance is set by 8 bits, the brightest luminance (255) is white, the darkest luminance (0) is black, and gray between the white and black levels changes gradually from white to black.

FIG. 11 is an example of an image in a computer game. FIG. 11 shows one screen when a car (not shown) operated by the player is traveling from the outside of the tunnel to the inside of the tunnel. The image outside the tunnel is set to have relatively bright brightness, The image is set to relatively dark brightness. Therefore, when the image progresses and becomes an image in the tunnel, the image with the dark luminance is displayed.

[0004]

By the way, human vision perceives a dark environment under a bright environment as being darker, and sees a bright environment under a dark environment as a brighter environment. Has the property of feeling. For example,
In FIG. 10, when looking inside the tunnel from outside the tunnel,
Originally, it should look dark. However, if the inside of the tunnel is set to a completely dark luminance, that is, black, the whole screen becomes black when proceeding to the image in the tunnel, which is inconvenient. Also, when you look out of the tunnel from inside the tunnel, it should appear pure white. However, if the outside of the tunnel is set to be pure white, the whole screen becomes incomplete when proceeding to the image outside the tunnel after leaving the tunnel, which is inconvenient.

[0005] Further, when the human vision changes from a bright environment to a dark environment, it gradually adapts to the dark environment and feels the brightness in the dark environment. Therefore, conventionally, according to human vision, a predetermined brightness is given in advance to an image in a tunnel, which should be seen completely dark when viewed from outside the tunnel, and the inside of the tunnel is viewed from outside the tunnel. Even so, the brightness was displayed so that the inside of the tunnel could be seen. Also, the image outside the tunnel after exiting the tunnel is given in advance the brightness after human vision has adapted to that brightness, so that even if you look outside the tunnel from inside the tunnel, the image outside the tunnel can be seen. Was displayed.

As described above, if the brightness of the pixel is set in advance, when the brightness of the image changes in accordance with the progress of the image, an unnatural image different from an image that human eyes can perceive.

Further, by setting the luminance of the pixels in advance and setting a command for adjusting the luminance in a program which advances the image, it is possible to express a natural image suitable for human vision. However, in this case, it is necessary for the programmer who creates the program to manually input a command for sequentially adjusting the brightness of the image while viewing the image. Therefore, when there are many luminance changes, the work of the programmer becomes enormous. Further, it cannot cope with a luminance change that is not assumed at the time of creating a program.

Accordingly, it is an object of the present invention to provide an image processing apparatus and an image processing method for automatically adjusting the brightness of an image according to a change in the brightness of the image.

[0009]

According to a first aspect of the present invention, there is provided an image processing apparatus for updating an image of one frame at predetermined intervals according to a program given in advance. It is characterized by comprising a generation unit for sequentially generating an image for one frame, and an adjustment unit for adjusting the luminance of the image of the next second frame based on the luminance of the image of the first frame.

With this configuration, the brightness of each pixel displayed on the screen can be automatically adjusted at the stage of generating an image. Therefore, unlike the related art, there is no need to perform the brightness adjustment operation using the drawing command of the programmer in the program creation stage of the computer game.

[0011] Further, for example, when the brightness of the image of the first frame is relatively dark, the adjustment unit adjusts the brightness of the image of the second frame to be relatively bright. When the brightness of the image of the second frame is relatively bright, the brightness of the image of the second frame is adjusted to be relatively dark. Thereby, natural brightness adjustment suitable for human vision can be performed.

Further, according to an image processing method of the present invention for achieving the above object, in an image processing method for updating an image of one frame at predetermined intervals, an image of one frame is updated according to a program given in advance. It is characterized by comprising a generating step of sequentially generating and an adjusting step of adjusting the luminance of the image of the next second frame based on the luminance of the image of the first frame.

[0013]

Embodiments of the present invention will be described below. However, the technical scope of the present invention is not limited to the present embodiment.

FIG. 1 is a block diagram of an image processing apparatus according to an embodiment of the present invention. In the embodiments of the present invention, an image processing apparatus applied to a computer game apparatus that displays an image obtained by projecting an object constituted by polygons in a virtual three-dimensional space onto a two-dimensional plane will be described as an example. In FIG. 1, a computer game apparatus 1 includes a main body 2 having a built-in image processing apparatus according to an embodiment of the present invention, a display 3, a speaker 4, a lever 5 operated by a player, and a button 6. The image processing apparatus built in the main body 2 includes a CPU 11, a RAM 12, a ROM 1,
3 which are connected by a system bus 100. The lever 5 and the button 6 are connected to the system bus 100 via the interface 14.

Further, a cartridge 15 having, for example, a flash ROM as a storage element is connected to the system bus 100. The flash ROM stores a game program, image data, audio data, and the like. In addition,
Instead of the cartridge 15, a storage medium such as a CD-ROM or a DVD (digital video disk) for storing data such as a game program may be connected.

The VDP 20 executes image processing characteristic of an embodiment of the present invention, which will be described later, on the image data from the cartridge 15 under the control of the CPU 11. The image data subjected to the image processing is sequentially developed as image data for one screen of the display 3 in a frame buffer in the VDP 20, and at predetermined timing (1/60 second),
Output to the display 3 through the D / A converter 16,
The image is displayed.

On the other hand, the sound processor 17 connected to the system bus 100 is controlled by the CPU 11
The voice data stored in the cartridge 15 is read out,
An analog audio signal is output to the speaker 4 via the D / A converter 18.

FIG. 2 is a detailed block diagram of the VDP 20 characteristic of the present invention. 2, necessary drawing commands in the game program are set in a drawing command memory 22 based on the control of the CPU 11 of FIG. In the texture memory 23, necessary texture data in the image data is set based on the control of the CPU 11. The texture data is data of a pattern that is pasted (mapped) to a polygon in units of pixels (pixels) constituting the polygon. And V
The DP control unit 21 instructs the setup unit 24 and the screen brightness adjustment unit 26 to start image processing based on a control command from the CPU 11. The setup unit 24 reads out a drawing command from the drawing command memory 22, converts it into an internal format, and transmits it to the pixel data generation unit 25.

The pixel data generation unit 25 calculates the viewpoint coordinates of a plurality of pixels (pixels) constituting the polygon in the virtual three-dimensional space from the vertex data of the polygon in the display area of the display 3 according to the acquired drawing command. The center coordinate data is generated, and the texture data corresponding to the coordinate data is read from the texture memory 23.

The pixel data generation unit 25 further executes a shading process to obtain the luminance of the pixel, and generates color data of each pixel based on the texture data of each pixel and the luminance of the pixel. That is, the color data is given as red (R), green (G), and blue (B) luminance data of, for example, 8 bits each. In addition, the shading processing is to add a shadow to a polygon that is finally displayed in two dimensions and to express the polygon three-dimensionally.
This is a process of determining the luminance of each pixel constituting the polygon in consideration of the position and color of the light source, the position of the viewpoint, the direction of the line of sight, and the like. Then, the pixel data generation unit 25 transmits the coordinate data converted into the two-dimensional coordinates and the color data to the screen luminance adjustment unit 26 as pixel data.

The screen brightness controller 26 multiplies the color data by a predetermined coefficient, which will be described later, and transmits the resulting color data and its coordinate data (ie, pixel data) to the drawing unit 27.
The drawing unit 27 draws the pixel data in a frame buffer 28 that stores image data for one screen (frame) of the display 3. The display unit 29 reads the pixel data drawn in the frame buffer 28 at predetermined intervals (for example, 1/60 second), converts the read pixel data into an analog signal, and displays the read image as an image on the display 3. I do. At this time, the display unit 29 also transmits the read pixel data to the screen luminance adjustment unit 26.

Then, in the embodiment of the present invention, the screen luminance adjusting section 26 adjusts the color data of the next frame, that is, the luminance, based on the color data of the previous frame, that is, the luminance. Specifically, based on the luminance of each pixel of the previous frame, a predetermined luminance coefficient described below is calculated, and by multiplying the input color data of the pixel data of the next frame by the coefficient, The color data (luminance) of the pixel data of the next frame is determined. For example, the brightness coefficient increases when the brightness of the previous frame is relatively low (dark),
If the brightness of the frame is relatively high (bright) before,
It is set to be smaller. FIGS. 3 to 7 show examples of the image thus expressed. 3 to 7 show examples of images that have been subjected to the automatic brightness adjustment processing according to the embodiment of the present invention.

In FIGS. 3 to 7, images are images of the direction of the tunnel viewed from a position away from the tunnel (FIG. 3).
From the entrance of the tunnel (Fig. 4), the image inside the tunnel (Fig. 5), and the image before the tunnel exit (Fig. 6). Image of the outside of the tunnel viewed from above (Fig. 7)
Changes to

In FIG. 3, an image inside the tunnel is displayed in a narrow area at the center of the screen, and the luminance of pixels corresponding to the area is relatively dark, but many areas on the screen are images outside the tunnel. In this case, the luminance of the pixel corresponding to the area is relatively bright. That is, the brightness of the entire screen is relatively bright. It is assumed that such a screen (FIG. 3) changes to the screen of FIG. In FIG. 4, many areas of the screen are images in the tunnel, and the brightness of the image in the tunnel is relatively dark. At this time, since the luminance of the previous screen (FIG. 3) is bright, the luminance of the next screen (FIG. 4) becomes darker due to the effect of the luminance coefficient described above. Immediately after changing from a bright environment to a dark environment, such an image representation is adapted to human vision that makes the dark environment darker.

Assume further that the screen of FIG. 4 changes to the screen of FIG. In FIG. 5, many areas of the screen are images in the tunnel, and the screen brightness is relatively dark. At this time, since the luminance of the previous screen (FIG. 4) is dark, the luminance of the next screen (FIG. 5) becomes relatively bright due to the effect of the luminance coefficient described above. Such an image representation adapts to human vision that gradually adapts to the dark environment after changing from a bright environment to a dark environment.

It is further assumed that the screen of FIG. 5 changes to the screen of FIG. FIG. 6 shows an image just before the exit of the tunnel, and a bright area outside the tunnel becomes large in the center area of the screen. At this time, since the luminance of the previous screen (FIG. 5) is dark, the luminance of the next screen (FIG. 6) becomes bright due to the effect of the luminance coefficient described above. Therefore, the bright image outside the tunnel in the central area of the screen becomes brighter, and the area outside the tunnel becomes white saturated. This corresponds to the feeling that human vision adapted to a dark environment dazzles a bright environment and makes it appear white. The white saturation state means that the color data of each of the three colors RGB is the highest value (when the color data of each color is given by 8 bits, the highest value is (25
5) means a state in which white of maximum luminance is reached.

Assume further that the screen of FIG. 6 changes to the screen of FIG. FIG. 7 is an image of the exit of the tunnel, and there is a larger area outside the tunnel than in FIG. 6 in the center area of the screen. At this time, since the luminance of the previous screen (FIG. 6) is relatively bright, the luminance of the next screen (FIG. 7) becomes relatively dark due to the effect of the luminance coefficient described above. In other words, the region outside the tunnel where the white saturation occurs in the center region of the screen becomes relatively dark, thereby being released from the white saturation and the image outside the tunnel is displayed. Such an image representation adapts to human vision that gradually adapts to the bright environment after changing from a dark environment to a bright environment.

Next, the arithmetic expression of the luminance coefficient will be described. C ₁ , C ₂ , C ₃ , C ₄ , C ₅ , C
₆ is a predetermined constant. Equation (1) is a first example of an arithmetic expression for calculating the luminance coefficient K _n (n = 0, 1, 2,...) Of the n-th frame. The initial value K ₀ of the brightness coefficient K _n is
1.0.

K _n = (C ₁ −ave (Intensity) _n−1 ) × C ₂ (1) ave (Intensity) _n−1 is the color of each pixel in the ( _n−1 ) _th frame that is the previous frame, that is, It is an average value of luminance (Intensity). Then, advance ave (Intensity) have set up _n-1 thresholds, ave (Intensity) when _n-1 is greater than the threshold value, K _n becomes smaller than 1.0, less than the threshold If the constant C _1, C ₂ to K _n is greater than 1.0 is set. Incidentally, by adjusting the value of the constant C _2, it is possible to adjust the speed to follow the change in brightness.

According to equation (1), ave (Intensity)
_n-1Is smaller, that is, darker, the brightness coefficient K _nIs big
The next frame becomes relatively brighter and ave (Intensity)
_n-1Is larger, that is, brighter, the brightness coefficient K_nIs small
The next frame becomes relatively dark.

[0031] Equation (2) is a second example of a calculation formula for obtaining the brightness coefficient K _n.

K_n= K_n-1-C_Three(Ave (Intensity)_n-1> C_FourCase) K_n= K_n-1+ C_Three(Ave (Intensity)_n-1<C_Four) (2) According to equation (2), ave (Intensity)_n-1Is the constant C_FourThan
If it is large, that is, bright, the luminance coefficient K of the previous frame_n-1From
Constant C_ThreeIs subtracted to obtain a luminance coefficient K for the next frame._nIs small
Become. As a result, the next frame becomes relatively dark. Ma
Ave (Intensity) of the previous frame_n-1Is the constant C_FourLess than
In other words, when it is dark, the luminance coefficient K of the previous frame_{n -1}To the constant C_Three
Is added to the luminance coefficient K of the next frame._nBecomes larger.
As a result, the next frame becomes relatively bright. That is,
Constant C_FourIs the above threshold value. Also, the constant C_ThreeAdjust the value of
Adjust the speed to follow the change in brightness.
Can be.

[0033] Equation (3) is a third example of an arithmetic expression for obtaining brightness coefficient K _n.

K _n = K _n−1 − (ave (Intensity) _n−1 −C ₅ ) × C ₆ (3) Note that the constant C ₅ is the middle of the range that ave (Intensity) _n−1 can take. It is set to a value or an average value, or its vicinity. Further, by adjusting the value of the constant C _6, as in the above-described case, it is possible to adjust the speed to follow the change in brightness.

[0035] According to formula (3), ave (Intensity) when _n-1 is a constant C ₅ less than the value to be added to the brightness coefficient K _n-1 of smaller previous frame increases, the next frame brightness coefficient K _n increases. As a result, the next frame becomes relatively bright. Further, ave (Intensity) when _n-1 is greater than the constant C _5, the value that is subtracted from the brightness coefficient K _n-1 of the previous frame larger increases, the brightness coefficient K _n of the next frame becomes smaller. As a result, the next frame becomes relatively dark.

The screen brightness control section 26, the color data of the pixel data to be input, by multiplying the brightness coefficient K _n determined in accordance with the above operation expression, to adjust the color data,
It is possible to automatically generate pixel data having a luminance suitable for the nature of human vision. That is, if the previous frame is a bright screen and the next frame is a dark screen,
The dark screen is rendered darker. Then, when the next frame is also a dark screen, the human visual perception is used to the dark screen and is expressed so as to be relatively bright. When the previous frame is a bright screen and the next frame is a bright screen, the bright screen is expressed more brightly. Then, when the next frame is also a bright screen, human vision is used to the bright screen and is expressed so as to be relatively dark.

Note that the front frame used in each of the above equations is
Average brightness ave (Intensity)_n-1On behalf of
(Max (Intens)
ity) _n-1) May be used.

Further, ave (Intensity) _n-1 and (max (Intenity)
sity) _n-1 may be obtained based on the pixel data of a partial area, not the entire area of the previous frame. Some areas are
For example, it may be a central area of the screen or an area where the player gazes. The area watched by the player is, for example, an area where a road ahead is displayed in a car racing game, an area where an enemy character is displayed in a martial arts game, and these areas are defined as a central area of the screen. Not limited. Furthermore, in order to suppress a significant change with respect to the brightness coefficient K _n-1 of the previous frame of the brightness coefficient K _n of the next frame determined, it may be the upper or lower limit provided brightness coefficient K _n.

Here, the white saturation processing for processing the white saturation state described above will be further described. In the frame buffer 28 of FIG. 2, for example, for each coordinate data, 8 bits for each of the three colors (minimum value (0) to maximum value (25
5)), color data is drawn. On the other hand, the pixel data generation unit 25 generates color data using more than 8 bits (for example, 10 bits).

FIG. 8 is a diagram for explaining white saturation processing in the embodiment of the present invention. In FIG. 8, for example, the original color of a certain pixel is bright pink, and the color data generated by the pixel data generation unit 25 is [R (30
0), G (270), B (270)]. Since all of the color data exceeds the maximum value (255) that can be drawn in the frame buffer 28, all the color data are adjusted to (255) by the white saturation processing. Thereby, the color of this pixel becomes white. And such white saturation processing, if the present invention the characteristic brightness coefficient K _n to perform both the luminance adjustment processing for multiplying the color data, it executes the brightness adjustment processing of the present invention prior to the white saturation processing preferable. The reason will be described with reference to FIG.

FIG. 8A is a diagram showing a change in color data when the luminance adjustment processing (processing of multiplying the luminance coefficient K _n = 1.2) of the present invention is performed before the white saturation processing. 8
(B) is a diagram showing a change in color data when the same brightness adjustment processing of the present invention as described above is performed after the white saturation processing.

In FIG. 8A, the original color data [R
(300), G (270), B (270)]
By multiplying the luminance coefficient K _n = 1.2, [R (360), G
(324), B (324)]. Thereafter, by performing white saturation processing, the color data becomes [R (255), G
(255), B (255)].

On the other hand, in FIG. 8B, the original color data [R (300), G (270), B (270)] are first subjected to white saturation processing to obtain [R (255), G (270), G (270), G (270)]. (2
55), B (255)]. Then, the luminance coefficient K _n =
Multiplying by 1.2 gives [R (306), G (306), B
(306)], and the white saturation processing is required again. Then, by the white saturation processing again, the color data is again [R (255), G (255), B (255)].
Is processed. As described above, if the white saturation processing is performed before the brightness adjustment processing of the present invention, a case where the white saturation processing is required again occurs, and the efficiency of the entire image processing is reduced.

FIG. 8C shows a brightness adjustment process (a process of multiplying by a brightness coefficient K _n = 0.8) according to the present invention before the white saturation process.
FIG. 8D is a diagram showing a change in color data when the same brightness adjustment process of the present invention as described above is executed after the white saturation process. .

In FIG. 8C, the original color data [R
(300), G (270), B (270)]
By multiplying the luminance coefficient K _n = 0.8, [R (240), G
(216), B (216)]. Therefore, there is no need to perform white saturation processing, and the color data is adjusted from the original light pink color to darker pink color data.

On the other hand, in FIG. 8D, the original color data [R (300), G (270), B (270)] is first subjected to white saturation processing to obtain [R (255), G (270), G (270)]. (2
55), B (255)]. Then, the luminance coefficient K _n =
Multiplying by 0.8 gives [R (204), G (204), B
(204)]. Therefore, since all the color data have the same value, the color data is adjusted to light gray. That is, the color is adjusted to a color different from the original color, and the adjustment accuracy is reduced.

As described above, it is preferable to execute the brightness adjustment processing of the present invention before the white saturation processing from the viewpoint of the efficiency of image processing and the accuracy of brightness adjustment.

Further, as shown in FIG. 8A, the color data after the brightness adjustment processing of the present invention in the screen brightness adjustment section 26 is [R (360), G (324), B (3).
24)], the drawing unit 27 executes the white saturation processing, and outputs the color data [R (255), G (255), B (25).
5)] is drawn in the frame buffer 28. Then, the display unit 29 reads out the color data of the frame buffer 28 and sets the read data as the color data of the previous frame.
Feedback to Accordingly, the color data of the previous frame fed back to the screen brightness adjustment unit 26 is different from the original color data and is based on the color data subjected to the white saturation processing stored in the frame buffer 28,
Brightness coefficient K obtained by screen brightness adjusting unit 26
_n is not a value that completely reflects the color data of the previous frame.

[0049] obtained based on the original color data of the previous frame the brightness coefficient K _n, for example, the frame buffer 2
8 may be expanded. That is, in the frame buffer 28, the number of bits given to each color data in each pixel data is expanded from 8 bits to the number of bits (for example, 10 bits) that can store the original color data as it is. Thus, the display unit 29 can feed back the original color data to the screen brightness adjustment unit 26. In this case, the brightness coefficient K _n obtained by the screen brightness adjusting unit 26 is supplied to the display unit 29, a display unit 29
May perform the brightness adjustment processing of the present invention. If the display 3 is a device that supports 8-bit color,
The display unit 29 may perform the white saturation processing on the color data read from the frame buffer 28 and output the color data to the display 3.

However, expanding the storage capacity of the frame buffer 28 leads to an increase in the cost of the image processing apparatus.

FIG. 9 is a block diagram showing another configuration of the VDP 20.
FIG. Description of portions different from FIG. 2 in FIG. 9 will be described.
Then, in FIG. 9, the drawing unit 27 includes the screen brightness adjustment unit 26
Divide the pixel data adjusted by
Tile buffer 3 for each area (hereinafter referred to as tile)
Draw at 0. Tile buffer 30 corresponds to one tile
This is a memory in which pixel data to be drawn is drawn. And ta
The file buffer 30 performs a white saturation process on each coordinate data.
Capacity that can store unprocessed original color data (for example,
(10 bits for each color of each coordinate)
You. Then, the second drawing unit 31 includes the tile buffer 30
Read the pixel data drawn on the
Thereafter, the drawing is sequentially performed on the corresponding area of the frame buffer 28.
You. At this time, the second drawing unit 31 performs the processing before the white saturation processing.
The read pixel data is sequentially sent to the screen brightness adjustment unit 26.
give feedback. The screen brightness adjustment unit 26 sequentially
Based on the pixel data to be fed back, ave (Inte
nsity)_n-1Or max (Intensity)_{n -1}To find the previous frame
Pixel data (one frame) corresponding to all the tiles
When the pixel data for the
Brightness coefficient K of next frame _n, And the calculated luminance coefficient
K_nIs applied to the pixel data corresponding to the tile in the next frame.
To use.

The frame buffer 28 includes a second drawing unit 31
, A storage capacity of 8 bits is sufficient for each color of each coordinate. And
The display unit 29 reads out the pixel data of the frame buffer 28 at a predetermined cycle (1/60 second) and outputs it to the display 3.

As described above, by providing the tile buffer 30 for storing the original color data of the pixels included in one tile which is an area sufficiently smaller than one frame, the capacity of the frame buffer 28 can be increased without increasing the capacity.
The calculation of the luminance coefficient Kn based on the original color data becomes possible, and the above-mentioned increase in cost can be suppressed.

FIG. 10 is a block diagram showing still another configuration of the VDP 20. As shown in FIG. 10 will be described. In FIG. 10, the drawing unit 27 includes:
The pixel data generated by the pixel data generation unit 25 is drawn in the tile buffer 30. Then, the reading unit 32 reads the pixel data drawn in the tile buffer 30 at regular intervals, and sends the pixel data to the screen brightness adjusting unit 26. The screen brightness adjustment unit 26, based on the sent pixel data,
Find the above ave (Intensity) _n-1 or max (Intensity) _n-1 ,
When all pixel data constituting one frame was sent to determine the brightness coefficient K _n of the frame. Luminance determined coefficient K _n is temporarily held to be applied to pixel data corresponding to the next frame. Then, the pixel data sent, the brightness coefficient K _n which have already been determined from pixel data corresponding to the previous frame is applied. That is, the screen brightness adjustment unit 26 performs a brightness adjustment process on the pixel data drawn in the tile buffer 30.

The pixel data whose brightness has been adjusted by the screen brightness adjusting section 26 is sent to the second drawing section 31. Second drawing unit 31
Performs white saturation processing on the pixel data and sequentially draws the pixel data on the frame buffer 28. Then, the display unit 29 reads out the pixel data of the frame buffer 28 at a predetermined cycle (1/60 second) and outputs it to the display 3.

In the above-described embodiment of the present invention, the arithmetic expression of the luminance coefficient Kn is not limited to the above expression. Also, ave (Intensity) _n-1 or m used in the above equation
ax (Intensity) _n-1 is not limited to these, and a combination of these or min (Intensity) _n-1 which is the minimum value of luminance may be used.

The scope of protection of the present invention is not limited to the above embodiments, but extends to the inventions described in the claims and their equivalents.

[0058]

As described above, according to the present invention, in the three-dimensional computer graphics technology using polygons, the brightness of each pixel displayed on the screen is automatically adjusted at the stage of rendering. Therefore, unlike the related art, there is no need to perform the brightness adjustment operation using the drawing command of the programmer in the program creation stage of the computer game. Furthermore, natural brightness adjustment suitable for human vision can be performed using a simple arithmetic expression.

[Brief description of the drawings]

FIG. 1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram of a VDP 20.

FIG. 3 is an example of an image that has been subjected to automatic brightness adjustment processing according to the embodiment of the present invention.

FIG. 4 is an example of an image that has been subjected to automatic brightness adjustment processing according to the embodiment of the present invention.

FIG. 5 is an example of an image subjected to automatic brightness adjustment processing according to the embodiment of the present invention.

FIG. 6 is an example of an image subjected to automatic brightness adjustment processing according to the embodiment of the present invention.

FIG. 7 is an example of an image subjected to automatic brightness adjustment processing according to the embodiment of the present invention.

FIG. 8 is a diagram for explaining white saturation processing in the embodiment of the present invention.

FIG. 9 is a block diagram showing another configuration of the VDP 20.

FIG. 10 is a block diagram showing still another configuration of the VDP 20.

FIG. 11 is a diagram showing an example of an image in a conventional computer game.

[Explanation of symbols]

 Reference Signs List 1 computer game device 2 image processing device 3 display 11 CPU 12 RAM 13 ROM 20 VDP 21 VDP control unit 22 drawing command memory 23 texture memory 24 setup unit 25 pixel data generation unit 26 screen brightness adjustment unit 27 drawing unit 28 frame buffer 29 display Part 30 Tile buffer

Claims (16)

[Claims] 1. An image processing apparatus for updating an image of one frame at predetermined intervals, comprising: a generation unit for sequentially generating the image of one frame according to a program given in advance; An image processing apparatus comprising: an adjustment unit that adjusts the luminance of the image of the next second frame based on the luminance. 2. The control unit according to claim 1, wherein the adjusting unit adjusts the brightness of the image of the second frame to be relatively bright when the brightness of the image of the first frame is relatively dark. An image processing apparatus that adjusts the luminance of the image of the second frame to be relatively dark when the luminance of the image of the first frame is relatively bright. 3. The image processing apparatus according to claim 1, wherein the image of the first frame is an image before white saturation processing. 4. The image processing apparatus according to claim 1, wherein the image of the first frame is an image after white saturation processing. 5. The image processing apparatus according to claim 1, wherein the adjusting unit adjusts the image of the second frame and then performs white saturation processing on the image of the second frame. apparatus. 6. The image processing apparatus according to claim 1, wherein the generating unit generates the image for one frame based on luminance data of a plurality of pixels constituting the image. Calculating a luminance coefficient based on luminance data of all or a part of pixels constituting the image of the first frame, and multiplying the luminance coefficient of each pixel constituting the image of the second frame by the luminance coefficient; An image processing apparatus characterized by the above-mentioned. 7. The luminance coefficient according to claim 6, wherein the adjusting unit calculates the luminance coefficient using an average value of luminance data of all or a part of pixels constituting the image of the first frame. Image processing device. 8. The image processing apparatus according to claim 6, wherein the adjustment unit calculates the luminance coefficient using a maximum value of luminance data of all or a part of pixels constituting the image of the first frame. Image processing device. 9. An image processing method for updating an image of one frame at predetermined intervals, comprising: a generating step of sequentially generating the image of one frame according to a program given in advance; Adjusting the luminance of the image of the next second frame based on the luminance. 10. The method according to claim 9, wherein the adjusting step adjusts the brightness of the image of the second frame to be relatively bright when the brightness of the image of the first frame is relatively dark. An image processing method, wherein when the luminance of the image of the first frame is relatively bright, the luminance of the image of the second frame is adjusted to be relatively dark. 11. The image processing method according to claim 9, wherein the image of the first frame is an image before white saturation processing. 12. The image processing method according to claim 9, wherein the image of the first frame is an image after white saturation processing. 13. The image processing method according to claim 9, wherein the adjusting step adjusts the image of the second frame and then white-saturates the image of the second frame. Method. 14. The image processing apparatus according to claim 9, wherein the generating step generates the image for one frame based on luminance data of a plurality of pixels constituting the image. Calculating a luminance coefficient based on luminance data of all or a part of pixels constituting the image of the first frame, and multiplying the luminance coefficient of each pixel constituting the image of the second frame by the luminance coefficient; An image processing method characterized by the following. 15. The method according to claim 14, wherein the adjusting step uses an average value of luminance data of all or a part of pixels constituting the image of the first frame.
An image processing method comprising calculating the luminance coefficient. 16. The method according to claim 14, wherein the adjusting step uses a maximum value of luminance data of all or a part of pixels constituting the image of the first frame.
An image processing method comprising calculating the luminance coefficient.