JP4466234B2 - Image processing method and apparatus - Google Patents

Description

  The present invention relates to an image processing apparatus used for a game machine or the like, and more particularly to an image processing method and apparatus for improving display of a boundary portion of a character image.

  As is well known, image display methods using sprites are widely used in pachinko and other game machines. FIG. 5 is a diagram showing the configuration of a display system using this sprite display method. In this figure, 1 is a CPU (central processing unit), 2 is an image processing device, and 3 is a pattern in which sprite patterns are stored in advance. ROMs 4 and 4 are display devices such as a liquid crystal display. In such a configuration, the image processing apparatus 2 receives sprite attribute data indicating the number of sprites to be displayed, a display position, a rendering process parameter, and the like from the CPU 1 and writes them in the internal sprite attribute table. Here, the rendering process parameter is a parameter for instructing a rendering process such as enlargement, reduction, or deformation of a sprite. The image processing device 2 reads a sprite pattern from the pattern ROM 3 based on the attribute data written in this table, performs processing such as enlargement / reduction based on the rendering processing parameters, and then outputs the display to the display device 4 for display. . FIG. 6 shows an example of the sprite pattern SP, the symbol C indicates a character displayed in this pattern, and D indicates a transparent portion.

  Incidentally, in the above-described image display using sprites, when the sprite pattern is enlarged, reduced, or deformed, there is a problem that the color difference between adjacent dots (pixels) is emphasized and the display color does not change smoothly. Therefore, conventionally, in order to prevent this problem, bilinear filter interpolation processing is performed.

FIG. 7 is a diagram for explaining bilinear filter interpolation processing associated with enlargement processing, for example. In this figure, rgb (x, y) is a color indicating the color of the dot at the coordinates (x, y) after enlargement. It is data. Also, rgb (m, n), rgb (m + 1, n), rgb (m, n + 1), and rgb (m + 1, n + 1) are calculated display positions when the adjacent four dots before enlargement are enlarged (m , N), (m + 1, n), (m, n + 1), and (m + 1, n + 1) color data. These display positions are the nearest calculated dots that surround the coordinates (x, y). Note that m and n are integers. In the figure, p and q are values calculated from the coordinates (x, y) and the coordinates (m, n), (m + 1, n), (m, n + 1), (m + 1, n + 1) by the following equation. .
p = coordinate value x-coordinate value m
q = coordinate value y-coordinate value n

And rgb (x, y) is calculated | required by following Formula.
rgb (x, n) = (1−p) × rgb (m, n) + p × rgb (m + 1, n)
rgb (x, n + 1) = (1-p) × rgb (m, n + 1) + p × rgb (m + 1, n + 1)
rgb (x, y) = (1-q) * rgb (x, n) + q * rgb (x, n + 1)

In addition, the applicant of the present application previously as a sprite image display device,
Japanese Patent Application No. 2003-001140
Japanese Patent Application No. 2004-049377
Has been filed.

By the way, the above-described bilinear filter interpolation processing has the following problem in the boundary line portion of the character. That is, in FIG. 6, the outside of the boundary line of the character C is the transparent data D. Therefore, when sprite enlargement or the like is performed, the color data rgb (m, n), rgb (m + 1) in FIG. , N), rgb (m, n + 1), or rgb (m + 1, n + 1) may be transparent data. Then, when the above bilinear filter interpolation processing is calculated in the state in which transparent data is included in the four surrounding data, the luminance of the boundary portion is lowered as a result, the boundary portion becomes conspicuous, the background and There is a problem that smoothing is not possible.
The present invention has been made in view of the above circumstances, and an object of the present invention is to provide an image processing method and apparatus capable of smoothly and neatly displaying a boundary portion between a character and a background image.

The present invention has been made in order to solve the above-described problems. The present invention provides an image processing method for displaying a display pattern after performing a predetermined rendering process on the display pattern. A first process for obtaining the coordinates of the display dots to be actually displayed, the coordinates of the actual display dots, the coordinates of the four display points around the display dots, Based on the color data to be displayed at the four display points, two sets of two display points having the same coordinate value are determined for the x-axis coordinate value or the y-axis coordinate value of the four display points. It performs linear interpolation, to calculate the color data to be displayed on the actual display dot by composed bilinear interpolation by the linear interpolation between the color data of the two resulting two-point linear interpolation A process, wherein when one of the color data of the respective underlying two points calculation of linear interpolation were clear data, the color data after linear interpolation as the basis for calculation of linear interpolation 2 An image processing method comprising: a second process for processing the same color data as that of the other point.

Further, the present invention performs a predetermined rendering process on display data including color data indicating the display color of each display dot constituting the display pattern and α data indicating a mixing ratio of the color data and the color data of the background image. In the image processing method to be displayed after being performed, a first process for obtaining the display coordinates of the display dots to be actually displayed and a display coordinate of the display dots to be actually displayed by the display pattern rendering process, and the actual display Based on the coordinates of the dots, the coordinates of the four display points around the display dot, and the color data to be displayed on the four display points, the x-axis coordinate value or the y-axis of the four display points For two coordinate points, two sets of two display points having the same coordinate value are determined, linear interpolation is performed for each group, and linear interpolation between the two color data obtained as a result of the two linear interpolations is performed. In in a process of calculating the color data to be displayed on the actual display dot by configured bilinear interpolation, whereas color data transparent data of the two points as the basis of calculation of the respective linear interpolation A second process for processing the color data after linear interpolation as being the same as the color data of the other of the two points that are the basis of the calculation of linear interpolation, and the rendering process. Based on the four α data corresponding to the four display points in the calculation around the actual display dots, the coordinates of the four display points, and the coordinates of the actual display dots, the actual data is obtained by linear interpolation. The third process for calculating the α data of the display dot, the color data calculated by the second process, and the color data of the background image are calculated by the third process. The image processing method characterized by having a fourth process of obtaining the display data are mixed in a ratio based on the α data.

Further, the present invention reads out the display pattern from the storage means storing the display pattern, and obtains the display coordinates of the calculated display point by rendering processing of the read display pattern and actually displays it. Coordinate calculating means for obtaining the coordinates of the power display dots, the coordinates of the actual display dots, the coordinates of the four display points around the display dots, and the color data to be displayed at the four display points. Based on the x-axis coordinate value or the y-axis coordinate value of the four display points, two sets of two display points having the same coordinate value are determined, linear interpolation is performed for each set, and the two linear interpolations are performed. the composed bilinear interpolation by the linear interpolation between the results color two points obtained data to calculate the color data to be displayed on the actual display dots, group of calculations of the respective linear interpolation If one of the color data of the two points to be were clear data, the color data after linear interpolation same as the color data of the other points of the underlying two-point calculation of linear interpolation An image processing apparatus comprising color data calculation means for calculating as being present.

Further, the present invention is an image processing apparatus described above, the color data calculation means, calculating coefficients used when the color data for one or more points of the four display points were clear data is written When the color data of one or more of the four display points is transparent data, the calculation coefficient is read from the decode table and the color data is calculated.

Further, the present invention performs a predetermined rendering process on display data including color data indicating the display color of each display dot constituting the display pattern and α data indicating a mixing ratio of the color data and the color data of the background image. In the image processing apparatus to be displayed after being performed, the coordinate calculation means for obtaining the display coordinates of the display dots to be actually displayed as well as the display coordinates of the display dots to be actually displayed by the rendering processing of the display pattern, and the actual display dots Of the four display points around the display dot, and the color data to be displayed on the four display points, the x-axis coordinate value or the y-axis coordinate value of the four display points For coordinate values, two sets of two display points with the same coordinate value are determined, linear interpolation is performed for each set, and linear interpolation between the two color data obtained as a result of the two linear interpolations is performed. If the calculated color data to be displayed on the actual display dots, one of the color data of the two points as the basis of calculation of the respective linear interpolation were clear data by configured bilinear interpolation by the Includes color data calculation means for processing the color data after linear interpolation as being the same as the color data of the other of the two points that are the basis of the calculation of linear interpolation, and the actual data obtained by the rendering process. Based on the four α data corresponding to the four display points in the calculation around the display dots, the coordinates of the four display points, and the coordinates of the actual display dots, the actual display is performed by linear interpolation. and α data calculation means for calculating a dot of α data, the α data calculation and color data of the color data and background image calculated by said color data calculation means An image processing apparatus characterized by comprising a mixing means for obtaining a display data are mixed in a ratio based on the α data calculated by the stage.

  According to the present invention, it is possible to display the boundary portion between the character and the background image smoothly and cleanly.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. 1 is a block diagram showing a configuration of a bilinear filter interpolation processing unit in an image processing apparatus according to an embodiment of the present invention, FIG. 2 is a decoding table showing processing contents of an arithmetic coefficient decoder 32 in FIG. 1, and FIG. 3 is image processing. It is a block diagram which shows the whole apparatus structure.

Prior to the description of the image processing apparatus, the α data and unacceptable processing used in this apparatus will be described. The uncertain process is a process for smoothly displaying the boundary line of the character. In dot display, an oblique boundary line is displayed in a jagged manner, and a process for smoothing this jaggedness is an uncertain process. In FIG. 4, a curve L is a character boundary, a hatched portion is a character, and the others are transparent portions. In each dot through which the boundary line L passes, the proportion of the character portion is
0.46 0.98 0.70 0.15 0.95 0.75 0.36 0.04 ・ ・ ・
In this case, this numerical value is stored for each dot through which the boundary line passes, data “1” is stored for each dot in the character portion, and data “0” is stored for each dot in the transparent portion, corresponding to each dot in the sprite pattern. To do. This stored data is called α data. In sprite display, the color data of the character is multiplied by the α data, the color data of the background color is multiplied by (1−α), and the multiplied data are added and written to the frame buffer. . As a result, the color of the boundary line portion is a color obtained by mixing the character color and the background color, and the jagged edges of the boundary line are displayed smoothly.

  In FIG. 3, reference numeral 3 denotes a pattern ROM, which stores a plurality of sprite patterns compressed and stores α data corresponding to each pattern. Reference numeral 13 denotes a sprite attribute table, in which sprite attribute data is registered by a CPU (not shown). Here, the sprite attribute data includes the storage address of the sprite pattern in the pattern ROM 3, rendering processing parameters for instructing the enlargement, reduction, rotation, deformation, etc. of the pattern, data for instructing the display position, and the like. A decode controller 14 controls the decoding (decompression) processing of the compressed sprite pattern and α data in the pattern ROM 3. A ROM interface 15 outputs a read address to the pattern ROM 3, and outputs a sprite pattern and α data read from the pattern ROM 3 to the decoder 16.

  The decoder 16 decodes (expands) the sprite pattern and α data read from the pattern ROM 3 and outputs them to the sprite buffer interface 17. The sprite buffer interface 17 develops the sprite pattern and α data output from the decoder 16 in the sprite buffer 18. In response to an instruction from the rendering engine 21, the sprite pattern and α data in the sprite buffer 18 are read and output to the rendering engine 21. Here, the sprite buffer 18 has a capacity capable of developing a plurality of sprite patterns and α data. A rendering controller 20 reads the sprite attribute data in the sprite attribute table 13 and outputs the read attribute data to the rendering engine 21.

  The rendering engine 21 performs a rendering process of the sprite pattern and α data read from the sprite buffer 18 in accordance with an instruction from the rendering controller 20, and then performs the sprite pattern and α processing by the bilinear filter interpolation processing unit in FIG. 1 in the rendering engine 21. Data bilinear filter interpolation processing and α blending processing are performed, and processed data are output to the frame buffer interface 22.

  The frame buffer interface 22 draws the frame buffer 23 based on the sprite pattern and α data output from the rendering engine 21. That is, the frame buffer interface 22 first multiplies each color data of the sprite pattern by α data. Next, the color data of the background image is read from the frame buffer 23, and each read color data is multiplied by (1-α). Next, display data is generated by adding the data after multiplication, and the generated display data is overwritten on the frame buffer.

  Further, the frame buffer interface 22 receives an instruction from the display controller 25, reads display data from the frame buffer 23, and outputs the display data to the display controller 25. The frame buffer 23 is a memory in which pattern data is written in correspondence with the display dots of the display device 4, and has a double buffer configuration for drawing / display. The display controller 25 generates various timing signals for image display and outputs them to the display device 4, and outputs the display data read from the frame buffer 23 to the display device 4 in synchronization with the timing signals. .

Next, the bilinear filter interpolation processing unit shown in FIG. 1 will be described.
In the figure, reference numeral 31 denotes an α data interpolation circuit, which obtains α data after interpolation by the calculation described in FIG. That is, the coordinates (x, y) obtained by the rendering process and the coordinates (m, n), (m + 1, n), (m, n + 1), (m + 1, n + 1) of four points surrounding the coordinates (x, y). ) To obtain data p and q, and then α (m, n), α (m + 1, n), α (m, n + 1), α (m + 1, n + 1), which are α data of four points. ), Α (x, y) which is α data after interpolation is obtained by the following equation.
α (x, n) = (1−p) × α (m, n) + p × α (m + 1, n)
α (x, n + 1) = (1−p) × α (m, n + 1) + p × α (m + 1, n + 1)
α (x, y) = (1−q) × α (x, n) + q × α (x, n + 1)

  Reference numeral 32 denotes an arithmetic coefficient decoder. The arithmetic coefficient decoder firstly has coordinates (x, y) obtained by rendering processing and four coordinates (m, n), (m + 1, n), (m, n + 1) surrounding the coordinates (x, y). ), (M + 1, n + 1), data p and q are obtained. Next, it is checked whether or not there is transparent data in rgb (m, n), rgb (m + 1, n), rgb (m, n + 1), and rgb (m + 1, n + 1) which are the four color data. If there is data, the data is set to “1”. If the data is not transparent, the data is set to “0” to obtain 4-bit data. Next, the 4-bit data is converted into six operation coefficients by a decode table (FIG. 2) stored in advance.

For example, if rgb (m, n), rgb (m + 1, n), rgb (m, n + 1), and rgb (m + 1, n + 1) are not transparent data, the 4-bit data is “0000” and decoded. The next calculation coefficient is obtained from the first row of the table.
p (n) '= p
np (n) ′ = 1−p
p (n + 1) ′ = p
np (n + 1) ′ = 1−p
q ′ = q
nq ′ = 1−q

For example, when only rgb (m, n) is transparent data, the 4-bit data is “0001”, and the next calculation coefficient is obtained from the second row of the decode table.
p (n) ′ = 1
np (n) ′ = 0
p (n + 1) ′ = p
np (n + 1) ′ = 1−p
q ′ = q
nq ′ = 1−q

If all the four data are transparent data, the 4-bit data is “1111”, and the next calculation coefficient is obtained from the 16th row of the decoding table.
p (n) ′ = 0
np (n) ′ = 1
p (n + 1) ′ = 0
np (n + 1) ′ = 1
q ′ = 0
nq ′ = 1
Then, the arithmetic coefficient decoder 32 outputs the arithmetic coefficient thus obtained to the sprite pattern interpolation circuit 33.

The sprite pattern interpolation circuit 33 performs the same interpolation calculation as described with reference to FIG. 7 using the above-described calculation coefficients, and obtains color data rgb (x, y) after the interpolation processing. That is, the color data rgb (x, y) is obtained by the following calculation.
rgb (x, n) = np (n) ′ × rgb (m, n) + p (n) ′ × rgb (m + 1, n)
rgb (x, n + 1) = np (n + 1) ′ × rgb (m, n + 1) + p (n + 1) ′ × rgb (m + 1, n + 1)
rgb (x, y) = nq ′ × rgb (x, n) + q ′ × rgb (x, n + 1)

  Reference numeral 34 denotes an α blending circuit, which multiplies the color data rgb (x, y) output from the sprite pattern interpolation circuit 33 by α (x, y) output from the α data interpolation circuit 31, and the frame buffer 23. The background color data read out from 1 is multiplied by 1−α (x, y), and the data obtained by adding the multiplication results is written in the frame buffer 23.

  As described above, in this embodiment, when one or more of the four data used in the bilinear filter interpolation processing is transparent data, the transparent data is not used for calculation and there is no data. Treat as a thing. In other words, the color data after the interpolation process is processed as being the same as the color data of the other point out of the two points that are the basis of the linear interpolation calculation. By this process, the marking of the boundary between the character and the transparent portion can be performed smoothly and cleanly.

  The present invention is used for a display device of a game machine.

It is a block diagram which shows the structure of the bilinear filter interpolation process unit in the image processing apparatus by one Embodiment of this invention. It is a figure which shows the decoding table memorize | stored and held in the arithmetic coefficient decoder 32 in FIG. 1 is a block diagram illustrating a configuration of an image processing apparatus according to an embodiment of the present invention. It is explanatory drawing for demonstrating the uncertain process performed in the image processing apparatus. It is a block diagram which shows the basic composition of the image processing apparatus by a sprite. It is a figure which shows an example of the sprite pattern SP. It is explanatory drawing for demonstrating a bilinear filter interpolation process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 3 ... Pattern ROM, 4 ... Display apparatus, 11 ... Image processing apparatus, 21 ... Rendering engine, 23 ... Frame buffer, 31 ... Alpha data interpolation circuit, 32 ... Arithmetic coefficient decoder, 33 ... Sprite pattern interpolation circuit, 34 ... Alpha blending circuit.

Claims (5)

In an image processing method for displaying a display pattern after performing a predetermined rendering process,
First processing for obtaining display coordinates of display points to be actually displayed, as well as obtaining display coordinates of display points in calculation by rendering processing of the display pattern;
Based on the coordinates of the actual display dots, the coordinates of the four display points calculated around the display dots, and the color data to be displayed on the four display points, the coordinates of the four display points on the x axis For two values or y-axis coordinate values, two sets of two display points having the same coordinate value are determined, linear interpolation is performed for each set, and linear interpolation between the two color data obtained as a result of the two linear interpolations is performed. Is a process for calculating color data to be displayed on the actual display dot by bilinear interpolation , wherein one of the two color data serving as a basis for the calculation of each linear interpolation is transparent data. A second process for processing the color data after linear interpolation as being the same as the color data of the other of the two points that are the basis of the calculation of linear interpolation;
An image processing method comprising: An image to be displayed after predetermined rendering processing is performed on display data including color data indicating the display color of each display dot constituting the display pattern and α data indicating the mixing ratio of the color data and the color data of the background image In the processing method,
First processing for obtaining display coordinates of display points to be actually displayed, as well as obtaining display coordinates of display points in calculation by rendering processing of the display pattern;
Based on the coordinates of the actual display dots, the coordinates of the four display points calculated around the display dots, and the color data to be displayed on the four display points, the coordinates of the four display points on the x axis For two values or y-axis coordinate values, two sets of two display points having the same coordinate value are determined, linear interpolation is performed for each set, and linear interpolation between the two color data obtained as a result of the two linear interpolations is performed. Is a process for calculating color data to be displayed on the actual display dot by bilinear interpolation , wherein one of the two color data serving as a basis for the calculation of each linear interpolation is transparent data. A second process for processing the color data after linear interpolation as being the same as the color data of the other of the two points that are the basis of the calculation of linear interpolation;
Based on the four α data corresponding to the four display points in the calculation around the actual display dots obtained by the rendering process, the coordinates of the four display points, and the coordinates of the actual display dots. A third process for calculating α data of the actual display dot by linear interpolation;
A fourth process of obtaining display data by mixing the color data calculated by the second process and the color data of the background image at a ratio based on the α data calculated by the third process;
An image processing method comprising: Storage means for storing display patterns;
Coordinate calculation means for reading the display pattern from the storage means, obtaining display coordinates of display points for calculation by rendering processing of the read display pattern, and obtaining coordinates of display dots to be actually displayed;
Based on the coordinates of the actual display dots, the coordinates of the four display points calculated around the display dots, and the color data to be displayed on the four display points, the coordinates of the four display points on the x axis For two values or y-axis coordinate values, two sets of two display points having the same coordinate value are determined, linear interpolation is performed for each set, and linear interpolation between the two color data obtained as a result of the two linear interpolations is performed. When the color data to be displayed on the actual display dot is calculated by bilinear interpolation composed of: and one of the two color data serving as the basis of the calculation of each linear interpolation is transparent data Includes color data calculation means for calculating the color data after linear interpolation as being the same as the color data of the other of the two points that are the basis of the calculation of linear interpolation;
An image processing apparatus comprising: The color data calculation means has a decoding table in which calculation coefficients used when the color data of one or more of the four display points is transparent data are included. the image processing apparatus according to claim 3, color data of one or more points and performing calculation of the color data read the operation coefficient from the decode table when was transparent data. An image to be displayed after predetermined rendering processing is performed on display data including color data indicating the display color of each display dot constituting the display pattern and α data indicating the mixing ratio of the color data and the color data of the background image In the processing device,
The coordinate calculation means for obtaining the display coordinates of the display dots to be actually displayed, as well as obtaining the display coordinates of the calculated display points by the rendering process of the display pattern;
Based on the coordinates of the actual display dots, the coordinates of the four display points calculated around the display dots, and the color data to be displayed on the four display points, the coordinates of the four display points on the x axis For two values or y-axis coordinate values, two sets of two display points having the same coordinate value are determined, linear interpolation is performed for each set, and linear interpolation between the two color data obtained as a result of the two linear interpolations is performed. When the color data to be displayed on the actual display dot is calculated by bilinear interpolation composed of: and one of the two color data serving as the basis of the calculation of each linear interpolation is transparent data Includes color data calculation means for processing the color data after linear interpolation as being the same as the color data of the other of the two points that are the basis of the calculation of linear interpolation,
Based on the four α data corresponding to the four display points in the calculation around the actual display dots obtained by the rendering process, the coordinates of the four display points, and the coordinates of the actual display dots. Α data calculating means for calculating α data of the actual display dots by linear interpolation;
Mixing means for obtaining display data by mixing the color data calculated by the color data calculating means and the color data of the background image at a ratio based on the α data calculated by the α data calculating means ;
An image processing apparatus comprising:

Images