JP2004185319A - Image processing method and image processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily realize processing to gradually make transparent natural images and the movement of the display positions in an image processing method/device for overlapping a plurality of image inputs. <P>SOLUTION: This image processing method for overlapping a plurality of image input signals comprises a plurality of input means for inputting image input signals and a plurality of blend means for blending images inputted by the plurality of input means. In this case, an input signal other than two image signals to be blended is used as the blend value of a blend part. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an image processing method and an image processing apparatus, and more particularly, to use an image input signal as a coefficient of a superimposition ratio to reduce a ratio when superimposing image input signals other than an image input signal to be blended. The present invention relates to an image processing method and an image processing apparatus that can be arbitrarily changed.
[0002]
[Prior art]
As shown in FIG. 4, an image processing apparatus 10 having a technique for superimposing image input signals according to the related art includes a first input unit 11 that inputs an input signal InA in synchronization with a reference timing signal CLK, A second input section 12 for inputting the input signal InB in synchronization with the timing signal CLK, a third input section 13 for inputting the input signal InC in synchronization with the reference timing signal CLK, and an input in synchronization with the reference timing signal CLK; A fourth input section 14 for inputting the signal InD, a control section 15 for inputting control information CnI and controlling the first to fourth input sections 11 to 14, an image signal GrA from the first input section 11, A first blending unit 16 that inputs and blends the image signal GrB from the input unit 12 and the blend value αB from the second input unit 12; , A blend image signal BrA from the third input unit 13, and a blend value αC from the third input unit 13, and a blend from the second blend unit 17. A third blending unit 18 for inputting and blending the image signal BrB, the image signal GrD from the fourth input unit 14, and the blend value αD from the fourth input unit 13, respectively. A desired image output signal GrO is output.
[0003]
Each of the first to fourth input sections 11 to 14 has the same configuration. Now, the configuration will be described with reference to the second input section 12. As shown in FIG. 5, the input signal InB is temporarily stored. From the FIFO memory 21, a color lookup table (CLUT) 22 which is a table of color information of video signals stored in the FIFO memory 21, a timing signal for inputting the input signal InB into the FIFO memory 21, and the FIFO memory 21. When the timing generation circuit 23 that generates the timing signal to be output to the subsequent stage, the first and second switches SW1 and SW2 (24, 25) for switching the output of the image signal or the blend value, and when the input signal InB itself does not exist Alternatively, when the image signal and the blend value do not exist in the input signal InB, the first and second signals for outputting the fixed value are output. A register 27, and a control circuit 28 for controlling the timing generating circuit 23, the first and second registers 26 and 27.
[0004]
Returning to FIG. 4, each of the first to third blending units 16 to 18 has the same configuration. As shown in FIG. 6, if the input is P and Q, the blend value is α, and the output is O, , In the first to third blending units 16, 17, and 18,
O = α · Q + (1−α) · P = α · (Q−P) + P
Is performed. Here, α is a small number of 0 to 1.
[0005]
The blending unit has a configuration including a subtractor 31 for performing a subtraction of X = Q−P, a multiplier 32 for performing a calculation of Y = X * α, and an adder 33 for performing an addition of O = Y + P. Has become.
[0006]
As described above, the inputs P and Q are input to the subtractor 31 and subjected to the arithmetic processing of X = Q−P. The resulting X is multiplied by the blend value α by the multiplier 32, and the multiplied result Y is added. The input O is added to the output P by the unit 33 to obtain an output O subjected to a desired blending process.
[0007]
In such a configuration, first, the image signals GrA to GrD output from the first to fourth input units 11 to 14 are blended by the first to third blending units 16 to 18 using the blend values αB to αD. Is done. The image signal GrA of the first input unit 11, the image signal GrB of the second input unit 12, and the blend value αB are input to the first blending unit 16, and the blended image signal of the first blending unit 16 is input to the second blending unit 17. BrA, the image signal GrC of the third input unit 13 and the blend value αC are input, and the third blend unit 18 has the blend image signal BrB of the second blend unit 16, the image signal GrD of the fourth input unit 14, and the blend value αD. Is entered.
FIG. 7 illustrates an image superimposition process, in which the input signal InA of the first input unit 11 is background graphics data, and the input signal InB of the second input unit 12 is a natural image such as a moving image or a still image. In this case, by superimposing the natural image of the input signal InB on the screen area including the background graphics data of the input signal InA, it is possible to generate a superimposed image shown on the right side in the drawing.
[0008]
[Patent Document 1]
JP-A-5-308507 (page 2 FIG. 4)
[0009]
[Problems to be solved by the invention]
However, in the image processing apparatus described in the related art, even if two images can be superimposed, the input signal InA is gradually transmitted through the edge portion of the natural image of the superimposed input signal InB. However, there is a problem that it is difficult to perform a process of superimposing the image data on a screen area including background graphics data.
Because, in general, natural image data such as a moving image and a still image often does not have a blend value for each pixel. In this case, the first to fourth input units 11 to 15 output a blend value as a blend value. This is to output a fixed value.
[0010]
Therefore, in order to realize such an effect, conventionally, it was necessary to separately process a natural image input from the outside before inputting the image.
For example, before inputting an image, it was necessary to perform an operation such as temporarily loading the image into a memory and adding a blend value for each pixel by software processing such as a CPU. For this reason, an externally required image capturing device, a CPU for software processing, a memory, a device for outputting an image from the memory, and the like are newly required, resulting in an increase in hardware cost.
[0011]
Further, since a considerable amount of time is required for software arithmetic processing, when this is applied to a moving image, a high performance is required for a CPU or the like, and there is a problem that it cannot be realized in a consumer device such as a TV. .
[0012]
Further, when the input signal InA is a natural image and the input signal InB is graphics data for background as shown in FIG. 8, a similar processing function is used to convert the pixel blend value of the input signal InB into the input signal InA. It is also possible to achieve this by partially translucent in a shape that can accommodate the natural image, but in this case, for example, when trying to achieve the effect of moving the display of the natural image smoothly, There is also a problem that it is necessary to change the blend value of the pixels of the image in real time, and the performance required for software processing therefor is extremely high, so that it is impossible with a consumer device such as a TV.
[0013]
Therefore, by making it possible to use either a blend value or an image signal output from one input unit as a blend value used for blending the other two input signals, it is possible to add a very small scale of hardware to a conventional device. There is a problem that needs to be solved in order to realize a process of gradually increasing transparency and a process of smoothly changing its display position without requiring a necessary high software processing capability or the like.
[0014]
[Means for Solving the Problems]
In order to achieve the above object, an image processing method and an image processing apparatus according to the present invention have the following configurations.
[0015]
(1) An image processing method is an image processing method in which a plurality of image input signals are superimposed, wherein a plurality of input means for inputting the image input signals and respective images input by the plurality of input means are blended. And an input signal other than the two image signals to be blended is used as a blend value of the blending means.
(2) In the image processing method according to (1), the blend value given to the blending unit may be a blend value for each pixel included in one of the two image signals to be blended. , And a blend value switched by a switch unit that switches between a blend value from an input signal other than the two image signals to be blended.
[0016]
(3) In the image processing apparatus for superimposing a plurality of image input signals, the image processing apparatus includes: a plurality of input units for inputting the image input signals; and a unit for blending the images input by the plurality of input units. And a plurality of blending units, and an input signal other than the two image signals to be blended is used as a blend value of the blending unit.
(4) In the image processing device according to (3), the blend value given to the blend unit may be a blend value for each pixel included in one of the two image signals to be blended, and The blend value is switched by a switch unit for switching between a blend value from an input signal other than the two image signals to be blended.
[0017]
In this way, by making either the blend value or the image signal output from one input unit usable as the blend value used for blending the other two input signals, it is possible to add a very small-scale hardware. Therefore, it is possible to easily realize the process of gradually making the natural image transparent and the movement of the display position in the superimposition process without requiring the advanced software processing capability or the like which was conventionally required.
[0018]
BEST MODE FOR CARRYING OUT THE INVENTION
Next, an embodiment of an image processing method and an image processing apparatus according to the present invention will be described with reference to the drawings. The same components as those described in the related art will be described with the same reference numerals.
[0019]
As shown in FIG. 1, an image processing apparatus capable of realizing the image processing method of the present invention is a circuit for blending a plurality of input image signals and superimposing the input image signals. Circuit configuration.
This circuit configuration includes a first input section 11 for inputting an input signal InA in synchronization with a reference timing signal CLK, a second input section 12 for inputting an input signal InB in synchronization with the reference timing signal CLK, and a reference timing signal. A third input unit 13 for inputting the input signal InC in synchronization with the clock signal CLK, a fourth input unit 14 for inputting the input signal InD in synchronization with the reference timing signal CLK, Control of the four input units 11 to 14, a control unit 15 for controlling a first switch SW1 (41), a second switch SW2 (42), and a third switch SW3 (43), which will be described later, and an image from the first input unit 11 The signal GrA, the image signal GrB from the second input unit 12, the blend value αB from the second input unit 12 via the first switch SW1 (41), or the blur of the third input unit 13. A first blending unit 16 for inputting and blending each of the blending values αBC generated at the threshold value αC, a blended image signal BrA from the first blending unit 16, an image signal GrC from the third input unit 13, and a second A second blending operation is performed by inputting the blend value αC from the third input unit 13, the blend value αD from the fourth input unit 14, or the blend value αCD0 including the fixed value “0” via the switch SW2 (42). The blend unit 17, the blend image signal BrB from the second blend unit 17, the image signal GrD from the fourth input unit 14, the blend value αD from the fourth input unit 14 via the third switch SW3 (43), or a fixed value. And a third blending unit 18 for inputting and blending each of the blending values αD0 having the value “0”. Image output signal GrO is output.
[0020]
The first to fourth input units 11 to 14 have the same configuration as the first to fourth input units described in the related art. Now, the configuration will be described with the second input unit 12. As shown in FIG. 5 described above, a FIFO memory 21 for temporarily storing the input signal InB, a color look-up table (CLUT) 22, which is a table of color information of video signals stored in the FIFO memory 21, A timing generation circuit 23 for generating a timing signal for inputting the input signal InB into the FIFO memory 21 and a timing signal for outputting the timing signal from the FIFO memory 21 to a subsequent stage; and a first and second switch SW1 for switching output of an image signal or a blend value. , SW2 (24, 25), when the input signal itself does not exist, or when the image signal and the blend value do not exist in the input signal. First and second registers 26 and 27 for outputting a fixed value, and a control circuit 28 for controlling the timing generating circuit 23, the first and second registers 26 and 27.
[0021]
In the second input unit 12 having such a configuration, first, the input signal InB is fetched into the FIFO memory 21 and temporarily stored in accordance with the fetch timing signal generated by the timing generation circuit 23. The signal is output to the subsequent stage in accordance with the output timing signal generated by the timing generation circuit 23.
If the output signal is the number data of the pixel value data stored in the color look-up table 22, the pixel value data corresponding to the number data is taken out of the color look-up table 22 and sent to the first switch (SW1) 24. input. Alternatively, when the input signal itself does not exist, or when there is no image signal in the input signal, the pixel value data stored in the first register 26 is input to the first switch (SW1) 24.
[0022]
The first switch (SW1) 24 is a switch that is switched using a timing signal generated by the timing generation circuit 23 in accordance with the type and timing of the input signal, and outputs a desired pixel value data image signal GrB.
[0023]
Similarly, when the signal output from the FIFO memory 21 is the number data of the pixel value data stored in the color look-up table 22, the pixel value data corresponding to the number data is extracted from the color look-up table 22, The blend value portion is input to the second switch (SW2) 25.
[0024]
Alternatively, when the output signal includes a blend value, the blend value portion of the output signal itself is input to the second switch (SW2) 25. Alternatively, when the input signal itself does not exist, or when there is no blend value in the input signal, the blend value data held in the second register 27 is input to the second switch (SW2) 25.
[0025]
The second switch (SW2) 25 is a switch that is switched using the timing signal generated by the timing generation circuit 23 in accordance with the type and timing of the input signal, and outputs desired blend value data as the blend value αB.
The control information CnI is control information separated and generated by the control circuit 28 based on control information from a CPU or the like (not shown), and the control circuit 28 controls the timing generation circuit 23 Pixel value data and blend value data stored in the first and second registers 26 and 27 are extracted and generated.
[0026]
Returning to FIG. 1, the first to third blending units 16, 17, and 18 have the same configuration as the first to third blending units described in the related art, and are the same as those in the related art. As shown in FIG. 6, if the input is P and Q, the blend value is α, and the output is O, the first to third blending units 16, 17, and 18
O = α · Q + (1−α) · P = α · (Q−P) + P
Is performed. Here, α is a small number of 0 to 1.
[0027]
The blending unit has a configuration including a subtractor 31 for performing a subtraction of X = Q−P, a multiplier 32 for performing a calculation of Y = X * α, and an adder 33 for performing an addition of O = Y + P. Has become.
As described above, the inputs P and Q are input to the subtractor 31 and subjected to the arithmetic processing of X = Q−P. The resulting X is multiplied by the blend value α by the multiplier 32, and the multiplied result Y is added. The input O is added to the output P by the unit 33 to obtain an output O subjected to a desired blending process.
[0028]
The configuration of the device has been described above. The operation of the device having such a configuration will be described below.
[0029]
First, the image signals GrA to GrD output from the first to fourth input units 11 to 14 are blended by the first to third blending units 16 to 18 using the blend values αBC, αCD0, and αD0.
That is, the image signals GrA, GrB and the blend value αBC are input to the first blending unit 16, and the blended image signal BrA output from the first blending unit 16 and the image of the third input unit 13 are input to the second blending unit 17. The signal GrC and the blend value αCD0 are input, and the blend image signal BrB output from the second blend unit 17 and the image signal GrD and the blend value αD0 of the fourth input unit 14 are input to the third blending unit 18. The output of the third blending unit 18 is output as an image output signal GrO.
[0030]
Here, the blend value αBC is an output obtained by switching the blend value αB of the second input unit 12 and the blend value αC of the third input unit 13 by the first switch (SW1) 41, and the blend value αCD0 is the third input unit 13, the blended value αD of the fourth input unit 14 and the fixed value “0” are output by switching the second switch (SW2) 42. The blended value αD0 is the blended value αD of the fourth input unit 14. , Fixed value “0” is switched by the third switch (SW3) 43.
This switching control is performed by the controller 15A generating switching signals for the first to third switches (SW1 to SW3) 41 to 43 based on control information CnI from a CPU (not shown) or the like. Note that the blend value αA (not shown) of the first input unit 11 is not used.
[0031]
FIG. 2 shows an example of image superposition processing using actual data of the image processing apparatus described above. In this example, when the input signal InA of the first input unit 11 is background graphics data and the input signal InB of the second input unit 12 is a natural image such as a moving image or a still image, the input signal of the third input unit 13 is used. The superimposition processing is performed by using InC as the blend value data of the first blend unit 16.
The input signal InC of the third input unit 13 is a screen area having the same size as the input signal InB of the second input unit 12, and the blend value is formed of gradation data such that both ends of the screen are gradually transparent. .
The blend value αC generated from the input signal InC of the third input unit 13 is selected by the first switch (SW1) 41 and used as the blend value αBC.
[0032]
In the input signal InC in FIG. 2, white represents the blend value 1 and black represents the blend value 0. The output of the first blending unit 16 outputs the image signal component of the input signal InB as the input signal InC becomes white. This indicates that the ratio at which the image signal component of the input signal InA is output increases as the color becomes black.
[0033]
Also, the second and third switches (SW2, SW3) 42, 43 are controlled so that a fixed value “0” is selected, so that the output of the first blending unit 16 is directly used as the image output signal GrO. Can be output. By the above processing, as shown on the right side of FIG. 2, an image in which gradation is applied to both ends of the image of the second input unit InB is superimposed on the image area of the input signal InA of the first input unit 11. Image output can be obtained.
[0034]
Here, the method of generating the blend value αBC used as the blend value includes a case where a signal including only the desired blend value is used as the input signal InC and a case where the color lookup table 22 in the third input unit 13 stores the desired blend value. There are two cases in which pixel data including a value is stored, and the number data of the stored pixel value data is input as an input signal InC.
[0035]
Since the reference timing signal CLK15 is the same in each of the first to fourth input units 11 to 14, the control information CnI for controlling the timing generation circuit 23 in the third and fourth input units 13 and 14 is provided. Simultaneously changing the input timing and the output timing inside the third and fourth input units 13 and 14 make it possible to match the image signal GrB of the second input unit 12 and the blend value of the third input unit 13. αC can be output at the same timing.
As a result, the display position can be easily moved while maintaining the superimposition effect without processing the image signal itself.
[0036]
When four input signals are used as image inputs, it is possible to superimpose four images as in the conventional case. FIG. 3 is an image diagram when images are superimposed using four input signals InA to InD. For example, the input signal InA is background graphics data, the input signal InB is still image data of approximately 1/9 the size of the input signal InA, and the input signal InC is a still image of approximately 1/4 the size of the input signal InA. When the data and the input signal InD are image data composed of codes, as shown on the right side of the figure, the data and the input signal InD are superimposed on the image of the input signal InB at the upper left position, and the image of the input signal InC is obtained. Is superimposed on the substantially center position, and the image of the input signal InD can be superimposed on the lower center position.
[0037]
【The invention's effect】
As described above, the image processing method and the image processing apparatus according to the present invention use either the blend value output from one input unit or the image signal as the blend value used for blending the other two input units. By making it possible to use, by adding a very small amount of hardware, the process of gradually making the natural image transparent at the time of the superimposition process without requiring the conventionally required high software processing capability, and There is an effect that the movement of the display position can be easily realized.
[Brief description of the drawings]
FIG. 1 is a block diagram schematically showing a configuration of an image processing apparatus according to the present invention.
FIG. 2 is an explanatory diagram schematically showing how the image processing apparatus performs blending.
FIG. 3 is an explanatory diagram schematically showing how the image processing apparatus performs blending.
FIG. 4 is a block diagram schematically illustrating a configuration of an image processing apparatus according to the related art.
FIG. 5 is a block diagram schematically illustrating a configuration of a second input unit of the input unit.
FIG. 6 is a block diagram schematically showing a configuration of a blending unit.
FIG. 7 is an explanatory diagram showing a state of blending according to a conventional technique.
FIG. 8 is an explanatory diagram showing a state of blending according to a conventional technique.
[Explanation of symbols]
10A; image processing apparatus, 11; first input section, 12; second input section, 13; third input section, 14; fourth input section, 15A; control section, 16; first blending section, 17; Blending unit, 18; Third blending unit, 21; FIFO memory, 22; Color look-up table, 23; Timing generation circuit, 24; First switch (SW1), 25; Second switch (SW2), 26; Register 27; second register 28; control circuit 31; subtracter 32; multiplier 33; adder 41; first switch (SW1) 42; second switch (SW2) 43; Switch (SW3).

Claims (4)

In an image processing method for superimposing a plurality of image input signals,
A plurality of input means for inputting an image input signal;
A plurality of blending means for blending the respective images input by the plurality of input means,
An image processing method, wherein an input signal other than two image signals to be blended is used as a blend value of the blending means. The image processing method according to claim 1,
The blend value given to the blending means is a blend value for each pixel included in one of the two image signals to be blended, and a blend value from an input signal other than the two image signals to be blended. An image processing method, wherein the blend value is switched by a switch unit that switches between the two. In an image processing apparatus that superimposes a plurality of image input signals,
A plurality of input units for inputting image input signals,
A plurality of blending units for blending the images input by the plurality of input units,
An image processing apparatus, wherein an input signal other than two image signals to be blended is used as a blend value of the blend unit. The image processing device according to claim 3,
The blend value given to the blend unit is a blend value for each pixel included in one of the two image signals to be blended, and a blend value from an input signal other than the two image signals to be blended. An image processing apparatus characterized in that the blend value is switched by a switch unit for switching between the two.

Images