JP2010191835A - Device and method for simulating image processing circuit, method for designing image processing circuit, and image processing circuit simulation program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device for simulating an image processing circuit, which can find a combination of parameter values of an optimal image processing module in a short period of time. <P>SOLUTION: The device for simulating the image processing circuit includes: a plurality of image processing modules which can be executed on a computer and have a function corresponding to each partial image processing circuit; a means 61 for selecting a parameter for changing values among parameters of the plurality of image processing modules; a means 62 for setting a condition for changing the value of the selected parameter; a means 63 for executing changing of the value of the parameter and setting the changed value; a means 64 for repeating sequential execution of the image processing modules about the whole combinations of respective parameter values that are set, and performing image processing of input image data; and a means 7 for outputting result data after image processing of the image data by an executed image processing module. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an image processing circuit simulation apparatus, an image processing circuit simulation method, an image processing circuit design method, and an image processing circuit simulation program.

2. Description of the Related Art Conventionally, programs for simulating results of executing various functions are known for function evaluation and debugging of software systems that can execute a plurality of functions.
For example, the test sequencer described in Patent Document 1 is configured to include a management module and an execution module. When a new function is added to a test executive to be tested or a function is corrected, Proposals have been made to easily check whether or not the function interferes.

Further, in the software test apparatus described in Patent Document 2, an apparatus that interfaces with input and output to software to be verified and receives and evaluates an output group according to an operation procedure, setting contents, and the like has been proposed. .
Further, in the software component system described in Patent Document 3, pre-condition definition information indicating a state before executing another software component and post-condition definition information indicating a subsequent state are stored in the database in executing the software component. Aside, it has been proposed to accurately test software components.

By the way, in an image display device such as a projector or an FPD (Flat Panel Display), image processing is performed on input image data to form an appropriate display image. Is expanding.
Therefore, it is possible to form an image processing circuit capable of performing multi-functional image processing by combining various image processing such as color conversion, resolution conversion, gamma conversion and the like into a partial image processing circuit that is chipped in units of image processing. Has been done.
Conventionally, when designing such an image processing circuit, a technique has been adopted in which partial image processing circuits are prototyped, combined with each other to form an image processing circuit and evaluated.

JP 2006-53924 A JP 2006-48310 A JP 2006-91944 A

However, the trial production of such a partial image processing circuit has a problem that not only error verification takes time but also the trial production cost increases.
In addition, there are a number of partial image processing circuits that are incorporated into the image processing circuit as the functions increase even if they are actually incorporated into the image processing circuit, and it is possible to specify which parameter is effective when adjusted. There is a problem that it is very difficult.
Furthermore, although the effects of individual functions are difficult to understand, there are also combinations of parameters that reveal the effects only when the functions are combined, and it is very difficult to verify this.
In general, a display image formed by an image display device is composed of a large number of pixels. However, it is difficult to evaluate the result of processing by the partial image processing circuit for each pixel. 3 cannot simply be applied to the world of image display devices.

  The present invention can be realized as the following application examples or forms so as to solve at least one of the above-described problems.

  Application Example 1 An image processing circuit simulation apparatus according to this application example is an image processing circuit simulation apparatus that simulates the operation of an image processing circuit configured by combining a plurality of partial image processing circuits. A plurality of image processing modules having a function corresponding to each of the partial image processing circuits, and a parameter for selecting a parameter of the image processing module whose value is to be changed among parameters of the plurality of image processing modules. A plurality of image processing for a combination of a selection means, a parameter value changing means for setting a parameter value changing condition selected by the parameter selecting means, and a parameter value changing condition set by the parameter value changing means The modules are executed sequentially and the input image Module execution means for performing image processing of data; and result data output means for outputting result data after image processing of the image data by the image processing module executed by the module execution means. .

According to this application example, the parameter combination of the partial image processing circuit to be mounted on the image processing circuit is converted into the parameter of the image processing module corresponding to the partial image processing circuit by the parameter selection unit, the parameter value changing unit, and the module execution unit. Can be combined on software, and the result data output means can check the results of image processing, so there is no need to prototype a partial image processing circuit, etc. In addition, simulation of image processing of the image processing circuit can be performed.
Further, by performing such combination simulation on software, it is possible to perform simulation for all combinations in a short time, and to find the optimum combination of parameters of the partial image processing circuit.

  Application Example 2 The image processing circuit simulation apparatus according to the application example records the parameters of the image processing module selected by the parameter selection unit and the parameter value changing conditions set by the parameter value changing unit. It is preferable to provide parameter value changing condition writing means for writing to the medium.

  According to this application example, since the parameter value change condition writing means is provided, it is possible to check the combination of the simulation performed in the past and the execution result at any time by reading from the recording medium. In designing the above, it is possible to set a more efficient combination of parameters of the partial image processing circuit and execution procedure with reference to this.

  Application Example 3 In the image processing circuit simulation apparatus according to the application example described above, the parameter value changing condition includes the parameter number for changing the parameter value, the number of levels indicating the number of change stages, and addition or subtraction for each level. It is preferable that an increase / decrease value indicating a value to be performed is provided.

Application Example 4 In the simulation apparatus for an image processing circuit according to the application example, the result data output unit displays a result image after image processing on the image display device based on the output result data. It is preferable to provide.
Here, the result image display unit may display the image processing result in each image processing module as a result image, or may display the image processing results of a plurality of image processing modules as a result image.

  According to the above application example, the observer can visually confirm the result image by each image processing module and the result of the plurality of image processing by the combination of the parameters of the plurality of image processing modules. It is possible to easily confirm which parameter combination is executed to improve or deteriorate the image quality.

Application Example 5 In the image processing circuit simulation apparatus according to the application example described above, it is preferable that the result data output unit includes a result data writing unit that writes the output result data onto a recording medium.
According to this application example, by writing the result data to the recording medium, it becomes possible to compare the input image data and the result data on the data. It is possible to automatically quantify and evaluate the degree of image quality improvement or deterioration of both.

  Application Example 6 In the image processing circuit simulation apparatus according to the application example, it is preferable that the plurality of image processing modules include at least a resolution conversion module, a color conversion module, and a gamma characteristic conversion module.

  According to this application example, among various types of image processing, resolution conversion, color conversion, and gamma characteristic conversion include color conversion processing, sharpness processing, and contrast processing in the modules that execute each image processing. Depending on the order of image processing, the image quality of the resulting image after image processing may vary. Therefore, by including at least these image processing modules in the plurality of image processing modules, it is possible to find a combination of parameters of the image processing modules that can obtain an optimum result image.

  The present invention is established not only as the above-described image processing circuit simulation apparatus but also as the image processing circuit simulation method described in the following application examples, and can enjoy the same operations and effects as those described above. .

  Application Example 7 An image processing circuit simulation method according to this application example is an image processing circuit simulation method for simulating the operation of an image processing circuit configured by combining a plurality of partial image processing circuits. Selecting a parameter of an image processing module whose value is changed on a computer from among a plurality of parameters of the image processing module having a function corresponding to each of the partial image processing circuits. A step of setting a parameter value change condition of the image processing module, a step of sequentially executing the image processing module and performing image processing of input image data for all combinations of the set parameter values; The image data by the processed image processing module Which comprises carrying out the step of outputting the result data after the image processing results on a computer.

  Application Example 8 The image processing circuit design method according to this application example is an image processing circuit design method configured by combining a plurality of partial image processing circuits, and the image described in the application example described above. A simulation method of the processing circuit is performed to obtain an optimal combination of parameter values of the image processing module, and then a combination of parameter values of the partial image processing circuit in the image processing circuit is determined.

  According to the application example, as described above, the optimum combination of the parameter values of the image processing module can be obtained on the software by the image processing circuit simulation method of the application example. Can be determined in a short time and at low cost, and the design of the image processing circuit, and thus the manufacturing cost can be greatly reduced.

  Application Example 9 Further, an image processing circuit simulation program according to this application example causes a computer to execute the above-described image processing circuit simulation method.

  According to this application example, the same operations and effects as those of the application example described above can be enjoyed.

1 is a block diagram illustrating a simulation apparatus for an image processing circuit according to an embodiment of the present invention. The schematic diagram showing the execution screen of the simulation device of the image processing circuit in an embodiment. The schematic diagram showing the parameter setting screen of the simulation apparatus of the image processing circuit in the embodiment. The table showing the execution procedure and parameter of the image processing module in an embodiment. The table showing the parameter in embodiment. The flowchart showing the effect | action of the simulation apparatus of the image processing circuit in embodiment. The flowchart showing the parameter value change execution means in embodiment. The data block diagram for demonstrating the effect | action of the simulation apparatus of the image processing circuit in embodiment. The graph showing the example of the state of the image processing result of the image processing module in embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 shows a simulation apparatus 1 according to an embodiment of the present invention. The simulation device 1 is configured as a computer including an arithmetic processing device 2 and a memory 3. The simulation apparatus 1 can simulate the operation of an image processing circuit configured by combining a plurality of partial image processing circuits.
In the memory 3, a program for executing the image processing circuit simulation according to the present embodiment and various image processing modules are stored. Each image processing module is software executable on a computer and has a function corresponding to each partial image processing circuit.
Although not shown in the figure, the input side of the simulation apparatus 1 is connected to an image data output device such as a scanner, digital camera, hard disk device or the like, and an input for evaluation for evaluating the image after the image processing result from each device. Image data VIDEO is input.

On the other hand, a hard disk device (HDD) 4 as a storage medium and a display 5 as an image display device are connected to the output side of the simulation apparatus 1.
As will be described in detail later, the hard disk device 4 stores an image processing module selected by the simulation device 1, its execution procedure, and result data obtained by performing image processing by each image processing module.
A display image is formed on the display 5 based on the result data obtained by performing the image processing of the image processing module.

  The arithmetic processing unit 2 includes a parameter management unit 6, a result data output unit 7, and a parameter value change condition writing unit 8. Each of these functional units (parameter management unit 6, result data output unit 7, The parameter value changing condition writing means 8) is configured as a program group executed on the OS (Operating System) of the arithmetic processing unit 2. These functional means are stored in the memory 3 and are activated when a predetermined icon displayed on the display 5 is selected while the simulation apparatus 1 is activated. By displaying the screen G1 as shown, the operator is prompted to input, and the parameter selection of the image processing module and the parameter value changing condition are set according to the selection result based on the input of the operator.

The module name displayed by default on the screen G1 reads and displays the image processing module stored in the memory 3 in advance. In order to read out a new image processing module, the parameter value reading button G4 in the lower right on the screen G1 is clicked, and the parameters of the new image processing module are read out by selecting the image processing module to be read out on the selection screen. Be able to.
Note that the image processing module needs to cover all image processing performed by the image display device to be subjected to image processing. In particular, the conversion processing from the RGB color space to the Yuv color space, and the inverse of the color space conversion processing. Examples include conversion processing, gamma characteristic conversion, and conversion processing from high resolution to low resolution.
These image processes are common in that sharpness processing, contrast processing, and color conversion processing are performed in the in-module processing. Depending on the order of image processing, the processing may interfere with each other in the image processing result image. This is because a phenomenon such as a general defect or color unevenness of the entire image may be emphasized.

The parameter management means 6 is a part for selecting a parameter of the image processing module, setting a parameter value change condition for the selected image processing module, and executing the image processing module. A change setting unit 62, a parameter value change execution unit 63, and a module execution unit 64 are provided.
The parameter selection means 61 is a part for selecting the parameter file of the image processing module, and as shown in FIG. 2, a screen G1 prompting the operator to select is displayed on the display 5, and the operator selects the screen G1. The parameter file of the image processing module selected in is selected as the parameter file of the image processing module to be executed.

  The parameter selection of the image processing module on the screen G1 by the operator selects the image processing module on the screen G1 and its parameter list item area G2, clicks the parameter value read button G4, the Enter key from the keyboard, or the mouse Do this by double clicking the left button.

  The parameter value change setting means 62 is a part for setting the change means for the parameter selected by the parameter selection means 61. The parameter value change setting means 62 allows the operator to select an image processing module as in the list item area G2 on the screen G1 shown in FIG. 2, and subsequently, a parameter change condition change button G5 at the bottom of the screen G1. Is clicked with the mouse, a screen P1 as shown in FIG. 3 is displayed on the display 5, and a parameter value changing condition is set.

  On the screen P1, a parameter changing condition for the image processing module selected on the screen G1 is set. When the radio button P2 is clicked, it is specified that all parameters are set in common, and the parameter range P4 becomes invalid. When the radio button P3 is clicked, a change condition can be set for each parameter, and the parameters specified in the parameter range P4 can be specified.

The parameter range P4 is a minimum value and a maximum value of item numbers indicating the range of parameters to be changed. The number of levels P5 is the number of levels to be changed by increasing or decreasing the parameter value, and specifies a positive odd number. The increase / decrease value P6 is an absolute value to be added / subtracted for each level. For example, in the setting shown in FIG. 3, the value of parameter 7 is changed by adding −10, 0, and +10, respectively. Parameters that are not included in the range specified by the parameter range P4 are not changed and are not changed when the module is executed.
When the OK button P7 is clicked, an error message is displayed when there is an overlap in the parameter range P4 input multiple times. If there is no overlap, the settings entered on the screen P1 are valid and the screen P1 is closed. If the Cancel button P8 is clicked, all are invalidated and the screen P1 is closed in both cases.

  The parameter selection and parameter value changing conditions of the image processing module set in this way are written in the memory 3. The writing on the memory 3 is written as a module table T1 and a parameter table T2, for example, as shown in FIGS. In the module table T1, the name of the image processing module to be executed and the parameter file name used in each image processing module are recorded. The parameter number and parameter data part (items No. 1 to 11) of the parameter table T2 are already recorded specified values, and the subsequent parts (items No. 12 to 21) are parameter value change condition data. is there.

  The module execution means 64 is a portion that repeatedly executes the image processing modules sequentially based on the parameter value change conditions set by the parameter value change setting means 62 for the parameters of the image processing modules selected by the parameter selection means 61. The image processing by the selected image processing module is sequentially executed for the input image data VIDEO for evaluation to be input.

Specifically, the module execution means 64 executes the image processing module from the upper level of the module table T1 shown in FIG. 4 described above, while referring to the parameter file name in the module table T1, The image processing by the image processing module stored in 3 is performed. In the present embodiment, the execution of the image processing module is performed by clicking the execution button G3 in FIG. 2, and every time the operator clicks the execution button G3, all combinations of parameter changes are completed. The execution of the image processing module is repeated.
The result data of the image processing by the module execution unit 64 is output to the result data output unit 7.

The result data output means 7 is a part that outputs the result of the image processing of the input image data VIDEO by the image processing module in the module execution means 64, and includes a result image display part 71 and a result data writing part 72.
The result image display unit 71 is a part for displaying the image processing result of the input image data VIDEO by the image processing module on the display 5.
The result data writing unit 72 is a part that writes the image processing result of the input image data VIDEO by the image processing module into the hard disk device 4 as result data.

  The parameter value change condition writing means 8 is a part for writing the change condition of the parameter value of the image processing module set by the image processing module parameter management means 6 to the hard disk device 4, and is set on the screen P1 shown in FIG. The generated parameter table T2 is written in the hard disk device 4 by clicking the OK button P7 in the lower left of the screen P1 with the mouse or the like as the parameter value changing condition of the image processing module.

Next, the operation of the present embodiment will be described based on the flowchart shown in FIG.
When activated, the parameter management means 6 displays a screen G1 shown in FIG. 2 on the display 5 and prompts the operator to select parameters of the image processing module.
When the operator selects an image processing module to be executed by clicking the list item area G2 with a mouse or the like, the parameter selection means 61 selects a parameter of the selected image processing module in the module table T1 (step S1).

  Next, the parameter value change setting means 62 determines the parameter value change condition part in the parameter table T2 according to the parameter value change condition changed by pressing the parameter change condition change button G5 for the list item area G2 selected by the operator ( No. 12 to 21) are added and changed, and parameter value changing conditions for the selected image processing module are set (step S2).

Next, the module execution unit 64 executes the image processing module selected according to the order set in the module table T1.
First, the module execution means 64 reads the input image data VIDEO based on the description in the first row of the module table T1 (step S3).
Next, the module execution means 64 reads the parameter file into the parameter table T2 based on the parameter file name described in the second row of the module table T1 (step S4).
Next, the parameter value change execution unit 63 changes the parameter value based on the parameter value change condition described in the parameter table T2 (step S5).

The parameter value change by the parameter value change execution means 63 will be described based on the flowchart of this means shown in FIG. The parameter value change execution means 63 stores the index I and each changed level number array L []. These are initialized for the first time (procedure R1) and are initialized to 0 (procedure R2). Similarly, for the first time, the number of each parameter group to be changed described in the parameter table T2 is stored in the parameter number array N [] (procedure R2).
Each time, the level number L [I] is incremented (L [I] ← L [I] +1) (procedure R3). When the level number L [I] exceeds the number of parameter levels of the number N [I] described in the parameter table T2 (procedure R4), the label number L [I] is initialized (L [I] ← 0) The index I is incremented (I ← I + 1) (procedure R5).
If the index I is less than the total number of parameters to be changed described in the parameter table T2 (= parameter number array N [] total) (step R6), the label number L [] of each parameter and the parameters described in the parameter table T2 The parameter value V is calculated by the following formula (1) from the reference value K, the number of levels E, and the increase / decrease value Z of N [I] (procedure R8).
V ← K + Z * (L [I] − (E + 1) / 2) (1)
In step R6, if index I is equal to or greater than the total number of parameters to be changed (= parameter number array N [] total) described in parameter table T2, the end of all combinations is stored (procedure R7).

  Returning to FIG. If the parameter value change execution means 63 stores all the combinations completed, the simulation is terminated (step S6).

  If all the combinations are not stored in step 6, the module execution means 64 searches the memory 3 based on the image processing module name in the second row of the module table T1 and selects the corresponding image processing module. The acquired and searched image processing module is executed with reference to the parameter combination calculated in step S5, and image processing is performed on the input image data VIDEO (step S7).

When the image processing by the image processing module is completed, the result image display unit 71 of the result data output unit 7 displays the result image of the image processing on the display 5 (step S8).
Similarly, the result data writing unit 72 of the result data output means 7 writes the result data to the hard disk device 4 and stores and saves it (step S9). The file name stored in the result data writing unit 72 is generated from the level number array L [] stored in the parameter value change execution unit 63. For example, in the case of the parameter table T2 in FIG. 5, the level number arrays L [0] and L [1] all store 1 to 3, so that the file names are O2_10bit_1_1.ppm, O2_10bit_2_1.ppm, ..., O2_10bit_3_3.ppm.
Thereafter, the module execution means 64 repeats from step S5 in order to obtain the combination of parameters of the image processing module to be executed next and execute the image processing module.

In this way, various combinations of image processing modules are simulated to select an image processing module and an execution procedure so as to obtain an optimal image processing result, and to design an image processing circuit for mounting a partial image processing circuit. Do.
Specifically, the mounting layout of the partial image processing circuit on the image processing circuit board may be designed so that the image processing procedure is similar to the execution procedure of the image processing module.

  In such a simulation apparatus 1, for example, as shown in the curve γ correction module parameter combination T3 in FIG. 8, the parameter management unit 6 performs x columns, and y, y2-, y2 +, y3-, y3 + It is possible to execute a curve γ correction processing module for each of a series of parameter combinations in a row, and display the result output image on the display 5 by each curve γ correction processing module, thereby correcting the curve γ with any parameter combination. It is possible to easily check whether the image quality of the processing module processing has improved or deteriorated. In addition, in the parameter combination T3 for the curve γ correction module in FIG. 8, any one of the x column and the y column to the y3 + column represents a parameter of the curve γ correction module, and the x column represents an input representative value group, The y to y3 + columns indicate output values for the respective input representative values in the x column. The curve γ correction processing, when given these parameters, smoothly outputs an output value for an arbitrary input value and outputs it. FIGS. 9A to 9C are input / output graphs of the curve γ correction process when the input representative value x columns and the output values y, y3−, y3 + columns are given as parameters.

Then, for example, in FIG. 4, when evaluating the curve γ correction processing result, it is possible to easily visually compare and confirm the result images sequentially displayed on the display 5 with combinations of parameters.
In addition, image quality degradation due to image processing is not only locally caused, but also color unevenness on the entire screen, and when converting from high resolution to low resolution, it also appears as jaggy, block noise, and blur on the entire screen. These image quality degradations can be evaluated by visual comparison.

In addition, since the operator can freely set the combination of the parameters of the image processing module on the screen G1, it is possible to perform simulation by easily selecting a number of image processing modules and changing the order of image processing. Therefore, it becomes easy to find the optimum combination of parameters of the image processing module in a short time.
Furthermore, since the result data writing unit 72 writes the result data to the hard disk device 4, it is also possible to perform comparative evaluation with the input image data VIDEO by executing known evaluation software on the computer. As a comparative evaluation method, for example, if the luminance, color unevenness, etc. of each pixel are converted into numerical values and compared, and statistical processing is performed and the change exceeds a certain threshold, it is regarded as image quality deterioration. A method that determines that there is no deterioration in image quality can be employed unless the value exceeds.
Further, since the file name generated by the result data writing unit 72 incorporates the level number of each parameter value, the correspondence between the result data and the parameter combination from which the result data is output can be understood.

  DESCRIPTION OF SYMBOLS 1 ... Simulation apparatus, 2 ... Arithmetic processing apparatus, 3 ... Memory, 4 ... Hard disk drive, 5 ... Display, 6 ... Parameter management means, 7 ... Result data output means, 8 ... Parameter value change condition writing means, 61 ... Parameter Selection means 62 ... Parameter value change setting means 63 ... Parameter value change execution means 64 ... Module execution means 71 ... Result image display part 72 ... Result data writing part G1 ... Screen G2 ... List item area G3 ... execute button, G4 ... parameter value read button, G5 ... parameter change condition change button, T1 ... module table, T2 ... parameter table, T3 ... parameter combination for curve gamma correction processing module, VIDEO ... input image data.

Claims (9)

An image processing circuit simulation apparatus for simulating the operation of an image processing circuit configured by combining a plurality of partial image processing circuits,
A plurality of image processing modules executable on a computer and having a function corresponding to each of the partial image processing circuits;
Parameter selection means for selecting a parameter of the image processing module whose value is to be changed among parameters of the plurality of image processing modules;
Parameter value changing means for setting a condition for changing the value of the parameter selected by the parameter selecting means;
Module execution means for sequentially executing the plurality of image processing modules and performing image processing of input image data for a combination of parameter value change conditions set by the parameter value changing means;
A simulation apparatus for an image processing circuit, comprising: result data output means for outputting result data after image processing of the image data by the image processing module executed by the module execution means. The image processing circuit simulation apparatus according to claim 1,
A parameter value change condition writing means for writing the parameter of the image processing module selected by the parameter selection means and the parameter value change condition set by the parameter value changing means to a recording medium; An image processing circuit simulation apparatus. In the simulation apparatus of the image processing circuit according to claim 1 or 2,
The parameter value changing condition includes an image processing characterized by including a parameter number for changing the parameter value, a number of levels indicating the number of stages of change, and an increase / decrease value indicating a value to be added or subtracted for each level. Circuit simulation device. The image processing circuit simulation apparatus according to any one of claims 1 to 3,
The result data output means includes a result image display unit for displaying a result image after image processing on the image display device based on the output result data. In the simulation apparatus of the image processing circuit according to any one of claims 1 to 4,
The simulation apparatus for an image processing circuit, wherein the result data output means includes a result data writing unit for writing the result data to be output on a recording medium. In the simulation apparatus of the image processing circuit according to any one of claims 1 to 5,
The image processing circuit simulation apparatus, wherein the plurality of image processing modules include at least a resolution conversion module, a color conversion module, and a gamma characteristic conversion module. An image processing circuit simulation method for simulating the operation of an image processing circuit configured by combining a plurality of partial image processing circuits,
Selecting a parameter of the image processing module whose value is changed on the computer from among a plurality of parameters of the image processing module that can be executed on the computer and has a function corresponding to each of the partial image processing circuits;
Setting a parameter value change condition for the selected image processing module;
Sequentially executing the image processing modules for the set parameter value combinations, and performing image processing of input image data;
And a step of outputting the result data after the image processing result of the image data by the executed image processing module on a computer. An image processing circuit design method configured by combining a plurality of partial image processing circuits,
After carrying out the image processing circuit simulation method according to claim 7 to obtain an optimal combination of parameter values of the image processing module,
A design method of an image processing circuit, wherein a combination of parameter values of the partial image processing circuit in the image processing circuit is determined.   An image processing circuit simulation program for causing a computer to execute the image processing circuit simulation method according to claim 7.

Images