JP2012244491A - Image processing apparatus and image processing apparatus control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technique capable of generating progressive image data having sizes expanded or reduced in a horizontal direction and a vertical direction with a set magnification from interlace image data by a simple configuration.SOLUTION: An image processing apparatus which generates progressive image data having sizes expanded or reduced with a set magnification from interlace image data and outputs the progressive image data comprises: request line number output means which successively outputs a request line number on the basis of the set magnification; conversion means which generates data on the line of the request line number outputted from the request line number output means from the inputted interlace image data and outputs the data; and scaling means which generates data on the line of the progressive image data to be outputted, using the data on the line outputted from the conversion means.

Description

  The present invention relates to an image processing apparatus and a control method for the image processing apparatus.

  2. Description of the Related Art Conventionally, there is an image processing apparatus that generates and outputs progressive image data having a size enlarged or reduced at a set magnification from interlaced image data. In such an image processing apparatus, after the IP conversion (interlace-progressive conversion) process, a process (scaling process) for generating progressive image data having the above-mentioned enlarged or reduced size is executed. Specifically, such an image processing apparatus includes a frame memory between an IP conversion processing unit that performs IP conversion processing and a scaling processing unit that performs scaling processing. The frame memory stores progressive image data generated by the IP conversion processing unit. The scaling processing unit reads the progressive image data from the frame memory and performs the scaling process.

In addition, an apparatus that can execute scaling processing after IP conversion processing without arranging a frame memory between the IP conversion processing portion and the scaling processing portion has been proposed (for example, Patent Document 1). However, the apparatus described in Patent Document 1 can only perform horizontal scaling processing (a frame memory is used for vertical scaling processing).
The use of such a frame memory increases the cost.

JP 2001-222251 A JP 2007-019708 A

  An object of the present invention is to provide a technique capable of generating progressive image data having a size that is enlarged or reduced in a horizontal direction and a vertical direction at a set magnification from an interlaced image data with a simple configuration. .

The image processing apparatus of the present invention
An image processing apparatus that generates and outputs progressive image data having a size enlarged or reduced at a set magnification from interlaced image data configured by only even-numbered lines or odd-numbered lines,
For each line of progressive image data to be output, request line number output means for sequentially outputting a request line number that is a line number used for generating data of the line based on the set magnification,
Conversion means for generating and outputting the data of the requested line number output from the requested line number output means from the input interlaced image data;
Scaling means for generating line data of the progressive image data to be output using data of the line output from the conversion means;
Have
The converting means includes
When the line of the requested line number output from the requested line number output means exists in the input interlaced image data, the data of the line is output as it is,
When the line of the requested line number output from the requested line number output means does not exist in the input interlaced image data, the line data is generated and output by interlace-progressive conversion. To do.

The control method of the image processing apparatus of the present invention includes:
A control method for an image processing apparatus that generates and outputs progressive image data of a size enlarged or reduced at a set magnification from interlaced image data configured by only even-numbered lines or odd-numbered lines,
For each line of progressive image data to be output, a requested line number output step for sequentially outputting a requested line number, which is a line number used for generating data of the line, based on the set magnification,
A conversion step of generating and outputting line data of the requested line number output in the requested line number output step from the input interlaced image data;
A scaling step for generating line data of the progressive image data to be output using the line data output in the conversion step;
Have
In the conversion step,
When the line of the requested line number output in the requested line number output step exists in the input interlaced image data, the data of the line is output as it is,
If the line of the requested line number output in the requested line number output step does not exist in the input interlaced image data, the data of the line is generated and output by interlace-progressive conversion. To do.

  According to the present invention, progressive image data having a size that is enlarged or reduced in the horizontal direction and the vertical direction at a set magnification can be generated from interlaced image data with a simple configuration.

An example of a schematic configuration of an image processing apparatus according to the present embodiment Example of processing flow of image processing apparatus according to this embodiment An example of a processing flow of the IP conversion processing determination unit according to the present embodiment Example of the flow of the first determination process Example of the flow of the second determination process Example of relationship between delay mode, field information, and interpolation line Example of relationship between request line number and IP conversion process determination result during enlargement process Example of relationship between request line number and IP conversion process determination result during reduction process

  Hereinafter, an image processing apparatus and a control method for the image processing apparatus according to the present embodiment will be described. The image processing apparatus according to the present embodiment generates and outputs progressive image data having a size enlarged or reduced at a set magnification from interlaced image data. Interlaced image data is image data composed of only even-numbered lines or odd-numbered lines. The progressive image data to be output is progressive image data expanded in the horizontal direction, the vertical direction, or the horizontal direction and the vertical direction.

(Constitution)
FIG. 1 is a block diagram illustrating a schematic configuration of an image processing apparatus according to the present embodiment.
The input image processing unit 101 performs image processing on the input interlaced image data, and writes the interlaced image data subjected to the image processing in the field memory 102. Alternatively, the input image processing unit 101 writes the input interlaced image data as it is in the field memory 102. The image processing is, for example, conversion processing from a YCbCr signal to an RGB signal.

  The field memory 102 is a storage medium capable of storing a plurality of fields of interlaced image data. As the field memory 102, a magnetic disk, a nonvolatile memory, a volatile memory, or the like can be used.

  The output synchronization signal generation unit 103 generates or acquires a synchronization signal and outputs it to the request line number output unit 104. In the present embodiment, a synchronization signal of input interlaced image data is generated or acquired as the synchronization signal. The synchronization signal is a vertical synchronization signal (Vsync) or a horizontal synchronization signal (Hsync).

For each line of progressive image data to be output, the requested line number output unit 104 sets the requested line number, which is the number of the line used to generate the data of the line, to a set magnification (enlargement ratio, reduction ratio). Output sequentially. Specifically, the requested line number output unit 104 generates a requested line number based on the magnification set in the scaling processing unit 107 at a timing based on the synchronization signal from the output synchronization signal generation unit 103, and performs IP conversion processing. The data is output to the determination unit 105 and the IP conversion processing unit 106.
The method for determining the requested line number to be output depends on an algorithm for generating progressive image data to be output (enlarged or reduced progressive image data), and is not a feature of the present invention. Omit.
In this embodiment, it is assumed that the number of the top line of the image data is 1, and the line number increases by 1 from the top line of the image data toward the bottom. However, the line number is not limited to this. For example, the number of the lowest line of the image data may be 1.

  The IP conversion processing determination unit 105 determines whether or not to perform interlace-progressive conversion (IP conversion) processing from the requested line number, and outputs the determination result to the IP conversion processing unit 106. Specifically, it is determined whether or not to perform the IP conversion process from the field information of the interlaced image data of the current field, the delay mode information of the IP conversion processing unit 106, and the requested line number, and the determination result is used as the IP conversion processing unit To 106.

  The field information indicates whether the field of the interlaced image data is an image data field composed only of odd-numbered lines (odd lines) or an image data field composed only of even-numbered lines (even-numbered lines). It is information to represent. Hereinafter, a field of interlaced image data composed of only odd lines is referred to as an “odd field”, and a field of interlaced image data composed of only even lines is referred to as an “even field”. The field information may be added to the input interlaced image data from the beginning, or may be generated using the input interlaced image data.

  The delay mode information is information indicating the delay mode of the IP conversion processing unit 106. In the present embodiment, either “low delay mode” or “standard delay mode” is selected as the delay mode of the IP conversion processing unit 106. The delay mode of the IP conversion processing unit 106 is set (selected) according to a user operation, for example. The “low delay mode” and “standard delay mode” will be described in detail later.

The IP conversion processing unit 106 generates line data of the requested line number output from the requested line number output unit 104 from the input interlaced image data (interlaced image data to be processed), and sends the data to the scaling processing unit 107. Output.
In the present embodiment, the IP conversion processing unit 106 generates interpolation line data by IP conversion only when the IP conversion processing determination unit 105 determines that “IP conversion processing is performed”. An interpolation line is a line that does not exist in the input interlaced image data. A line existing in the input interlaced image data is called an original line.

Specifically, when the line with the requested line number output from the requested line number output unit 104 exists in the input interlaced image data, the IP conversion processing unit 106 outputs the data of the line as it is. .
If the line with the requested line number output from the requested line number output unit 104 does not exist in the input interlaced image data, the IP conversion processing unit 106 generates and outputs the data of the line by IP conversion. To do. For example, the IP conversion processing unit 106 reads three interlaced image data of the current field, one field before, and two fields before from the field memory 102 based on the request line number. Then, the IP conversion processing unit 106 executes the IP conversion process such as the motion adaptive IP conversion process using the read interlaced image data, thereby generating line data of the requested line number. Note that the fields of interlaced image data used for IP conversion are not limited to the above three fields. For example, interlaced image data after one field and two fields after the current field may be used.
However, when the requested line number output from the requested line number output unit 104 is the same number as the previous time and is a number of a line that does not exist in the input interlaced image data (in the IP conversion processing determination unit 105) When it is determined that “IP conversion processing is not performed”, the IP conversion processing unit 106 outputs the same data as the previous time without performing IP conversion.

  The scaling processing unit 107 uses the line data output from the IP conversion processing unit 106 to execute scaling processing according to the set magnification. Specifically, the scaling processing unit 107 uses the line data output from the IP conversion processing unit 106 to perform processing for generating line data of progressive image data to be output.

(Processing flow)
FIG. 2 is a flowchart illustrating an example of a processing flow of the image processing apparatus according to the present embodiment.
First, the user sets a magnification (enlargement ratio, reduction ratio) in the scaling processing unit 107 (S201).

  Next, the requested line number output unit 104 generates a requested line number based on the set magnification, and outputs it to the IP conversion processing determination unit 105 and the IP conversion processing unit 106 (S202). In the present embodiment, the requested line number output unit 104 outputs the requested line number at a frequency twice that of the horizontal synchronization signal (horizontal synchronization signal of interlaced image data) generated (acquired) by the output synchronization signal generation unit 103. To do. The request line number may be output at any timing. For example, the request line number may be output in synchronization with the horizontal synchronization signal of the input interlaced image data.

  Then, the IP conversion processing unit 106 reads interlaced image data from the field memory 102 based on the input request line number, and generates data of the line of the input request line number from the read interlaced image data. And output (S203).

  Next, the scaling processing unit 107 executes scaling processing according to the set magnification using the data output in S203 (S204; scaling processing).

(IP conversion processing determination flow)
An example of the processing flow of the IP conversion processing determination unit 105 according to the present embodiment will be described using the flowchart of FIG.
First, the IP conversion processing determination unit 105 determines whether the delay mode of the IP conversion processing unit 106 is “low delay mode” or “standard delay mode” (S301). Specifically, the IP conversion processing determination unit 105 acquires a signal indicating the delay mode (delay mode information) from the IP conversion processing unit 106, and using the signal, the delay mode is “low delay mode”. It is determined whether it is “standard delay mode”.

The “low delay mode” is a mode in which interlaced image data in the current field is converted into progressive image data. That is, in the “low delay mode”, the interlaced image data of the current field is the processing target. Therefore, in the case of the “low delay mode”, the IP conversion processing unit 106 generates data of the line of the requested line number output from the requested line number output unit 104 from the interlaced image data of the current field, and performs scaling. The data is output to the processing unit 107 (first delay mode). When interlaced image data is converted to progressive image data in the “low delay mode”, the delay time of the output of progressive image data relative to the input of interlaced image data is within one frame period.
The “standard delay mode” is a mode for converting interlaced image data of a field immediately before the current field into progressive image data. That is, in the “standard delay mode”, interlaced image data one field before the current field is processed. Therefore, in the case of “standard delay mode”, the IP conversion processing unit 106 generates data of the line of the requested line number output from the requested line number output unit 104 from the interlaced image data one field before the current field. Then, the data is output to the scaling processing unit 107 (second delay mode). When interlace image data is converted to progressive image data in the “standard delay mode”, the delay time of the output of the progressive image data with respect to the input of the interlace image data is 1 frame period or more and 2 frame periods or less.

6A to 6D show the relationship between the delay mode, field information, and interpolation line.
In the “low delay mode”, the interlaced image data in the current field is the processing target of the IP conversion processing unit 106. Therefore, when the current field is an odd field (a field in which even lines are interpolation lines), the field of interlaced image data to be processed by the IP conversion processing unit 106 is an odd field (FIG. 6A). When the current field is an even field (a field in which odd lines are interpolation lines), the field of interlaced image data to be processed by the IP conversion processing unit 106 is an even field (FIG. 6B).
In the “standard delay mode”, the interlaced image data of the previous field is the processing target of the IP conversion processing unit 106. Therefore, when the current field is the odd field, the field of the interlaced image data that is the processing target of the IP conversion processing unit 106 is the even field (FIG. 6C). When the current field is the even field, the field of the interlaced image data that is the processing target of the IP conversion processing unit 106 is the odd field (FIG. 6D).

When it is determined in S301 that the delay mode is the “low delay mode”, the IP conversion processing determination unit 105 determines whether the current field is an odd field from the field information (S303). If it is determined that the current field is an odd field, the process proceeds to S304. If it is determined that the current field is an even field, the process proceeds to S305.
When it is determined in S301 that the delay mode is the “standard delay mode”, the IP conversion processing determination unit 105 determines whether or not the current field is an even field from the field information (S302). If it is determined that the current field is an even field, the process proceeds to S304. If it is determined that the current field is an odd field, the process proceeds to S305.
That is, when the even line of the interlaced image data to be processed by the IP conversion processing unit 106 is an interpolation line, the process proceeds to S304, and when the odd line is an interpolation line, the process proceeds to S305.

In S304, the IP conversion process determination unit 105 performs a first determination process.
In S305, the IP conversion process determination unit 105 performs a second determination process.

(First determination process)
FIG. 4 is a flowchart illustrating an example of the flow of the first determination process.
First, the IP conversion processing determination unit 105 determines whether or not the input request line number is the same as the previous time (S402). If the input request line number is the same as the previous one, the process proceeds to S404, and if not, the process proceeds to S402.
In S402, the IP conversion processing determination unit 105 determines whether or not the input request line number is an even number. If the input request line number is an even number, the process proceeds to S403, and if it is an odd number, the process proceeds to S404.
In step S403, the IP conversion processing determination unit 105 determines that “IP conversion processing is to be performed”.
In S404, the IP conversion processing determination unit 105 determines that “IP conversion processing is not performed”.
Then, the IP conversion process determination unit 105 repeats the processes of S401 to S404 until the requested line number reaches the final line number (S405).

(Second determination process)
FIG. 5 is a flowchart illustrating an example of the flow of the second determination process.
First, the IP conversion processing determination unit 105 determines whether or not the input request line number is the same as the previous time (S501). If the input request line number is the same as the previous one, the process proceeds to S504, and if not, the process proceeds to S502.
In S502, the IP conversion processing determination unit 105 determines whether or not the input request line number is an odd number. If the input request line number is an odd number, the process proceeds to S503, and if it is an even number, the process proceeds to S504.
In step S503, the IP conversion processing determination unit 105 determines that “IP conversion processing is to be performed”.
In step S504, the IP conversion processing determination unit 105 determines that “IP conversion processing is not performed”.
Then, the IP conversion processing determination unit 105 repeats the processing from S501 to S504 until the requested line number becomes the final line number (S505).

  4 and 5 show the processing flow when the IP conversion processing determination unit 105 makes a determination each time a request line number is input, the determination method is not limited to this. For example, the IP conversion processing determination unit 105 samples request line numbers (a predetermined number of request line numbers) input at a predetermined time, and determines whether to perform IP conversion processing on the sampled request line numbers. May be.

(Request line number and IP conversion processing judgment result during enlargement processing)
With reference to FIGS. 7A to 7D, an example of the relationship between the requested line number during the enlargement process and the determination result of the IP conversion process determination unit 105 will be described. FIGS. 7A and 7B are examples when the enlargement ratio is set to 6 times. FIGS. 7C and 7D are examples in the case where an enlargement ratio of 10 is set. FIGS. 7A to 7D are examples in which the input requested line number is sampled in synchronization with the horizontal synchronization signal of the interlaced image data (horizontal synchronization signal of the interlace timing). 7A to 7D, the requested line number is output at a frequency twice the frequency of the horizontal synchronization signal of the input interlaced image data (in synchronization with the horizontal synchronization signal at the progressive timing). This is an example. In other words, FIGS. 7A to 7D are examples in the case of sampling two request line numbers input in each period of the horizontal synchronization signal at the interlace timing. Note that the sampling number of the requested line number is not limited to two. The sampling number of the request line number may be 1, 3, 5, 8, or the like.

7A and 7C show the case where the delay mode of the IP conversion processing unit 106 is the low delay mode and the current field is the odd field, and the delay mode of the IP conversion processing unit 106 is the standard delay mode. In this example, the field is an even field (the previous field is an odd field).
In the example of FIGS. 7A and 7C, the IP conversion processing determination unit 105 determines that “IP conversion processing is not performed” when the sampled request line numbers include only odd numbers. Further, the IP conversion processing determination unit 105 determines that “IP conversion processing is not performed” when all the even numbers included in the sampled request line numbers are the same as the previous number (the last sampled even number). In other cases, it is determined that “IP conversion processing” is performed.

7B and 7D show the case where the delay mode of the IP conversion processing unit 106 is the low delay mode and the current field is the even field, and the delay mode of the IP conversion processing unit 106 is the standard delay mode. This is an example when the field is an odd field (the previous field is an even field).
In the example of FIGS. 7B and 7D, the IP conversion processing determination unit 105 determines that “IP conversion processing is not performed” when the sampled request line numbers include only even numbers. The IP conversion processing determination unit 105 determines that “IP conversion processing is not performed” when all of the odd numbers included in the sampled request line numbers are the same as the previous number. In other cases, it is determined that “IP conversion processing” is performed.

  In the example of FIGS. 7A to 7D, when the same interpolation line number is output twice as the request line number, “IP conversion processing” is performed on these two request line numbers. May be determined. The IP conversion processing unit 106 may perform the process of generating and outputting an interpolation line by IP conversion twice when the above two request line numbers are input. The IP conversion processing unit 106 may perform a process of generating and outputting an interpolation line by IP conversion only when the first request line number of the two request line numbers is input. That is, when the second request line number is input, the IP conversion processing unit 106 determines that the input request line number is the same as the previous one, and performs the same as the previous time without performing IP conversion. Data may be output.

(Request line number and IP conversion processing judgment result during reduction processing)
With reference to FIGS. 8A and 8B, an example of the relationship between the request line number during the reduction process and the determination result of the IP conversion process determination unit 105 will be described. FIGS. 8A and 8B are examples when a reduction ratio of 0.6 is set. FIGS. 8A and 8B show an example in which the input requested line number is sampled in synchronization with the horizontal synchronization signal of the interlaced image data (horizontal synchronization signal of the interlace timing). 8A and 8B, the requested line number is output at a frequency twice the frequency of the horizontal synchronization signal of the input interlaced image data (in synchronization with the horizontal synchronization signal at the progressive timing). This is an example.

FIG. 8A shows the case where the delay mode of the IP conversion processing unit 106 is the low delay mode and the current field is the odd field, and the delay mode of the IP conversion processing unit 106 is the standard delay mode and the current field is the even field. This is an example in the case of (the previous field is an odd field).
In the example of FIG. 8A, as in the examples of FIGS. 7A and 7C, the IP conversion processing determination unit 105 determines that “no IP conversion processing is performed when the sampled request line number includes only odd numbers. Is determined. Further, the IP conversion processing determination unit 105 determines that “IP conversion processing is not performed” when all the even numbers included in the sampled request line numbers are the same as the previous number. In other cases, it is determined that “IP conversion processing” is performed.

FIG. 8B shows a case where the delay mode of the IP conversion processing unit 106 is the low delay mode and the current field is the even field, and the delay mode of the IP conversion processing unit 106 is the standard delay mode and the current field is the odd field. This is an example in the case of (the previous field is an even field).
In the example of FIG. 8B, as in the examples of FIGS. 7B and 7D, the IP conversion processing determining unit 105 determines that “IP conversion processing is not performed when the sampled request line number includes only even numbers. Is determined. Further, the IP conversion processing determination unit 105 determines that “IP conversion processing is not performed” when all the even numbers included in the sampled request line numbers are the same as the previous number. In other cases, it is determined that “IP conversion processing” is performed.

  As described above, according to the present embodiment, data suitable for scaling processing is output from the IP conversion processing unit. Specifically, the line data used to generate the line data of the progressive image data to be output is output from the IP conversion processing unit. Then, scaling processing is performed using data output from the IP conversion processing unit. Thereby, progressive image data of a size enlarged or reduced in the horizontal direction and the vertical direction at a set magnification can be generated from the interlaced image data with a simple configuration. Specifically, without providing a frame memory between the IP conversion processing unit and the scaling processing unit, it is possible to generate progressive image data having a size enlarged or reduced in the horizontal direction and the vertical direction at a set magnification. .

In the present embodiment, it is determined whether the delay mode of the IP conversion processing unit is “low delay mode” or “standard delay mode”. However, if the delay mode is determined in advance, such a determination is made. Is not necessary.
In the present embodiment, when the requested line number is the same as the previous number and the interpolation line number, the same data as the previous time is output without performing IP conversion. However, such a configuration is not necessary. When the requested line number is an interpolation line number, the IP conversion processing unit may always generate and output data of the interpolation line by IP conversion. However, if the requested line number is the same number as the previous time and is the number of the interpolation line, if the same data as the previous time is output without performing the IP conversion, the IP conversion processing unit Processing load can be reduced.

104 Request line number output unit 106 IP conversion processing unit 107 Scaling processing unit

Claims (4)

An image processing apparatus that generates and outputs progressive image data having a size enlarged or reduced at a set magnification from interlaced image data configured by only even-numbered lines or odd-numbered lines,
For each line of progressive image data to be output, request line number output means for sequentially outputting a request line number that is a line number used for generating data of the line based on the set magnification,
Conversion means for generating and outputting the data of the requested line number output from the requested line number output means from the input interlaced image data;
Scaling means for generating line data of the progressive image data to be output using data of the line output from the conversion means;
Have
The converting means includes
When the line of the requested line number output from the requested line number output means exists in the input interlaced image data, the data of the line is output as it is,
When the line of the requested line number output from the requested line number output means does not exist in the input interlaced image data, the line data is generated and output by interlace-progressive conversion. An image processing apparatus. The conversion means performs interlace-progressive conversion when the generation line outputs a request line number that is the same number as the previous time and is a line number that does not exist in the input interlaced image data. The image processing apparatus according to claim 1, wherein the same data as the previous time is output without performing the operation. The converting means generates a first line data of the requested line number output from the requested line number output means from the interlaced image data of the current field and outputs the first delay mode, and the field immediately before the current field. The second delay mode for generating and outputting the data of the line of the requested line number output from the requested line number output means from the interlaced image data of claim 1 or 2 Image processing device. A control method for an image processing apparatus that generates and outputs progressive image data of a size enlarged or reduced at a set magnification from interlaced image data configured by only even-numbered lines or odd-numbered lines,
For each line of progressive image data to be output, a requested line number output step for sequentially outputting a requested line number, which is a line number used for generating data of the line, based on the set magnification,
A conversion step of generating and outputting line data of the requested line number output in the requested line number output step from the input interlaced image data;
A scaling step for generating line data of the progressive image data to be output using the line data output in the conversion step;
Have
In the conversion step,
When the line of the requested line number output in the requested line number output step exists in the input interlaced image data, the data of the line is output as it is,
If the line of the requested line number output in the requested line number output step does not exist in the input interlaced image data, the data of the line is generated and output by interlace-progressive conversion. For controlling an image processing apparatus.

Images