CN114679547A - Image processing apparatus, method, and program - Google Patents
Image processing apparatus, method, and program Download PDFInfo
- Publication number
- CN114679547A CN114679547A CN202210358694.0A CN202210358694A CN114679547A CN 114679547 A CN114679547 A CN 114679547A CN 202210358694 A CN202210358694 A CN 202210358694A CN 114679547 A CN114679547 A CN 114679547A
- Authority
- CN
- China
- Prior art keywords
- data
- line
- unit
- interpolation
- storage unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 101
- 238000000034 method Methods 0.000 title claims abstract description 34
- 238000001914 filtration Methods 0.000 claims abstract description 55
- 238000003672 processing method Methods 0.000 claims description 10
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000002146 bilateral effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Image Processing (AREA)
Abstract
The application provides an image processing apparatus, method and program, the apparatus including: the device comprises a control unit, a storage unit, a filtering unit and a scaling unit; the control unit is used for controlling the image data to be written into the storage unit one time line by line; the storage unit is used for only storing single-row data which is currently controlled to be written by the control unit; the filtering unit is used for carrying out filtering processing on the single-line data; and the zooming unit is used for carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data. The capacity of the storage unit can be prevented from being overlarge, the image data can be zoomed, excessive resource area in a chip of the display device can be prevented from being occupied, and the power consumption of the chip can be reduced.
Description
Technical Field
The present application relates to the field of video image data processing technologies, and in particular, to an image processing apparatus, method, and program.
Background
With the development of technology, display devices for displaying video images are also gradually diversified. The resolution of the output may vary from display device to display device. Even if the resolution of the display device output is fixed, the resolution of the video image input to the display device may differ from the resolution of the display device output. This requires the display device to scale the resolution of the input video image to accommodate the output resolution of the current display device.
Currently, the specific implementation manner of the display device for scaling the video image therein is various. One of the common ways is: and a multi-order interpolation algorithm and a filter are adopted to realize the scaling of the video image. Specifically, after receiving the video image, the display device firstly filters each frame of image by using a filter, and then scales the filtered frame of image by using a multi-order interpolation algorithm. Each frame of image thereafter operates as described above. In this way, matching of the video image input in the display device with the output of the display device in resolution is achieved.
However, when the multi-order interpolation algorithm and the filter are used to scale the video image in the display device, the corresponding hardware elements occupy more resource area on the chip in the display device, thereby increasing the power consumption of the chip in the display device.
Disclosure of Invention
An object of the embodiments of the present application is to provide an image processing apparatus, an image processing method, and an image processing program, which can reduce excessive occupation of resource areas on a chip of a display apparatus and further reduce power consumption of the chip of the display apparatus while scaling a video image in the display apparatus.
In order to solve the above technical problem, an embodiment of the present application provides the following technical solutions:
a first aspect of the present application provides an image processing apparatus, the apparatus comprising: the device comprises a control unit, a storage unit, a filtering unit and a scaling unit; the control unit is used for controlling the image data to be written into the storage unit one time line by line; the storage unit is used for storing only one row of data which is currently controlled to be written by the control unit; the filtering unit is used for carrying out filtering processing on the single-line data; and the zooming unit is used for carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data.
A second aspect of the present application provides an image processing method performed by an image processing apparatus, the method including: controlling the image data to be written into the storage unit line by line at a time; storing only a single line of data currently controlled to be written by the control unit; filtering the single-line data; and carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data.
The third aspect of the present application provides an image processing program executed using an image processing apparatus, the program executing: controlling the image data to be written into the storage unit line by line at a time; storing only one-line data currently controlled to be written by the control unit; filtering the single-line data; and carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data.
Compared with the prior art, the image processing apparatus provided in the first aspect of the present application controls the image data to be written into the storage unit one time and line by line through the control unit, so that only the single line data written by the control unit is stored in the storage unit, the single line data is further read from the storage unit, the single line data is filtered through the filtering unit, and the single line data after being filtered is scaled through the scaling unit. Therefore, the capacity of the storage unit can be prevented from being overlarge, the image data can be zoomed, excessive resource area in a chip of the display device can be prevented from being occupied, and the power consumption of the chip can be reduced.
The image processing method performed by the image processing apparatus provided by the second aspect of the present application, and the image processing program performed using the image processing apparatus provided by the third aspect of the present application have the same or similar advantageous effects as the image processing apparatus provided by the first aspect.
Drawings
The above and other objects, features and advantages of exemplary embodiments of the present application will become readily apparent from the following detailed description read in conjunction with the accompanying drawings. Several embodiments of the present application are illustrated by way of example and not by way of limitation in the figures of the accompanying drawings and in which like reference numerals refer to similar or corresponding parts and in which:
FIG. 1 is a first schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
FIG. 2 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
FIG. 3 is a schematic diagram of determining interpolation coefficients in an embodiment of the present application;
fig. 4 is a flowchart illustrating an image processing method performed by an image processing apparatus in an embodiment of the present application;
fig. 5 is a schematic diagram of a hardware configuration corresponding to an image processing method or program in the embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It is to be noted that, unless otherwise specified, technical or scientific terms used herein shall have the ordinary meaning as understood by those skilled in the art to which this application belongs.
At present, the display device mainly adopts a multi-order interpolation algorithm and a filtering process for scaling the video image data input therein. Then, the video image data is zoomed by adopting the method, so that more resource area on a chip in the display equipment is occupied, and the power consumption of the chip of the display equipment is further increased.
The inventor carefully researches and discovers that the video image data scaling in the display device occupies more resource area of a chip, and the main reasons are as follows: before the video image data is processed by adopting a multi-order interpolation algorithm, filtering and other modes, the video image data is directly and completely stored in a corresponding memory on a chip, so that the memory occupies more resource area in the chip, the memory occupies more resource area of the chip in the process of scaling the video image data, and the power consumption of the chip is increased.
In view of this, embodiments of the present application provide an image processing apparatus, an image processing method, and an image processing program, which store only line data corresponding to a line that needs to be currently processed in video image data and store only the line data in a process of performing scaling processing on the video image data. After the scaling process, i.e., reading, is performed on the line data, the next line data is written again, and the operation is repeated as described above. Therefore, the storage space for storing the video image data can be saved, the occupied resource area of a chip in the display equipment is reduced, and the power consumption of the chip is reduced.
First, the image processing apparatus provided in the embodiments of the present application will be described in detail.
Fig. 1 is a schematic structural diagram of an image processing apparatus in an embodiment of the present application, and referring to fig. 1, the apparatus may include: a control unit 101, a storage unit 102, a filtering unit 103 and a scaling unit 104.
And the control unit is used for controlling the image data to be written into the storage unit line by line at a time.
In order to avoid that the image data is directly and completely written into the storage unit, the storage unit needs to have larger capacity, and further occupies excessive resource area on a chip. A control unit may be added so that the control unit can control the writing of image data to the memory unit for only one line at a time.
For example, assume that the resolution of the image data is 4 × 4. In the process of scaling the image data, the 4 × 4 image data is not directly written into the storage unit at one time, but the control unit writes the 4 pixel data of the first line in the image data into the storage unit first, then performs interpolation processing after reading, then writes the 4 pixel data of the second line in the image data into the storage unit, and then performs scaling processing after reading. And so on until the pixel data of all the rows in the image data are stored in the storage unit.
And the storage unit is used for storing only one row of data which is currently controlled to be written by the control unit.
Since the control unit controls only data of a certain line (i.e., single-line data) in the image data to be written into the storage unit each time, the capacity of the storage unit does not need to be too large, and only the single-line data needs to be stored. Therefore, the storage unit can not occupy excessive resource area in the chip, and further can avoid occupying excessive chip resource area and reduce the power consumption of the chip when the image data is subjected to zooming processing.
After the control unit controls the single-row data to be written into the storage unit, when the single-row data needs to be subjected to scaling processing, the control unit also controls the single-row data stored in the storage unit to be read, and therefore the single-row data is subjected to scaling processing.
And the filtering unit is used for carrying out filtering processing on the single-row data.
After the single-line data is read from the memory unit, the single-line data may be subjected to a filtering process using a filtering unit.
In practical applications, the filtering unit may be a gaussian filtering unit. Specifically, the current pixel is taken as a center point, and a convolution kernel (composed of coefficients in the vertical direction and the horizontal direction) is used to perform weighted average on surrounding pixels to obtain a new value of the current position. The method aims to carry out smooth filtering on input video image data, eliminate noise and improve the quality of zoomed images.
Of course, the filtering unit may also be a median filtering unit, a mean filtering unit, a bilateral filtering unit, etc. The specific type of the filtering unit is not limited here, as long as the input video image data can be denoised to improve the image quality.
And the zooming unit is used for carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data.
After the filtering unit carries out filtering processing on the single-line data, the image quality corresponding to the single-line data is improved, and then the zooming unit can continue to zoom the single-line data after the filtering processing. In essence, the single line data is interpolated so that the corresponding image can be enlarged or reduced. Generally, image data is reduced.
In the scaling unit, the specific process of interpolation processing for single-line data adopts a conventional interpolation algorithm. Therefore, the specific process of performing interpolation processing on the single line data is not described herein again.
As can be seen from the above, in the image processing apparatus provided in the embodiment of the present application, the control unit controls the image data to be written into the storage unit line by line at a time, so that only the single-line data currently written by the control unit is stored in the storage unit, the single-line data is further read from the storage unit, the filtering unit performs filtering processing on the single-line data, and the scaling unit performs scaling processing on the single-line data after the filtering processing. Therefore, the capacity of the storage unit can be prevented from being overlarge, the image data can be zoomed, excessive resource area in a chip of the display device can be prevented from being occupied, and the power consumption of the chip can be reduced.
Further, as a refinement and an extension of the apparatus shown in fig. 1, an embodiment of the present application also provides an image processing apparatus. Fig. 2 is a schematic structural diagram of an image processing apparatus in an embodiment of the present application, and referring to fig. 2, the apparatus may include: a control unit 101, a storage unit 102, a filtering unit 103, a scaling unit 104, an interpolation relationship determination unit 105, and an interpolation coefficient generation unit 106.
And the interpolation relation judging unit is used for determining target pixel data to be subjected to interpolation processing from the line data currently stored in the storage unit according to the scaling ratio of the image data.
In the process of scaling and plug-and-play processing of image data, two certain pixel points in the image data are required to be used for weighted average, and the obtained result is a certain pixel point in the scaled image data.
When interpolation is performed each time, which two pixel points in the image data are specifically used needs to be determined according to the scaling ratio of the image data. The scaling ratio, i.e. ratio, here is the ratio of the resolution of the output image to the resolution of the input image.
For example, assume that the resolution of input image data is 4 × 4, and the resolution of output image data is 2 × 2. It can be seen that the input image data needs to be reduced to 1/2. At this time, the interpolation relation determining unit first determines two pixel points (i.e., target pixel data) to be interpolated from the image data as the first and second pixel points in the first line according to the scaling ratio of 1/2. Thereafter, the target pixel data is, in order: the third and fourth pixel points in the first row, the first and second pixel points in the second row, … …, and the third and fourth pixel points in the fourth row.
In the process of interpolating image data, interpolation is required from both the horizontal direction (i.e., x direction) and the vertical direction (i.e., y direction) of the image data. Therefore, the interpolation relation determination unit needs to determine the corresponding target pixel data from the horizontal direction and the vertical direction, respectively.
The interpolation relation judging unit is specifically used for determining first target pixel data to be subjected to interpolation processing from first line data currently stored in the storage unit according to the scaling ratio of the image data, and determining second target pixel data to be subjected to interpolation processing from second line data currently stored in the storage unit according to the scaling ratio of the image data;
the first row of data is a certain row of data in the image data, and the second row of data is column data which is obtained by correspondingly interpolating all the rows of data in the image data.
For example, it is assumed that the resolution of input image data is 4 × 4, and the resolution of output image data needs to be 2 × 2, i.e., the scaling ratio is 1/2. At this time, the interpolation relation determining unit firstly uses the first pixel point and the second pixel point in the first line as a group of target pixel points, and subsequently uses the third pixel point and the fourth pixel point in the first line, the first pixel point and the second pixel point in the second line, … …, the third pixel point and the fourth pixel point in the fourth line as other groups of target pixel points respectively. It can be seen that the target pixel points are two paired pixel points. And is divided from the horizontal direction.
After the target pixel point is determined in the horizontal direction, the interpolation relation determining unit needs to continuously determine the corresponding target pixel point in the vertical direction. Since the image data is two-dimensional, scaling in both the horizontal and vertical directions is required to achieve global scaling of the image data.
Continuing the above example, after the interpolation relation determining unit determines the first pixel point and the second pixel point in the first line, the third pixel point and the fourth pixel point in the first line, the first pixel point and the second pixel point in the second line, … …, the third pixel point and the fourth pixel point in the fourth line, after the interpolation processing is performed on the two pixel points of each group, a new pixel point is obtained respectively, each line has two pixel points, namely, the first line has a new pixel point 1 and a new pixel point 2, the second line has a new pixel point 3 and a new pixel point 4, the third line has a new pixel point 5 and a new pixel point 6, and the fourth line has a new pixel point 7 and a new pixel point 8. At this time, the new pixels 1, 3, 5, and 7 can be regarded as one row of data, and the new pixels 2, 4, 6, and 8 can be regarded as another row of data. At this time, in the vertical direction, the interpolation relation determining unit uses the new pixel points 1 and 3 in the first column as a set of target pixel data, uses the new pixel points 5 and 7 in the first column as a set of target pixel data, uses the new pixel points 2 and 4 in the second column as a set of target pixel data, and uses the new pixel points 6 and 8 in the second column as a set of target pixel data.
Thus, the interpolation relation judgment unit completes the determination of each pixel point to be interpolated in the image data. Then, the control unit can accurately read the corresponding pixel data from the storage unit according to the result determined by the interpolation relation determination unit.
The control unit includes: a write data control subunit and a read data control subunit.
And the data writing control subunit is used for controlling the writing of the currently processed line data in the image data into the storage unit.
In essence, the function of the write data control subunit is the same as that of the control unit in the foregoing embodiment, and all of them control the data of a certain row in the image data, that is, the data of a single row is written into the memory unit.
And the read data control subunit is used for controlling the reading of the line data currently stored in the storage unit.
After the interpolation relation judging unit determines the target pixel data needing interpolation processing in the image data, the data reading control subunit can only read the corresponding target pixel data from the single-line data stored in the storage unit according to the result determined by the interpolation relation judging unit, so that the accurate reading of the pixel data to be interpolated is realized, and the image processing efficiency is improved.
The data reading control subunit is specifically configured to control, according to the target pixel data determined by the interpolation relationship determination unit, reading of the target pixel data in the line data currently stored in the storage unit.
For example, assume that the resolution of the image data is 4 × 4 and the scaling ratio is 1/2. Then, the write data control subunit first controls writing of the first line data (i.e. pixel 0, pixel 1, pixel 2, and pixel 3 in the image data) in the image data into the storage unit. After the interpolation relation judgment unit determines that the target pixel data to be interpolated are pixel 0 and pixel 1, and pixel 2 and pixel 3, the read data control subunit will read pixel 0 and pixel 1 from the storage unit according to the result determined by the interpolation relation judgment unit, so as to perform weighted average on pixel 0 and pixel 1. Then, pixel 2 and pixel 3 are read out from the storage unit, and thus, pixel 2 and pixel 2 are weighted-averaged. Thereafter, each line of data in the image data is also operated according to the above method.
However, only data of a certain line in the image data can be stored in the storage unit. Therefore, the storage unit does not need to be configured with larger capacity, and the occupation of the resource area in the chip can be saved.
And the storage unit is particularly used for single-row storage.
Wherein the storage depth of the storage unit is determined based on a maximum line resolution of the image data.
That is, the depth of the line buffer of the memory cell may be the maximum line resolution of the image data. Therefore, the storage unit can completely store the single-row data of the image data, and the problem that the storage space is too large, and further more resource area of a chip is occupied is solved.
In practical applications, the storage unit may be a single-port memory. That is, the memory cell is only capable of read or write operations at the same time. Therefore, when the storage unit reads and writes data, the power consumption can be reduced to the maximum extent, and the power consumption of a chip can be further reduced.
After the target pixel data is read out from the storage unit, the filtering unit firstly carries out filtering processing on the target pixel data so as to improve the image quality. The filtering unit is the same as the filtering unit in the previous embodiment, and is not described herein again.
So far, a data processing route of the interpolation relation judging unit, the control unit, the storage unit and the filtering unit is described. After the interpolation relation judging unit determines the target pixel data, another data processing route, namely a interpolation relation judging unit, an interpolation coefficient generating unit and a scaling unit, is arranged. Next, the detailed description of this other data processing route is continued.
And the interpolation coefficient generating unit is used for determining an interpolation coefficient corresponding to the target pixel data according to the point to be interpolated and the target pixel data determined by the interpolation relation determining unit.
After the interpolation relation determining unit determines two pixel points, that is, target pixel data, which need to be interpolated currently, the interpolation coefficient generating unit may calculate, based on the point to be interpolated and the two pixel points, interpolation coefficients corresponding to the two pixel points during interpolation processing, which may also be referred to as weights.
Specifically, the interpolation coefficient generation unit is specifically configured to determine a distance between a point to be interpolated and the target pixel data, and determine an interpolation coefficient corresponding to the target pixel point based on the distance.
Wherein the interpolation coefficient is inversely related to the distance.
For example, fig. 3 is a schematic diagram of determining an interpolation coefficient in the embodiment of the present application, and referring to fig. 3, interpolation coefficients of two corresponding pixel points of interpolation points at different positions are different. X0 is the point to be interpolated, and p0 and p1 are two corresponding pixel points. The distance from X0 to p0 is Xratio, then the distance from X0 to p1 is (1-Xratio). The weights are reversed, p0 is (1-ratio) and p1 is ratio. Correspondingly, X1 is the point to be interpolated, and p2 and p3 are the corresponding two pixel points. The distance from X1 to p2 is Xratio, then the distance from X1 to p3 is (1-Xratio). The weights are reversed, p2 is (1-ratio) and p3 is ratio.
Similarly, in the vertical direction, Y is the point to be interpolated, and X0 and X1 are the corresponding two pixel points. The distance Y to X0 is YRatio, then the distance Y to X1 is (1-YRatio). The weights are reversed, X0 is (1-ratio) and X1 is ratio.
After the interpolation coefficient generation unit determines the interpolation coefficients corresponding to the interpolation points, the scaling unit obtains the filtered target pixel data from the filtering unit, and then the interpolation coefficients of the target pixel data calculated by the interpolation coefficient generation unit are used for interpolation processing.
And the zooming unit is specifically used for carrying out interpolation processing on the filtered target pixel data based on the interpolation coefficient corresponding to the target pixel data to obtain zoomed image data.
Continuing the above example, in the horizontal direction, X0 ═ p0 × Xratio + p1 × (1-Xratio), X1 ═ q2 × Xratio + q3 × (1-Xratio) ×. in the vertical direction, Y ═ X0 × Yratio + X1 × (1-Yratio). Y is the output of the final point to be interpolated.
Based on the same inventive concept, as an implementation method for the above device, the embodiment of the application also provides an image processing method executed by the image processing device. Fig. 4 is a flowchart illustrating an image processing method executed by an image processing apparatus in an embodiment of the present application, and referring to fig. 4, the method may include:
s401: controlling the image data to be written into the storage unit line by line at a time;
s402: storing only a single line of data currently controlled to be written by the control unit;
s403: filtering the single-line data;
s404: and carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data.
Further, the storing only the single line of data currently controlled to be written by the control unit includes: storing the single-row data which is controlled to be written by the control unit at present by adopting a single row; the storage depth is determined based on a maximum line resolution of the image data.
Further, the storing only the single line of data currently controlled to be written by the control unit includes: and a single-port memory is adopted to store the single-row data which is controlled to be written by the control unit currently.
Further, the controlling the writing of the image data to the storage unit one time row by row comprises: controlling the currently processed line data in the image data to be written into the storage unit; and controlling the reading of the currently stored row data in the storage unit.
Further, the method further comprises: determining target pixel data to be subjected to interpolation processing from the line data currently stored in the storage unit according to the scaling ratio of the image data;
the controlling of the reading of the line data currently stored in the storage unit includes: and controlling the reading of the target pixel data in the line data currently stored in the storage unit according to the target pixel data determined by the interpolation relation judging unit.
Further, the determining, according to the scaling ratio of the image data, target pixel data to be subjected to interpolation processing from line data currently stored in the storage unit includes: determining first target pixel data to be subjected to interpolation processing from first line data currently stored in the storage unit according to the scaling ratio of the image data, and determining second target pixel data to be subjected to interpolation processing from second line data currently stored in the storage unit according to the scaling ratio of the image data; the first line of data is a certain line of data in the image data, and the second line of data is line data which is obtained by correspondingly interpolating all lines of data in the image data.
Further, the method further comprises: determining an interpolation coefficient corresponding to the target pixel data according to the point to be interpolated and the target pixel data determined by the interpolation relation determination unit;
the interpolation processing of the filtered single-line data to obtain the zoomed image data includes: and performing interpolation processing on the filtered target pixel data based on the interpolation coefficient corresponding to the target pixel data to obtain zoomed image data.
Further, the determining an interpolation coefficient corresponding to the target pixel data according to the point to be interpolated and the target pixel data determined by the interpolation relation determination unit includes: determining the distance between the point to be interpolated and the target pixel data, and determining an interpolation coefficient corresponding to the target pixel point based on the distance; wherein the interpolation coefficient is inversely related to the distance.
It is to be noted here that the above description of the method embodiment, like the above description of the apparatus embodiment, has similar advantageous effects as the apparatus embodiment. For technical details which are not disclosed in the method embodiments of the present application, reference is made to the description of the embodiments of the apparatus of the present application for understanding.
Based on the same inventive concept, as an implementation of the above method, an embodiment of the present application further provides an image processing program executed using the image processing apparatus. The program executes: controlling the image data to be written into the storage unit line by line at a time; storing only one-line data currently controlled to be written by the control unit; filtering the single-line data; and carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data.
Further, the storing only the single line of data currently controlled to be written by the control unit includes: storing the single-row data which is controlled to be written by the control unit at present by adopting a single row; the storage depth is determined based on a maximum line resolution of the image data.
Further, the storing only the single line of data currently controlled to be written by the control unit includes: and a single-port memory is adopted to store the single-row data which is controlled to be written by the control unit currently.
Further, the controlling the writing of the image data to the storage unit one time row by row comprises: controlling the currently processed line data in the image data to be written into the storage unit; and controlling the reading of the currently stored row data in the storage unit.
Further, the method further comprises: determining target pixel data to be subjected to interpolation processing from the line data currently stored in the storage unit according to the scaling ratio of the image data;
the controlling of the reading of the line data currently stored in the storage unit includes: and controlling the reading of the target pixel data in the line data currently stored in the storage unit according to the target pixel data determined by the interpolation relation judging unit.
Further, the determining, according to the scaling ratio of the image data, target pixel data to be subjected to interpolation processing from line data currently stored in the storage unit includes: determining first target pixel data to be subjected to interpolation processing from first line data currently stored in the storage unit according to the scaling ratio of the image data, and determining second target pixel data to be subjected to interpolation processing from second line data currently stored in the storage unit according to the scaling ratio of the image data; the first line of data is a certain line of data in the image data, and the second line of data is line data which is obtained by correspondingly interpolating all lines of data in the image data.
Further, the method further comprises: determining an interpolation coefficient corresponding to the target pixel data according to the point to be interpolated and the target pixel data determined by the interpolation relation determination unit;
the interpolation processing of the single-line data after the filtering processing to obtain the zoomed image data includes: and performing interpolation processing on the filtered target pixel data based on the interpolation coefficient corresponding to the target pixel data to obtain zoomed image data.
Further, the determining an interpolation coefficient corresponding to the target pixel data according to the point to be interpolated and the target pixel data determined by the interpolation relation determination unit includes: determining the distance between the point to be interpolated and the target pixel data, and determining an interpolation coefficient corresponding to the target pixel point based on the distance; wherein the interpolation coefficient is inversely related to the distance.
Fig. 5 is a schematic diagram of a hardware configuration corresponding to an image processing method or program in an embodiment of the present application, and referring to fig. 5, the hardware configuration may include:
a Central Processing Unit (CPU) 501 serves as a control Unit or a data Processing Unit that executes various processes in accordance with a program stored in a Read Only Memory (ROM) 502 or a storage Unit 508. For example, the CPU 501 executes processing according to the order described in the above-described embodiments. A Random Access Memory (RAM) 503 stores therein programs executed by the CPU 501 and related data. The CPU 501, ROM 502, and RAM 503 are connected to each other via a bus 504.
The CPU 501 is connected to an input/output interface 505 via a bus 504, and the input/output interface 505 is connected to an input unit 506 including various switches, a keyboard, a mouse device, a microphone, a sensor, and other input means, and an output unit 505 including a display, a speaker, and other output means.
The CPU 501 executes various processes in response to an instruction input from the input unit 506, and outputs a processing result to, for example, the output unit 505.
The storage unit 508 connected to the input/output interface 505 includes, for example, a hard disk or the like, and stores therein programs executed by the CPU 501 and various data. The communication unit 509 functions as a transmission/reception unit for Wi-Fi communication, bluetooth (registered trademark) (BT) communication, and any other data communication via a network such as the internet or a local area network, and communicates with an external apparatus.
A drive 310 connected to the input/output interface 505 drives a removable medium 311 including, for example, a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory such as a memory card to perform recording/reading of data.
It is noted here that the above description of the program embodiments, like the description of the method or apparatus embodiments described above, has similar advantageous effects as the method or apparatus embodiments. For technical details not disclosed in the embodiments of the procedure of the present application, reference is made to the description of the embodiments of the method or apparatus of the present application for understanding.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. An image processing apparatus, characterized in that the apparatus comprises: the device comprises a control unit, a storage unit, a filtering unit and a scaling unit;
the control unit is used for controlling the image data to be written into the storage unit one time line by line;
the storage unit is used for only storing the single-row data currently controlled to be written by the control unit;
the filtering unit is used for carrying out filtering processing on the single-line data;
and the zooming unit is used for carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data.
2. The apparatus according to claim 1, characterized in that said storage unit, in particular for single-row storage; the storage depth of the storage unit is determined based on a maximum line resolution of the image data.
3. The apparatus of claim 2, wherein the storage unit is a single-port memory.
4. The apparatus of claim 1, wherein the control unit comprises: a data writing control subunit and a data reading control subunit;
the data writing control subunit is configured to control line data currently processed in the image data to be written into the storage unit;
and the read data control subunit is used for controlling the reading of the currently stored row data in the storage unit.
5. The apparatus of claim 4, further comprising: an interpolation relation determination unit;
the interpolation relation judging unit is used for determining target pixel data to be subjected to interpolation processing from the line data currently stored in the storage unit according to the scaling ratio of the image data;
and the read data control subunit is specifically configured to control reading of target pixel data in the line data currently stored in the storage unit according to the target pixel data determined by the interpolation relationship determination unit.
6. The apparatus according to claim 5, wherein the interpolation relation determining unit is specifically configured to determine, according to the scaling ratio of the image data, first target pixel data to be subjected to interpolation processing from the first line of data currently stored in the storage unit, and determine, according to the scaling ratio of the image data, second target pixel data to be subjected to interpolation processing from the second line of data currently stored in the storage unit;
the first row of data is a certain row of data in the image data, and the second row of data is corresponding column data obtained after all rows of data in the image data are subjected to interpolation processing.
7. The apparatus of claim 5, further comprising: an interpolation coefficient generation unit;
the interpolation coefficient generating unit is used for determining an interpolation coefficient corresponding to the target pixel data according to the point to be interpolated and the target pixel data determined by the interpolation relation determining unit;
the scaling unit is specifically configured to perform interpolation processing on the filtered target pixel data based on the interpolation coefficient corresponding to the target pixel data to obtain scaled image data.
8. The device according to claim 7, wherein the interpolation coefficient generation unit is specifically configured to determine a distance between the point to be interpolated and the target pixel data, and determine an interpolation coefficient corresponding to the target pixel point based on the distance;
wherein the interpolation coefficient is inversely related to the distance.
9. An image processing method performed by an image processing apparatus, characterized in that the method comprises:
controlling the image data to be written into the storage unit line by line at a time;
storing only a single line of data currently controlled to be written by the control unit;
filtering the single-line data;
and carrying out interpolation processing on the single-line data after filtering processing to obtain zoomed image data.
10. An image processing program executed using an image processing apparatus, characterized in that the program executes:
controlling the image data to be written into the storage unit line by line at a time;
storing only one-line data currently controlled to be written by the control unit;
filtering the single-line data;
and carrying out interpolation processing on the single-line data after the filtering processing to obtain zoomed image data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210358694.0A CN114679547A (en) | 2022-04-07 | 2022-04-07 | Image processing apparatus, method, and program |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210358694.0A CN114679547A (en) | 2022-04-07 | 2022-04-07 | Image processing apparatus, method, and program |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114679547A true CN114679547A (en) | 2022-06-28 |
Family
ID=82078405
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210358694.0A Pending CN114679547A (en) | 2022-04-07 | 2022-04-07 | Image processing apparatus, method, and program |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114679547A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101520887A (en) * | 2009-03-30 | 2009-09-02 | 北京中星微电子有限公司 | Image zooming method, device and chip |
| US20120002901A1 (en) * | 2010-07-05 | 2012-01-05 | Infovision Optoelectronics (Kunshan) Co., Ltd. | Method and Device for Image Zooming |
| CN203800997U (en) * | 2014-04-16 | 2014-08-27 | 常州纺织服装职业技术学院 | System for processing image in VGA format |
| CN106910162A (en) * | 2017-02-07 | 2017-06-30 | 深圳市爱协生科技有限公司 | Image zoom processing method and device based on FPGA |
| CN108875733A (en) * | 2018-04-23 | 2018-11-23 | 西安电子科技大学 | A kind of infrared small target quick extraction system |
| US20200193563A1 (en) * | 2017-08-31 | 2020-06-18 | SZ DJI Technology Co., Ltd. | Image processing apparatus and method, and related circuit |
| CN111968033A (en) * | 2020-07-29 | 2020-11-20 | 青岛经济技术开发区海尔热水器有限公司 | Image scaling processing method and device |
-
2022
- 2022-04-07 CN CN202210358694.0A patent/CN114679547A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101520887A (en) * | 2009-03-30 | 2009-09-02 | 北京中星微电子有限公司 | Image zooming method, device and chip |
| US20120002901A1 (en) * | 2010-07-05 | 2012-01-05 | Infovision Optoelectronics (Kunshan) Co., Ltd. | Method and Device for Image Zooming |
| CN203800997U (en) * | 2014-04-16 | 2014-08-27 | 常州纺织服装职业技术学院 | System for processing image in VGA format |
| CN106910162A (en) * | 2017-02-07 | 2017-06-30 | 深圳市爱协生科技有限公司 | Image zoom processing method and device based on FPGA |
| US20200193563A1 (en) * | 2017-08-31 | 2020-06-18 | SZ DJI Technology Co., Ltd. | Image processing apparatus and method, and related circuit |
| CN108875733A (en) * | 2018-04-23 | 2018-11-23 | 西安电子科技大学 | A kind of infrared small target quick extraction system |
| CN111968033A (en) * | 2020-07-29 | 2020-11-20 | 青岛经济技术开发区海尔热水器有限公司 | Image scaling processing method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10621697B2 (en) | Blended neural network for super-resolution image processing | |
| CN102263880B (en) | Image scaling method and apparatus thereof | |
| US9443281B2 (en) | Pixel-based warping and scaling accelerator | |
| CN112037129B (en) | Image super-resolution reconstruction method, device, equipment and storage medium | |
| EP3804347B1 (en) | A method for processing image data with reduced transmission bandwidth for display | |
| JP2005122361A (en) | Image processor, its processing method, computer program, and recording medium | |
| US5263135A (en) | Image processing apparatus | |
| JP2008067230A (en) | Image processing apparatus, image processing method, and program | |
| CN115471404A (en) | Image scaling method, processing device and storage medium | |
| JP4224876B2 (en) | Storage device, writing method and reading method | |
| KR20000039714A (en) | Texture mapping system | |
| CN114679547A (en) | Image processing apparatus, method, and program | |
| CN113362235A (en) | Image defogging method and device | |
| KR20080046276A (en) | Wipe pattern generation device | |
| CN113900813B (en) | Blind pixel filling method, system and device based on double-port RAM | |
| EP0827082A1 (en) | Semiconductor memory having arithmetic function, and processor using the same | |
| CN104918073A (en) | Image display method and terminal | |
| US11748933B2 (en) | Method for performing shader occupancy for small primitives | |
| US20070217714A1 (en) | Image processing apparatus and image processing method | |
| CN111798385B (en) | Image processing method and device, computer readable medium and electronic equipment | |
| CN101305600A (en) | Wipe pattern generation device | |
| CN117011146B (en) | Image scaling method and device, electronic equipment and storage medium | |
| CN116385260B (en) | Image processing method, device, chip, electronic equipment and medium | |
| CN111883151A (en) | Audio signal processing method, device, equipment and storage medium | |
| JPH08305895A (en) | Method and device for moving vector detection, and method and device for moving image encoding |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Room 263, block B, science and technology innovation center, 128 Shuanglian Road, Haining Economic Development Zone, Haining City, Jiaxing City, Zhejiang Province, 314400 Applicant after: Haining yisiwei IC Design Co.,Ltd. Applicant after: Beijing ESWIN Computing Technology Co.,Ltd. Address before: Room 263, block B, science and technology innovation center, 128 Shuanglian Road, Haining Economic Development Zone, Haining City, Jiaxing City, Zhejiang Province, 314400 Applicant before: Haining yisiwei IC Design Co.,Ltd. Applicant before: Beijing yisiwei Computing Technology Co.,Ltd. |
|
| CB02 | Change of applicant information |