CN103366340A - Image processing device and method and electronic device using image processing device and method - Google Patents
Image processing device and method and electronic device using image processing device and method Download PDFInfo
- Publication number
- CN103366340A CN103366340A CN 201210100190 CN201210100190A CN103366340A CN 103366340 A CN103366340 A CN 103366340A CN 201210100190 CN201210100190 CN 201210100190 CN 201210100190 A CN201210100190 A CN 201210100190A CN 103366340 A CN103366340 A CN 103366340A
- Authority
- CN
- China
- Prior art keywords
- image
- original
- resolution
- picture block
- piece
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
Provided are an image processing device and method and an electronic device using the image processing device and method. The image processing device can be applied to reconstruct a reconstructing image with a high resolution according to an original image with a low resolution. The image processing device comprises a feature point selecting device and an image reconstructing device. The feature point selecting device is used for selecting at least one feature point in the original image. The image reconstructing device is used for acquiring a corresponding first reconstructing image block with the high resolution of a first original image block comprising the feature point in the original image. Besides, with the first original image block as a center, reconstructing image blocks with the high resolution of other original image blocks around the first original image block in the original image are reconstructed according to the first reconstructing image block so that the reconstructing image of the original image is obtained.
Description
Technical field
The disclosure relates to image processing field, particularly, relates to and low-resolution image can be redeveloped into image processing equipment and the method for high-definition picture and the electronic equipment that uses described image processing equipment and method.
Background technology
Image super-resolution is a focus of present image process field.Image super-resolution method refers to from the method for low resolution (LD) image reconstruction high resolving power (HD) image.In order to rebuild high-definition picture from low-resolution image, can collect in advance a large amount of low-resolution images and corresponding high-definition picture with it.The low-resolution image that these correspond to each other and high-definition picture are divided into respectively a plurality of topographies piece.Such image block is generally very little, such as 3 * 3 pixels or 5 * 5 pixels etc., to guarantee its locality.When utilizing a low-resolution image to carry out super-resolution rebuilding, it can be divided into a plurality of image blocks, from the low-resolution image piece of collecting in advance, seek the image block that mates most with each image block, and utilize corresponding high-definition picture piece to form high-definition picture.
In the process of reconstruction of image, if select each image block in mode completely independent from one another, the continuity of the high-definition picture of then rebuilding is difficult to be guaranteed, and shows as in the high-definition picture of reconstruction to have larger noise.For this problem, thus proposed a kind of when selecting the high-definition picture piece corresponding with the low-resolution image piece, add with the estimation of error of the overlapping region of last reconstructed image interblock and selection can optimization and the low-resolution image piece between the method for high-definition picture piece reconstruction high-definition picture of difference in appearance and overlapping region error sum.Pertinent literature comprises: Freeman, W.T., Jones, T.R. and Pasztor, E.C. " the Example-Based Super-Resolution " that shows (publishes in IEEE Computer Graphics and Applications, 22 (2): 56-65,2002) (being called pertinent literature 1).
Summary of the invention
Inventor of the present disclosure finds, in the disclosed image super-resolution method of pertinent literature 1, image reconstruction process must according to from left to right, from top to bottom raster scanning (raster scan) order carries out.That is to say that the overlapping region of current image block and previous image piece comprises left part and the top of image block.This method has been improved the continuity of reconstructed image interblock, so that the high-definition picture of rebuilding has less noise.Yet, carry out in the process of image reconstruction utilizing this method, if made wrong selection for the previous image piece, so because next image block can be considered the continuity with this previous image piece, therefore selected next image block also can continue to occur to select mistake, is passed and is amplified to whole reconstructed image thereby lead to errors.
Embodiment more of the present disclosure provide a kind of image processing equipment and method that low-resolution image can be redeveloped into high-definition picture, wherein can avoid the generation of the problems referred to above.
Provide hereinafter about brief overview of the present disclosure, in order to basic comprehension about some aspect of the present disclosure is provided.Should be appreciated that this general introduction is not about exhaustive general introduction of the present disclosure.It is not that intention is determined key of the present disclosure or pith, neither be intended to limit the scope of the present disclosure.Its purpose only is that the form of simplifying provides some concept, with this as the in greater detail preorder of discussing after a while.
According to an aspect of the present disclosure, a kind of image processing equipment is provided, be used for rebuilding high-resolution reconstructed image according to the original image of low resolution.This image processing equipment can comprise: the unique point selecting arrangement is used for selecting at least one unique point at described original image; Reach equipment for reconstructing image, be used for high-resolution the first reconstructed image piece corresponding to the first original picture block that acquisition and described original image comprise described unique point; And centered by described the first original picture block, rebuild the high-resolution reconstructed image piece that is positioned at described the first original picture block other original picture block on every side in the described original image according to described the first reconstructed image piece, to obtain the reconstructed image of described original image.
According to another aspect of the present disclosure, a kind of image processing method is provided, be used for rebuilding high-resolution reconstructed image according to the original image of low resolution.This image processing method can comprise: select at least one unique point in described original image; And high-resolution the first reconstructed image piece corresponding to the first original picture block that comprises described unique point in acquisition and the described original image, and centered by described the first original picture block, rebuild the high-resolution reconstructed image piece that is positioned at described the first original picture block other original picture block on every side in the described original image according to described the first reconstructed image piece, to obtain the reconstructed image of described original image.
According to another aspect of the present disclosure, a kind of watch-dog is provided, this watch-dog comprises the above-mentioned image processing equipment that can rebuild according to the original image of low resolution high-resolution reconstructed image.According to this aspect of the present disclosure, a kind of supervisory system also is provided, this supervisory system comprises at least one watch-dog, and in described at least one watch-dog at least one comprises the above-mentioned image processing equipment that can rebuild according to the original image of low resolution high-resolution reconstructed image.
According to another aspect of the present disclosure, a kind of televisor is provided, this televisor comprises the above-mentioned image processing equipment that can rebuild according to the original image of low resolution high-resolution reconstructed image.According to another aspect of the present disclosure, a kind of set-top box of televisor also is provided, this set-top box comprises the above-mentioned image processing equipment that can rebuild according to the original image of low resolution high-resolution reconstructed image.
In addition, the disclosure also is provided for realizing the computer program of above-mentioned image processing method.
In addition, the disclosure also provides at least computer program or the recording medium of computer-readable medium form, records on it be used to the computer program code of realizing above-mentioned image processing method.
Description of drawings
With reference to below in conjunction with the explanation of accompanying drawing to disclosure embodiment, can understand more easily above and other purpose of the present disclosure, characteristics and advantage.Parts in the accompanying drawing are not proportional draftings, and just for principle of the present disclosure is shown.In the accompanying drawings, same or similar technical characterictic or parts will adopt identical or similar Reference numeral to represent.
Fig. 1 illustrates the schematic block diagram according to the structure of the image processing equipment of the disclosure one embodiment;
Fig. 2 is the indicative flowchart that illustrates according to the image processing method of the disclosure one embodiment;
Fig. 3 illustrates the schematic block diagram according to the structure of the image processing equipment of the disclosure one specific embodiment;
Fig. 4 is the indicative flowchart that illustrates according to the method for the high-definition picture piece of the reconstruction low-resolution image piece of the disclosure one specific embodiment;
Fig. 5 is the indicative flowchart that illustrates according to the method for the high-definition picture piece of the reconstruction low-resolution image piece of another specific embodiment of the disclosure; And
Fig. 6 is the block diagram that illustrates be used to the structure of the computing machine of realizing embodiment of the present disclosure or example.
Embodiment
Embodiment of the present disclosure is described with reference to the accompanying drawings.The element of describing in an accompanying drawing of the present disclosure or a kind of embodiment and feature can combine with element and the feature shown in one or more other accompanying drawing or the embodiment.Should be noted that for purpose clearly, omitted in accompanying drawing and the explanation and the disclosure expression and description irrelevant, parts known to persons of ordinary skill in the art and processing.
Image processing equipment and the method for rebuilding high-resolution reconstructed image according to the original image of low resolution of being used for according to embodiment more of the present disclosure is described below.
Fig. 1 shows the block diagram according to the structure of the image processing equipment of an embodiment of the present disclosure.Fig. 2 is the exemplary process diagram that illustrates according to the image processing method of an embodiment.
In the embodiment shown in Fig. 1 or 2, in low-resolution image to be rebuild, select one or more unique point, and begin to rebuild high-definition picture from the corresponding image block of selected unique point.
As shown in Figure 1, image processing equipment 100 comprises unique point selecting arrangement 101 and equipment for reconstructing image 103.As shown in Figure 2, this image processing method comprises step 202,204,206 and 208 etc.
Unique point selecting arrangement 101 is used for selecting at least one unique point (step 202 among Fig. 2) in low resolution input picture to be rebuild (for convenience, hereinafter referred to as " original image ").
As example, unique point described here can refer in the original image to compare with neighborhood territory pixel or zone pixel or the zone of certain or some characteristic remarkables.As a specific example, described unique point can be pixel or the zone of the representative and robustness in the original image (namely have in the situation of noise also can stably be located), and the image block (the perhaps image block centered by this point or zone) that comprises this point or zone all has the texture that enough enriches at vertical and horizontal usually.Concrete example for example comprises: the first and second eigenwerts in angle point, the gradient summation matrix character are the corresponding point of curvature maximal value on very large point, local bright spot or dim spot, line segment terminal point or certain curve all, etc.
Unique point selecting arrangement 101 (in step 202) can adopt any suitable method to select described unique point in image, concrete example can (be published in Proceedings of the 4th Alvey Vision Conference referring to " the A combined corner and edge detector " that C.Harris and M.Stephens show, the 147-151 page or leaf, 1988) (being called pertinent literature 2) and C.Tomasi and T.Kanade " the Detection and Tracking of Point Features " that show (publish in Pattern Recognition, 37:165-168,2004) (being called pertinent literature 3).Except above-mentioned concrete example, can also adopt other suitable methods to select the point of the characteristic remarkable in the image, do not do concrete restriction here.
Equipment for reconstructing image 103 comprises low resolution original picture block (for convenience, being called the first original picture block) beginning of selected unique point from original image, rebuild the high-definition picture piece of each original picture block in the original image.
Particularly, equipment for reconstructing image 103 is at first rebuild the high-definition picture piece (being called the first reconstructed image piece) of the first original picture block, namely obtains the high-resolution first reconstructed image piece (shown in Figure 2 step 204) corresponding with the first original picture block.Then, equipment for reconstructing image 103 is rebuild the high-definition picture piece of each other original picture block in the original image centered by the first original picture block.Namely, rebuild the high-resolution reconstructed image piece (step 206 shown in Figure 2) that is positioned at the first original picture block other original picture block on every side in the described original image according to the first reconstructed image piece, until obtain the super-resolution reconstruction image of whole original image.For example, when rebuilding the super-resolution reconstruction image block of original picture block, consider to make this reconstructed image piece and each adjacent reconstructed image piece adjoiner of having rebuild to keep continuity, treat that namely the reconstructed image piece should have similar image texture to adjacent reconstructed image piece at adjoiner (overlapping region or juncture area).Because at first rebuilding the first original picture block obtains the first reconstructed image piece, other original picture block around rebuilding again realize rebuilding the high-resolution reconstructed image piece that is positioned at the first original picture block other original picture block on every side in the described original image according to the first reconstructed image piece in this way.
Equipment for reconstructing image 103 (in step 204 or step 206) can be adopted the super-resolution reconstruction image block of rebuilding in any suitable manner certain low resolution original picture block, for example can adopt hereinafter method or any other the suitable image rebuilding method described with reference to figure 4 or Fig. 5, not enumerate one by one here.
As an example, equipment for reconstructing image 103 (in step 206) can according to the distance of other image blocks in the original image and the first original picture block, be rebuild the super-resolution reconstruction image block of described other original picture block with distance order from small to large.As a concrete example, can adopt any suitable method to calculate two distances between the image block, for example, can adopt following formula to calculate the distance of two image blocks:
d(p
1，p
2)＝|x
1-x
2|+|y
1+y
2| (1)
Wherein, d (p
1, p
2) two image block p of expression
1And p
2Between distance, (x
1, y
1) presentation video piece p
1The coordinate figure of reference point (such as central point), (x
2, y
2) presentation video piece p
2The coordinate figure of reference point (such as central point).Certainly, can also adopt any other suitable method to calculate two distances between the image block, not enumerate one by one here.
As an example, can be from the first original image BOB(beginning of block), along the high-definition picture piece that centered by the first original picture block, comes other original picture block of sequential reconstruction to extraradial direction.As a concrete example, can along with the reconstructed image piece of other original picture block of sequential reconstruction such as direction of each edge-perpendicular of this first original picture block, for example, be in the situation of rectangle at image block, can along upwards, downwards, left and to the right direction rebuilds the high-definition picture piece of other image blocks from the first original image BOB(beginning of block) block-by-block, until rebuild the high-definition picture of whole original image.More than having provided image block is the example of rectangle.Should be understood that and can also adopt any other suitable shapes to come the partitioned image piece, can be pentagon, hexagon or rhombus etc. such as image block, does not enumerate one by one here.The disclosure is not limited to these concrete examples.
In the above-described embodiments, begin super-resolution reconstruction from least one unique point of the original image of low resolution, expand to gradually entire image.Because the first original picture block comprises unique point, therefore, the probability of correctly rebuilding its high-definition picture piece is larger, can avoid better the original reconstruction mistake, thereby avoids wrong transmission.Further, in one embodiment, from the original input picture of low resolution, selecting in the situation of a plurality of unique points, can be respectively centered by each of this a plurality of unique points, and begin to rebuild other original picture block from each unique point respectively.Since disperse respectively from comprising a plurality of first original image BOB(beginning of block) super-resolution reconstructions of unique point, even occur original reconstruction mistake to a certain degree in the process of reconstruction of some the first original picture block, error diffusion can be limited in the respective regions and can not be passed to whole image, thereby guarantees the performance of whole image super-resolution.From the another one angle, the reconstruction of other original picture block is based on the first reconstructed image piece of accurate reconstruction, thereby can improves the precision of entire image super-resolution.In addition, as mentioned above, as preferred exemplary, described at least one unique point can be chosen the point of the characteristic remarkable in the low resolution original image; Compare with above-described embodiment, in such preferred exemplary, because the first original picture block comprises the point of such characteristic remarkable, therefore, the probability of correct its high-definition picture piece of reconstruction is larger, can avoid most possibly the original reconstruction mistake, thereby further avoids wrong transmission.
Fig. 3 is the schematic block diagram that illustrates according to the structure of the image processing equipment of a specific embodiment.In this specific embodiment, a plurality of low-resolution image pieces that image processing equipment storage is collected in advance and the high-definition picture piece of correspondence with it are for super-resolution rebuilding.
As shown in Figure 3, similar to image processing equipment 100 shown in Figure 1, image processing equipment 300 also comprises unique point selecting arrangement 301 and equipment for reconstructing image 303.Difference is that image processing equipment 300 also comprises memory storage 305, and equipment for reconstructing image 303 can comprise searcher 303-1 and selecting arrangement 303-2.
Unique point selecting arrangement 301 and unique point selecting arrangement 101 functional similarities shown in Figure 1 can adopt the method for above describing with reference to step 202 shown in Figure 2 to select unique point, are not repeated in this description here.
A plurality of sample low-resolution image pieces that memory storage 305 is used in advance collection of storage reach corresponding with it sample high-definition picture piece.As an example, each sample low-resolution image piece can be corresponding to a sample high-definition picture piece.As another example, each sample low-resolution image piece can be corresponding to a plurality of sample high-definition picture pieces.
Equipment for reconstructing image 303 is used for from the first original image BOB(beginning of block), rebuilds the high-definition picture piece of each original picture block in the original image, thereby rebuilds the high-definition picture of whole original image.
Fig. 4 is the indicative flowchart that illustrates according to the method for the super-resolution reconstruction image block of the reconstruction low resolution original picture block of the disclosure one specific embodiment.Equipment for reconstructing image 303 can adopt method shown in Figure 4 to rebuild the super-resolution reconstruction image block of certain low resolution original picture block.Step 204 shown in Figure 2 and step 206 all can comprise each step shown in Figure 4, can adopt method shown in Figure 4 to rebuild the super-resolution reconstruction image block of the first original picture block and other original picture block.
Describe the function of each device in the equipment for reconstructing image 303 in detail below in conjunction with the process flow diagram of Fig. 4.
Particularly, searcher 303-1 is used for searching for one or more sample low-resolution image piece (step 408 shown in Figure 4) that mates with original picture block in a plurality of sample low-resolution image pieces of memory storage 305 storages, thereby obtains the sample high-definition picture piece corresponding with these sample low-resolution image pieces.Searcher 303-1 can adopt any suitable method to search in pre-stored a plurality of sample image pieces.As a concrete example, searcher 303-1 can adopt the method for fast searching in the following document: S.Arya, " An optimal algorithm for approximate nearest neighbor searching " that D.M.Mount, N.S.Netanyahu, R.Silverman and A.Wu show (publishes in Journal of the ACM, 45 (6): 891-923,1998) (being called pertinent literature 4).
Selecting arrangement 303-2 is used for selecting one at sample high-definition picture piece corresponding to one or more sample low-resolution image piece that searches, as the high-resolution reconstructed image piece (step 410 shown in Figure 4) of this original picture block.
Fig. 5 is the indicative flowchart that illustrates according to the method for the super-resolution reconstruction image block of the reconstruction low resolution original picture block of another specific embodiment of the disclosure.Equipment for reconstructing image 303 can adopt method shown in Figure 5 to rebuild the super-resolution reconstruction image block of certain low resolution original picture block.Step 206 shown in Figure 2 can comprise each step shown in Figure 5, can adopt method shown in Figure 5 to rebuild the super-resolution reconstruction image block of original picture block.
Describe the function of each device in the equipment for reconstructing image 303 in detail below in conjunction with the process flow diagram of Fig. 5.
Particularly, searcher 303-1 is used for searching for one or more sample low-resolution image piece (step 508 shown in Figure 5) that mates with original picture block in a plurality of sample low-resolution image pieces of memory storage 305 storages, thereby obtains the sample high-definition picture piece corresponding with these sample low-resolution image pieces.
The error (step 510 shown in Figure 5) of the overlapping region between each of the sample high-definition picture piece that one or more sample low-resolution image piece that selecting arrangement 303-2 searches for calculating is corresponding and each adjacent reconstructed image piece of having rebuild.In other words, in this specific embodiment, when dividing original image, so that have the overlapping region between each adjacent original picture block.Also can there be the overlapping region between the super-resolution reconstruction image block of each original picture block that obtains like this, and one or more its adjacent reconstructed image piece.Can adopt any suitable method to calculate the error of the overlapping region of two adjacent image pieces, for example, can calculate the respective pixel values of two adjacent image pieces in the overlapping region difference and, or calculate the mean value of difference of the respective pixel values in this overlapping region or intermediate value etc., as described error.Certainly, can also adopt its other party to calculate the error of the overlapping region between the adjacent image piece, for example, adopt the distance scale that discloses in the pertinent literature 1 to calculate this error, not enumerate one by one here.
Then, selecting arrangement 303-2 selects (for example least error) sample high-definition picture piece corresponding with Optimal error from described sample high-definition picture piece, as the high-resolution reconstructed image piece (step 512 shown in Figure 5) of original picture block to be rebuild.
In method shown in Figure 5, have the overlapping region between the adjacent original picture block, therefore, also have the overlapping region between the corresponding adjacent super-resolution reconstruction image block, adopt this method can be so that the super-resolution reconstruction image is more continuous.
As a concrete example, between two adjacent super-resolution reconstruction image blocks, have in the situation of overlapping region, selecting arrangement 303-2 can also adopt the mean value of two the respective pixel values of these two adjacent image pieces on reconstruction regions, as the value (not shown among Fig. 5) of each pixel in this overlapping region in the reconstructed image.
In another embodiment, there is not the overlapping region between two adjacent super-resolution reconstruction image blocks, but seamless adjacency.In the present embodiment, selecting arrangement 303-2 be used for to calculate each of sample high-definition picture piece corresponding to one or more sample low-resolution image piece of searching and the distance in the both sides of edges zone, boundary of each adjacent reconstructed image piece of having rebuild.Can adopt any suitable method to calculate the distance in the both sides of edges zone, boundary of two adjacent image pieces, for example, can get respectively two adjacent image piece boundary both sides of edges the juncture area of formed objects, calculate the correspondence position of two adjacent image pieces in juncture area pixel value difference and, or calculate the mean value of difference of pixel value of the correspondence position in this juncture area or intermediate value etc., as described error.
Then, selecting arrangement 303-2 selects (for example least error) sample high-definition picture piece corresponding with Optimal error from described sample high-definition picture piece, as the high-resolution reconstructed image piece of original picture block to be rebuild.
In one embodiment, from the original input picture of low resolution, selecting in the situation of a plurality of unique points, can be respectively centered by each of this a plurality of unique points, and begin to rebuild other original picture block from each unique point respectively.Can adopt the mode of parallel or serial to rebuild, can further improve like this speed of image super-resolution rebuilding.When the mode that adopts serial is rebuild, can rebuild by image block.When adopting parallel mode to rebuild, can begin to rebuild from a plurality of unique points simultaneously.
Can be applied to various application scenarioss according to image processing equipment and the method that low-resolution image is rebuild high-definition picture according to of the present disclosure, for example, can be applied in the various video monitoring equipments.When original image clear not (resolution is lower) that watch-dog gathers, can adopt above-mentioned image processing equipment or method to carry out super-resolution rebuilding.And for example, image processing equipment and method according to disclosure embodiment can also be applied in televisor or the television set top box, can be used for the television image (such as the standard definition television image) of low resolution is redeveloped into high-resolution image (such as high-definition television image).
According to an embodiment of the present disclosure, a kind of watch-dog (not shown) also is provided, this watch-dog comprises the image processing equipment according to above-described embodiment or example.According to an embodiment of the present disclosure, a kind of supervisory system (not shown) also is provided, this supervisory system comprises at least one above-mentioned watch-dog.According to an embodiment of the present disclosure, a kind of televisor (not shown) also is provided, this televisor comprises the image processing equipment according to above-described embodiment or example.According to an embodiment of the present disclosure, a kind of set-top box (not shown) of televisor also is provided, this set-top box comprises at least one above-mentioned watch-dog.
Understand easily, the various electronic systems or the equipment (such as watch-dog and system, television set top box etc.) that comprise the image processing equipment of above-mentioned embodiment of the present disclosure or used above-mentioned image processing method also should be considered to fall in the protection domain of the present disclosure.
Should be understood that above-described embodiment and example are exemplary, rather than exhaustive, the disclosure should not be regarded as being confined to any specific embodiment or example.In above-described embodiment and example, adopted " first " such wait statement (such as the first original picture block etc.).Those of ordinary skill in the art should be understood that above-mentioned statement just for term being done literal differentiation, and is not its order or any other restriction of expression.In addition, in above-described embodiment and example, adopt figure notation to come the step of method for expressing or the module of equipment.Those of ordinary skill in the art should be understood that these figure notations just for these steps or module are done literal differentiation, and is not its order or any other restriction of expression.
As an example, each step of said method and all modules of the said equipment and/or unit may be embodied as software, firmware, hardware or its combination.As an example, in situation about realizing by software or firmware, the program of the software that is configured for implementing said method can be installed from storage medium or network to the computing machine with specialized hardware structure (for example multi-purpose computer 600 shown in Figure 6), this computing machine can be carried out various functions etc. when various program is installed.
In Fig. 6, CPU (central processing unit) (CPU) 601 carries out various processing according to the program of storage in the ROM (read-only memory) (ROM) 602 or from the program that storage area 608 is loaded into random access memory (RAM) 603.In RAM 603, also store as required data required when CPU 601 carries out various processing etc.CPU 601, ROM 602 and RAM 603 are connected to each other via bus 604.Input/output interface 605 also is connected to bus 604.
Following parts are connected to input/output interface 605: importation 606 (comprising keyboard, mouse etc.), output 607 (comprise display, such as cathode-ray tube (CRT) (CRT), liquid crystal display (LCD) etc., with loudspeaker etc.), storage area 608 (comprising hard disk etc.), communications portion 609 (comprising that network interface unit is such as LAN card, modulator-demodular unit etc.).Communications portion 609 is processed such as the Internet executive communication via network.As required, driver 610 also can be connected to input/output interface 605.Detachable media 611 is installed on the driver 610 as required such as disk, CD, magneto-optic disk, semiconductor memory etc., so that the computer program of therefrom reading is installed in the storage area 608 as required.
Realizing by software in the situation of above-mentioned series of processes, such as detachable media 611 program that consists of software is being installed such as the Internet or storage medium from network.
It will be understood by those of skill in the art that this storage medium is not limited to shown in Figure 6 wherein has program stored therein, distributes separately to provide the detachable media 611 of program to the user with equipment.The example of detachable media 611 comprises disk (comprising floppy disk (registered trademark)), CD (comprising compact disc read-only memory (CD-ROM) and digital universal disc (DVD)), magneto-optic disk (comprising mini-disk (MD) (registered trademark)) and semiconductor memory.Perhaps, storage medium can be hard disk that comprises in ROM 602, the storage area 608 etc., computer program stored wherein, and be distributed to the user with the equipment that comprises them.
The disclosure also proposes a kind of program product that stores the instruction code that machine readable gets.When described instruction code is read and carried out by machine, can carry out above-mentioned method according to disclosure embodiment.
Correspondingly, being used for carrying the above-mentioned storage medium that stores the program product of the instruction code that machine readable gets is also included within of the present disclosure open.Described storage medium includes but not limited to floppy disk, CD, magneto-optic disk, storage card, memory stick etc.
In the above in the description to disclosure specific embodiment, can in one or more other embodiment, use in identical or similar mode for the feature that a kind of embodiment is described and/or illustrated, combined with the feature in other embodiment, or the feature in alternative other embodiment.
Should emphasize that term " comprises/comprise " existence that refers to feature, key element, step or assembly when this paper uses, but not get rid of the existence of one or more further feature, key element, step or assembly or additional.
In addition, the time sequencing of describing during method of the present disclosure is not limited to is to specifications carried out, also can according to other time sequencing ground, carry out concurrently or independently.The execution sequence of the method for therefore, describing in this instructions is not construed as limiting technical scope of the present disclosure.
Although the above discloses the disclosure by the description to specific embodiment of the present disclosure, but, should be appreciated that those skilled in the art can design various modifications of the present disclosure, improvement or equivalent in the spirit and scope of claims.These modifications, improve or be equal to also and should be believed to comprise in protection domain of the present disclosure.
Claims (18)
1. an image processing equipment is used for rebuilding high-resolution reconstructed image according to the original image of low resolution, comprising:
The unique point selecting arrangement is used for selecting at least one unique point at described original image; And
Equipment for reconstructing image be used for to obtain and described original image comprises high-resolution the first reconstructed image piece corresponding to the first original picture block of described unique point; And centered by described the first original picture block, rebuild the high-resolution reconstructed image piece that is positioned at described the first original picture block other original picture block on every side in the described original image according to described the first reconstructed image piece, to obtain the reconstructed image of described original image.
2. image processing equipment according to claim 1, wherein, described equipment for reconstructing image is configured to:
With with the distance order from small to large of described the first original picture block, rebuild the reconstructed image piece of described other original picture block.
3. image processing equipment according to claim 2, wherein, described equipment for reconstructing image is further configured to:
From described the first original image BOB(beginning of block), along with the described original image of direction sequential reconstruction of the edge-perpendicular of described the first original picture block in the reconstructed image piece of other original picture block.
4. each described image processing equipment according to claim 1-3 wherein, also comprises:
Memory storage is used for a plurality of sample low-resolution image pieces and corresponding sample high-definition picture piece that storage is collected in advance, and
Wherein, described equipment for reconstructing image comprises:
Searcher is used for searching for one or more sample low-resolution image piece that mates with original picture block to be rebuild at pre-stored a plurality of sample low-resolution image pieces,
Selecting arrangement is used for selecting one at sample high-definition picture piece corresponding to one or more sample low-resolution image piece that searches, as the reconstructed image piece of original picture block described to be rebuild.
5. image processing equipment according to claim 4, wherein,
Described selecting arrangement is arranged to the error of the overlapping region between each the adjacent reconstructed image piece that calculates each in one or more sample high-definition picture piece corresponding with described one or more sample low-resolution image piece and rebuild, and a selection sample high-definition picture piece corresponding with least error, as the reconstructed image piece of original picture block described to be rebuild.
6. each described image processing equipment according to claim 1-3, wherein, described unique point is pixel or the zone of comparing characteristic remarkable with other parts in the described original image.
7. image processing equipment according to claim 6, wherein, described feature is Corner Feature, gradient summation matrix character, pixel value or its combination in any.
8. an image processing method is used for rebuilding high-resolution reconstructed image according to the original image of low resolution, comprising:
In described original image, select at least one unique point; And
Obtain with described original image in comprise high-resolution the first reconstructed image piece corresponding to the first original picture block of described unique point, and centered by described the first original picture block, rebuild the high-resolution reconstructed image piece that is positioned at described the first original picture block other original picture block on every side in the described original image according to described the first reconstructed image piece, to obtain the reconstructed image of described original image.
9. image processing method according to claim 8, wherein, the reconstructed image piece of rebuilding other original picture block in the described original image comprises:
With with the distance order from small to large of described the first original picture block, rebuild the reconstructed image piece of described other original picture block.
10. image processing method according to claim 9, wherein, the reconstructed image piece of rebuilding other original picture block in the described original image comprises:
Centered by described the first original picture block, along with the described original image of direction sequential reconstruction of the edge-perpendicular of described the first original picture block in the reconstructed image piece of other original picture block.
11. each described image processing method according to claim 8-10 wherein, obtains the first reconstructed image piece corresponding with described the first original picture block and comprises:
One or more sample low-resolution image piece that search and described the first original picture block are mated most in pre-stored a plurality of sample low-resolution image pieces; And
From sample one or more sample high-definition picture piece corresponding with described sample low-resolution image piece, select one, as described the first reconstructed image piece.
12. the described image processing method of each according to claim 8-10, wherein, the reconstructed image piece of rebuilding other original picture block in the described original image comprises:
For original picture block to be rebuild, one or more sample low-resolution image piece that search and this original picture block are mated most from pre-stored a plurality of sample low-resolution image pieces, and acquisition one or more sample high-definition picture piece corresponding with described one or more sample low-resolution image piece; And
The error of the overlapping region between each the adjacent reconstructed image piece that calculates respectively each in described one or more sample high-definition picture piece and rebuild, and a selection sample high-definition picture piece corresponding with least error, as the reconstructed image piece of original picture block described to be rebuild.
13. each described image processing method according to claim 8-10, wherein, described unique point is pixel or the zone of comparing characteristic remarkable with other parts in the described original image.
14. image processing method according to claim 13, wherein, described feature is Corner Feature, gradient summation matrix character, pixel value or its combination in any.
15. a watch-dog can be rebuild high-resolution reconstructed image according to the original image of low resolution, comprising:
The unique point selecting arrangement is used for selecting at least one unique point at described original image; And
Equipment for reconstructing image be used for to obtain and described original image comprises high-resolution the first reconstructed image piece corresponding to the first original picture block of described unique point; And centered by described the first original picture block, rebuild the high-resolution reconstructed image piece that is positioned at described the first original picture block other original picture block on every side in the described original image according to described the first reconstructed image piece, to obtain the reconstructed image of described original image.
16. a supervisory system comprises at least one watch-dog, wherein, at least one in described at least one watch-dog can be rebuild high-resolution reconstructed image and comprise according to the original image of low resolution:
The unique point selecting arrangement is used for selecting at least one unique point at described original image; And
Equipment for reconstructing image be used for to obtain and described original image comprises high-resolution the first reconstructed image piece corresponding to the first original picture block of described unique point; And centered by described the first original picture block, rebuild the high-resolution reconstructed image piece that is positioned at described the first original picture block other original picture block on every side in the described original image according to described the first reconstructed image piece, to obtain the reconstructed image of described original image.
17. a televisor comprises the image processing equipment that can rebuild according to the original image of low resolution high-resolution reconstructed image, this image processing equipment comprises:
The unique point selecting arrangement is used for selecting at least one unique point at described original image; And
Equipment for reconstructing image be used for to obtain and described original image comprises high-resolution the first reconstructed image piece corresponding to the first original picture block of described unique point; And centered by described the first original picture block, rebuild the high-resolution reconstructed image piece that is positioned at described the first original picture block other original picture block on every side in the described original image according to described the first reconstructed image piece, to obtain the reconstructed image of described original image.
18. a set-top box that is used for televisor comprises the image processing equipment that can rebuild according to the original image of low resolution high-resolution reconstructed image, this image processing equipment comprises:
The unique point selecting arrangement is used for selecting at least one unique point at described original image; And
Equipment for reconstructing image be used for to obtain and described original image comprises high-resolution the first reconstructed image piece corresponding to the first original picture block of described unique point; And centered by described the first original picture block, rebuild the high-resolution reconstructed image piece that is positioned at described the first original picture block other original picture block on every side in the described original image according to described the first reconstructed image piece, to obtain the reconstructed image of described original image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201210100190 CN103366340A (en) | 2012-04-06 | 2012-04-06 | Image processing device and method and electronic device using image processing device and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 201210100190 CN103366340A (en) | 2012-04-06 | 2012-04-06 | Image processing device and method and electronic device using image processing device and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103366340A true CN103366340A (en) | 2013-10-23 |
Family
ID=49367616
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 201210100190 Pending CN103366340A (en) | 2012-04-06 | 2012-04-06 | Image processing device and method and electronic device using image processing device and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103366340A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015078420A1 (en) * | 2013-11-29 | 2015-06-04 | Mediatek Inc. | Methods and apparatus for intra picture block copy in video compression |
| CN106447610A (en) * | 2016-08-31 | 2017-02-22 | 重庆大学 | Image reconstruction method and image reconstruction device |
-
2012
- 2012-04-06 CN CN 201210100190 patent/CN103366340A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2015078420A1 (en) * | 2013-11-29 | 2015-06-04 | Mediatek Inc. | Methods and apparatus for intra picture block copy in video compression |
| US10171834B2 (en) | 2013-11-29 | 2019-01-01 | Mediatek Inc. | Methods and apparatus for intra picture block copy in video compression |
| CN106447610A (en) * | 2016-08-31 | 2017-02-22 | 重庆大学 | Image reconstruction method and image reconstruction device |
| CN106447610B (en) * | 2016-08-31 | 2019-07-23 | 重庆大学 | Image rebuilding method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10778949B2 (en) | Robust video-based camera rotation estimation | |
| Li et al. | Video super-resolution using an adaptive superpixel-guided auto-regressive model | |
| Meng et al. | The augmented lagrange multipliers method for matrix completion from corrupted samplings with application to mixed Gaussian-impulse noise removal | |
| US20160104301A1 (en) | Cross-level image blending | |
| Patel et al. | Accelerated seam carving for image retargeting | |
| Jiang et al. | Deep edge map guided depth super resolution | |
| Walha et al. | Resolution enhancement of textual images: a survey of single image‐based methods | |
| Muhammad et al. | Multi-scale Xception based depthwise separable convolution for single image super-resolution | |
| Zhao et al. | Single MR image super-resolution via channel splitting and serial fusion network | |
| Chen et al. | Enhanced semantic feature pyramid network for small object detection | |
| KR20120138642A (en) | Image processing method and image processing apparatus | |
| Yu et al. | Progressive refined redistribution pyramid network for defect detection in complex scenarios | |
| CN103366340A (en) | Image processing device and method and electronic device using image processing device and method | |
| Xu et al. | Magnification-arbitrary depth super-resolution with multiscale consistency deformable alignment | |
| Yang et al. | Infrared image super-resolution with parallel random Forest | |
| Chen et al. | High-order relational generative adversarial network for video super-resolution | |
| Das et al. | Extracting building footprints from high-resolution aerial imagery using refined cross AttentionNet | |
| Pan et al. | Research on seamless image stitching based on fast marching method | |
| US20100260435A1 (en) | Edge Directed Image Processing | |
| Voronin et al. | Image restoration using 2D autoregressive texture model and structure curve construction | |
| Lu et al. | Context-aware single image super-resolution using sparse representation and cross-scale similarity | |
| Wang et al. | Robust training for multi-view stereo networks with noisy labels | |
| Wu et al. | Dense stereo matching in depth discontinuity areas based on edge detection and nearest valid point search | |
| Jin et al. | Content aware metric for image resizing assessment | |
| Amintoosi et al. | Precise image registration with structural similarity error measurement applied to superresolution |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20131023 |