CN102915521A - Method and device for processing mobile terminal images - Google Patents

Method and device for processing mobile terminal images Download PDF

Info

Publication number
CN102915521A
CN102915521A CN2012103153457A CN201210315345A CN102915521A CN 102915521 A CN102915521 A CN 102915521A CN 2012103153457 A CN2012103153457 A CN 2012103153457A CN 201210315345 A CN201210315345 A CN 201210315345A CN 102915521 A CN102915521 A CN 102915521A
Authority
CN
China
Prior art keywords
original image
vegetarian refreshments
interpolation pixel
area
interest
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2012103153457A
Other languages
Chinese (zh)
Inventor
张静
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN2012103153457A priority Critical patent/CN102915521A/en
Publication of CN102915521A publication Critical patent/CN102915521A/en
Priority to PCT/CN2013/080113 priority patent/WO2013185695A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a method and a device for processing mobile terminal images, which are used for increasing the processing speed. The method comprises the steps that: area-of-interest detection is carried out on an image to be processed according to area-of-interest prior information which is obtained in advance; and the resolution of a detected area of interest is improved. The device comprises an area-of-interest detection module and a resolution improving module. Compared with the prior art, an area-of-interest detection part fully takes the prior information of a user interested object which is obtained in advance into consideration, and the detection accuracy of the area of interest is improved; and the resolution improving part of the area of interest only improves the resolution of the detected area of interest, so that the processing speed can be increased.

Description

A kind of portable terminal image processing method and device
Technical field
The present invention relates to image processing field, be specifically related to a kind of portable terminal image processing method and device.
Background technology
In image processing field, the figure image intensifying is very important direction.Image enhancement technique is mainly studied the feature that original unsharp image is become clear or strengthen some concern, suppresses the feature of non-concern, improves picture quality, abundant information amount to reach, and strengthens the purpose of image interpretation and recognition effect.
Existing image resolution ratio lift technique is broadly divided into 2 large classes, and a class is based on many low-resolution images, by to correct image, then utilizes the modes such as interpolation, reconstruction or study to obtain a secondary high-definition picture.The quality of this class methods effect depends on the kinematic parameter before 2 sub-pictures to a great extent, and computation complexity is generally higher simultaneously; The Equations of The Second Kind method is based on single low-resolution image, it is carried out interpolation obtain a high-definition picture.This method is owing to only relate to low-resolution image itself, and the scope of application is wider.
The interpolation algorithm that extensively adopts comprises point of proximity interpolation algorithm, bilinear interpolation algorithm and two cubes of interpolation algorithms etc.Linear between point of proximity interpolation algorithm hypothesis interpolation point pixel and its horizontal neighborhood territory pixel, often can cause obvious distortion; The bilinear interpolation algorithm increases the constraint that vertical neighborhood territory pixel point is treated interpolating pixel point on the basis of point of proximity interpolation, be better than the former on the interpolation performance; Compare an above-mentioned interpolation algorithm considered pixel and put the impact that 4 neighborhood territory pixels are treated interpolation point, two cubes of interpolation algorithms with expanded range to 16 neighborhoods, adopt simultaneously more level and smooth curve calculation interpolation picture element point chromatic value, the interpolation effect is optimum, yet computation complexity is also the highest.
Summary of the invention
The technical problem to be solved in the present invention provides a kind of portable terminal image processing method and device, improves processing speed.
For solving the problems of the technologies described above, the invention provides a kind of portable terminal image processing method, comprising:
According to the area-of-interest prior imformation that obtains in advance pending image being carried out area-of-interest detects;
Detected area-of-interest is carried out resolution to be promoted.
Further, described area-of-interest prior imformation obtains in the following ways in advance:
Provide one or more image to the user, every image comprises one or more targets, and prompting user is provided in the image that provides by own interested target;
Calculate the characteristic parameter of the interesting target of user's demarcation;
The characteristic parameter of user's interesting target is saved in active user's standard interesting target storehouse as prior imformation.
Further, the area-of-interest prior imformation that described basis obtains is in advance carried out area-of-interest to pending image and is detected, and comprising:
According to image inside similar features pending image is divided into one or more subject area;
Calculate the characteristic parameter of described subject area;
The characteristic parameter of described subject area and the characteristic parameter in the standard area-of-interest object library are carried out similarity compare, will be defined as user's area-of-interest greater than the subject area of predetermined threshold value with standard feature parameter similarity.
Further, describedly detected area-of-interest carried out resolution promote, comprising:
According to the image enlargement factor N that pre-sets, detected area-of-interest is mapped in the amplification space, described amplification space is N times of area-of-interest;
In described amplification space, according to the original image vegetarian refreshments, adopt in the described amplification of the interpolation calculation space color-values of other pixels except the original image vegetarian refreshments, finish the lifting of image local resolution.
Further, the image enlargement factor N that pre-sets in described basis, with detected area-of-interest be mapped to amplify in the space before, described method also comprises:
Described area-of-interest is carried out regularization to be processed.
Further, described in amplifying the space according to the original image vegetarian refreshments, adopt interpolation calculation to amplify in the space color-values of other pixels except the original image vegetarian refreshments, comprising:
If in the amplification space except the original image vegetarian refreshments other pixels be the interpolation pixel, each interpolation pixel is carried out following processing:
Calculate the degree of correlation of interpolation pixel and M original image vegetarian refreshments around it, generate this M original image vegetarian refreshments to the factor of influence of described interpolation pixel;
Arrive the factor of influence of described interpolation pixel according to the original color value of M original image vegetarian refreshments around the described interpolation pixel and this M original image vegetarian refreshments, calculate the color-values of described interpolation pixel.
Further, the degree of correlation of described calculating interpolation pixel and M original image vegetarian refreshments around it generates this M original image vegetarian refreshments to the factor of influence of described interpolation pixel, comprising:
Adopt following formula to calculate the degree of correlation of each original image vegetarian refreshments and described interpolation pixel:
r m = e - ( ( x - i ) 2 + ( y - j ) 2 )
Wherein, r mThe degree of correlation that represents m original image vegetarian refreshments and described interpolation pixel, wherein, 1≤m≤M, i, j are respectively the transverse and longitudinal coordinate of m original image vegetarian refreshments, and x, y are respectively the transverse and longitudinal coordinate of described interpolation pixel;
The degree of correlation of each original image vegetarian refreshments and described interpolation pixel is carried out following normalized obtains the factor of influence that each original image vegetarian refreshments arrives described interpolation pixel:
ω m = r m ( r 1 + r 2 + . . . + r M ) , 1 ≤ m ≤ M
Wherein, ω mBe that m original image vegetarian refreshments is to the factor of influence of described interpolation pixel, r mIt is the degree of correlation of m original image vegetarian refreshments and described interpolation pixel.
Further, described original color value and this M original image vegetarian refreshments factor of influence of arriving described interpolation pixel according to M original image vegetarian refreshments around the interpolation pixel calculates the color-values of described interpolation pixel, comprising:
Adopt following formula to calculate the color-values of each interpolation pixel:
Red p=Red 1×ω 1+Red 2×ω 2+…+Red M×ω M
Green p=Green 1×ω 1+Green 2×ω 2+…+Green M×ω M
Blue p=Blue 1×ω 1+Blue 2×ω 2+…+Blue M×ω M
Red wherein p, Green PAnd Blue PThe red, green, blue color component size that represents respectively described interpolation pixel, Red mBe the red component of m original image vegetarian refreshments, Green mBe the green component of m original image vegetarian refreshments, Blue mBe the blue component of m original image vegetarian refreshments, ω mBe m original image vegetarian refreshments to the factor of influence of described interpolation pixel, 1≤m≤M wherein.
Further, described M=4.
For solving the problems of the technologies described above, the present invention also provides a kind of portable terminal image processing apparatus, comprises area-of-interest detection module and resolution hoisting module, wherein:
Described area-of-interest detection module is used for according to the area-of-interest prior imformation that obtains in advance pending image being carried out area-of-interest and detects;
Described resolution hoisting module is used for that the detected area-of-interest of described area-of-interest detection module is carried out resolution and promotes.
Further, described device also comprises the prior imformation acquisition module, is used for obtaining described area-of-interest prior imformation in advance, comprises Tip element, the first computing unit and storage unit, wherein:
Described Tip element is used for providing one or more image to the user, and every image comprises one or more targets, and prompting user is provided in the image that provides by own interested target;
Described the first computing unit is for the characteristic parameter of the interesting target that calculates user's demarcation;
Described storage unit is for the standard interesting target storehouse that the characteristic parameter of user's interesting target is saved in the active user as prior imformation.
Further, described area-of-interest detection module comprises regional division unit, the second computing unit and contrast unit, wherein:
Described regional division unit is used for according to image inside similar features pending image being divided into one or more subject area;
Described the second computing unit is for the characteristic parameter that calculates described subject area;
Described contrast unit is used for characteristic parameter with the characteristic parameter of described subject area and standard area-of-interest object library and carries out similarity and compare, and will be defined as user's area-of-interest greater than the subject area of predetermined threshold value with standard feature parameter similarity.
Further, described resolution hoisting module comprises amplifying unit and color-values computing unit, wherein:
Described amplifying unit is used for according to the image enlargement factor N that pre-sets, and detected area-of-interest is mapped to amplifies in the space, and described amplification space is N times of area-of-interest;
Described color-values computing unit is used in described amplification space according to the original image vegetarian refreshments, adopts in the described amplification of the interpolation calculation space color-values of other pixels except the original image vegetarian refreshments, finishes the lifting of image local resolution.
Further, described resolution hoisting module also comprises the regularization processing unit, is used for first the detected area-of-interest of described area-of-interest detection module being carried out regularization and processes.
Further, described color-values computing unit according to the original image vegetarian refreshments, adopts interpolation calculation to amplify in the space color-values of other pixels except the original image vegetarian refreshments in amplifying the space, comprising:
If in the amplification space except the original image vegetarian refreshments other pixels be the interpolation pixel, described color-values computing unit carries out following processing to each interpolation pixel:
Calculate the degree of correlation of interpolation pixel and M original image vegetarian refreshments around it, generate this M original image vegetarian refreshments to the factor of influence of described interpolation pixel;
Arrive the factor of influence of described interpolation pixel according to the original color value of M original image vegetarian refreshments around the described interpolation pixel and this M original image vegetarian refreshments, calculate the color-values of described interpolation pixel.
Further, described color-values computing unit calculates the degree of correlation of interpolation pixel and M original image vegetarian refreshments around it, generates this M original image vegetarian refreshments to the factor of influence of described interpolation pixel, comprising:
Described color-values computing unit adopts following formula to calculate the degree of correlation of each original image vegetarian refreshments and described interpolation pixel:
r m = e - ( ( x - i ) 2 + ( y - j ) 2 )
Wherein, r mThe degree of correlation that represents m original image vegetarian refreshments and described interpolation pixel, wherein, 1≤m≤M, i, j are respectively the transverse and longitudinal coordinate of m original image vegetarian refreshments, and x, y are respectively the transverse and longitudinal coordinate of described interpolation pixel;
Described color-values computing unit carries out following normalized to the degree of correlation of each original image vegetarian refreshments and described interpolation pixel and obtains the factor of influence that each original image vegetarian refreshments arrives described interpolation pixel:
ω m = r m ( r 1 + r 2 + . . . + r M ) , 1 ≤ m ≤ M
Wherein, ω mBe that m original image vegetarian refreshments is to the factor of influence of described interpolation pixel, r mIt is the degree of correlation of m original image vegetarian refreshments and described interpolation pixel.
Further, described color-values computing unit arrives the factor of influence of described interpolation pixel according to the original color value of M original image vegetarian refreshments around the interpolation pixel and this M original image vegetarian refreshments, calculates the color-values of described interpolation pixel, comprising:
Described color-values computing unit adopts following formula to calculate the color-values of each interpolation pixel:
Red p=Red 1×ω 1+Red 2×ω 2+…+Red M×ω M
Green p=Green 1×ω 1+Green 2×ω 2+…+Green M×ω M
Blue p=Blue 1×ω 1+Blue 2×ω 2+…+Blue M×ω M
Red wherein p, Green PAnd Blue pThe red, green, blue color component size that represents respectively described interpolation pixel, Red mBe the red component of m original image vegetarian refreshments, Green mBe the green component of m original image vegetarian refreshments, Blue mBe the blue component of m original image vegetarian refreshments, ω mBe m original image vegetarian refreshments to the factor of influence of described interpolation pixel, 1≤m≤M wherein.
Further, described M=4.
Compared with prior art, the embodiment of the invention comprises that the self-adaptation area-of-interest detects and resolution lifting two parts, the area-of-interest test section takes into full account this prior imformation of user's interesting target of knowing in advance, improved the accuracy that area-of-interest detects, method more has personalization, satisfies the demand that different user stresses to like to same image difference; Area-of-interest resolution lift portion is owing to only carry out the resolution lifting to detected area-of-interest, therefore can improve processing speed, in addition, resolution method for improving in the embodiment of the invention has taken into full account the impact that the original image vegetarian refreshments is treated interpolating pixel point, introduce the original image pixels point and treated the factor of influence of interpolating pixel point, calculate interpolation point color-values according to this factor of influence, improve the interpolation performance.
The embodiment of the invention provides a kind of functional independence, efficient image processing method for the cellphone subscriber, and is user-friendly, in the area-of-interest in the usage mining image more the information of details possibility is provided, the increase user experiences joyful sense.
Description of drawings
Fig. 1 is the embodiment of the invention 1 process flow diagram;
Fig. 2 is the embodiment of the invention 2 apparatus structure synoptic diagram;
Fig. 3 is the detection of adapting to image area-of-interest and resolution method for improving process flow diagram that the present invention uses example;
Fig. 4 is the simulation area-of-interest synoptic diagram that the present invention uses example;
Fig. 5 is that simulation region of interest area image that the present invention uses example is amplified to and specifies the synoptic diagram that amplifies behind the space;
Fig. 6 is the synoptic diagram that affects that simulation original image pixels point that the present invention uses example is treated interpolating pixel point.
Embodiment
Consider that in most of occasions the user is interested to be not entire image, if the resolution method for improving is applied to entire image, will increase greatly computation complexity, the processing time also increases greatly simultaneously.In order to guarantee under the prerequisite of low computation complexity, realize preferably interpolation performance, so this paper considers only user's area-of-interest to be promoted resolution i.e. interesting image regions resolution lifting.Because taken into full account the subjective information of interest of user, the result of acquisition more meets user's emotion, effect is better.
When area-of-interest is detected, consider that the user participates in information, because different user's area-of-interests is often different, therefore the result for the same width of cloth image of different user may be different, more targeted, meets user feeling, and effect is better.In addition, only user's area-of-interest in the image is carried out image resolution ratio and promote, help to improve processing speed, also more satisfy the user simultaneously to the image of interest zone needs that obtain of detailed information more.
For making the purpose, technical solutions and advantages of the present invention clearer, hereinafter in connection with accompanying drawing embodiments of the invention are elaborated.Need to prove that in the situation of not conflicting, the embodiment among the application and the feature among the embodiment be combination in any mutually.
Embodiment 1
The image processing method of present embodiment may further comprise the steps as shown in Figure 1:
Step 10 is carried out area-of-interest according to the area-of-interest prior imformation that obtains in advance to pending image and is detected;
Preferably, above-mentioned area-of-interest prior imformation can obtain in the following ways in advance: provide one or more image to the user, every image comprises one or more targets, and prompting user is provided in the image that provides by own interested target; Calculate the characteristic parameter of the interesting target of user's demarcation; The characteristic parameter of user's interesting target is saved in active user's standard interesting target storehouse as prior imformation.
Preferably, the area-of-interest prior imformation that above-mentioned basis obtains is in advance carried out area-of-interest to pending image and is detected, and comprising:
Step 101 is divided into one or more subject area according to image inside similar features with pending image;
Step 102 is calculated the characteristic parameter of described subject area;
Step 103 is carried out similarity with the characteristic parameter of described subject area and the characteristic parameter in the standard area-of-interest object library and is compared, and will be defined as user's area-of-interest greater than the subject area of predetermined threshold value with standard feature parameter similarity;
Step 20 is carried out resolution to detected area-of-interest and is promoted;
Can adopt known resolution method for improving that this area-of-interest is carried out resolution and promote, preferably, also can adopt following methods that detected area-of-interest is carried out resolution and promote:
Step 201 according to the image enlargement factor N that pre-sets, is mapped to detected area-of-interest in the amplification space, and the N that this amplification space is area-of-interest doubly;
Preferably, convenient for subsequent treatment if area-of-interest is irregular figure, before mapping, first this area-of-interest is carried out regularization and process.So-called regularization is processed and is referred to: in pending image, detected irregular object is carried out following processing, make the horizontal line through this object top frontier point and least significant end frontier point, and the perpendicular line of this object high order end frontier point of process and low order end frontier point, the area-of-interest that process for the process regularization closed region that above-mentioned four lines are divided after intersecting in twos.A kind of simple disposal route is: original irregular area-of-interest is enclosed with rectangle frame, to the processing of this irregular figure, can change into the processing to this rectangular area;
Step 202 is amplified in space according to the original image vegetarian refreshments at this, adopts interpolation calculation should amplify in the space color-values of other pixels except the original image vegetarian refreshments, finishes the lifting of image local resolution;
If in the amplification space except the original image vegetarian refreshments other pixels be the interpolation pixel, each interpolation pixel is carried out following processing:
Step 2021, the degree of correlation of calculating interpolation pixel and M original image vegetarian refreshments around it generates this M original image vegetarian refreshments to the factor of influence of described interpolation pixel;
Preferably, can adopt following formula to calculate the degree of correlation of each original image vegetarian refreshments and described interpolation pixel:
r m = e - ( ( x - i ) 2 + ( y - j ) 2 )
Wherein, r mThe degree of correlation that represents m original image vegetarian refreshments and described interpolation pixel, wherein, 1≤m≤M, i, j are respectively the transverse and longitudinal coordinate of m original image vegetarian refreshments, and x, y are respectively the transverse and longitudinal coordinate of described interpolation pixel;
The degree of correlation of each original image vegetarian refreshments and described interpolation pixel is carried out following normalized obtains the factor of influence that each original image vegetarian refreshments arrives described interpolation pixel:
ω m = r m ( r 1 + r 2 + . . . + r M ) , 1 ≤ m ≤ M
Wherein, ω mBe that m original image vegetarian refreshments is to the factor of influence of described interpolation pixel, r mIt is the degree of correlation of m original image vegetarian refreshments and described interpolation pixel;
Step 2022 arrives the factor of influence of described interpolation pixel according to the original color value of M original image vegetarian refreshments around the described interpolation pixel and this M original image vegetarian refreshments, calculates the color-values of described interpolation pixel.
Preferably, can adopt following formula to calculate the color-values of each interpolation pixel:
Red p=Red 1×ω 1+Red 2×ω 2+…+Red M×ω M
Green p=Green 1×ω 1+Green 2×ω 2+…+Green M×ω M
Blue p=Blue 1×ω 1+Blue 2×ω 2+…+Blue M×ω M
Red wherein p, Green PAnd Blue pThe red, green, blue color component size that represents respectively described interpolation pixel, Red mBe the red component of m original image vegetarian refreshments, Green mBe the green component of m original image vegetarian refreshments, Blue mBe the blue component of m original image vegetarian refreshments, ω mBe m original image vegetarian refreshments to the factor of influence of described interpolation pixel, 1≤m≤M wherein.
In above-mentioned steps 2021 and 2022, the original pixels that participates in calculating is counted out more, and it is also better that resolution promotes effect, but computation complexity is also higher, thus the effect in order to obtain compromising, preferred M=4.
Although the resolution method for improving has a lot, but resolution promotes effect in order to obtain preferably, often need to pay the cost of huge computation complexity, adopt present embodiment method computation complexity low, and because what adopt is the method for similar low-pass filtering, kept preferably the global information of image.
Embodiment 2
Realize the device of said method as shown in Figure 2, comprise area-of-interest detection module and resolution hoisting module, wherein:
Figure BDA00002079624300101
This area-of-interest detection module is used for according to the area-of-interest prior imformation that obtains in advance pair
Pending image carries out area-of-interest and detects;
Preferably, this area-of-interest detection module comprises regional division unit, the second computing unit and contrast unit, wherein:
This zone division unit is used for according to image inside similar features pending image being divided into one or more subject area;
This second computing unit is for the characteristic parameter that calculates this subject area;
This contrasts the unit, is used for characteristic parameter with the characteristic parameter of this subject area and standard area-of-interest object library and carries out similarity and compare, and will be defined as user's area-of-interest greater than the subject area of predetermined threshold value with standard feature parameter similarity.
This resolution hoisting module is used for detected interested in described area-of-interest detection module
The zone is carried out resolution and is promoted.
Preferably, this resolution hoisting module comprises amplifying unit and color-values computing unit, wherein:
This amplifying unit is used for according to the image enlargement factor N that pre-sets, and detected area-of-interest is mapped to amplifies in the space, and the N that this amplification space is area-of-interest doubly;
This color-values computing unit is used for amplifying space according to the original image vegetarian refreshments at this, adopts in the described amplification of the interpolation calculation space color-values of other pixels except the original image vegetarian refreshments, finishes the lifting of image local resolution.
Preferably, this resolution hoisting module also can comprise a regularization processing unit, is used for first the detected area-of-interest of described area-of-interest detection module being carried out regularization and processes.
Above-mentioned color-values computing unit according to the original image vegetarian refreshments, adopts interpolation calculation to amplify in the space that the process of the color-values of other pixels repeats no more referring to embodiment 1 except the original image vegetarian refreshments herein in amplifying the space.
Preferably, this device also comprises the prior imformation acquisition module, is used for obtaining described area-of-interest prior imformation in advance, comprises Tip element, the first computing unit and storage unit, wherein:
This Tip element is used for providing one or more image to the user, and every image comprises one or more targets, and prompting user is provided in the image that provides by own interested target;
This first computing unit is for the characteristic parameter of the interesting target that calculates user's demarcation;
This storage unit is for the standard interesting target storehouse that the characteristic parameter of user's interesting target is saved in the active user as prior imformation.
Use example
Adopt adapting to image area-of-interest resolution method for improving can realize preferably the local amplification effect of interesting image regions, the below detects with regard to the adapting to image area-of-interest respectively as an example of M=4 example and area-of-interest resolution method for improving describes.As shown in Figure 3.
One, interesting image regions detects:
Before carrying out the interesting image regions detection, need to adopt first following steps to set up user's interesting target storehouse, obtain prior imformation:
Step 11: many images that comprise plurality of target are provided;
Step 12: prompting user is demarcated respectively own interested target in above-mentioned many images;
Step 13: the characteristic parameter that calculates the interesting target of user's demarcation;
Step 14: the counting user interesting target is saved in the characteristic parameter of user's interesting target in active user's standard interesting target storehouse.
By the establishment of above-mentioned steps completing user interesting target object normal data, be used for processing definite user's area-of-interest at follow-up image.The characteristic parameter of above-mentioned user's interesting target can be described as prior imformation.In order to adapt to the variation of user preferences, can regularly carry out above-mentioned steps, upgrade user's standard interesting target storehouse.
The interesting image regions testing process comprises:
Step 21: the pending image that will input according to image inside similar features is divided into different subject area;
The inner similar features of image refers to the close similarity between the image inside, i.e. the nearer pixel of physical location, and its color-values is also more similar.Therefore, can be that color-values is divided subject area according to image inside similar features.
Step 22: the characteristic parameter that calculates above-mentioned each subject area;
Step 23: respectively the characteristic parameter of above-mentioned each subject area and the characteristic parameter in the standard area-of-interest object library are carried out similarity and compare, be user's area-of-interest with standard feature parameter similarity greater than the subject area of predetermined threshold value T.
Finished self-adaptation area-of-interest testing process to pending image by above-mentioned steps, in order to realize that the information of this part target is strengthened, improved its resolution, below just can carry out resolution to the area-of-interest of extraction and promoted.
Two, image adaptive area-of-interest resolution promotes:
Step 31 according to the image enlargement factor N that pre-sets (user arranges or default setting), is mapped to area-of-interest respectively and amplifies in the space, and the N that this amplification space is area-of-interest doubly;
Wherein, N is controllable parameter, and the user can input definite in advance.
Preferably, convenient for subsequent treatment before amplifying, can namely be treated to regular figure first with the area-of-interest regularization, as shown in Figure 4, A is user's area-of-interest, obtains B after processing through regularization, regular figure is preferably square or rectangle.
Amplify to process as shown in Figure 5, Fig. 5 left hand view is the position of 4 pixels in the original image before amplifying, amplify 4 times after, the position of these 4 pixels is shown in Fig. 5 right part of flg.
Step 32: in amplifying the space, according to the original image vegetarian refreshments, adopt interpolation calculation to amplify in the space color-values of other pixels except the original image vegetarian refreshments, finish the lifting of image local resolution.
Above-mentioned steps 32 specifically may further comprise the steps:
If 4 original image vegetarian refreshments are O (i, j), O (i, j+N), O (i+N, j)And O (i+N, j+N), the interpolation pixel in the original pixels point range is P;
Step 321 is calculated respectively the degree of correlation of 4 original image vegetarian refreshments around interpolation pixel and its, generates these 4 original image vegetarian refreshments to the factor of influence of interpolation pixel;
Take P point shown in Figure 5 as example, calculate respectively the degree of correlation that A, B, four original image vegetarian refreshments of C, D are ordered to P, this degree of correlation of normalization obtains 4 original image vegetarian refreshments color-values to the factor of influence ω of P point color-values 1, ω 2, ω 3And ω 4, as shown in Figure 6.According to Fig. 6, establish A point coordinate (i, j), B point coordinate (i then, j+N), C point coordinate (i+N, j), D point coordinate (i+N, j+N), establish interpolation pixel P coordinate and be (x, y), at first calculate A, B, the degree of correlation with interpolation pixel P is as follows respectively for 4 of C, D, can adopt following negative exponent Euclidean distance method:
r AP = e - ( ( x - i ) 2 + ( y - j ) 2 )
R wherein APThe degree of correlation of expression A point and interpolation pixel P, by that analogy, r BP, r CPAnd r DPBe respectively:
r BP = e - ( ( x - i ) 2 + ( y - j - N ) 2 )
r CP = e - ( ( x - i - N ) 2 + ( y - j ) 2 )
r DP = e - ( ( x - i - N ) 2 + ( y - j - N ) 2 )
Then according to above-mentioned degree of correlation, calculate respectively A, B, 4 factors of influence for the treatment of interpolating pixel point P of C, D, it is as follows to be about to above-mentioned degree of correlation normalization:
ω 1 = r AP ( r AP + r BP + r CP + r DP )
ω 2 = r BP ( r AP + r BP + r CP + r DP )
ω 3 = r CP ( r AP + r BP + r CP + r DP )
ω 3 = r DP ( r AP + r BP + r CP + r DP )
ω wherein 1Be the factor of influence that the A point is ordered to P, B, C, D point are respectively ω to the factor of influence of P 2, ω 3And ω 4
Step 322 is according to the original color value of 4 original image vegetarian refreshments around the interpolation pixel and this 4 original image vegetarian refreshments factor of influence to the interpolation pixel, the color-values of calculating interpolation pixel;
Concrete, with Fig. 5 and example shown in Figure 5, according to the color-values of above-mentioned factor of influence and A, B, 4 color-values assessments of C, D interpolation pixel P, as follows:
Red p=Red A×ω 1+Red B×ω 2+Red C×ω 3+Red D×ω 4
Green P=Green A×ω 1+Green B×ω 2+Green C×ω 3+Green D×ω 4
Blue P=Blue A×ω 1+Blue B×ω 2+Blue C×ω 3+Blue D×ω 4
Red wherein p, Green PAnd Blue PThe red, green, blue color component size that represents respectively interpolation pixel P.
After above-mentioned image adaptive area-of-interest detection and resolution lifting step, interesting image regions obtains self-adaptation and determines, and obtain resolution according to user's needs and promote, improved the quantity of information of region of interest area image, the user can more effectively check image detail information, and flow process finishes.
One of ordinary skill in the art will appreciate that all or part of step in the said method can come the instruction related hardware to finish by program, described program can be stored in the computer-readable recording medium, such as ROM (read-only memory), disk or CD etc.Alternatively, all or part of step of above-described embodiment also can realize with one or more integrated circuit.Correspondingly, each the module/unit in above-described embodiment can adopt the form of hardware to realize, also can adopt the form of software function module to realize.The present invention is not restricted to the combination of the hardware and software of any particular form.
Certainly; the present invention also can have other various embodiments; in the situation that does not deviate from spirit of the present invention and essence thereof; those of ordinary skill in the art work as can make according to the present invention various corresponding changes and distortion, but these corresponding changes and distortion all should belong to the protection domain of the appended claim of the present invention.

Claims (18)

1. portable terminal image processing method comprises:
According to the area-of-interest prior imformation that obtains in advance pending image being carried out area-of-interest detects;
Detected area-of-interest is carried out resolution to be promoted.
2. the method for claim 1 is characterized in that:
Described area-of-interest prior imformation obtains in the following ways in advance:
Provide one or more image to the user, every image comprises one or more targets, and prompting user is provided in the image that provides by own interested target;
Calculate the characteristic parameter of the interesting target of user's demarcation;
The characteristic parameter of user's interesting target is saved in active user's standard interesting target storehouse as prior imformation.
3. method as claimed in claim 2 is characterized in that:
The area-of-interest prior imformation that described basis obtains is in advance carried out area-of-interest to pending image and is detected, and comprising:
According to image inside similar features pending image is divided into one or more subject area;
Calculate the characteristic parameter of described subject area;
The characteristic parameter of described subject area and the characteristic parameter in the standard area-of-interest object library are carried out similarity compare, will be defined as user's area-of-interest greater than the subject area of predetermined threshold value with standard feature parameter similarity.
4. such as claim 1 or 2 or 3 described methods, it is characterized in that:
Describedly detected area-of-interest carried out resolution promote, comprising:
According to the image enlargement factor N that pre-sets, detected area-of-interest is mapped in the amplification space, described amplification space is N times of area-of-interest;
In described amplification space, according to the original image vegetarian refreshments, adopt in the described amplification of the interpolation calculation space color-values of other pixels except the original image vegetarian refreshments, finish the lifting of image local resolution.
5. method as claimed in claim 4 is characterized in that:
The image enlargement factor N that pre-sets in described basis, with detected area-of-interest be mapped to amplify in the space before, described method also comprises:
Described area-of-interest is carried out regularization to be processed.
6. method as claimed in claim 4 is characterized in that:
Described in amplifying the space according to the original image vegetarian refreshments, adopt interpolation calculation to amplify in the space color-values of other pixels except the original image vegetarian refreshments, comprising:
If in the amplification space except the original image vegetarian refreshments other pixels be the interpolation pixel, each interpolation pixel is carried out following processing:
Calculate the degree of correlation of interpolation pixel and M original image vegetarian refreshments around it, generate this M original image vegetarian refreshments to the factor of influence of described interpolation pixel;
Arrive the factor of influence of described interpolation pixel according to the original color value of M original image vegetarian refreshments around the described interpolation pixel and this M original image vegetarian refreshments, calculate the color-values of described interpolation pixel.
7. method as claimed in claim 6 is characterized in that:
The degree of correlation of described calculating interpolation pixel and M original image vegetarian refreshments around it generates this M original image vegetarian refreshments to the factor of influence of described interpolation pixel, comprising:
Adopt following formula to calculate the degree of correlation of each original image vegetarian refreshments and described interpolation pixel:
r m = e - ( ( x - i ) 2 + ( y - j ) 2 )
Wherein, r mThe degree of correlation that represents m original image vegetarian refreshments and described interpolation pixel, wherein, 1≤m≤M, i, j are respectively the transverse and longitudinal coordinate of m original image vegetarian refreshments, and x, y are respectively the transverse and longitudinal coordinate of described interpolation pixel;
The degree of correlation of each original image vegetarian refreshments and described interpolation pixel is carried out following normalized obtains the factor of influence that each original image vegetarian refreshments arrives described interpolation pixel:
ω m = r m ( r 1 + r 2 + . . . + r M ) , 1 ≤ m ≤ M
Wherein, ω mBe that m original image vegetarian refreshments is to the factor of influence of described interpolation pixel, r mIt is the degree of correlation of m original image vegetarian refreshments and described interpolation pixel.
8. method as claimed in claim 7 is characterized in that:
Described original color value and this M original image vegetarian refreshments factor of influence of arriving described interpolation pixel according to M original image vegetarian refreshments around the interpolation pixel calculates the color-values of described interpolation pixel, comprising:
Adopt following formula to calculate the color-values of each interpolation pixel:
Red p=Red 1×ω 1+Red 2×ω 2+…+Red M×ω M
Green p=Green 1×ω 1+Green 2×ω 2+…+Green M×ω M
Blue p=Blue 1×ω 1+Blue 2×ω 2+…+Blue M×ω M
Red wherein p, Green PAnd Blue PThe red, green, blue color component size that represents respectively described interpolation pixel, Red mBe the red component of m original image vegetarian refreshments, Green mBe the green component of m original image vegetarian refreshments, Blue mBe the blue component of m original image vegetarian refreshments, ω mBe m original image vegetarian refreshments to the factor of influence of described interpolation pixel, 1≤m≤M wherein.
9. such as claim 6 or 7 or 8 described methods, it is characterized in that:
Described M=4.
10. a portable terminal image processing apparatus comprises area-of-interest detection module and resolution hoisting module, wherein:
Described area-of-interest detection module is used for according to the area-of-interest prior imformation that obtains in advance pending image being carried out area-of-interest and detects;
Described resolution hoisting module is used for that the detected area-of-interest of described area-of-interest detection module is carried out resolution and promotes.
11. device as claimed in claim 10 is characterized in that:
Described device also comprises the prior imformation acquisition module, is used for obtaining described area-of-interest prior imformation in advance, comprises Tip element, the first computing unit and storage unit, wherein:
Described Tip element is used for providing one or more image to the user, and every image comprises one or more targets, and prompting user is provided in the image that provides by own interested target;
Described the first computing unit is for the characteristic parameter of the interesting target that calculates user's demarcation;
Described storage unit is for the standard interesting target storehouse that the characteristic parameter of user's interesting target is saved in the active user as prior imformation.
12. device as claimed in claim 11 is characterized in that:
Described area-of-interest detection module comprises regional division unit, the second computing unit and contrast unit, wherein:
Described regional division unit is used for according to image inside similar features pending image being divided into one or more subject area;
Described the second computing unit is for the characteristic parameter that calculates described subject area;
Described contrast unit is used for characteristic parameter with the characteristic parameter of described subject area and standard area-of-interest object library and carries out similarity and compare, and will be defined as user's area-of-interest greater than the subject area of predetermined threshold value with standard feature parameter similarity.
13. such as claim 10 or 11 or 12 described devices, it is characterized in that:
Described resolution hoisting module comprises amplifying unit and color-values computing unit, wherein:
Described amplifying unit is used for according to the image enlargement factor N that pre-sets, and detected area-of-interest is mapped to amplifies in the space, and described amplification space is N times of area-of-interest;
Described color-values computing unit is used in described amplification space according to the original image vegetarian refreshments, adopts in the described amplification of the interpolation calculation space color-values of other pixels except the original image vegetarian refreshments, finishes the lifting of image local resolution.
14. device as claimed in claim 13 is characterized in that:
Described resolution hoisting module also comprises the regularization processing unit, is used for first the detected area-of-interest of described area-of-interest detection module being carried out regularization and processes.
15. device as claimed in claim 13 is characterized in that:
Described color-values computing unit according to the original image vegetarian refreshments, adopts interpolation calculation to amplify in the space color-values of other pixels except the original image vegetarian refreshments in amplifying the space, comprising:
If in the amplification space except the original image vegetarian refreshments other pixels be the interpolation pixel, described color-values computing unit carries out following processing to each interpolation pixel:
Calculate the degree of correlation of interpolation pixel and M original image vegetarian refreshments around it, generate this M original image vegetarian refreshments to the factor of influence of described interpolation pixel;
Arrive the factor of influence of described interpolation pixel according to the original color value of M original image vegetarian refreshments around the described interpolation pixel and this M original image vegetarian refreshments, calculate the color-values of described interpolation pixel.
16. device as claimed in claim 15 is characterized in that:
Described color-values computing unit calculates the degree of correlation of interpolation pixel and M original image vegetarian refreshments around it, generates this M original image vegetarian refreshments to the factor of influence of described interpolation pixel, comprising:
Described color-values computing unit adopts following formula to calculate the degree of correlation of each original image vegetarian refreshments and described interpolation pixel:
r m = e - ( ( x - i ) 2 + ( y - j ) 2 )
Wherein, r mThe degree of correlation that represents m original image vegetarian refreshments and described interpolation pixel, wherein, 1≤m≤M, i, j are respectively the transverse and longitudinal coordinate of m original image vegetarian refreshments, and x, y are respectively the transverse and longitudinal coordinate of described interpolation pixel;
Described color-values computing unit carries out following normalized to the degree of correlation of each original image vegetarian refreshments and described interpolation pixel and obtains the factor of influence that each original image vegetarian refreshments arrives described interpolation pixel:
ω m = r m ( r 1 + r 2 + . . . + r M ) , 1 ≤ m ≤ M
Wherein, ω mBe that m original image vegetarian refreshments is to the factor of influence of described interpolation pixel, r mIt is the degree of correlation of m original image vegetarian refreshments and described interpolation pixel.
17. device as claimed in claim 16 is characterized in that:
Described color-values computing unit arrives the factor of influence of described interpolation pixel according to the original color value of M original image vegetarian refreshments around the interpolation pixel and this M original image vegetarian refreshments, calculates the color-values of described interpolation pixel, comprising:
Described color-values computing unit adopts following formula to calculate the color-values of each interpolation pixel:
Red p=Red 1×ω 1+Red 2×ω 2+…+Red M×ω M
Green p=Green 1×ω 1+Green 2×ω 2+…+Green M×ω M
Blue p=Blue 1×ω 1+Blue 2×ω 2+…+Blue M×ω M
Red wherein p, Green PAnd Blue PThe red, green, blue color component size that represents respectively described interpolation pixel, Red mBe the red component of m original image vegetarian refreshments, Green mBe the green component of m original image vegetarian refreshments, Blue mBe the blue component of m original image vegetarian refreshments, ω mBe m original image vegetarian refreshments to the factor of influence of described interpolation pixel, 1≤m≤M wherein.
18. such as claim 15 or 16 or 17 described devices, it is characterized in that:
Described M=4.
CN2012103153457A 2012-08-30 2012-08-30 Method and device for processing mobile terminal images Pending CN102915521A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN2012103153457A CN102915521A (en) 2012-08-30 2012-08-30 Method and device for processing mobile terminal images
PCT/CN2013/080113 WO2013185695A1 (en) 2012-08-30 2013-07-25 Method and device for processing mobile terminal images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2012103153457A CN102915521A (en) 2012-08-30 2012-08-30 Method and device for processing mobile terminal images

Publications (1)

Publication Number Publication Date
CN102915521A true CN102915521A (en) 2013-02-06

Family

ID=47613876

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2012103153457A Pending CN102915521A (en) 2012-08-30 2012-08-30 Method and device for processing mobile terminal images

Country Status (2)

Country Link
CN (1) CN102915521A (en)
WO (1) WO2013185695A1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013185695A1 (en) * 2012-08-30 2013-12-19 中兴通讯股份有限公司 Method and device for processing mobile terminal images
CN105279734A (en) * 2015-09-23 2016-01-27 联想(北京)有限公司 Image processing method and device, and electronic equipment
CN105787875A (en) * 2015-01-14 2016-07-20 卢茨洛格斯技术有限公司 Method and apparatus for controlling spatial resolution in a computer system
CN106971374A (en) * 2016-01-13 2017-07-21 北大方正集团有限公司 Picture pixels method and picture pixels system
CN107358190A (en) * 2017-07-07 2017-11-17 广东中星电子有限公司 A kind of image key area management method and device
CN107950017A (en) * 2016-06-15 2018-04-20 索尼公司 Image processing equipment, image processing method and picture pick-up device
WO2018120519A1 (en) * 2016-12-26 2018-07-05 华为技术有限公司 Image processing method and device
CN110211039A (en) * 2019-04-29 2019-09-06 西安电子科技大学 A kind of image processing method and its device
CN110955243A (en) * 2019-11-28 2020-04-03 新石器慧通(北京)科技有限公司 Travel control method, travel control device, travel control apparatus, readable storage medium, and mobile device
CN113065553A (en) * 2021-04-01 2021-07-02 杭州思看科技有限公司 Data processing method and device, three-dimensional scanning system and electronic device
CN113822799A (en) * 2020-06-19 2021-12-21 南宁富桂精密工业有限公司 Image amplification method, device and computer readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1916906A (en) * 2006-09-08 2007-02-21 北京工业大学 Image retrieval algorithm based on abrupt change of information
CN101093491A (en) * 2006-06-23 2007-12-26 郝红卫 Interactive image retrieval method
CN101242474A (en) * 2007-02-09 2008-08-13 中国科学院计算技术研究所 A dynamic video browse method for phone on small-size screen
CN101789120A (en) * 2010-02-08 2010-07-28 上海交通大学 Image interpolation method based on cosine polynomial
US8218895B1 (en) * 2006-09-27 2012-07-10 Wisconsin Alumni Research Foundation Systems and methods for generating and displaying a warped image using fish eye warping

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100811796B1 (en) * 2007-03-30 2008-03-10 삼성전자주식회사 Mobile terminal and method for displaying image using focus information thereof
CN100590656C (en) * 2008-01-17 2010-02-17 四川虹微技术有限公司 Image amplification method based on spline function interpolation algorithm
EP2266099A1 (en) * 2008-03-18 2010-12-29 Thomson Licensing Method and apparatus for adaptive feature of interest color model parameters estimation
CN102915521A (en) * 2012-08-30 2013-02-06 中兴通讯股份有限公司 Method and device for processing mobile terminal images

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101093491A (en) * 2006-06-23 2007-12-26 郝红卫 Interactive image retrieval method
CN1916906A (en) * 2006-09-08 2007-02-21 北京工业大学 Image retrieval algorithm based on abrupt change of information
US8218895B1 (en) * 2006-09-27 2012-07-10 Wisconsin Alumni Research Foundation Systems and methods for generating and displaying a warped image using fish eye warping
CN101242474A (en) * 2007-02-09 2008-08-13 中国科学院计算技术研究所 A dynamic video browse method for phone on small-size screen
CN101789120A (en) * 2010-02-08 2010-07-28 上海交通大学 Image interpolation method based on cosine polynomial

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2013185695A1 (en) * 2012-08-30 2013-12-19 中兴通讯股份有限公司 Method and device for processing mobile terminal images
CN105787875A (en) * 2015-01-14 2016-07-20 卢茨洛格斯技术有限公司 Method and apparatus for controlling spatial resolution in a computer system
CN105787875B (en) * 2015-01-14 2019-03-19 谷歌有限责任公司 Method and apparatus for controlling spatial resolution in computer systems
CN105279734B (en) * 2015-09-23 2018-10-12 联想(北京)有限公司 A kind of image processing method and device, electronic equipment
CN105279734A (en) * 2015-09-23 2016-01-27 联想(北京)有限公司 Image processing method and device, and electronic equipment
CN106971374B (en) * 2016-01-13 2020-06-23 北大方正集团有限公司 Picture pixelization method and picture pixelization system
CN106971374A (en) * 2016-01-13 2017-07-21 北大方正集团有限公司 Picture pixels method and picture pixels system
CN107950017A (en) * 2016-06-15 2018-04-20 索尼公司 Image processing equipment, image processing method and picture pick-up device
WO2018120519A1 (en) * 2016-12-26 2018-07-05 华为技术有限公司 Image processing method and device
CN109804409A (en) * 2016-12-26 2019-05-24 华为技术有限公司 The method and apparatus of image procossing
CN107358190A (en) * 2017-07-07 2017-11-17 广东中星电子有限公司 A kind of image key area management method and device
CN110211039A (en) * 2019-04-29 2019-09-06 西安电子科技大学 A kind of image processing method and its device
CN110211039B (en) * 2019-04-29 2021-03-23 西安电子科技大学 Image processing method and device
CN110955243A (en) * 2019-11-28 2020-04-03 新石器慧通(北京)科技有限公司 Travel control method, travel control device, travel control apparatus, readable storage medium, and mobile device
CN110955243B (en) * 2019-11-28 2023-10-20 新石器慧通(北京)科技有限公司 Travel control method, apparatus, device, readable storage medium, and mobile apparatus
CN113822799A (en) * 2020-06-19 2021-12-21 南宁富桂精密工业有限公司 Image amplification method, device and computer readable storage medium
CN113065553A (en) * 2021-04-01 2021-07-02 杭州思看科技有限公司 Data processing method and device, three-dimensional scanning system and electronic device

Also Published As

Publication number Publication date
WO2013185695A1 (en) 2013-12-19

Similar Documents

Publication Publication Date Title
CN102915521A (en) Method and device for processing mobile terminal images
EP3163504B1 (en) Method, device and computer-readable medium for region extraction
KR101782633B1 (en) Method and apparatus for area identification
US20150206318A1 (en) Method and apparatus for image enhancement and edge verificaton using at least one additional image
CN102663696B (en) Denoising method of enlarged image and system thereof
CN108154149B (en) License plate recognition method based on deep learning network sharing
US20140029788A1 (en) Detecting objects with a depth sensor
US20110280475A1 (en) Apparatus and method for generating bokeh effect in out-focusing photography
CN105590319A (en) Method for detecting image saliency region for deep learning
CN103150735A (en) Gray level difference averaging-based image edge detection method
WO2020082731A1 (en) Electronic device, credential recognition method and storage medium
US20160300328A1 (en) Method and apparatus for implementing image denoising
CN105243371A (en) Human face beauty degree detection method and system and shooting terminal
CN105957030A (en) Infrared thermal imaging system image detail enhancing and noise inhibiting method
WO2016029555A1 (en) Image interpolation method and device
CN105096330A (en) Image processing method capable of automatically recognizing pure-color borders, system and a photographing terminal
US20170061585A1 (en) System and method for supporting image denoising based on neighborhood block dimensionality reduction
CN103886553A (en) Method and system for non-local average value denoising of image
CN106204441A (en) The method and device that a kind of image local amplifies
CN107277346A (en) A kind of image processing method and terminal
CN104376540A (en) Bayer image denoising method
CN111598088B (en) Target detection method, device, computer equipment and readable storage medium
CN115660945A (en) Coordinate conversion method and device, electronic equipment and storage medium
CN106651903B (en) A kind of Mobile object detection method
WO2020078102A1 (en) Image enhancement method and apparatus, and computer-readable storage medium

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20130206

RJ01 Rejection of invention patent application after publication