CN107408401A

CN107408401A - The user's sliding block for simplifying adjustment for image

Info

Publication number: CN107408401A
Application number: CN201680017397.2A
Authority: CN
Inventors: 丹尼尔·佩蒂格鲁; 杰森·张; 罗纳德·弗兰克·沃茨罗; 谢夫凯特·德林·巴巴肯; 阿拉温德·克里希纳斯瓦米
Original assignee: Google LLC
Current assignee: Google LLC
Priority date: 2015-03-27
Filing date: 2016-03-27
Publication date: 2017-11-28
Anticipated expiration: 2036-03-27
Also published as: EP3254283A1; US20160284070A1; WO2016160638A1; US9934560B2; EP3254283B1; CN107408401B

Abstract

Describe for by applying effect to image to change the method and system of image.Effect includes the protrusion effect to image, light adjusts or color adjustment.Method and system includes providing user's sliding block for applying effect to image.Method and system further comprises determining that the Part I of the image including face and creates protection and cover to protect the face in Part I during amending image.The enhancing threshold value that can include being used to change the Part I of image is covered in protection.The modification of image can include the Part I different from image and change the Part II of image.Also describe for implementing the different resolution of identical input picture to produce the method for similar visual results.

Description

The user's sliding block for simplifying adjustment for image

The cross reference of related application

Entitled " the User Sliders for that the application requires to submit on March 27th, 2015 according to 35U.S.C. § 119 (e) Simplified Adjustments of Images (the user's sliding block for simplifying adjustment for being used for image) " US provisional patent Apply for No.62/139,621 priority, it comes in by quoting overall addition herein.

Background technology

The consumer applied using existing photo editing is typically desirable to improve the entirety " outward appearance " of their digital picture.Certain A little normal image editor applications provide countless control, generally by sliding block, curve and take the combination of color device to form.Although specialty is clapped The person of taking the photograph knows the implication of these difference controls and generally has typical work or method to browse these controls, and general user is led to Often these controls are insufficient to be familiar with best to utilize them.General user be likely to touch each control until user certain Result is satisfied with degree, but does not firmly believe that he/her is applied with the combination of optimal sliding block and control operation.

In addition, existing photo editing application does not provide similar visual results for the identical input picture under different resolution. Once (a) strengthens image to take details (applying " prominent (pop) ") out of and reduce the size of image to user, or (b) reduces The size of original image and then application " protrusion ", it would be desirable to which obtained image looks similar after the two operations.This It is even more important in many editor's applications, because user can be compiled on low resolution (such as screen resolution) image Volume, but their editor can apply and preserve for original high-resolution image.If operate with identical for these Parameter sets, then generally many normal image editors apply in result and differ.

Moreover, existing photo editing application be not provided with efficacious prescriptions method come the skin color in protecting image or it is facial when increase The local contrast and saturation degree of strong image.The amount of the performed enhancing of these editor's applications is too strong generally for face, and this leads Cause undesired and visually not very good effect.

The content of the invention

This specification is related to for the light regulation of image and/or the image processing techniques of color adjustment.

Sample implementation user interface is provided with enable simple in image and intuitively color and/or light adjust and Processing.According to the one side of the theme described in the disclosure, a kind of system includes processor；And the storage of store instruction Device, the instruction cause the system upon being performed：Receive input of the selection image for modification；Determine the face in image Portion；It is determined that the Part I of the image including face；Determine the enhancing threshold value of the Part I of described image；User's sliding block is provided For changing image；It is chosen so as to apply effect in response to user's sliding block, strengthens the Part II of image, described image Part II eliminate the Part I；It is chosen in response to user's sliding block, in the situation no more than enhancing threshold value The Part I of lower enhancing described image；And the image of storage enhancing.

Usually, the another aspect of the theme described in the disclosure includes a kind of method for being used to apply effect to image. Methods described includes：Input of the selection image for modification is received using one or more computing devices；Using one Or multiple computing devices determine the face in image；Determine to include facial image using one or more of computing devices Part I；The enhancing threshold value of the Part I of described image is determined using one or more of computing devices；Using described One or more computing devices provide user's sliding block for changing image；It is chosen in response to user's sliding block, uses institute The Part II of one or more computing device enhancing images is stated, the Part II of described image eliminates the Part I； It is chosen in response to user's sliding block, is increased using one or more of computing devices in the case of no more than enhancing threshold value The Part I of strong described image；And the image using the storage enhancing of one or more of computing devices.

Other implementations of one or more of these aspects include corresponding system, device and computer program, by with It is set to the action for performing the method encoded on computer memory device.

These and other implementations each can alternatively include one or more of following characteristics.For example, operation Further comprise, when effect is prominent effect, the prominent effect of user's sliding block control, and method includes：Use one or more Computing device determines the amount of the prominent effect based on user's sliding block to apply to described image；Using one or Multiple computing devices adjust described image by the way that the prominent effect to be applied to the Part I of described image；And use The prominent effect is applied to second of described image by one or more of computing devices based on user's sliding block Point.For example, the prominent effect is included with one in the following group：Saturation boost, brightness regulation, local contrast use with Strengthen the details of image.

For example, operation further comprises, when the effect is light regulation, user's sliding block control is to described image Light is adjusted, and methods described includes：Using one or more of computing devices based on using selected by user's sliding block Institute's light requirement regulated quantity and the usable range that extends histogram range to be adjusted including light simultaneously deploy to be distributed；Using one or more Individual computing device adjusts the shade associated with image or bloom details based on institute's light requirement regulated quantity；And using one Or multiple computing devices adjust the gamma associated with image based on institute's light requirement regulated quantity.

For example, wherein described modification is that the size of described image is readjusted into fixed small in resolution image, operation Further comprise：Color in the described image being saturated using the determination of one or more of computing devices；And using institute One or more computing devices are stated based on making the second of described image using the color adjustment amount selected by user's sliding block Fractional saturation.

Usually, the another aspect of the theme disclosed in the disclosure can be presented as method, and it includes：Use described one Individual or multiple computing devices determine pyramidal layer series to match some pre-defined fixation lower resolution images；Using institute State the selection of one or more computing devices and remap level as from the constant offset of the top layer of pyramid level；And using institute State one or more computing devices apply local Laplce smoothly with ensure various sizes of image procossing similar frequency band with Produce the similar visual results for fixing small in resolution image.

For example, feature can include providing user's sliding block for changing image, user's sliding block have prominent sliding block, The preview of color sliding block, smooth piece and image.

It is contemplated that improve the technical problem of the picture quality of image regardless of the resolution ratio of image.More specifically, this Invention solves the technical problem for producing high visual quality and reducing the complexity for setting image rectification by hand by user.The present invention Sliding block set is advantageously comprised, the sliding block is determined for performing the operation of image enhaucament to solve to control using graphical analysis Complexity issue.One advantage of these sliding blocks is the custom for catching professional photographer, and operates sliding block in user to increase Its typical work is replicated during strong image.Further advantage is that it includes effective means to implement identical input picture Different resolution to produce similar visual results.Another advantage be the present invention include unique mixing and coverage technology with Face in protection image is not enhanced too many and generation visually more preferable result.

Brief description of the drawings

In each figure of accompanying drawing, by example, rather than by limitation, to be illustrated to specification；Accompanying drawing In, Similar reference characters are used to refer to similar element.

Fig. 1 is to illustrate the block diagram for the example system using user's sliding block enhancing image.

Fig. 2 is the block diagram for illustrating Example Computing Device.

Fig. 3 A-3E are to illustrate the flow chart for the exemplary method using user's sliding block enhancing image.

Fig. 4 is for strengthening the local contrast of image and the exemplary method of saturation degree.

Fig. 5 is to produce the exemplary method of similar visual effect for implementing the different resolution of identical input picture.

Fig. 6 A-6C are the example user interfaces of user's sliding block in description activity.

Fig. 7 is that the figure for comparing image enchancing method and existing image enchancing method described in the disclosure represents.

Fig. 8 is that the figure for illustrating the light adjusting slider in the activity for example image represents.

Fig. 9 is that the figure for illustrating the light adjusting slider in the activity for another example image represents.

Figure 10 A and 10B be illustrate during the operation for the light adjusting slider of example image scope extension and The figure of shadow detail regulation represents.

Figure 11 is that the figure for illustrating the light adjusting slider in the activity for example image represents.

Figure 12 is that the figure for illustrating the light adjusting slider in the activity for another example image represents.

Figure 13 be illustrate for strengthen example image activity in light adjusting slider example graph represent.

Figure 14 is that the example graph for illustrating the color adjustment sliding block in the activity for making example image saturation represents.

Figure 15 is the example graph table for illustrating the color adjustment sliding block in the activity for making example image desaturation Show.

Figure 16 be illustrate for strengthen example image include activity in light adjusting slider, color adjustment sliding block and The example graph of user's sliding block of prominent adjusting slider represents.

Figure 17 is to illustrate, compared with the image enhaucament of one of existing method, when use light adjusting slider, color adjustment In sliding block and prominent adjusting slider it is one or more to strengthen image when how to retain the example graph of briliancy and represent.

Figure 18 is to illustrate the example graph expression for applying the constant rendering intent of tone to example image.

Figure 19 is to illustrate to represent using the example graph of the situation of identical parameters set.

Figure 20 is to be represented with pyramidal layer series to illustrate two pyramidal example graphs.

Figure 21 is that the example graph for illustrating pyramidal construction represents.

Figure 22 is that the example graph for the selection for illustrating the different levels that remap represents.

Figure 23 is that the example graph for the example for illustrating the prominent effect of limitation represents.

Embodiment

Existing photo editing application suffer from some technical problems.Existing photo editing user circle with many controls Face, general user may be made to puzzle.General user may not be sure that warp-wise image has applied for they using various existing controls The optimum combination of editor.Some existing photo editing applications do not provide similar vision knot for the input picture under different resolution Fruit.Some existing photo editings are applied puts on whole image by editor, typically results in editor for face included in image It is too strong for portion.

In some implementations, there is provided the method that computer system and computer performs, it is included to discussed above The technical solution of technical problem.Specifically, computer system and computer performs method and realized at one or more images Reason or editor's user interface, it is directly perceived and is fairly easy to use, and it allows users to obtain the desired of their images " outward appearance " (such as more or less brightness, more or less colors, etc.).Example system or method are sliding via one or more Block receives user and inputs (user moves sliding block to the left or to the right), analyzes image, and is inputted and analyzed to strengthen based on user Image.Determine to strengthen based on graphical analysis and image detail (such as light, shade, color, contrast etc.).

In some implementations, the method that computer system and computer performs provides effective means to implement so that phase With image, the picture editting under different resolution generates essentially identical visual results.This is by determining pyramidal layer series Level is remapped as from the fixation at the top of pyramid using the fixed lowest resolution image (such as 100x100) of matching and then selection Offset and complete.This ensures that for various sizes of image procossing similar frequency band it is finally produced for different resolution figure The analog result of picture.It should be understood that different pyramidal layer series can be used according to fixed lowest resolution image.

In some implementations, method that computer system and computer performs enables unique mix and coverage technology The face in image is enough protected to be not enhanced result too many and that generation is visually better.System and method described here are Allow to imitate in the pixel beyond face by the amount of the prominent effect of (such as human face) limitation on the specific part of image Fruit plays its complete effect and realizes this point.In some implementations, on face and/or around use fuzzy set Shape (such as rectangle, ellipse etc.) is with restriction effect.The fuzzy rectangular of example is to obscure face by using frame wave filter Bounding box generates.Caused convolution can be calculated with closing form.According to signal processing theory, obscured with another rectangle One rectangle will obtain trapezoidal.Value on the arbitrfary point of output can be dependent only on the distance of rectangle, and it can be used per pixel Set time calculate, but regardless of fuzzy size of cores.In other some implementations, different geometries (such as it is ellipse It is circular, circular) it can be used for protecting the specific part of image.In some implementations, shape can be based on holding for image Capable object or face detection and generate.For example, being confirmed as a part of of image comprising face can be designated as at it The upper shape for being used for limiting prominent effect.

Fig. 1 illustrates the block diagram for the example system 100 using user's sliding block enhancing image.Illustrated explanation System 100 has generally by user 114a to 114n using come (or objective via the user of the server of network access trustship website Family end) equipment 106a to 106n.System 100 can include image server 134, for strengthening, handling and storage image.Institute In the example illustrated, these entities are communicatively coupled via network 102.

It should be appreciated that in Fig. 1 and in the other accompanying drawings for illustrating technology, the letter after reference marker Instruction, such as " 106a ", be to as the element indicated by the particular reference marker or part with particular reference to.Go out in the text Referring now to mark without letter it is followed by the case of, such as " 106 ", it should be appreciated that this is to the generality The general reference of the element of reference marker or the different implementations of part.Moreover, although only two user equipmenies are in Fig. 1 In show, it will be appreciated by those of ordinary skill in the art that any number of client device 106n can be by any number of user 114n is used.

Network 102 can be general type, wired or wireless, and can have it is multiple it is different configure, including star like arrangement, Token ring configures or other configurations.Moreover, network 102 can include LAN (LAN), wide area network (WAN) (such as internet) And/or other interconnection data paths that multiple equipment can communicate thereon.In some implementations, network 102 can be Point to point network.Network 102 is also coupled to or including part communication network, for sending number with various different communication protocols According to.In some other implementations, network 102 includes bluetooth communication network or cellular communications networks, for sending and receiving Data, including via short message service (SMS), multimedia information service (MMS), HTTP (HTTP), immediate data Connection, WAP (WAP), Email etc..In addition, it is coupled to and is schemed although Fig. 1 illustrates single network 102 The user equipment 106 and image server 134 shown, indeed, it is possible to there is one or more networks 102 to be connected to these entities.

For example, using user equipment 106a to the 106n in Fig. 1.It is public although illustrate only two user equipmenies 106 The content opened is applied to the system architecture with any number of user equipment 106 available for any number of user 114. In the implementation of diagram, user 114a to 114n and user equipment 106a and 106n respectively via signal wire 112a to 112n and Interaction.User equipment 106a to 106n is communicatively coupled to network 102 via signal wire 104a to 104n respectively.

In some implementations, user equipment 106 (any or whole in 106a to 106n) can be any calculating Equipment, including memory and processor.For example, user equipment 106 can be notebook computer, desktop computer, tablet personal computer, shifting Mobile phone, personal digital assistant, mobile E-mail equipment, portable game player, portable music player, have one or It is multiple to be embedded or the TV of processor coupled thereto or be able to access that any other electronic equipment of network 102 etc. Deng.

In some implementations, user equipment 106a to 106n applies 108 (being illustrated as 108a to 108n) including user And image enhaucament engine 136.User 114 (114a to 114n) using user using 108 come optionally with image enhaucament engine 136 and image server 134 exchange information, complete the operation of this technology.As an example, user 114 can use bag Include user's sliding block 110a in user applies 108a and light and/or color adjustment are carried out to image, and can be based on from figure These of image intensifying engine 136 adjust and receive results using 108 via user.User using 108 further behavior and/ Or function is described in more detail with reference at least Fig. 2 below.

System and method discussed here do not require to collect or using userspersonal information.The some realizations discussed herein Mode may collect or personal information (such as user data, the information of relevant user social networks, user using relevant user Position, user biological metrical information, User Activity and demographic information) in the case of, provide a user one or more Chance come control whether collect personal information, if storage personal information, if using personal information, and how to collect, deposit Storage and the information using relevant user.It is, system and method discussed here are only clearly awarded being received from associated user Power is just collected, stored and/or using userspersonal information when so doing.In addition, some data are stored at it or use it Before can be handled with one or more modes so that the recognizable information of individual is removed.As an example, the identity of user It can be processed so that can be determined without personal recognizable information.As another example, the geographical position of user can be by Generalization is to bigger region so that the ad-hoc location of user can not be determined.

In some implementations, user requires that user agrees to allow user to apply 108 and/or here other using 108 The miscellaneous part processing information and image that place is discussed.If user disagrees, user will not be handled and user's phase using 108 Any information closed.

Image server 134 can be computing device, including processor, memory and network communications capability.Images serve Device 134 is coupled to network 102 via signal wire 132.Image server 134 can be configured as setting from user via network 102 Standby 106 (106a to 106n) obtain multiple images and are used for strengthening.Although only an image server 134 is illustrated, this area Skilled artisan will realize that multiple servers can be used, framework or other frameworks in a distributed manner.For this application Operation performed by purpose, system configuration and system describes in the environment of single image server 134.

In some implementations, image server 134 is used for image enhaucament including image enhaucament engine 136.Image increases Strong engine 136 can receive user's input on user's sliding block 110 from user using 108, and be then based on received On sliding block 110 user input and change image.For example, it can be provided input to using the user 114 of light adjusting slider Make fade up, and image enhaucament engine 136 can be with analysis chart picture and based on the required use received on light adjusting slider Family inputs and lightens image.By another example, input can be provided so that image is satisfied using the user 114 of color adjustment sliding block With, and image enhaucament engine 136 can be inputted with analysis chart picture and based on the required user received on color adjustment sliding block To make its saturation.Many other examples are also possible and considered.

As depicted in Figure 1, image enhaucament engine 136 is shown in broken lines to indicate image enhaucament engine described here Operation performed by 136 can perform in server side (such as image server 134) or in user side (such as user equipment 106a to 106n) perform, or performed under combination.Additional structure, action and/or the work(of image enhaucament engine 136 It can be described in more detail with reference at least Fig. 2 below.

Fig. 2 is the block diagram of Example Computing Device 200, and it can be serviced in 134 and/or user equipment 106 with representative image and wrapped The computing device included.As depicted, computing device 200 can include processor 216, memory 218, communication unit 220, number 108 and image enhaucament engine 136 are applied according to storage 222, one or more users, it can be communicated by communication bus 214 Coupling.

According to configuration, computing device 200 can include different parts.For example, in server-side implementation, calculating is set Standby 200 can include image enhaucament engine 136.In the implementation of example client side, computing device 200 can include user Using 108 and/or image enhaucament engine 136.There is provided it should be understood that configuration above is citing, and it is many further Configuration can be considered and be possible.

Processor 216 can perform software instruction by performing various input, logic and/or mathematical operations.Processor 216 can have various computing architectures to method data-signal, including such as CISC (CISC) framework, simplify Instruction set computer (RISC) framework, and/or the framework for realizing instruction set combination.Processor 216 can be physics and/or empty Intend, and single core or multiple processing units and/or core can be included.In some implementations, processor 216 may energy Enough generations and offer electronical display signal support the display of image, catch and transmission image, execution include various to display device Complex task of feature extraction and sampling of type etc..In some implementations, processor 216 can be via bus 214 It is coupled to memory 218 therefrom to access data and instruction and wherein data storage.Bus 214 can be by processor 216 It is coupled to the miscellaneous part of computing device 200, including such as memory 218, communication unit 220 and data storage 222.

Memory 218 can store and provide miscellaneous part of the access to computing device 200 to data.In some realizations In mode, memory 218 can store the instruction that can be performed by processor 216 and/or data.Memory 218 can also store Other instruction and datas, including such as operating system, hardware driving, other software application, database etc..Memory 218 can Communicated with being coupled to bus 214 with the miscellaneous part with processor 216 and computing device 200.

Memory 218 can include non-momentary computer and can use (for example, readable, writeable etc.) medium, and it can be appointed What non-momentary device or equipment, can include, stores, transmits, propagates or transport instruction, data, computer program, software, generation Code, routine etc., to be handled by or to processor 216 is related.In some implementations, memory 218 can wrap Include one or more volatile memory and nonvolatile memory (such as RAM, ROM, hard disk, CD etc.).It should be understood that Memory 218 can be individual equipment or can include polytype equipment and configuration.

Bus 214 can include being used for the communication for transmitting data between the part of computing device or between computing device Bus, including the network-bus system of network 102 or part thereof, processor net, combinations thereof etc..In some implementations In, user can assist using 108 and image enhaucament engine 136 via the software communication mechanism for being associated with bus 214 and realizing Make and communicate.Software communication mechanism can include and/or promote such as Inter Process Communication, local function or process invocation, is long-range Process invocation, network communication, secure communication etc..

Communication unit 220 can include one or more interface equipments and be used for setting with network 102 and including such as user Other entities and/or part for the system 100 of 106, image server 134 and data storage 222 etc. carry out wired and nothing Line connects.For example, communication unit 220 can include, but not limited to CAT type interfaces；Radio receiving-transmitting unit, for using Wi- Fi, bluetooth, cellular communication etc. send and receive signal；USB interface；Its various combination；Etc..Communication unit 220 can be through Network 102 is coupled to by signal wire 104 and 132.In some implementations, communication unit 220 can link processor 216 To network 102, network 102 may be coupled to other processing systems again.Communication unit 220 can be assisted using various standard traffics View, including those for example discussed elsewhere here, there is provided other are connected to network 102 and other entities to system 100.

Data storage 222 is information source, for data storage and provides the access to data.In some implementations, Data storage 222 can be coupled to via bus 214 part 216,218,220,108 and/or 136 of computing device 200 so as to Receive data and the access to data is provided.In some implementations, data storage 222 can store from system 100 its The data that his entity 106 and/or 134 receives, and the data access to these entities is provided.Data storage 222 can wrap One or more non-emporary computer-readable mediums are included, for data storage.In some implementations, data storage 222 can To merge with memory 218 or can be with different.In some implementations, data storage 222 can include database Management system (DBMS).For example, DBMS can include SQL (SQL) DBMS, NoSQL DMBS, its various combination Etc..In some instances, the various dimensions table data storage that DBMS can be to be made up of row and column, and use programming operation Manipulate, for example, insertion, inquiry, renewal and/or deletion, the row of data.In some implementations, data storage 222 can be Image has been used storage enhancing image after the change of user's sliding block 110.

As depicted, user includes user's sliding block 110 using 108.User's sliding block 110 can include light adjusting slider, One or more combination in color adjustment sliding block and prominent adjusting slider.Light adjusting slider can be increase/reduction image Brightness (brightness) sliding block, such as it is for example shown in fig. 6b.Color adjustment sliding block may be such that image saturation/go The sliding block of saturation, it is such as example shown in figure 6 c.Prominent adjusting slider can be saturation degree and the sliding block of brightness in lifting image, It is such as example shown in figure 16.

In some implementations, in these sliding blocks 110 each can be with the one or more of image enhaucament engine 136 Part coordinates to perform its operation discussed herein.For example, light adjusting slider can be with user circle of image enhaucament engine 136 Face mould block 202, image dissector 204, light adjustment module 206 and image are completed module 212 and coordinated to increase/reduce the bright of image Degree.Color adjustment sliding block can be with the subscriber interface module 202, image dissector 204, color adjustment of image enhaucament engine 136 Module 208 and image are completed module 212 and coordinated to make image saturation/desaturation.

As depicted, image enhaucament engine 136 includes subscriber interface module 202, image dissector 204, light regulation mould Block 206, color adjustment module 208, prominent effects module 210 and image complete module 212.The part of image enhaucament engine 136 202nd, 204,206,208,210 and 212 be coupled to communicate with one another and with the miscellaneous part 108 of computing device 200,110, 216th, 218 and 220 communication.Part 202,204,206,208,210 and 212 also via communication unit 220 be coupled to network 102 with Just with other entity communications of system 100.

In some implementations, subscriber interface module 202, image dissector 204, light adjustment module 206, color adjustment It is that can provide them by the instruction set that processor 216 performs that module 208, prominent effects module 210 and image, which complete module 212, Corresponding action and/or function.In other implementations, subscriber interface module 202, image dissector 204, light adjustment module 206th, color adjustment module 208, prominent effects module 210 and image complete the memory that module 212 is stored in computing device 200 In 218 and it can be accessed and be performed by processor 216 to provide their corresponding actions and/or function.In these implementations In any one in, it is subscriber interface module 202, image dissector 204, light adjustment module 206, color adjustment module 208, prominent Go out effects module 210 and image and complete module 212 to go for miscellaneous part with processor 216 and computing device 200 108th, 110,218 and 220 cooperations and communication.

Subscriber interface module 202 can be performed for including being used to then will from the reception user's input of user's sliding block 110 One or more miscellaneous parts that these inputs are sent to image enhaucament engine 136 act accordingly to perform them thereon And/or function routine the step of, processing, function or equipment.In some implementations, the user from user's sliding block 110 Input can include, for example, being adjusted the input of the light of image using light adjusting slider, being adjusted figure using color adjustment sliding block The input of the color of picture and adjust the input of the protrusion effect of image using prominent adjusting slider.In some implementations In, subscriber interface module 202 can be additionally configured to receive image enhaucament result from the miscellaneous part of image enhaucament engine 136 right Image is provided based on these results to be shown to user afterwards.

Image dissector 204 can be performed for including being used to analyze have been selected to carry out the image of image enhaucament by user Routine the step of, processing, function or equipment.In some implementations, analysis image can include determining that related to image The current light details of connection, the current color detail associated with image be (for example, which color saturation and insatiable hunger in image With, image whether the saturation intensity in supersaturation, image etc.), the one or more protection zones associated with image (such as One or more personages present in skin color, image in image etc.) etc..In some implementations, image point Parser can send its analysis result to light adjustment module 206, color adjustment module 208, protrusion effects module 210 and/or Image completes module 212, and these modules can then be used as the basis of their operation using these results.

The step of light adjustment module 206 can be performed for including the routine for the light for adjusting image, processing, function Or equipment.In some implementations, adjusting the light of image can include as lightened or dimming with discussing elsewhere here Image.In some implementations, light adjustment module 206 can be determined the light details of image based on image dissector and lighten figure Picture.Light adjustment module 206 can extensively be deployed to be distributed and account for by 1) extending the scope of the histogram associated with image According to the usable range adjusted for light, 2) the regulation shadow detail associated with image, or 3) lifted or corrected using gamma, As discussed, such as in Fig. 3 D and 8, and image is lightened.Shade regulation refers to performing image procossing with correction exposure (per single The light quantity of plane product).Gamma be used in video or rest image adjust briliancy (luminance) or tristimulus values it is non-linear Operation.Light adjustment module 206 can be engaged with the user's input received on light adjusting slider and perform described here It is operated.

In some implementations, light adjustment module 206 can be determined the light details of image and be adjusted based on image dissector Dark image.Light adjustment module 206 can widely be deployed to be distributed by 1) extending the scope of the histogram associated with image And all usable ranges of light regulation are occupied, and 2) the regulation bloom details associated with image, or 3) reduction is associated with image Gamma, as discussed, such as in Fig. 3 D and 11, and dim image.In some implementations, once light adjustment module 206 complete to perform its light regulation described here, and light adjustment module 206 can send the regulation of its light and complete module 212 to image, Image, which completes module 212, then to complete image using these regulations and other further regulations to show to user Show.

Color adjustment module 208 can be performed for including being used for the step of routine for the color for adjusting image, processing, Function or equipment.In some implementations, adjusting the color of image can include as what is discussed elsewhere here makes figure As saturation or desaturation.In some implementations, color adjustment module 208 can be based on user in color adjustment sliding block Current location makes image saturation or desaturation.Color adjustment module 208 can receive user in cunning from subscriber interface module 202 Current location in block, the subscriber interface module 202 are communicatively coupled to user's sliding block 110 to receive the input of the user on sliding block.

If current location of the user in sliding block surmounts the point midway on first direction (such as right or up), color is adjusted Agent module 208 can determine that user wants to make image saturation and then can be by 1) making the color in also unsaturated image satisfy With, and/or the 2) skin color of the personage in saturation history in protection image, to make image saturation.On the other hand, if with Current location of the family in sliding block surmounts the point midway in second direction (such as left or down), and color adjustment module 208 can be with Determine that user wants to make image desaturation and can then gone by what the current location based on user in sliding block was reflected The amount of saturation makes the color desaturation in the image of also non-desaturation make image desaturation.In some implementations, one Denier color adjustment module 208, which completes, performs its color adjustment described here, and color adjustment module 208 can send its color Adjust image and complete module 212, image completion module 212 can then use these regulations and other further regulations To complete image to be shown to user.

Prominent effects module 210 can be performed for including being used for the step that prominent effect is applied to the routine of image Suddenly, processing, function or equipment.Apply prominent effect can include to image add saturation boost, the brightness for adjusting image or Person strengthens the details of image using local contrast.In some implementations, prominent effect can be in light adjustment module 206 And/or the light performed by color adjustment module 208 adjusts and/or color adjustment is applied in before.In other implementations, dash forward Going out effect can be applied in any time during the process of image enhaucament.In some implementations, once protruding effect Module 210 completes to apply described here its and protrudes effect, prominent effects module 210 can will prominent effect to be sent to image complete Into module 212, the image completes module 212 then can complete image using these effects and other further regulations To be shown to user.It is discussed further that additional description about prominent effect combines at least Fig. 3 B, 3C, 4 and 5 below.

Image completes the step that module 212 can be performed for including the routine for completing image to show to user Suddenly, processing, function or equipment.In some implementations, image, which completes module 212, to be based on by light adjustment module 206, color Light, color and/or the protrusion that color adjustment module 208 and protrusion effects module 210 are respectively completed are adjusted to complete image, so Afterwards, if it is desired, the constant rendering intent of tone is applied to image, as example discussed in figure 18.In some implementations In, image, which completes module 212, can apply some other wave filters or image enhancement technique to further enhance image.Once figure As being done, image, which completes module 212, to be sent to subscriber interface module 202 by the image of completion, the subscriber interface module 202 can then provide it so that user shows.

Subscriber interface module 202, image dissector 204, light adjustment module 206, color adjustment module 208, prominent effect Supernumerary structure, action and/or the function that module 210 and image complete module 212 combine at least Fig. 3 A-3E and figure below 4 and 5 further describe.

Method

Fig. 3 A-3E are to illustrate the flow chart for strengthening the exemplary method 300 of image using user's sliding block.Method 300 start from receiving user input of the 302 selection images for enhancing, and provide 304 user's sliding block set, including light is adjusted Sliding block, color adjustment sliding block and prominent effect sliding block are saved, to be shown to user.In some implementations, block 302 and 304 In operation can be performed or performed in different order using 108 by user.For example, user's application can be mounted in Photo application on user equipment, and the photo application can provide use after user is received to the selection of image enhaucament Family sliding block to user to show, as example described in fig. 6.

Another user that method 300 passes through the sliding block needed for selection from the user's sliding block set shown to user of reception 306 Input continues.In some implementations, the input from more than one sliding block can be received.Method 300 then can be Determine that user's selection is prominent effect sliding block, light adjusting slider or color adjustment sliding block respectively in block 308,310 and 312.Should The understanding, these blocks 308,310 and 312 can be to perform different from other order shown in Fig. 3 A.For example, block 310 can be with Performed before block 308.If it is determined that result be prominent effect sliding block, then method 300 may be advanced to block 316 (referring to figure 3B) with analyze image and in block 318 determine image whether include any protection zone.Protection zone is that wherein enhancing will not be applied The image-region for adding or differently applying with image remainder.In some implementations, protection zone is automatically defined, and It is manual definition based on user's input in other implementations.In some implementations, protection zone need not wrap It is entirely user's definable to include face but this.For example, method 300 can determine that image is in block 318 via face detection It is no including any character face and if any, then apply prominent effect in a manner of protecting facial zone.In some realities In existing mode, prominent effect can be applied to protect by the way that prominent effect is applied into predetermined threshold value in facial zone Protect facial zone.In some cases, prominent effect in facial zone can be applied to the first degree and without anyone The second different degree is applied in the region of the image in object plane portion.In some cases, the first degree can be less than the second journey Degree.For example, same amount of prominent effect can be applied to specified level to the facial zone of image and non-face region, and so Protruding effect afterwards can continue in image remainder, and facial zone protrudes effect and is then maintained at specified level.One In a little implementations, prominent effect can gradually be applied to the not same district of facial zone peripheral limit.These regions can be by protecting Shield is covered to define.It is the General Boundary matched with protection zone that protection, which is covered, and will not apply or differently apply wherein Add enhancing.For example, for Figure 23, it is not bounds that protection, which covers 2302, but covers to image remainder from protection and gradually take off Color.

If method 300 determines that the pixel of image is not a part for protection zone, method 300 can simply be proceeded to and carried Rise 320 saturation degrees (if these pixels need), 322 brightness of regulation (i.e. increase/reduction) (if these pixels need) and Strengthen the details of non-protected area using 324 local contrasts, as discussed elsewhere here.On the other hand, if Method 300 determines in the protection zone of pixel in the picture that then method 300 can lift the saturation degree in 326 regions in block 318 Some predetermined threshold value is only reached, the brightness that can adjust 328 regions only reaches some predetermined threshold value, and Using 330 local contrasts some predetermined threshold value can be only reached to strengthen the details in the region.So do that will scheme As only lightening, some is horizontal and to be maintained at the skin color of the personage identified in image constant.

In some implementations, method 300 can still apply prominent effect to protection zone, but be different from The second predetermined level of the first level in unprotected region is applied to, it still can strengthen horizontal holding guarantor with appropriate Region is protected, but different from image remainder (for example, keeping being equivalent to the color of skin color and realistic appearance).This is in Fig. 3 C In further illustrate.Referring now to Fig. 3 C, if protection zone be present in the image that method 300 determines to analyze in block 316 Domain, method 300 can lift 332 saturation degrees in protection zone with the second predetermined speed, can be in protection zone With the second predetermined brightness of rate adaptation 334, and can be used in protection zone with the second predetermined speed 336 local contrasts strengthen the details of image.In some implementations, the operation in the block described in Fig. 3 B and 3C is by scheming As analyzer 204 and prominent effects module 210 coordinate the protrusion adjusting slider that user's sliding block 110 includes to perform.

Return to Fig. 3 A, if it is determined that result be light adjusting slider, then method 300 can advance with block 338 or 340 Determine whether to lighten image respectively (referring to Fig. 3 D) or dim image.If method 300 determines to lighten 338 images, method 300 can To advance and present cursor position based on user in light adjusting slider adjusts the bloom details in 341 images.Next, Method 300 can extend 342 histogram ranges with using all based on present cursor position of the user in light adjusting slider Usable range (for example, with reference to Fig. 8,10A, 11 and 13).Method 300 continues to adjust the shadow detail in 344 images, and then Present cursor position based on user in light adjusting slider is lifted to carry out colour correction to apply 346 gammas, such as here Discussed elsewhere.For example, gamma lifting can be the parameter for being changed the human perception of image and image briliancy Value.This arrives tone scale regulation the level felt evenly.

If on the other hand, method 300 determines to dim 340 images, method 300 can advance to be adjusted based on user in light Present cursor position in sliding block extends 348 histogram ranges to use all usable ranges, as discussed above.Method 300 can then based on present cursor position of the user in light adjusting slider come adjust the bloom details in 350 images and 352 gammas are reduced, it is such as example shown in fig. 11.In some implementations, the operation in the block described in fig. 3d is by light Adjustment module 206 coordinates the light adjusting slider that user's sliding block 110 includes to perform.

Return to Fig. 3 A, if it is determined that result be color adjustment sliding block, then method 300 may be advanced to block 354 (referring to figure 3E) to analyze image and it is later determined that present cursor position of 356 users in color adjustment sliding block.In response to determining user Present cursor position in sliding block, method 300 can be determined in block 358 and 360 cursor position be respectively in sliding block from The first direction or second direction of point midway.Method 300 can make this determination to determine to make image saturation or go to satisfy With.For example, if method 300 determines that cursor position is higher than point midway in block 358, method 300 can be determined in 362 images Color whether be equivalent to skin tone color, and then based on present cursor position of the user in color adjustment sliding block come Make image saturation 364, exclude the color of saturation and protect the skin color of one or more personages in image.In some realities In existing mode, method 300 can apply saturation to skin color until predetermined threshold value.For example, if skin color takes off Color (the such as less than saturated level of skin color), then it can apply saturation to skin color and skin tone color can be satisfied With to horizontal with other color identicals in image.In another example, skin color can be saturated and be schemed with a level As the color of remainder can be saturated to varying level.On the other hand, if method 300 determines cursor position in block 360 Less than point midway, then method 300 can make image go to satisfy based on present cursor position of the user in color adjustment sliding block With 366, as discussed elsewhere here.In some implementations, the operation in the block described in Fig. 3 E is by image Analyzer 204 and color adjustment module 208 coordinate the color adjustment sliding block that user's sliding block 110 includes to perform.

Referring now to Fig. 3 A, once method 300 is respectively using prominent effect sliding block 308, light adjusting slider 310 and color Color adjusting slider 312 performs one or more of prominent effect regulation, light regulation and color adjustment, if it is desired, method 300 can be with after-applied 314 any constant rendering intents of tone to image, as example with reference to discussing Figure 18.In some realities In existing mode, the operation in block 314 can complete module 212 to perform by the image of image enhaucament engine 136.

In some implementations, method 300 can include automatic Enhanced feature.Automatic Enhanced feature can be set automatically Light regulation, effect regulation and/or color adjustment are protruded to the predetermined value optimized by the demand of specific image.In advance really Fixed value can be identified preferably in advance using standard image analysis to determine and compare different images version with different adjustment The value first determined.

Fig. 4 is for smoothly strengthening the exemplary method of the local contrast of image and saturation degree using local Laplce 400.Method 400 carries out knowing the smooth of edge using local Laplce.Method 400 can then find original image and The difference between image after smooth, and difference is added back to strengthen the details of image.Enhancing is generally under high intensity It is probably undesirable for face.Therefore, method 400 can calculate face and cover to protect face to be less highlighted.One In a little implementations, the operation described in method 400 can be performed by prominent effects module 210.

Here is the general introduction of some material particulars of each part that description is described in method 400：

Primary layer：Image is received and changes 402 as gray level.Directly via appropriate local Laplace method enhancing office Portion's contrast and saturation degree may generally produce staircase artifacts.Method 400 can use local laplacian pyramid 404 Grayscale image is calculated and knows that edge obscures.Difference 405 between original image and the blurred picture for knowing edge is subsequent 406 are added to return to increase contrast and saturation degree.

Local Laplce is smooth：As user, it will expect that following two image looks similar：

It is smaller (output for readjusting size) that application, which protrudes and readjusts image,

Image is readjusted to be smaller and apply prominent (output for readjusting the input of size)

This is even more important in many editor's applications, because user may be directed to low resolution (such as screen resolution) Image enters edlin, but his/her editor may be applied in and preserve for original high-resolution image.

As a result will be different if using identical parameters collection.Describe the example of the scene figure 19 illustrates.

Although effect is likely difficult to distinguish side by side, quick change between two images causes to be very easy to what is discovered Difference.It is all fixed that the reason for this undesired effect, which is exactly pyramidal layer series and performs the level to remap,. The two parameters select specific frequency to be strengthened relative to original image resolution together.Because two input pictures have Different resolution, pyramid will influence different frequency, and cause different images.

Method 400 can be by determining pyramidal number of levels to solve this problem from image resolution ratio.It is desirable that side Method 400 can create pyramid until the image (such as 100x100) of some fixation lowest resolution.Two pyramidal examples Such as figure 20 illustrates.

Image may not be always within two mutual factors.Method 400 can find pyramidal optimal number of levels with Best match some and fix lowest resolution scope.Worst-case difference in the pyramid of structure shows in such as Figure 21 Go out.

Method 400 can then select to remap level as from the constant offset at the top of pyramid (referring to Figure 22).This Ensure that same frequency band is processed.

Structure is covered：Method 400 uses structure to cover 408 so that the big region of small gradient is not enhanced.This help suppresses Noise artifact in prominent effect.Structure, which covers 408, to calculate the energy in multiband essentially by using Gabor filter Measure and be calculated.

Face covers protection：In some cases, when other regions of image do not apply enough protrusions, prominent effect It is too strong that fruit may be directed to face.Typically, the maximum intensity for the protrusion of face should be~0.6, and if on other ground Side, which applies, to be protruded, and maximum intensity should be~1.5.

Method 400 can be directed to facial protrusion effect by using protection zone to limit, and protection zone is facial surroundings Fuzzy rectangular, its example figure 23 illustrates.

Protection zone can determine by performing face detection 410 and be defined as protecting by these regions detected Area.Protection, which is covered, to be calculated by fuzzy 412 smeared out boundary frames, the rectangle with framed wave filter.But because input is schemed There is rectangle as only known, caused convolution can be calculated with closing form.According to signal processing theory, with another rectangular mold One rectangle of paste will obtain trapezoidal.In fact, the value of the arbitrfary point of output is dependent only on the distance of rectangle, this can be very Rapidly calculate.Once face is covered and has been generated, prominent image and protection zone are mixed 414 to produce output image.

Fig. 5 is to produce the exemplary method 500 of similar visual effect for implementing the different resolution of identical input picture. Method 500 start from determining 502 optimal pyramidal layer series with best match some fix lowest resolution image (such as 100x100).Method 500 can select 504 to remap level as from the constant offset at the top of pyramid.This ensures similar frequency Band is treated for the different image of size, and it finally produces analog result for different resolution image.Finally, method 500 can To apply 506 local Laplces smoothly to strengthen the local contrast of image and saturation degree, or, in other words, will be prominent Effect is applied to image.In some implementations, the operation in block 502-504 can be performed by prominent effects module 210.

Figure represents

Fig. 6 A-6C are the example user interfaces of user's sliding block in description activity.Particularly, Fig. 6 A be describe in response to The example interface of the option set for the progress image enhaucament that family selects user's sliding block 602 and given the user.For example, as retouch Paint, once receiving user's selection to user's sliding block 602, the option 604 of regulation light can be provided a user, adjust color The option 608 of option 606 and prominent image.Fig. 6 B are to describe the light that regulation image is selected in response to user or the option of brightness The example interface of 604 light adjusting slider 610.Fig. 6 C are the options 606 for describing the color that regulation image is selected in response to user Color adjustment sliding block 612 example interface.

Fig. 7 is the example graph table for comparing the image enchancing method described in the disclosure and existing image enchancing method Show.As depicted, image enchancing method described here only obtains phase using two user's sliding blocks (such as light and color) Same or more preferable result, as shown in image 702.Compare, existing image enchancing method 1,2 and 3 is respectively such as 702,704 and Shown in 706, there is provided countless controls or option adjust image.Advantage is, with such as existing image enchancing method 1, existing What image enchancing method 2 and/or existing image enchancing method 3 were described more has experience or professional user may be by adjusting nothing Numerical control system or option and the image enhaucament that obtains is compared, novice users may can be by only using light regulation and color adjustment to slide Block just obtains the desired enhancing for image.

Fig. 8 be illustrate for illuminate example image activity in light adjusting slider example graph represent. Particularly, the interface indicated by reference marker 802 indicates no any default image for illuminating effect and putting on image.This is It is located at the center of light adjusting slider by the present cursor position 804 of user to prove.Interface 802 also includes histogram 806, Its details based on default image and show to be distributed.The interface that reference marker 808 is described indicate based on cursor position 810 from The increase of brightness in the image that its front position 804 is moved to the right.Moreover, as reference marker 812 is proved, histogram model Enclose and be expanded so that widely expansion is distributed and carries out light regulation using all usable ranges.What reference marker 814 was described Interface indicates being automatically adjusted for the enhancing based on present cursor position 816 and as indicated by reference marker 818 Shade and further enhancing in brightness of image.Finally, the interface indicated by reference marker 820 indicates is existed based on user Cursor position 822 in sliding block is moved to the final of the application of its gamma lifting extreme and as indicated by reference marker 824 Highlight image.

Fig. 9 is that the figure for illustrating the light adjusting slider in the activity for another example image represents.Pay attention to, Scope extension is not needed in the case of this, because gamut has all been available.

Figure 10 A and 10B be illustrate during the operation for the light adjusting slider of example image scope extension and Another figure of shadow detail regulation represents.In Figure 10 A, figure represents that 1000 illustrate change scope extension.Scheming In 1002, scope extension 1004 is shown as sliding block in centre.In image 1006, scope extension 1008 is shown as sliding block The right of scope extension 1008 is moved to, when with image 1002 compared with, enhancing image 1006.In fig. 1 ob, figure represents 1008 Show that shade is adjusted in example image.In one implementation, example image 1010 includes shade regulation 1012, sliding block position Position on the right of center line.Example image 1014 includes shade regulation 1016, and sliding block is located at the position on very the right of center line And when compared with image 1010, display enhancing image 1014.

Figure 11 is that the figure for illustrating the light adjusting slider in the activity for example image represents 1100.Especially It is that the interface indicated by reference marker 1102 indicates default image, effect is dimmed without putting on any of image.This is It is located at the center of light adjusting slider by user's present cursor position 1104 and is proved.Interface 1102 also includes histogram 1106, its details based on default image shows to be distributed.The interface that reference marker 1108 is described be based on cursor position 1110 from Its front position 1104 is moved to the left and indicates the reduction of brightness in image or dim.Moreover, as reference marker 1112 is demonstrate,proved Bright, histogram range is expanded to widely deploy to be distributed and using all usable ranges so that light is adjusted.With reference to mark The interfaces described of note 1114 indicate based on present cursor position 1116 and as indicated by reference marker 1118 by oneself The bloom details of dynamic regulation, and further dimming in the picture.

Figure 12 is that the figure for illustrating the light adjusting slider in the activity for another example image represents 1200.Note Meaning, for this situation (being similar to the in the case of of being discussed with reference to figure 9), it is not necessary to which scope extends, because gamut has all been It is available.

Figure 13 be illustrate for strengthen example image activity in light adjusting slider example graph represent 1300. Particularly, the interface indicated by reference marker 1302 indicates default image, does not apply any effect or enhancing to image.This is It is located at the center of light adjusting slider by user's present cursor position 1304 and is proved.Interface 1302, similar to the He of interface 802 1102, in addition to histogram 1306, show to be distributed based on the details of default image.Interface table indicated by reference marker 1308 Understand the increase of brightness in the image to be moved right based on cursor position 1310 from its front position 1304.Moreover, as with reference to mark What note 1312 was proved, histogram range all extends on both sides so that widely expansion is distributed and uses all available models Enclose to carry out light regulation.The interface that reference marker 1314 is described is indicated based on present cursor position 1316 and as with reference to mark The shade being automatically adjusted indicated by note 1318, the further enhancing in brightness of image.Finally, by reference marker The cursor position that interface indicated by 1320 is indicated based on user in sliding block 1322 is moved to its extreme and such as reference mark The final enhancing image of gamma regulation indicated by note 1324.

Figure 14 is that the example graph for illustrating the color adjustment sliding block in the activity for making example image saturation represents 1400.As depicted, image saturation is made as follows：In image the skin color of personage be protected and in image Color through saturation is no longer saturated.For example, make the image saturation described in figure as follows：Saturation is being performed for image Afterwards, two personages that image includes, which look no tanned or do not looked, loses its natural skin tone.

Figure 15 is to illustrate color adjustment sliding block 1502 in the activity for making example image desaturation at three not The example graph of same position (1502a-1502c) represents.

Figure 16 be illustrate for strengthen example image include activity in light adjusting slider, color adjustment sliding block and The example graph of user's sliding block of prominent adjusting slider represents 1602.As depicted, once using prominent adjusting slider, if Need, the saturation degree of example image and/or brightness can be with elevated, and local contrast may be used to further enhance image Details.

Figure 17 is illustrated compared with the image enhaucament of one of existing method, is adjusted when using light adjusting slider, color The example graph for how retaining briliancy when one or more of section sliding block and prominent adjusting slider are to strengthen image represents.With reference to Mark 1702 indicates original image (that is, the image before any enhancing).Reference marker 1704 is indicated described in the disclosure Identical image and reference marker 1706 after method enhancing indicate the identical image after being strengthened by existing Enhancement Method.As institute Describe, the tone in original image as indicated by 1702 is more shallow and lighter, and needs to be conditioned.Increased by existing method Strong image 1706 make it that the color of sky in image is too dark, thus its become can not area with the water of 1708 blooms instructions of arrow Point, and on the other hand, the image 1704 strengthened by method described here, compared with image 1702, while cause color adjustment Just appropriately keep retained briliancy.

Figure 18 is to illustrate the example graph expression for applying the constant rendering intent of tone to example image.Reference marker 1802 instruction original images (image before i.e. any enhancing).Reference marker 1804 indicates strengthening it by existing Enhancement Method Rear identical image and reference marker 1806 indicate the identical image after the method enhancing described in the disclosure.Pay attention to, will What the undesired hue shift 1808 in the image that existing Enhancement Method is strengthened was strengthened with the method described in the disclosure How its in image 1810, which improves, is compared.

Figure 19 is that the example graph for the difference for showing to introduce when output is resized represents.Show at one Example in, user may receive image be used for edit and edlin is entered to it at lower resolutions.Relatively low resolution after editor The image of rate is resized 1904 and the phase of image 1902 readjusted after size with being edited under high-resolution Than when, have differences 1906 between two images.Even if identical parameters put on identical image, simply resolution ratio is different, still These differences 1906 so be present.

Figure 20 is that the pyramidal example graph of image represents.Method 400 described in Fig. 4 can be according to image resolution ratio Determine pyramid level 2002.Method 400 in Fig. 4 can create pyramid, until some fixation lowest resolution image.So Afterwards, pyramid level is resized to readjust the pyramid level 2004 of size and golden word by 2 factor The resolution ratio of tower is retained so that when the pyramid level 2004 for readjusting size edited and then be re-adjusted to it is original During size, the editor is retained by resolution ratio, therefore caused image is avoided on the difference described in Figure 19.

Figure 21 is represented with the pyramidal example graph of different factors adjustment size.Method 400 described in Fig. 4 can be with Determine optimal pyramidal layer series and fix lowest resolution image best to match some.Original pyramid 2102 and the worst The image 2104 that situation readjusts size is illustrated, and wherein worst case is confirmed as than original pyramid 2102 small 29.3% Pyramid.

Figure 22 is to be represented using pyramid come the example graph for the level that remaps.Method 400 described in Fig. 4 can be true Surely the level that remaps is from the constant offset at the top of pyramid.Original pyramid 2202 is shown under the top level that remaps Two levels.Pyramid 2204 shows to remap with what different zoom resolution ratio was carried out.Pyramid 2206 is shown that can replace Change remapping for scaling resolution ratio progress.By being remapped with specific level, this, which remaps, ensure that same frequency band quilt Processing.

The example graph that Figure 23 is used as the fuzzy rectangular that protection is covered represents.In Fig. 4 in described method 400, Fuzzy rectangular 2302 can be determined based on the face of the identification in original image 2304.Image 2306 is shown with application The image that effect is covered without the fuzzy protection of rectangle 2302.The fuzzy protection of rectangle 2302 of the display of image 2308 is covered just It is used to protect the face identified in image 2304, and effect is applied to the remainder of image 2308.

Reference in specification to " some implementations " or " implementation " means with reference to described in the implementation Special characteristic, structure or characteristic are included at least some situations of description.Phrase " in some implementations " is in specification In appearance in various positions be not necessarily all referring to identical implementation.

The some parts of embodiment pass through the processing to the data bit in computer storage and the symbol of operation Number represent to present.These processing descriptions and expression are that the technical staff of data processing field is used most effectively to pass on it Means of the essence of work to others skilled in the art.These steps need the physical operations of physical quantity.Generally, although Inessential, this tittle uses the form for the electrical or magnetic signal that can be stored, transmitted, combined, compared and operated in addition.Have When, the reason for primarily for public use, it was demonstrated that these signals are referred to as into bit, value, element, symbol, character, term, number Etc. being convenient.

It should be borne in mind that all these and similar terms will be associated with suitable physical amount and be only applied to these The facility label of amount.Except non-specific statement, otherwise obviously find out from being discussed below, it is recognized that in describing in the whole text, make With " processing " or " calculating " or " calculating " or " it is determined that " or the term such as " display " discussion, refer to operating and change expression Data for physics (electronics) amount in the register and memory of computer system are that the similar computer system that is expressed as stores The computer system of device or register or other data of other such information storages, transmission or the physical quantity in display device Or the action and processing of similar electronic computing device.

Specification further relates to the device for performing operation here.The device can be specially constructed for required purposes, The general-purpose computations that either its computer program that can include being stored in computer is selectively activated or reconfigured Machine.Such computer program can store in a computer-readable storage medium, such as, but not limited to, any kind of disk, Including floppy disk, CD, CD-ROM and disk, read-only storage (ROM), random access memory (RAM), EPROM, EEPROM, the flash memories of magnetic or optical card including the usb key with nonvolatile storage refer to suitable for storage electronics Any kind of medium of order, is each coupled to computer system bus.

Specification can use whole hardware implementation mode, whole software realization mode or include hardware and software element The form of implementation.In some implementations, specification is realized with software, and it includes but is not limited to firmware, resident soft Part, microcode etc..

Moreover, description can use can be accessed in or computer-readable medium available from computer, offer program code with Just computer or the form of the use of any instruction execution system or computer program product used in combination.For this The purpose of description, computer is available or computer-readable medium can include, store, transmit, propagate or transmit program So as to by the use of instruction execution system, device or equipment or any device used in combination.

It will include passing through the direct or indirect coupling of system bus suitable for the data handling system of storage and/or configuration processor code Close at least one processor of memory component.Memory component can include being made during the actual execution of program code Local storage, massive store and the interim storages of at least some program codes is provided to reduce in the execution phase Between the cache memory of number that must be obtained from massive store of code.

Input/output or I/O equipment (including but is not limited to keyboard, display, sensing equipment etc.) can be direct or logical Cross intermediary's I/O controllers and be coupled to system.

Network adapter can also be coupled to system so that obtaining data handling system can become proprietary or public by intermediary Common network network is coupled to other data handling systems or remote printer or social network data storage.Modem, cable are adjusted Modulator-demodulator and Ethernet card are all several in the network adapter of currently available type.

Finally, routine presented herein and display be not substantially related to any certain computer or other devices Connection.Various general-purpose systems can be used together with the program according to teachings herein, or can prove to be easy to structure more special The device of change performs required method and step.According to following description, the required structure of these various systems will appear from.This Outside, specification describes not with reference to any certain programmed language.It will be recognized that various programming languages may serve to realize this In described specification teaching.

The described above of the implementation of specification is presented for the purpose of illustration and description.It is not intended to poor Most or limitation specification is to disclosed precise forms.According to teaching above, many modifications and variations are all possible. Wish that scope of disclosure is not limited by this embodiment, but limited by claims hereof.Such as What those skilled in the art will be understood that, specification can be embodied with other concrete forms without departing from its spirit or main Characteristic.Similarly, module, routine, feature, attribute, method and it is otherwise it is specific name and division and it is optional or effective , and the mechanism for realizing specification or its feature may have different names, division and/or form.Moreover, such as correlation It will be apparent that the module of the disclosure, routine, feature, attribute, method and other aspects can be with for the those of ordinary skill of field It is implemented as software, hardware, firmware or any combination of three.Moreover, no matter specification part where, its example is mould Block, when being implemented as software, part may be implemented as stand-alone program, a part for bigger program, multiple stand-alone programs, static state Or dynamic link library, kernel loadable module, device drives and/or with currently known or general for computer programming field in the future Each and any other modes known to logical technical staff are realized.In addition, the disclosure be not in any way restricted to it is any specific The implementation of programming language, or for any specific operating system or environment.Therefore, the disclosure want be it is illustrative, It is and unrestricted such as the scope of specification illustrated in appended claims.

Claims

1. a kind of computer implemented method for being used to change image, methods described include：

Input of the selection described image for modification is received using one or more computing devices；

The face in described image is detected using one or more of computing devices；

The Part I for including the facial described image is determined using one or more of computing devices；

The enhancing threshold value of the Part I of described image is determined using one or more of computing devices；

User's sliding block is provided using one or more of computing devices for changing described image；

It is chosen so as to apply effect in response to user's sliding block, strengthens described image using one or more of computing devices Part II, the Part II of described image eliminates the Part I；

It is chosen in response to user's sliding block, using one or more of computing devices no more than the enhancing threshold value In the case of strengthen described image the Part I；And

Use the image of one or more of computing devices storage enhancing.

2. computer implemented method as claimed in claim 1, wherein, the effect is prominent effect, user's sliding block The prominent effect is controlled, and methods described further comprises：

Determine the amount of the prominent effect with to described image based on user's sliding block using one or more computing devices Apply；

Using one or more of computing devices by the way that the prominent effect to be applied to the Part I of described image To adjust described image；And

The prominent effect is applied to by described image based on user's sliding block using one or more of computing devices The Part II.

3. computer implemented method as claimed in claim 2, wherein, the prominent effect is included with one in the following group： The use of saturation boost, brightness regulation, local contrast is to strengthen the details of described image.

4. computer implemented method as claimed in claim 1, wherein, the effect is that light is adjusted, user's sliding block control Make and the light of described image is adjusted, and methods described further comprises：

Using one or more of computing devices based on being extended using institute's light requirement regulated quantity selected by user's sliding block Histogram range is with the usable range that is adjusted including light and deploys to be distributed；

The shade associated with described image is adjusted based on institute's light requirement regulated quantity using one or more of computing devices；With And

The gamma associated with described image is adjusted based on institute's light requirement regulated quantity using one or more of computing devices.

5. computer implemented method as claimed in claim 1, wherein, the effect is that light is adjusted, user's sliding block control Make and the light of described image is adjusted, and methods described further comprises：

It is thin to adjust the bloom associated with described image based on institute's light requirement regulated quantity using one or more of computing devices Section；And

6. computer implemented method as claimed in claim 1, wherein, the effect is color, user's sliding block control To the color adjustment of described image, and methods described further comprises：

Color in the described image being saturated using the determination of one or more of computing devices；And

It is described based on being made using the color adjustment amount selected by user's sliding block using one or more of computing devices The Part II saturation of image.

7. computer implemented method as claimed in claim 1, wherein, the modification is to adjust the size of described image again It is whole to arrive fixed lower resolution image, and methods described further comprises：

Pyramidal layer series is determined using one or more of computing devices to match pre-defined fixation low resolution Image；

Level selection will be remapped as consolidating from the top layer of the pyramid level using one or more of computing devices Fixed skew；And

Apply local Laplce smoothly using one or more of computing devices to ensure to various sizes of image procossing Similar frequency band is to produce the similar visual results for the fixed lower resolution image.

8. computer implemented method as claimed in claim 1, wherein, there is provided user's sliding block is for modification described image bag Include：There is provided user interface, the user interface includes the preview of prominent sliding block, color sliding block, smooth piece and described image.

9. a kind of computer program product including computer usable medium, the computer usable medium includes computer journey Sequence, wherein, the computer-readable program causes the computer when being performed on computers：

Receive input of the selection image for modification；

Determine the face in described image；

It is determined that include the Part I of the facial described image；

Determine the enhancing threshold value of the Part I of described image；

User's sliding block is provided for changing described image；

Be chosen so as to apply effect in response to user's sliding block, strengthen the Part II of described image, described image it is described Part II eliminates the Part I；

It is chosen in response to user's sliding block, strengthens described the of described image in the case of no more than the enhancing threshold value A part；And

Store the image of enhancing.

10. computer program product as claimed in claim 9, wherein, the effect is prominent effect, user's sliding block control Make the prominent effect, and the computer-readable program when being performed on computers further such that the calculating Machine：

The amount of the prominent effect is determined based on user's sliding block to apply to described image；

Described image is adjusted by the way that the prominent effect to be applied to the Part I of described image；And

The prominent effect is applied to the Part II of described image based on user's sliding block.

11. computer program product as claimed in claim 10, wherein, the prominent effect includes one in the following group It is individual：The use of saturation boost, brightness regulation, local contrast is to strengthen the details of described image.

12. computer program product as claimed in claim 9, wherein, the effect is light regulation, user's sliding block control The light of image is adjusted, and the computer-readable program when being performed on computers further such that the meter Calculation machine：

Based on using institute's light requirement regulated quantity selected by user's sliding block come extend histogram range with including light adjust can With scope and deploy to be distributed；

The shade associated with described image is adjusted based on institute's light requirement regulated quantity；And

The gamma associated with described image is adjusted based on institute's light requirement regulated quantity.

13. computer program product as claimed in claim 9, wherein, the effect is light regulation, user's sliding block control The light of image is adjusted, and the computer-readable program when being performed on computers further such that the meter Calculation machine：

The bloom details associated with described image is adjusted based on institute's light requirement regulated quantity；And

14. computer program product as claimed in claim 9, wherein, the effect is color, user's sliding block control pair The color adjustment of described image, and the computer-readable program when being performed on computers further such that the meter Calculation machine：

It is determined that the color in the described image being saturated；And

Based on the Part II saturation for making described image using the color adjustment amount selected by user's sliding block.

15. computer program product as claimed in claim 9, wherein, the modification is to adjust the size of described image again Whole to arrive fixed lower resolution image, the computer-readable program when being performed further such that the meter on computers Calculation machine：

Pyramidal layer series is determined to match some pre-defined fixation lower resolution image；

It is the constant offset from the top layer of the pyramid level by level selection of remapping；And

Apply local Laplce smoothly with ensure to different sized images handle similar frequency band with produce be used for the fixation compared with The similar visual results of low-resolution image.

16. computer program product as claimed in claim 9, wherein so that the computer provide user's sliding block for Modification described image includes：So that the computer provides user interface, the user interface includes prominent sliding block, color is slided The preview of block, smooth piece and described image.

17. a kind of system, including：

Processor；And

The memory of store instruction, the instruction cause the system upon being performed：

Receive input of the selection image for modification；

Determine the face in described image；

It is determined that include the Part I of the facial described image；

Determine the enhancing threshold value of the Part I of described image；

User's sliding block is provided for changing described image；

Store the image of enhancing.

18. system as claimed in claim 17, wherein, the effect is prominent effect, and user's sliding block control is described prominent Go out effect, and the further store instruction of the memory, the instruction causes the system upon being performed：

The Part I of described image is applied to adjust described image by applying the prominent effect；And

19. system as claimed in claim 18, wherein, the prominent effect includes one in the following group：Saturation degree Lifting, the use of brightness regulation, local contrast are to strengthen the details of described image.

20. system as claimed in claim 17, wherein, the effect is light adjusting slider, and user's sliding block control is to institute The regulation of image, and the further store instruction of the memory are stated, the instruction causes the system upon being performed：

21. system as claimed in claim 17, wherein, the effect is light adjusting slider, and user's sliding block control is to institute The regulation of image, and the further store instruction of the memory are stated, the instruction causes the system upon being performed：

22. system as claimed in claim 17, wherein, the effect is color, and user's sliding block control is to described image Color adjustment, and the further store instruction of the memory, the instruction causes the system upon being performed：

It is determined that the color in the described image being saturated；And

23. system as claimed in claim 17, wherein, the modification be by the size of described image readjust it is fixed compared with Low-resolution image, and the further store instruction of the memory, the instruction cause the system upon being performed：

Determine pyramidal layer series with best match some pre-defined fixation lower resolution image；

24. system as claimed in claim 17, wherein so that the system with user sliding block is for modification described image The instruction include：So that the instruction at the system with user interface, the user interface includes prominent sliding block, color is slided The preview of block, smooth piece and described image.