WO2017166886A1 - Image processing system and method - Google Patents

Image processing system and method Download PDF

Info

Publication number
WO2017166886A1
WO2017166886A1 PCT/CN2016/113745 CN2016113745W WO2017166886A1 WO 2017166886 A1 WO2017166886 A1 WO 2017166886A1 CN 2016113745 W CN2016113745 W CN 2016113745W WO 2017166886 A1 WO2017166886 A1 WO 2017166886A1
Authority
WO
WIPO (PCT)
Prior art keywords
target image
contrast
coefficient
module
histogram
Prior art date
Application number
PCT/CN2016/113745
Other languages
French (fr)
Chinese (zh)
Inventor
唐文峰
Original Assignee
努比亚技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 努比亚技术有限公司 filed Critical 努比亚技术有限公司
Publication of WO2017166886A1 publication Critical patent/WO2017166886A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • G06T5/92Dynamic range modification of images or parts thereof based on global image properties
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/40Image enhancement or restoration using histogram techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/77Retouching; Inpainting; Scratch removal
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20004Adaptive image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20172Image enhancement details
    • G06T2207/20192Edge enhancement; Edge preservation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person

Definitions

  • This document relates to, but is not limited to, the field of terminal applications, and more particularly to an image processing system and method.
  • the beautification of the characters' pictures mainly includes: microdermabrasion, whitening and skin tone adjustment.
  • the camera is susceptible to ambient lighting, and the acquired image of the character is poorly contrasted, especially in the scenes of backlight, dark light, etc. when the self-timer is taken, and a single dermabrasion algorithm cannot adapt to such complex scenes.
  • the embodiment of the invention provides an image processing system and method, which can overcome the shortcomings that the current single dermabrasion technology cannot adapt to complex scenes, and improve the user experience of the camera.
  • An image processing system (01) provided by an embodiment of the present invention includes: an extraction module (02), a calculation module (03), an allocation module (04), a mapping module (05), and a dermabrasion processing module. (06).
  • the extraction module (02) is set to extract the contrast and illumination parameters of the target image.
  • the calculation module (03) is configured to calculate a clipping coefficient of the target image based on the extracted contrast and illumination parameters.
  • An allocation module (04) is arranged to redistribute the histogram of the target image based on the calculated clipping factor.
  • the mapping module (05) is configured to estimate an adjustment curve of the target image according to the re-allocated histogram, and perform global tone mapping on the target image according to the adjustment curve.
  • the dermabrasion processing module (06) is configured to perform dermabrasion processing on the target image subjected to global tone mapping according to a preset dermabrasion algorithm.
  • the extraction module (02) is set to achieve contrast of the extracted target image by:
  • the gray value of the pixel at each coordinate position on the target image is extracted.
  • the gray value difference of the pixels at each adjacent coordinate position is calculated based on the extracted gray value of the pixel at each coordinate position.
  • the calculated absolute value of the gray value difference of the pixels at each adjacent coordinate position is compared with a preset empirical value.
  • the calculated squared value is divided by the total number of pixels of the target image measured in advance, and the quotient obtained by dividing is taken as the contrast of the target image.
  • the extraction module (02) is set to realize the illumination parameter of the extraction target image by:
  • the sum of the gray values of the pixels at each coordinate position on the target image is calculated.
  • the sum of the calculated gradation values is divided by the total number of pixels of the target image that is pre-stated, and the quotient obtained by the division is taken as the illumination parameter of the target image.
  • the calculation module (03) is configured to calculate a cropping coefficient of the target image according to the extracted contrast and illumination parameters by:
  • the illumination parameter of the extracted target image is divided by the preset normalization coefficient, and the quotient obtained by dividing is used as the contrast coefficient after the normalization of the contrast.
  • the product of the contrast coefficient and the contrast of the extracted target image is calculated, and the calculated product is used as the cropping coefficient of the target image.
  • calculation module (03) is further configured to:
  • the clipping height of the histogram is calculated, including:
  • the calculated product is used as the crop height of the histogram.
  • the preset dermabrasion algorithm includes a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on the edge-preserving filter.
  • the histogram abscissa of the image is a pixel value, and the ordinate is a two-dimensional statistical chart of the number of pixels corresponding to each pixel value.
  • the extraction module (02) is configured to achieve contrast of the extracted target image by:
  • gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer
  • gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate
  • threshold is a previously obtained empirical value
  • M is a total amount of pixels of the target image that is pre-stated
  • C is a contrast of the target image.
  • the extraction module (02) is configured to implement an illumination parameter of the extraction target image by:
  • gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image measured in advance; l is the illumination parameter of the target image, l ⁇ [0, 255].
  • the calculation module (03) is configured to calculate a clipping coefficient of the target image according to the extracted contrast and illumination parameters by:
  • L is the contrast ratio after normalization of contrast
  • l is the illumination parameter of the target image
  • a a preset normalization coefficient
  • Cp is the clipping factor
  • C is the contrast of the target image
  • L is the contrast factor after the normalization of the contrast.
  • an embodiment of the present invention further provides an image processing method, where the method includes the following steps:
  • the contrast and illumination parameters of the target image are extracted (S101).
  • the cropping coefficient of the target image is calculated based on the extracted contrast and illumination parameters (S102).
  • a histogram of the target image is re-allocated according to the calculated cropping coefficient (S103).
  • the adjustment curve of the target image is estimated based on the re-allocated histogram, and the target image is subjected to global tone mapping according to the adjustment curve (S104).
  • the target image subjected to global tone mapping is subjected to dermabrasion processing according to a preset dermabrasion algorithm (S105).
  • the contrast of the extracted target image includes:
  • the gray value of the pixel at each coordinate position on the target image is extracted.
  • the gray value difference of the pixels at each adjacent coordinate position is calculated based on the extracted gray value of the pixel at each coordinate position.
  • the calculated absolute value of the gray value difference of the pixels at each adjacent coordinate position is compared with a preset empirical value.
  • the calculated squared value is divided by the total number of pixels of the target image measured in advance, and the quotient obtained by dividing is taken as the contrast of the target image.
  • the lighting parameters for extracting the target image include:
  • the sum of the gray values of the pixels at each coordinate position on the target image is calculated.
  • calculating the cropping coefficients of the target image according to the extracted contrast and illumination parameters includes:
  • the illumination parameter of the extracted target image is divided by the preset normalization coefficient, and the quotient obtained by dividing is used as the contrast coefficient after the normalization of the contrast.
  • the product of the contrast coefficient and the contrast of the extracted target image is calculated, and the calculated product is used as the cropping coefficient of the target image.
  • the method further includes:
  • the product of the clipping coefficient and the maximum number of pixels corresponding to the pixel value in the histogram is calculated, and the calculated product is taken as the clipping height of the histogram.
  • the preset dermabrasion algorithm comprises: a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on the edge-preserving filter.
  • the histogram abscissa of the image is a pixel value, and the ordinate is a two-dimensional statistical chart of the number of pixels corresponding to each pixel value.
  • the contrast of the extraction target image includes:
  • gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer
  • gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate
  • threshold is a previously obtained empirical value
  • M is a total amount of pixels of the target image that is pre-stated
  • C is a contrast of the target image.
  • the illumination parameters of the extraction target image include:
  • gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image measured in advance; l is the illumination parameter of the target image, l ⁇ [0, 255].
  • Calculating the cropping coefficients of the target image according to the extracted contrast and illumination parameters includes:
  • L is the contrast coefficient after normalization of contrast
  • l is the illumination parameter of the target image
  • a is the preset normalization coefficient
  • Cp is the clipping factor
  • C is the contrast of the target image
  • L is the contrast factor after the normalization of the contrast.
  • An image processing system and method proposed by the embodiments of the present invention includes: an extraction module configured to extract contrast and illumination parameters of a target image.
  • the calculation module is configured to calculate a clipping coefficient of the target image according to the extracted contrast and illumination parameters.
  • An allocation module configured to redistribute a histogram of the target image based on the calculated clipping factor.
  • the mapping module is configured to estimate an adjustment curve of the target image according to the re-allocated histogram, and perform global tone mapping on the target image according to the adjustment curve.
  • the dermabrasion processing module is configured to perform dermabrasion processing on the target image subjected to global tone mapping according to a preset dermabrasion algorithm.
  • FIG. 1 is a schematic structural diagram of hardware of an optional mobile terminal implementing an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 1;
  • FIG. 3 is a block diagram showing the composition of an image processing system according to an embodiment of the present invention.
  • FIG. 4 is a schematic diagram of histogram clipping of a conventional CLAHE algorithm
  • FIG. 5 is a flowchart of an image processing method according to an embodiment of the present invention.
  • the mobile terminal can be implemented in various forms.
  • the terminal described in the embodiments of the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device Mobile terminals of the like and fixed terminals such as digital TVs, desktop computers, and the like.
  • PDA Personal Digital Assistant
  • PAD Tablett
  • PMP Portable Multimedia Player
  • FIG. 1 is a schematic structural diagram of hardware of an optional mobile terminal implementing an embodiment of the present invention.
  • the mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more.
  • Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.
  • Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network.
  • the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.
  • the broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel.
  • the broadcast channel can include a satellite channel and/or a terrestrial channel.
  • the broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal.
  • the broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like.
  • the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal.
  • the broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112.
  • the broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like.
  • the broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast systems.
  • the broadcast receiving module 111 can use forward link media (MediaFLO) by using, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H)
  • MediaFLO forward link media
  • the digital broadcasting system of the @) data broadcasting system, the terrestrial digital broadcasting integrated service (ISDB-T), and the like receives digital broadcasting.
  • the broadcast receiving module 111 can be constructed as various broadcast systems suitable for providing broadcast signals as well as the above-described digital broadcast system.
  • the broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage
  • the mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server.
  • a base station e.g., an access point, a Node B, etc.
  • Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.
  • the wireless internet module 113 supports wireless internet access of the mobile terminal.
  • the module can be internally or externally coupled to the terminal.
  • the wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .
  • the short range communication module 114 is a module that is configured to support short range communication.
  • Examples of short-range communication technologies include BluetoothTM, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), ZigbeeTM, and the like.
  • the location information module 115 is a module configured to check or acquire location information of the mobile terminal.
  • Bit A typical example of a placement module is GPS (Global Positioning System).
  • GPS Global Positioning System
  • the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude.
  • the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite.
  • the GPS module 115 is capable of calculating speed information by continuously calculating current position information in real time.
  • the A/V input unit 120 is arranged to receive an audio or video signal.
  • the A/V input unit 120 may include a camera 121 and a microphone 1220 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode.
  • the processed image frame can be displayed on the display unit 151.
  • the image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 1210 may be provided according to the configuration of the mobile terminal.
  • the microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data.
  • the processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode.
  • the microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.
  • the user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal.
  • the user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc.
  • a touch screen can be formed.
  • the sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal.
  • the sensing unit 140 can sense whether the slide type phone is turned on or off.
  • the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device.
  • the sensing unit 140 may include a proximity sensor 1410 will be described below in connection with a touch screen.
  • the interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100.
  • the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port configured to connect a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more.
  • the identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like.
  • the device having the identification module may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device.
  • the interface unit 170 may be arranged to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more components within the mobile terminal 100 or may be configured to be at the mobile terminal and external device Transfer data between.
  • the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal.
  • Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base.
  • Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner.
  • the output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.
  • the display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.
  • UI user interface
  • GUI graphical user interface
  • the display unit 151 can function as an input device and an output device.
  • the display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like.
  • LCD liquid crystal display
  • TFT-LCD thin film transistor LCD
  • OLED organic light emitting diode
  • a flexible display a three-dimensional (3D) display, and the like.
  • 3D three-dimensional
  • Some of these displays can It is configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like.
  • TOLED Transparent Organic Light Emitting Diode
  • the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) .
  • the touch screen can be set to detect touch input pressure as well as touch input position and touch input area.
  • the audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like.
  • the audio signal is output as sound.
  • the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100.
  • the audio output module 152 can include a speaker, a buzzer, and the like.
  • the alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.
  • the memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.
  • the memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic storage , disk, CD, and more.
  • the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
  • the controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. Additionally, the controller 180 can include a multimedia module 1810 that is configured to reproduce (or play back) multimedia data, and the multimedia module 1810 can be constructed within the controller 180 or can be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
  • the power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.
  • the various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof.
  • the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle.
  • implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation.
  • the software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by
  • the mobile terminal has been described in terms of its function.
  • a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the embodiment of the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
  • the mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
  • a communication system in which a mobile terminal is operable according to an embodiment of the present invention will now be described with reference to FIG.
  • Such communication systems may use different air interfaces and/or physical layers.
  • air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc.
  • FDMA Frequency Division Multiple Access
  • TDMA Time Division Multiple Access
  • CDMA Code Division Multiple Access
  • UMTS Universal Mobile Telecommunications System
  • LTE Long Term Evolution
  • GSM Global System for Mobile Communications
  • the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
  • a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280.
  • the MSC 280 is configured to interface with a public switched telephone network (PSTN) 290.
  • PSTN public switched telephone network
  • the MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line.
  • the backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 may include multiple BSC 2750s.
  • Each BS 270 can serve one or more partitions (or regions), each of which is covered by a multi-directional antenna or an antenna directed to a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas that are set to receive diversity. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).
  • BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology.
  • BTS Base Transceiver Subsystem
  • the term "base station” can be used to generally refer to a single BSC 275 and at least one BS 270.
  • a base station can also be referred to as a "cell station.”
  • each partition of a particular BS 270 may be referred to as a plurality of cellular stations.
  • a broadcast transmitter (BT) 295 transmits a broadcast signal to the mobile terminal 100 operating within the system.
  • a broadcast receiving module 111 as shown in FIG. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295.
  • GPS Global Positioning System
  • the satellite 300 helps locate at least one of the plurality of mobile terminals 100.
  • a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites.
  • the GPS module 115 as shown in Figure 1 is typically configured to cooperate with the satellite 300 to obtain desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.
  • BS 270 receives reverse link signals from various mobile terminals 100.
  • Mobile terminal 100 typically participates in calls, messaging, and other types of communications.
  • Each reverse link signal received by a particular base station 270 is processed within a particular BS 270.
  • the obtained data is forwarded to the relevant BSC 275.
  • the BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270.
  • the BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290.
  • PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.
  • the beautification of the characters' pictures mainly includes: microdermabrasion, whitening and skin tone adjustment.
  • the camera is susceptible to ambient lighting, and the acquired image of the character is poorly contrasted, especially in the scenes of backlights and dark lights during self-timer.
  • a single dermabrasion algorithm cannot adapt to such complex scenes.
  • a character dermabrasion algorithm based on adaptive image enhancement is proposed. Firstly, the contrast and illumination parameters of the target image are extracted and the relevant evaluation is given. Then the image preprocessing is performed according to the contrast and illumination parameters of the currently acquired target image. Then, the pre-processed target image is subjected to dermabrasion processing; finally, the target image is post-processed and the final result is output.
  • the first embodiment of the present invention provides an image processing system 01.
  • the system includes: an extraction module 02, a calculation module 03, an allocation module 04, a mapping module 05, and Microdermabrasion treatment module 06.
  • the extraction module 02 is arranged to extract the contrast and illumination parameters of the target image.
  • Contrast refers to the measurement of different brightness levels between the brightest white and the darkest black in the dark and dark areas of an image.
  • the contrast ratio of 120:1 makes it easy to display vivid, rich colors, and when the contrast ratio is as high as 300:1, it can support the colors of each order.
  • the contrast is the brightness at the white screen (the brightest) in the darkroom divided by the black screen (the darkest). More precisely, contrast is the subtraction of the white signal between 100% and 0% saturation, divided by the white value of 0% (in illuminance, ie lux, lumens per square meter). The 0% white signal is actually black), the value obtained. Contrast is the division of the whitest and darkest luminance units. Therefore, the brighter the white, the darker the black, the higher the contrast. Strictly speaking, the contrast we refer to is the ratio of the brightness of the brightest point (white) to the darkest (black) at the same point on the screen, but usually the contrast indicator of the product is for the entire screen, for example, a screen is all white.
  • the brightness of the screen is 500 cd/m2, and the brightness of the black screen is 0.5 cd/m2, so the contrast of the screen is 1000:1.
  • a monitor displays a full white screen (255) with a measured luminance value of 200 cd/m2 and a full black screen with a measured luminance of 0.5 cd/m2, then its contrast ratio is 400:1.
  • contrast on the visual effect is very important. Generally speaking, the contrast is larger, the image is more clear and conspicuous, and the color is more vivid and bright; while the contrast is small, the whole picture will be grayed out. High contrast is very helpful for image sharpness, detail performance, and gray level performance.
  • high-contrast products have advantages in black and white contrast, clarity and integrity.
  • the illumination parameter is a parameter that reflects the brightness characteristic of the target image as a whole. The larger the parameter, the brighter the target image, and the smaller the parameter, the darker the target image.
  • Lightness is a property of color, or a dimension of a color space that is related to how bright a color is. In the Lab color space, brightness is defined to reflect the subjective bright feelings of humans. The unit of brightness is candela per square meter or square candle light cd/m2. Brightness is an important indicator of the luminous intensity of a TV screen or computer monitor. The three elements that make up the color of the image: brightness (brightness), saturation (saturation), and hue. Contrast indicates the degree of difference in degree, and the contrast is large, that is, "bright over, dark, dark”. Brightness is the brightness of the picture.
  • the extraction module 02 extracts the contrast of the target image including:
  • the calculated squared value is divided by the total number of pixels of the target image measured in advance, and the quotient obtained by dividing is taken as the contrast of the target image.
  • the contrast of the target image can be extracted according to the following equation:
  • gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer
  • gray j is the gray value of the pixel at the position of coordinate j
  • j is a positive integer
  • j is an adjacent coordinate
  • threshold is a previously obtained empirical value
  • M is a total amount of pixels of the target image that is pre-stated
  • C is a contrast of the target image; a larger C indicates a higher contrast of the target image, C The smaller the value, the lower the contrast of the target image.
  • the extraction module 02 extracts the illumination parameters of the target image, including:
  • the sum of the calculated gradation values is divided by the total number of pixels of the target image that is pre-stated, and the quotient obtained by the division is taken as the illumination parameter of the target image.
  • the illumination parameters of the target image may be extracted according to the following equation:
  • gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image measured in advance; l is the illumination parameter of the target image, l ⁇ [0, 255].
  • the calculation module 03 is configured to calculate a clipping coefficient of the target image according to the extracted contrast and illumination parameters.
  • the contrast of the target image is realized in a global scope, similar to the concept of Contrast Limited Adaptive histgram equalization (CLAHE). And lighting adjustments.
  • CLAHE Contrast Limited Adaptive histgram equalization
  • the CLAHE algorithm achieves contrast-limited adaptive image enhancement by dividing the image into multiple sub-regions, then performing histogram equalization on each sub-region, and then interpolating each pixel to obtain the transformed gray value.
  • CLAHE Limit Contrast Histogram Equalization
  • AHE Adaptive histgram equalization
  • the contrast magnification around the specified pixel value is primarily determined by the slope of the transform function. This slope is proportional to the slope of the cumulative histogram of the field.
  • the CLAHE achieves the purpose of limiting the amplification by cropping the histogram with a predefined threshold before calculating the CDF (cumulative histogram function). This limits the slope of the CDF and therefore limits the slope of the transformation function.
  • the value that the histogram is cropped also known as clipping clipping or clipping height, depends on the distribution of the histogram and therefore on the size of the field.
  • the cropping of the histogram in CLAHE can be manually adjusted by hand to obtain a suitable clipping height.
  • the size of the clipping factor determines the slope of the adjustment curve used to adjust the target image.
  • the CLAHE is a local adjustment, and the local adjustment can better highlight the detailed information of the image, but since the histogram of each image block needs to be calculated multiple times, the calculation amount of the algorithm is large.
  • This paper first extracts the contrast C and illumination parameters l of the target image through the extraction module 02. Then, the clipping coefficient is automatically calculated by the obtained contrast C and illumination parameter l, which greatly reduces the amount of calculation.
  • the calculating module 03 calculates the clipping coefficient of the target image according to the extracted contrast and illumination parameters, including:
  • the product of the contrast coefficient and the contrast of the extracted target image is calculated, and the calculated product is used as the cropping coefficient of the target image.
  • the contrast ratio after the normalization of the contrast can be calculated according to the following equation:
  • L is the contrast coefficient after normalization of contrast
  • l is the illumination parameter of the target image
  • a is the preset normalization coefficient
  • cp is the clipping factor
  • C is the contrast of the target image
  • L is the contrast coefficient after normalization of the contrast.
  • the assignment module 04 is arranged to redistribute the histogram of the target image based on the calculated crop coefficients.
  • a histogram is a two-dimensional statistical graph whose two coordinates are a measure of the statistical sample and the corresponding attribute of the sample.
  • the histogram abscissa of the image is a pixel value
  • the ordinate is a two-dimensional statistical graph of the number of pixels corresponding to each pixel value.
  • the histogram of the target image may be re-allocated according to the calculated clipping coefficient, that is, the histogram is calculated according to the calculated clipping coefficient in advance.
  • the height is cut, and the histogram is cropped by the crop height to realize the redistribution of the histogram to achieve the purpose of limiting the magnification.
  • calculation module 03 is further configured to:
  • Crop height Calculate the product of the clipping factor and the maximum number of pixels corresponding to the pixel value in the histogram, and use the calculated product as the crop height of the histogram.
  • the crop height of the histogram can be calculated by the following equation:
  • cp is the clipping coefficient
  • countNum is the maximum number of pixels corresponding to the pixel value in the histogram
  • cpCountNum is the clipping height of the histogram.
  • the mapping module 05 is configured to estimate an adjustment curve of the target image according to the re-allocated histogram, and perform global tone mapping on the target image according to the adjustment curve.
  • Tone mapping is a computer graphics technique that approximates high dynamic range images on a finite dynamic range medium. Print results, CRT or LCD displays, and projectors all have a limited dynamic range. Essentially, the problem with tone mapping is to make a large contrast reduction to change the brightness of the scene to a displayable range, while maintaining image detail and color information that is important for the original scene.
  • the fitting method of the adjustment curve and the tone mapping method of the target image are not limited, and any fitting method and mapping method that can be implemented are used to realize the fitting of the histogram to the adjustment curve and the target image.
  • Global mapping any fitting method and mapping method that can be implemented are used to realize the fitting of the histogram to the adjustment curve and the target image.
  • the dermabrasion processing module 06 is configured to perform dermabrasion processing on the target image subjected to global tone mapping according to a preset dermabrasion algorithm.
  • the pre-processing of the target image is completed by the global mapping of the target image by the mapping module 05, and the pre-processed image can be ground by the dermabrasion processing module 06 of the embodiment of the present invention.
  • the skin was processed.
  • Microdermabrasion which uses layers, masks, channels, tools, filters, or other software in the PS software to remove spots, blemishes, and mottled parts of the skin from the characters in the image.
  • Using photoshop to polish the face of a person can make the face of the character more delicate, smooth, and the outline is clearer.
  • the preset dermabrasion algorithm comprises: a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on the edge-preserving filter.
  • the channel dermabrasion algorithm comprises the following steps:
  • image ⁇ adjust ⁇ calculation, generate Alpha1 channel, and set parameters in the channel;
  • the post-skinned image is subjected to post-processing, which mainly performs a series of operations such as image skin color and image sharpening, and the steps are mainly to make the overall style of the characters in the image more natural.
  • post-processing mainly performs a series of operations such as image skin color and image sharpening
  • the steps are mainly to make the overall style of the characters in the image more natural.
  • improve the overall visual effect of the image For example, it can be implemented in the following manner: Example 1: skin color adjustment, sharpening; example two: whitening, sharpening.
  • the above image processing system may be disposed in the mobile terminal.
  • the extraction module 02, the calculation module 03, the distribution module 04, the mapping module 05, and the dermabrasion processing module 06 may be disposed in the controller 180 in FIG.
  • an embodiment of the present invention further provides an image processing method. As shown in FIG. 5, the method includes the following steps:
  • the contrast of the extracted target image includes:
  • the calculated squared value is divided by the total number of pixels of the target image measured in advance, and the quotient obtained by dividing is taken as the contrast of the target image.
  • the contrast of the target image can be extracted according to the following equation:
  • gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer
  • gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate
  • threshold is a previously obtained empirical value
  • M is a total amount of pixels of the target image that is pre-stated
  • C is a contrast of the target image.
  • the lighting parameters for extracting the target image include:
  • the sum of the calculated gradation values is divided by the total number of pixels of the target image that is pre-stated, and the quotient obtained by the division is taken as the illumination parameter of the target image.
  • the illumination parameters of the target image may be extracted according to the following equation:
  • gray i is the gray value of the pixel at the position of the coordinate i
  • i is a positive integer
  • M is the total number of pixels of the target image that is pre-stated
  • l is the illumination parameter of the target image.
  • calculating the cropping coefficient of the target image according to the extracted contrast and illumination parameters includes: dividing the illumination parameter of the extracted target image by a preset normalization coefficient, and normalizing the quotient obtained by dividing the contrast as a contrast Contrast factor in the future.
  • the contrast ratio after the normalization of the contrast can be calculated according to the following equation:
  • L is the contrast coefficient after normalization of contrast
  • l is the illumination parameter of the target image
  • a is the preset normalization coefficient
  • cp is the clipping factor
  • C is the contrast of the target image
  • L is the contrast coefficient after normalization of the contrast.
  • the method further includes:
  • the product of the clipping coefficient and the maximum number of pixels corresponding to the pixel value in the histogram is calculated, and the calculated product is taken as the clipping height of the histogram.
  • the crop height of the histogram can be calculated by the following equation:
  • cp is the clipping coefficient
  • countNum is the maximum number of pixels corresponding to the pixel value in the histogram
  • cpCountNum is the clipping height of the histogram.
  • S105 Perform dermabrasion processing on the target image subjected to global tone mapping according to a preset dermabrasion algorithm.
  • the preset dermabrasion algorithm comprises: a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on the edge-preserving filter.
  • the solution of the embodiment of the present invention can overcome the shortcomings that the current single dermabrasion technology cannot adapt to complex scenes, improve the user experience of the camera, and effectively improve the product competitiveness of the portable device camera.
  • the embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the method described in the foregoing embodiments.
  • computer storage medium includes volatile and nonvolatile implemented in any method or technique for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media.
  • the above technical solution can overcome the shortcomings that the single microdermabrasion technology in the current mobile terminal cannot adapt to a complicated scene, especially in a scene such as backlight and dark light when the character is self-photographed, which can beautify the photographed person and improve the user experience of the camera, and can Effectively improve the competitiveness of portable device cameras.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Studio Devices (AREA)
  • Image Processing (AREA)

Abstract

Disclosed are an image processing system and method. The system comprises: an extraction module (02), configured to extract a contrast ratio and an illumination parameter of a target image; a calculation module (03), configured to calculate a cropping coefficient of the target image according to the extracted contrast ratio and the illumination parameter; an allocation module (04), configured to reallocate a histogram of the target image according to the calculated cropping coefficient; a mapping module (05), configured to estimate a regulation curve of the target image according to the reallocated histogram and perform global tone mapping on the target image according to the regulation curve; and a dermabrasion processing module (06), configured to perform dermabrasion processing on the target image after the global tone mapping according to a pre-set dermabrasion algorithm.

Description

一种图像处理系统和方法Image processing system and method 技术领域Technical field
本文涉及但不限于终端应用领域,尤其涉及一种图像处理系统和方法。This document relates to, but is not limited to, the field of terminal applications, and more particularly to an image processing system and method.
背景技术Background technique
手机自拍已经逐步成为人们的一种生活习惯,而照片中人物的整体效果是关注的重点。因此对于照片的前期或者后期的美化是不可缺少的步骤。人物图片的美化主要包括:磨皮、美白和肤色调节。然而在不同环境下,像机容易受到环境光照的影响,获取的人物图像对比度较差,特别在自拍时人物处于背光、暗光等场景中,单一的磨皮算法无法适应这类复杂场景。Mobile phone selfies have gradually become a living habit of people, and the overall effect of the characters in the photos is the focus of attention. Therefore, the pre- or post-beautification of photos is an indispensable step. The beautification of the characters' pictures mainly includes: microdermabrasion, whitening and skin tone adjustment. However, in different environments, the camera is susceptible to ambient lighting, and the acquired image of the character is poorly contrasted, especially in the scenes of backlight, dark light, etc. when the self-timer is taken, and a single dermabrasion algorithm cannot adapt to such complex scenes.
发明内容Summary of the invention
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。The following is an overview of the topics detailed in this document. This Summary is not intended to limit the scope of the claims.
本发明实施例提出一种图像处理系统和方法,能够克服当前单一磨皮技术无法适应复杂场景的缺点,改善用户对相机的体验感。The embodiment of the invention provides an image processing system and method, which can overcome the shortcomings that the current single dermabrasion technology cannot adapt to complex scenes, and improve the user experience of the camera.
本发明实施例提供的一种图像处理系统(01),该系统(01)包括:提取模块(02)、计算模块(03)、分配模块(04)、映射模块(05)和磨皮处理模块(06)。An image processing system (01) provided by an embodiment of the present invention includes: an extraction module (02), a calculation module (03), an allocation module (04), a mapping module (05), and a dermabrasion processing module. (06).
提取模块(02),设置为提取目标图像的对比度和光照参数。The extraction module (02) is set to extract the contrast and illumination parameters of the target image.
计算模块(03),设置为根据提取出的对比度和光照参数计算目标图像的裁剪系数。The calculation module (03) is configured to calculate a clipping coefficient of the target image based on the extracted contrast and illumination parameters.
分配模块(04),设置为根据计算出的裁剪系数重新分配目标图像的直方图。An allocation module (04) is arranged to redistribute the histogram of the target image based on the calculated clipping factor.
映射模块(05),设置为根据重新分配后的直方图估计出目标图像的调整曲线,并根据调整曲线对目标图像进行全局色调映射。 The mapping module (05) is configured to estimate an adjustment curve of the target image according to the re-allocated histogram, and perform global tone mapping on the target image according to the adjustment curve.
磨皮处理模块(06),设置为根据预设的磨皮算法对进行全局色调映射后的目标图像进行磨皮处理。The dermabrasion processing module (06) is configured to perform dermabrasion processing on the target image subjected to global tone mapping according to a preset dermabrasion algorithm.
可选地,Optionally,
提取模块(02)是设置为通过如下方式实现提取目标图像的对比度:The extraction module (02) is set to achieve contrast of the extracted target image by:
提取目标图像上每个坐标位置上像素的灰度值。The gray value of the pixel at each coordinate position on the target image is extracted.
根据提取的每个坐标位置上像素的灰度值计算每个相邻的坐标位置上像素的灰度值差。The gray value difference of the pixels at each adjacent coordinate position is calculated based on the extracted gray value of the pixel at each coordinate position.
将计算出的每个相邻的坐标位置上像素的灰度值差的绝对值与预设的经验值相比较。The calculated absolute value of the gray value difference of the pixels at each adjacent coordinate position is compared with a preset empirical value.
根据比较结果获取一个或多个大于预设的经验值的灰度值差的绝对值。Obtaining one or more absolute values of gray value differences greater than a preset empirical value according to the comparison result.
计算一个或多个大于预设的经验值的灰度值差的绝对值的平方和。Calculating the sum of the squares of the absolute values of one or more gray value differences greater than the preset empirical value.
将计算出的平方和的数值除以预先统计的目标图像的像素总量,并将相除获得的商作为目标图像的对比度。The calculated squared value is divided by the total number of pixels of the target image measured in advance, and the quotient obtained by dividing is taken as the contrast of the target image.
提取模块(02)是设置为通过如下方式实现提取目标图像的光照参数:The extraction module (02) is set to realize the illumination parameter of the extraction target image by:
计算目标图像上每个坐标位置上像素的灰度值的和。The sum of the gray values of the pixels at each coordinate position on the target image is calculated.
将计算出的灰度值的和除以预先统计的目标图像的像素总量,并将相除获得的商作为目标图像的光照参数。The sum of the calculated gradation values is divided by the total number of pixels of the target image that is pre-stated, and the quotient obtained by the division is taken as the illumination parameter of the target image.
可选地,计算模块(03)是设置为通过如下方式实现根据提取出的对比度和光照参数计算目标图像的裁剪系数:Optionally, the calculation module (03) is configured to calculate a cropping coefficient of the target image according to the extracted contrast and illumination parameters by:
将提取的目标图像的光照参数除以预设的归一化系数,将相除获得的商作为对比度进行归一化以后的对比度系数。The illumination parameter of the extracted target image is divided by the preset normalization coefficient, and the quotient obtained by dividing is used as the contrast coefficient after the normalization of the contrast.
计算对比度系数与提取出的目标图像的对比度的乘积,将计算出的积作为目标图像的裁剪系数。The product of the contrast coefficient and the contrast of the extracted target image is calculated, and the calculated product is used as the cropping coefficient of the target image.
可选地,计算模块(03)还设置为:Optionally, the calculation module (03) is further configured to:
在分配模块(04)根据直方图估计目标图像的调整曲线之前,计算直方图的裁剪高度,包括:Before the allocation module (04) estimates the adjustment curve of the target image according to the histogram, the clipping height of the histogram is calculated, including:
计算剪裁系数与直方图中的像素值所对应的像素个数最大值的乘积,将 计算出的积作为直方图的裁剪高度。Calculating the product of the clipping factor and the maximum number of pixels corresponding to the pixel value in the histogram, The calculated product is used as the crop height of the histogram.
可选地,Optionally,
预设的磨皮算法包括:单通道磨皮算法和基于保边滤波器的三通道磨皮算法。The preset dermabrasion algorithm includes a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on the edge-preserving filter.
可选地,Optionally,
所述图像的直方图横坐标为像素值,纵坐标为每个像素值所对应的像素数量的二维统计图表。The histogram abscissa of the image is a pixel value, and the ordinate is a two-dimensional statistical chart of the number of pixels corresponding to each pixel value.
可选地,Optionally,
所述提取模块(02)是设置为通过如下方式实现提取目标图像的对比度:The extraction module (02) is configured to achieve contrast of the extracted target image by:
Figure PCTCN2016113745-appb-000001
Figure PCTCN2016113745-appb-000001
Figure PCTCN2016113745-appb-000002
Figure PCTCN2016113745-appb-000002
其中,Pi为相邻像素的绝对值差,grayi为坐标i位置处像素的灰度值,i为正整数;grayj为坐标j位置处像素的灰度值,j为正整数,i与j为相邻坐标;threshold为预先获得的经验值;M为预先统计的所述目标图像的像素总量;C为所述目标图像的对比度。Where P i is the absolute value difference of adjacent pixels, gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer; gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate; threshold is a previously obtained empirical value; M is a total amount of pixels of the target image that is pre-stated; C is a contrast of the target image.
可选地,Optionally,
所述提取模块(02)是设置为通过如下方式实现提取目标图像的光照参数:The extraction module (02) is configured to implement an illumination parameter of the extraction target image by:
Figure PCTCN2016113745-appb-000003
Figure PCTCN2016113745-appb-000003
其中,grayi为坐标i位置处像素的灰度值,i为正整数;M为预先统计的目标图像的像素总量;l为目标图像的光照参数,l∈[0,255]。Where, gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image measured in advance; l is the illumination parameter of the target image, l∈[0, 255].
可选地,Optionally,
所述计算模块(03)是设置为通过如下方式实现根据提取出的对比度和光照参数计算所述目标图像的裁剪系数:The calculation module (03) is configured to calculate a clipping coefficient of the target image according to the extracted contrast and illumination parameters by:
Figure PCTCN2016113745-appb-000004
Figure PCTCN2016113745-appb-000004
L为对比度进行归一化以后的对比度系数;l为目标图像的光照参数;a 为预设的归一化系数;L is the contrast ratio after normalization of contrast; l is the illumination parameter of the target image; a a preset normalization coefficient;
cp=C*LCp=C*L
cp为剪裁系数;C为目标图像的对比度;L为对比度进行归一化以后的对比度系数。Cp is the clipping factor; C is the contrast of the target image; L is the contrast factor after the normalization of the contrast.
此外,本发明实施例还提出了一种图像处理方法,该方法包括步骤:In addition, an embodiment of the present invention further provides an image processing method, where the method includes the following steps:
提取目标图像的对比度和光照参数(S101)。The contrast and illumination parameters of the target image are extracted (S101).
根据提取出的对比度和光照参数计算目标图像的裁剪系数(S102)。The cropping coefficient of the target image is calculated based on the extracted contrast and illumination parameters (S102).
根据计算出的裁剪系数重新分配目标图像的直方图(S103)。A histogram of the target image is re-allocated according to the calculated cropping coefficient (S103).
根据重新分配后的直方图估计出目标图像的调整曲线,并根据调整曲线对目标图像进行全局色调映射(S104)。The adjustment curve of the target image is estimated based on the re-allocated histogram, and the target image is subjected to global tone mapping according to the adjustment curve (S104).
根据预设的磨皮算法对进行全局色调映射后的目标图像进行磨皮处理(S105)。The target image subjected to global tone mapping is subjected to dermabrasion processing according to a preset dermabrasion algorithm (S105).
可选地,Optionally,
提取目标图像的对比度包括:The contrast of the extracted target image includes:
提取目标图像上每个坐标位置上像素的灰度值。The gray value of the pixel at each coordinate position on the target image is extracted.
根据提取的每个坐标位置上像素的灰度值计算每个相邻的坐标位置上像素的灰度值差。The gray value difference of the pixels at each adjacent coordinate position is calculated based on the extracted gray value of the pixel at each coordinate position.
将计算出的每个相邻的坐标位置上像素的灰度值差的绝对值与预设的经验值相比较。The calculated absolute value of the gray value difference of the pixels at each adjacent coordinate position is compared with a preset empirical value.
根据比较结果获取一个或多个大于预设的经验值的灰度值差的绝对值。Obtaining one or more absolute values of gray value differences greater than a preset empirical value according to the comparison result.
计算一个或多个大于预设的经验值的灰度值差的绝对值的平方和。Calculating the sum of the squares of the absolute values of one or more gray value differences greater than the preset empirical value.
将计算出的平方和的数值除以预先统计的目标图像的像素总量,并将相除获得的商作为目标图像的对比度。The calculated squared value is divided by the total number of pixels of the target image measured in advance, and the quotient obtained by dividing is taken as the contrast of the target image.
提取目标图像的光照参数包括:The lighting parameters for extracting the target image include:
计算目标图像上每个坐标位置上像素的灰度值的和。The sum of the gray values of the pixels at each coordinate position on the target image is calculated.
将计算出的灰度值的和除以预先统计的目标图像的像素总量,并将相除 获得的商作为目标图像的光照参数。Divide the sum of the calculated gray values by the total number of pixels of the pre-stated target image and divide by The obtained quotient is used as the illumination parameter of the target image.
可选地,根据提取出的对比度和光照参数计算目标图像的裁剪系数包括:Optionally, calculating the cropping coefficients of the target image according to the extracted contrast and illumination parameters includes:
将提取的目标图像的光照参数除以预设的归一化系数,将相除获得的商作为对比度进行归一化以后的对比度系数。The illumination parameter of the extracted target image is divided by the preset normalization coefficient, and the quotient obtained by dividing is used as the contrast coefficient after the normalization of the contrast.
计算对比度系数与提取出的目标图像的对比度的乘积,将计算出的积作为目标图像的裁剪系数。The product of the contrast coefficient and the contrast of the extracted target image is calculated, and the calculated product is used as the cropping coefficient of the target image.
可选地,该方法还包括:Optionally, the method further includes:
在根据直方图估计目标图像的调整曲线之前,通过以下步骤计算直方图的裁剪高度:Before estimating the adjustment curve of the target image from the histogram, calculate the clipping height of the histogram by the following steps:
计算剪裁系数与直方图中的像素值所对应的像素个数最大值的乘积,将计算出的积作为直方图的裁剪高度。The product of the clipping coefficient and the maximum number of pixels corresponding to the pixel value in the histogram is calculated, and the calculated product is taken as the clipping height of the histogram.
可选地,预设的磨皮算法包括:单通道磨皮算法和基于保边滤波器的三通道磨皮算法。Optionally, the preset dermabrasion algorithm comprises: a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on the edge-preserving filter.
可选地,Optionally,
所述图像的直方图横坐标为像素值,纵坐标为每个像素值所对应的像素数量的二维统计图表。The histogram abscissa of the image is a pixel value, and the ordinate is a two-dimensional statistical chart of the number of pixels corresponding to each pixel value.
可选地,Optionally,
所述提取目标图像的对比度包括:The contrast of the extraction target image includes:
Figure PCTCN2016113745-appb-000005
Figure PCTCN2016113745-appb-000005
Figure PCTCN2016113745-appb-000006
Figure PCTCN2016113745-appb-000006
其中,Pi为相邻像素的绝对值差,grayi为坐标i位置处像素的灰度值,i为正整数;grayj为坐标j位置处像素的灰度值,j为正整数,i与j为相邻坐标;threshold为预先获得的经验值;M为预先统计的所述目标图像的像素总量;C为所述目标图像的对比度。Where P i is the absolute value difference of adjacent pixels, gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer; gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate; threshold is a previously obtained empirical value; M is a total amount of pixels of the target image that is pre-stated; C is a contrast of the target image.
可选地, Optionally,
所述提取目标图像的光照参数包括:The illumination parameters of the extraction target image include:
Figure PCTCN2016113745-appb-000007
Figure PCTCN2016113745-appb-000007
其中,grayi为坐标i位置处像素的灰度值,i为正整数;M为预先统计的目标图像的像素总量;l为目标图像的光照参数,l∈[0,255]。Where, gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image measured in advance; l is the illumination parameter of the target image, l∈[0, 255].
可选地,Optionally,
根据提取出的对比度和光照参数计算所述目标图像的裁剪系数包括:Calculating the cropping coefficients of the target image according to the extracted contrast and illumination parameters includes:
Figure PCTCN2016113745-appb-000008
Figure PCTCN2016113745-appb-000008
L为对比度进行归一化以后的对比度系数;l为目标图像的光照参数;a为预设的归一化系数;L is the contrast coefficient after normalization of contrast; l is the illumination parameter of the target image; a is the preset normalization coefficient;
cp=C*LCp=C*L
cp为剪裁系数;C为目标图像的对比度;L为对比度进行归一化以后的对比度系数。Cp is the clipping factor; C is the contrast of the target image; L is the contrast factor after the normalization of the contrast.
本发明实施例提出的图像处理系统和方法包括:提取模块,设置为提取目标图像的对比度和光照参数。计算模块,设置为根据提取出的对比度和光照参数计算目标图像的裁剪系数。分配模块,设置为根据计算出的裁剪系数重新分配目标图像的直方图。映射模块,设置为根据重新分配后的直方图估计出目标图像的调整曲线,并根据调整曲线对目标图像进行全局色调映射。磨皮处理模块,设置为根据预设的磨皮算法对进行全局色调映射后的目标图像进行磨皮处理。通过本发明实施例的方案能够克服当前单一磨皮技术无法适应复杂场景的缺点,改善用户对相机的体验感。An image processing system and method proposed by the embodiments of the present invention includes: an extraction module configured to extract contrast and illumination parameters of a target image. The calculation module is configured to calculate a clipping coefficient of the target image according to the extracted contrast and illumination parameters. An allocation module configured to redistribute a histogram of the target image based on the calculated clipping factor. The mapping module is configured to estimate an adjustment curve of the target image according to the re-allocated histogram, and perform global tone mapping on the target image according to the adjustment curve. The dermabrasion processing module is configured to perform dermabrasion processing on the target image subjected to global tone mapping according to a preset dermabrasion algorithm. The solution of the embodiment of the present invention can overcome the shortcomings that the current single dermabrasion technology cannot adapt to complex scenes, and improve the user experience of the camera.
在阅读并理解了附图和详细描述后,可以明白其他方面。Other aspects will be apparent upon reading and understanding the drawings and detailed description.
附图概述BRIEF abstract
图1为实现本发明实施例一个可选的移动终端的硬件结构示意图;1 is a schematic structural diagram of hardware of an optional mobile terminal implementing an embodiment of the present invention;
图2为如图1所示的移动终端的无线通信系统示意图; 2 is a schematic diagram of a wireless communication system of the mobile terminal shown in FIG. 1;
图3为本发明实施例的图像处理系统组成框图;3 is a block diagram showing the composition of an image processing system according to an embodiment of the present invention;
图4为常规的CLAHE算法的直方图剪裁示意图;4 is a schematic diagram of histogram clipping of a conventional CLAHE algorithm;
图5为本发明实施例的图像处理方法流程图。FIG. 5 is a flowchart of an image processing method according to an embodiment of the present invention.
本发明的实施方式Embodiments of the invention
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
现在将参考附图描述实现本发明各个实施例的一个可选的移动终端。在后续的描述中,使用设置为表示元件的诸如“模块”、“部件”或“单元”的后缀仅为了有利于本发明实施例的说明,其本身并没有特定的意义。因此,"模块"与"部件"可以混合地使用。An optional mobile terminal embodying various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, the use of suffixes such as "module", "component" or "unit" set to indicate an element is merely an explanation for facilitating embodiments of the present invention, and does not have a specific meaning per se. Therefore, "module" and "component" can be used in combination.
移动终端可以以各种形式来实施。例如,本发明实施例中描述的终端可以包括诸如移动电话、智能电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、导航装置等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。下面,假设终端是移动终端。然而,本领域技术人员将理解的是,除了特别用于移动目的的元件之外,根据本发明的实施方式的构造也能够应用于固定类型的终端。The mobile terminal can be implemented in various forms. For example, the terminal described in the embodiments of the present invention may include, for example, a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (Personal Digital Assistant), a PAD (Tablet), a PMP (Portable Multimedia Player), a navigation device Mobile terminals of the like and fixed terminals such as digital TVs, desktop computers, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, those skilled in the art will appreciate that configurations in accordance with embodiments of the present invention can be applied to fixed type terminals in addition to components that are specifically for mobile purposes.
图1为实现本发明实施例一个可选的移动终端的硬件结构示意图。FIG. 1 is a schematic structural diagram of hardware of an optional mobile terminal implementing an embodiment of the present invention.
移动终端100可以包括无线通信单元110、A/V(音频/视频)输入单元120、用户输入单元130、感测单元140、输出单元150、存储器160、接口单元170、控制器180和电源单元190等等。图1示出了具有各种组件的移动终端,但是应理解的是,并不要求实施所有示出的组件。可以替代地实施更多或更少的组件。将在下面详细描述移动终端的元件。The mobile terminal 100 may include a wireless communication unit 110, an A/V (Audio/Video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190. and many more. Figure 1 illustrates a mobile terminal having various components, but it should be understood that not all illustrated components are required to be implemented. More or fewer components can be implemented instead. The elements of the mobile terminal will be described in detail below.
无线通信单元110通常包括一个或多个组件,其允许移动终端100与无线通信系统或网络之间的无线电通信。例如,无线通信单元可以包括广播接收模块111、移动通信模块112、无线互联网模块113、短程通信模块114和位置信息模块115中的至少一个。 Wireless communication unit 110 typically includes one or more components that permit radio communication between mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.
广播接收模块111经由广播信道从外部广播管理服务器接收广播信号和/或广播相关信息。广播信道可以包括卫星信道和/或地面信道。广播管理服务器可以是生成并发送广播信号和/或广播相关信息的服务器或者接收之前生成的广播信号和/或广播相关信息并且将其发送给终端的服务器。广播信号可以包括TV广播信号、无线电广播信号、数据广播信号等等。而且,广播信号可以进一步包括与TV或无线电广播信号组合的广播信号。广播相关信息也可以经由移动通信网络提供,并且在该情况下,广播相关信息可以由移动通信模块112来接收。广播信号可以以各种形式存在,例如,其可以以数字多媒体广播(DMB)的电子节目指南(EPG)、数字视频广播手持(DVB-H)的电子服务指南(ESG)等等的形式而存在。广播接收模块111可以通过使用各种类型的广播系统接收信号广播。特别地,广播接收模块111可以通过使用诸如多媒体广播-地面(DMB-T)、数字多媒体广播-卫星(DMB-S)、数字视频广播-手持(DVB-H),前向链路媒体(MediaFLO@)的数据广播系统、地面数字广播综合服务(ISDB-T)等等的数字广播系统接收数字广播。广播接收模块111可以被构造为适合提供广播信号的各种广播系统以及上述数字广播系统。经由广播接收模块111接收的广播信号和/或广播相关信息可以存储在存储器160(或者其它类型的存储介质)中。The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel can include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to the terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Moreover, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of Digital Multimedia Broadcasting (DMB) Electronic Program Guide (EPG), Digital Video Broadcasting Handheld (DVB-H) Electronic Service Guide (ESG), and the like. . The broadcast receiving module 111 can receive a signal broadcast by using various types of broadcast systems. In particular, the broadcast receiving module 111 can use forward link media (MediaFLO) by using, for example, multimedia broadcast-terrestrial (DMB-T), digital multimedia broadcast-satellite (DMB-S), digital video broadcast-handheld (DVB-H) The digital broadcasting system of the @) data broadcasting system, the terrestrial digital broadcasting integrated service (ISDB-T), and the like receives digital broadcasting. The broadcast receiving module 111 can be constructed as various broadcast systems suitable for providing broadcast signals as well as the above-described digital broadcast system. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).
移动通信模块112将无线电信号发送到基站(例如,接入点、节点B等等)、外部终端以及服务器中的至少一个和/或从其接收无线电信号。这样的无线电信号可以包括语音通话信号、视频通话信号、或者根据文本和/或多媒体消息发送和/或接收的各种类型的数据。The mobile communication module 112 transmits the radio signals to and/or receives radio signals from at least one of a base station (e.g., an access point, a Node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received in accordance with text and/or multimedia messages.
无线互联网模块113支持移动终端的无线互联网接入。该模块可以内部或外部地耦接到终端。该模块所涉及的无线互联网接入技术可以包括WLAN(无线LAN)(Wi-Fi)、Wibro(无线宽带)、Wimax(全球微波互联接入)、HSDPA(高速下行链路分组接入)等等。The wireless internet module 113 supports wireless internet access of the mobile terminal. The module can be internally or externally coupled to the terminal. The wireless Internet access technologies involved in the module may include WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless Broadband), Wimax (Worldwide Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. .
短程通信模块114是设置为支持短程通信的模块。短程通信技术的示例包括蓝牙TM、射频识别(RFID)、红外数据协会(IrDA)、超宽带(UWB)、紫蜂TM等等。The short range communication module 114 is a module that is configured to support short range communication. Examples of short-range communication technologies include BluetoothTM, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), ZigbeeTM, and the like.
位置信息模块115是设置为检查或获取移动终端的位置信息的模块。位 置信息模块的典型示例是GPS(全球定位系统)。根据当前的技术,GPS模块115计算来自三个或更多卫星的距离信息和准确的时间信息并且对于计算的信息应用三角测量法,从而根据经度、纬度和高度准确地计算三维当前位置信息。当前,用于计算位置和时间信息的方法使用三颗卫星并且通过使用另外的一颗卫星校正计算出的位置和时间信息的误差。此外,GPS模块115能够通过实时地连续计算当前位置信息来计算速度信息。The location information module 115 is a module configured to check or acquire location information of the mobile terminal. Bit A typical example of a placement module is GPS (Global Positioning System). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information to accurately calculate three-dimensional current position information based on longitude, latitude, and altitude. Currently, the method for calculating position and time information uses three satellites and corrects the calculated position and time information errors by using another satellite. Further, the GPS module 115 is capable of calculating speed information by continuously calculating current position information in real time.
A/V输入单元120设置为接收音频或视频信号。A/V输入单元120可以包括相机121和麦克风1220,相机121对在视频捕获模式或图像捕获模式中由图像捕获装置获得的静态图片或视频的图像数据进行处理。处理后的图像帧可以显示在显示单元151上。经相机121处理后的图像帧可以存储在存储器160(或其它存储介质)中或者经由无线通信单元110进行发送,可以根据移动终端的构造提供两个或更多相机1210。麦克风122可以在电话通话模式、记录模式、语音识别模式等等运行模式中经由麦克风接收声音(音频数据),并且能够将这样的声音处理为音频数据。处理后的音频(语音)数据可以在电话通话模式的情况下转换为可经由移动通信模块112发送到移动通信基站的格式输出。麦克风122可以实施各种类型的噪声消除(或抑制)算法以消除(或抑制)在接收和发送音频信号的过程中产生的噪声或者干扰。The A/V input unit 120 is arranged to receive an audio or video signal. The A/V input unit 120 may include a camera 121 and a microphone 1220 that processes image data of still pictures or video obtained by the image capturing device in a video capturing mode or an image capturing mode. The processed image frame can be displayed on the display unit 151. The image frames processed by the camera 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 1210 may be provided according to the configuration of the mobile terminal. The microphone 122 can receive sound (audio data) via a microphone in an operation mode of a telephone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound as audio data. The processed audio (voice) data can be converted to a format output that can be transmitted to the mobile communication base station via the mobile communication module 112 in the case of a telephone call mode. The microphone 122 can implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated during the process of receiving and transmitting audio signals.
用户输入单元130可以根据用户输入的命令生成键输入数据以控制移动终端的各种操作。用户输入单元130允许用户输入各种类型的信息,并且可以包括键盘、锅仔片、触摸板(例如,检测由于被接触而导致的电阻、压力、电容等等的变化的触敏组件)、滚轮、摇杆等等。特别地,当触摸板以层的形式叠加在显示单元151上时,可以形成触摸屏。The user input unit 130 may generate key input data according to a command input by the user to control various operations of the mobile terminal. The user input unit 130 allows the user to input various types of information, and may include a keyboard, a pot, a touch pad (eg, a touch sensitive component that detects changes in resistance, pressure, capacitance, etc. due to contact), a scroll wheel , rocker, etc. In particular, when the touch panel is superimposed on the display unit 151 in the form of a layer, a touch screen can be formed.
感测单元140检测移动终端100的当前状态,(例如,移动终端100的打开或关闭状态)、移动终端100的位置、用户对于移动终端100的接触(即,触摸输入)的有无、移动终端100的取向、移动终端100的加速或减速移动和方向等等,并且生成用于控制移动终端100的操作的命令或信号。例如,当移动终端100实施为滑动型移动电话时,感测单元140可以感测该滑动型电话是打开还是关闭。另外,感测单元140能够检测电源单元190是否提供电力或者接口单元170是否与外部装置耦接。感测单元140可以包括接近传感器 1410将在下面结合触摸屏来对此进行描述。The sensing unit 140 detects the current state of the mobile terminal 100 (eg, the open or closed state of the mobile terminal 100), the location of the mobile terminal 100, the presence or absence of contact (ie, touch input) by the user with the mobile terminal 100, and the mobile terminal. The orientation of 100, the acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide type mobile phone, the sensing unit 140 can sense whether the slide type phone is turned on or off. In addition, the sensing unit 140 can detect whether the power supply unit 190 provides power or whether the interface unit 170 is coupled to an external device. The sensing unit 140 may include a proximity sensor 1410 will be described below in connection with a touch screen.
接口单元170用作至少一个外部装置与移动终端100连接可以通过的接口。例如,外部装置可以包括有线或无线头戴式耳机端口、外部电源(或电池充电器)端口、有线或无线数据端口、存储卡端口、设置为连接具有识别模块的装置的端口、音频输入/输出(I/O)端口、视频I/O端口、耳机端口等等。识别模块可以是存储用于验证用户使用移动终端100的各种信息并且可以包括用户识别模块(UIM)、客户识别模块(SIM)、通用客户识别模块(USIM)等等。另外,具有识别模块的装置(下面称为"识别装置")可以采取智能卡的形式,因此,识别装置可以经由端口或其它连接装置与移动终端100连接。接口单元170可以设置为接收来自外部装置的输入(例如,数据信息、电力等等)并且将接收到的输入传输到移动终端100内的一个或多个元件或者可以设置为在移动终端和外部装置之间传输数据。The interface unit 170 serves as an interface through which at least one external device can connect with the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port configured to connect a device having an identification module, and an audio input/output. (I/O) port, video I/O port, headphone port, and more. The identification module may be stored to verify various information used by the user using the mobile terminal 100 and may include a User Identification Module (UIM), a Customer Identification Module (SIM), a Universal Customer Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter referred to as "identification device") may take the form of a smart card, and thus the identification device may be connected to the mobile terminal 100 via a port or other connection device. The interface unit 170 may be arranged to receive input (eg, data information, power, etc.) from an external device and transmit the received input to one or more components within the mobile terminal 100 or may be configured to be at the mobile terminal and external device Transfer data between.
另外,当移动终端100与外部底座连接时,接口单元170可以用作允许通过其将电力从底座提供到移动终端100的路径或者可以用作允许从底座输入的各种命令信号通过其传输到移动终端的路径。从底座输入的各种命令信号或电力可以用作用于识别移动终端是否准确地安装在底座上的信号。输出单元150被构造为以视觉、音频和/或触觉方式提供输出信号(例如,音频信号、视频信号、警报信号、振动信号等等)。输出单元150可以包括显示单元151、音频输出模块152、警报单元153等等。In addition, when the mobile terminal 100 is connected to the external base, the interface unit 170 may function as a path through which power is supplied from the base to the mobile terminal 100 or may be used as a transmission of various command signals allowing input from the base to the mobile terminal 100 The path to the terminal. Various command signals or power input from the base can be used as signals for identifying whether the mobile terminal is accurately mounted on the base. Output unit 150 is configured to provide an output signal (eg, an audio signal, a video signal, an alarm signal, a vibration signal, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.
显示单元151可以显示在移动终端100中处理的信息。例如,当移动终端100处于电话通话模式时,显示单元151可以显示与通话或其它通信(例如,文本消息收发、多媒体文件下载等等)相关的用户界面(UI)或图形用户界面(GUI)。当移动终端100处于视频通话模式或者图像捕获模式时,显示单元151可以显示捕获的图像和/或接收的图像、示出视频或图像以及相关功能的UI或GUI等等。The display unit 151 can display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 can display a user interface (UI) or a graphical user interface (GUI) related to a call or other communication (eg, text messaging, multimedia file download, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or image and related functions, and the like.
同时,当显示单元151和触摸板以层的形式彼此叠加以形成触摸屏时,显示单元151可以用作输入装置和输出装置。显示单元151可以包括液晶显示器(LCD)、薄膜晶体管LCD(TFT-LCD)、有机发光二极管(OLED)显示器、柔性显示器、三维(3D)显示器等等中的至少一种。这些显示器中的一些可以 被构造为透明状以允许用户从外部观看,这可以称为透明显示器,典型的透明显示器可以例如为TOLED(透明有机发光二极管)显示器等等。根据特定想要的实施方式,移动终端100可以包括两个或更多显示单元(或其它显示装置),例如,移动终端可以包括外部显示单元(未示出)和内部显示单元(未示出)。触摸屏可设置为检测触摸输入压力以及触摸输入位置和触摸输入面积。Meanwhile, when the display unit 151 and the touch panel are superposed on each other in the form of a layer to form a touch screen, the display unit 151 can function as an input device and an output device. The display unit 151 may include at least one of a liquid crystal display (LCD), a thin film transistor LCD (TFT-LCD), an organic light emitting diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays can It is configured to be transparent to allow a user to view from the outside, which may be referred to as a transparent display, and a typical transparent display may be, for example, a TOLED (Transparent Organic Light Emitting Diode) display or the like. According to a particular desired embodiment, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown) . The touch screen can be set to detect touch input pressure as well as touch input position and touch input area.
音频输出模块152可以在移动终端处于呼叫信号接收模式、通话模式、记录模式、语音识别模式、广播接收模式等等模式下时,将无线通信单元110接收的或者在存储器160中存储的音频数据转换音频信号并且输出为声音。而且,音频输出模块152可以提供与移动终端100执行的特定功能相关的音频输出(例如,呼叫信号接收声音、消息接收声音等等)。音频输出模块152可以包括扬声器、蜂鸣器等等。The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 when the mobile terminal is in a call signal receiving mode, a call mode, a recording mode, a voice recognition mode, a broadcast receiving mode, and the like. The audio signal is output as sound. Moreover, the audio output module 152 can provide audio output (eg, call signal reception sound, message reception sound, etc.) associated with a particular function performed by the mobile terminal 100. The audio output module 152 can include a speaker, a buzzer, and the like.
警报单元153可以提供输出以将事件的发生通知给移动终端100。典型的事件可以包括呼叫接收、消息接收、键信号输入、触摸输入等等。除了音频或视频输出之外,警报单元153可以以不同的方式提供输出以通知事件的发生。例如,警报单元153可以以振动的形式提供输出,当接收到呼叫、消息或一些其它进入通信(incomingcommunication)时,警报单元153可以提供触觉输出(即,振动)以将其通知给用户。通过提供这样的触觉输出,即使在用户的移动电话处于用户的口袋中时,用户也能够识别出各种事件的发生。警报单元153也可以经由显示单元151或音频输出模块152提供通知事件的发生的输出。The alarm unit 153 can provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alert unit 153 can provide an output in a different manner to notify of the occurrence of an event. For example, the alarm unit 153 can provide an output in the form of vibrations, and when a call, message, or some other incoming communication is received, the alarm unit 153 can provide a tactile output (ie, vibration) to notify the user of it. By providing such a tactile output, the user is able to recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 can also provide an output of the notification event occurrence via the display unit 151 or the audio output module 152.
存储器160可以存储由控制器180执行的处理和控制操作的软件程序等等,或者可以暂时地存储己经输出或将要输出的数据(例如,电话簿、消息、静态图像、视频等等)。而且,存储器160可以存储关于当触摸施加到触摸屏时输出的各种方式的振动和音频信号的数据。The memory 160 may store a software program or the like for processing and control operations performed by the controller 180, or may temporarily store data (for example, a phone book, a message, a still image, a video, etc.) that has been output or is to be output. Moreover, the memory 160 can store data regarding vibrations and audio signals of various manners that are output when a touch is applied to the touch screen.
存储器160可以包括至少一种类型的存储介质,所述存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等等)、随机访问存储器(RAM)、静态随机访问存储器(SRAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、可编程只读存储器(PROM)、磁性存储 器、磁盘、光盘等等。而且,移动终端100可以与通过网络连接执行存储器160的存储功能的网络存储装置协作。The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card type memory (eg, SD or DX memory, etc.), a random access memory (RAM), a static random access memory ( SRAM), read only memory (ROM), electrically erasable programmable read only memory (EEPROM), programmable read only memory (PROM), magnetic storage , disk, CD, and more. Moreover, the mobile terminal 100 can cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
控制器180通常控制移动终端的总体操作。例如,控制器180执行与语音通话、数据通信、视频通话等等相关的控制和处理。另外,控制器180可以包括设置为再现(或回放)多媒体数据的多媒体模块1810,多媒体模块1810可以构造在控制器180内,或者可以构造为与控制器180分离。控制器180可以执行模式识别处理,以将在触摸屏上执行的手写输入或者图片绘制输入识别为字符或图像。The controller 180 typically controls the overall operation of the mobile terminal. For example, the controller 180 performs the control and processing associated with voice calls, data communications, video calls, and the like. Additionally, the controller 180 can include a multimedia module 1810 that is configured to reproduce (or play back) multimedia data, and the multimedia module 1810 can be constructed within the controller 180 or can be configured to be separate from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
电源单元190在控制器180的控制下接收外部电力或内部电力并且提供操作各元件和组件所需的适当的电力。The power supply unit 190 receives external power or internal power under the control of the controller 180 and provides appropriate power required to operate the various components and components.
这里描述的各种实施方式可以以使用例如计算机软件、硬件或其任何组合的计算机可读介质来实施。对于硬件实施,这里描述的实施方式可以通过使用特定用途集成电路(ASIC)、数字信号处理器(DSP)、数字信号处理装置(DSPD)、可编程逻辑装置(PLD)、现场可编程门阵列(FPGA)、处理器、控制器、微控制器、微处理器、被设计为执行这里描述的功能的电子单元中的至少一种来实施,在一些情况下,这样的实施方式可以在控制器180中实施。对于软件实施,诸如过程或功能的实施方式可以与允许执行至少一种功能或操作的单独的软件模块来实施。软件代码可以由以任何适当的编程语言编写的软件应用程序(或程序)来实施,软件代码可以存储在存储器160中并且由控制器180执行。The various embodiments described herein can be implemented in a computer readable medium using, for example, computer software, hardware, or any combination thereof. For hardware implementations, the embodiments described herein may be through the use of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays ( An FPGA, a processor, a controller, a microcontroller, a microprocessor, at least one of the electronic units designed to perform the functions described herein, in some cases, such an embodiment may be at the controller 180 Implemented in the middle. For software implementations, implementations such as procedures or functions may be implemented with separate software modules that permit the execution of at least one function or operation. The software code can be implemented by a software application (or program) written in any suitable programming language, which can be stored in memory 160 and executed by controller 180.
至此,己经按照其功能描述了移动终端。下面,为了简要起见,将描述诸如折叠型、直板型、摆动型、滑动型移动终端等等的各种类型的移动终端中的滑动型移动终端作为示例。因此,本发明实施例能够应用于任何类型的移动终端,并且不限于滑动型移动终端。So far, the mobile terminal has been described in terms of its function. Hereinafter, for the sake of brevity, a slide type mobile terminal among various types of mobile terminals such as a folding type, a bar type, a swing type, a slide type mobile terminal, and the like will be described as an example. Therefore, the embodiment of the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
如图1中所示的移动终端100可以被构造为利用经由帧或分组发送数据的诸如有线和无线通信系统以及基于卫星的通信系统来操作。The mobile terminal 100 as shown in FIG. 1 may be configured to operate using a communication system such as a wired and wireless communication system and a satellite-based communication system that transmits data via frames or packets.
现在将参考图2描述其中根据本发明实施例的移动终端能够操作的通信系统。 A communication system in which a mobile terminal is operable according to an embodiment of the present invention will now be described with reference to FIG.
这样的通信系统可以使用不同的空中接口和/或物理层。例如,由通信系统使用的空中接口包括例如频分多址(FDMA)、时分多址(TDMA)、码分多址(CDMA)和通用移动通信系统(UMTS)(特别地,长期演进(LTE))、全球移动通信系统(GSM)等等。作为非限制性示例,下面的描述涉及CDMA通信系统,但是这样的教导同样适用于其它类型的系统。Such communication systems may use different air interfaces and/or physical layers. For example, air interfaces used by communication systems include, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)). ), Global System for Mobile Communications (GSM), etc. As a non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
参考图2,CDMA无线通信系统可以包括多个移动终端100、多个基站(BS)270、基站控制器(BSC)275和移动交换中心(MSC)280。MSC280被构造为与公共电话交换网络(PSTN)290形成接口。MSC280还被构造为与可以经由回程线路耦接到基站270的BSC275形成接口。回程线路可以根据若干己知的接口中的任一种来构造,所述接口包括例如E1/T1、ATM,IP、PPP、帧中继、HDSL、ADSL或xDSL。将理解的是,如图2中所示的系统可以包括多个BSC2750。Referring to FIG. 2, a CDMA wireless communication system can include a plurality of mobile terminals 100, a plurality of base stations (BS) 270, a base station controller (BSC) 275, and a mobile switching center (MSC) 280. The MSC 280 is configured to interface with a public switched telephone network (PSTN) 290. The MSC 280 is also configured to interface with a BSC 275 that can be coupled to the base station 270 via a backhaul line. The backhaul line can be constructed in accordance with any of a number of well known interfaces including, for example, E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. It will be appreciated that the system as shown in FIG. 2 may include multiple BSC 2750s.
每个BS270可以服务一个或多个分区(或区域),由多向天线或指向特定方向的天线覆盖的每个分区放射状地远离BS270。或者,每个分区可以由设置为分集接收的两个或更多天线覆盖。每个BS270可以被构造为支持多个频率分配,并且每个频率分配具有特定频谱(例如,1.25MHz,5MHz等等)。Each BS 270 can serve one or more partitions (or regions), each of which is covered by a multi-directional antenna or an antenna directed to a particular direction radially away from the BS 270. Alternatively, each partition may be covered by two or more antennas that are set to receive diversity. Each BS 270 can be configured to support multiple frequency allocations, and each frequency allocation has a particular frequency spectrum (eg, 1.25 MHz, 5 MHz, etc.).
分区与频率分配的交叉可以被称为CDMA信道。BS270也可以被称为基站收发器子系统(BTS)或者其它等效术语。在这样的情况下,术语“基站”可以用于笼统地表示单个BSC275和至少一个BS270。基站也可以被称为“蜂窝站”。或者,特定BS270的各分区可以被称为多个蜂窝站。The intersection of partitioning and frequency allocation can be referred to as a CDMA channel. BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" can be used to generally refer to a single BSC 275 and at least one BS 270. A base station can also be referred to as a "cell station." Alternatively, each partition of a particular BS 270 may be referred to as a plurality of cellular stations.
如图2中所示,广播发射器(BT)295将广播信号发送给在系统内操作的移动终端100。如图1中所示的广播接收模块111被设置在移动终端100处以接收由BT295发送的广播信号。在图2中,示出了几个全球定位系统(GPS)卫星300。卫星300帮助定位多个移动终端100中的至少一个。As shown in FIG. 2, a broadcast transmitter (BT) 295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in FIG. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In Figure 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 helps locate at least one of the plurality of mobile terminals 100.
在图2中,描绘了多个卫星300,但是理解的是,可以利用任何数目的卫星获得有用的定位信息。如图1中所示的GPS模块115通常被构造为与卫星300配合以获得想要的定位信息。替代GPS跟踪技术或者在GPS跟踪技术之外,可以使用可以跟踪移动终端的位置的其它技术。另外,至少一个GPS卫星300可以选择性地或者额外地处理卫星DMB传输。 In Figure 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information can be obtained using any number of satellites. The GPS module 115 as shown in Figure 1 is typically configured to cooperate with the satellite 300 to obtain desired positioning information. Instead of GPS tracking technology or in addition to GPS tracking technology, other techniques that can track the location of the mobile terminal can be used. Additionally, at least one GPS satellite 300 can selectively or additionally process satellite DMB transmissions.
作为无线通信系统的一个典型操作,BS270接收来自各种移动终端100的反向链路信号。移动终端100通常参与通话、消息收发和其它类型的通信。特定基站270接收的每个反向链路信号被在特定BS270内进行处理。获得的数据被转发给相关的BSC275。BSC提供通话资源分配和包括BS270之间的软切换过程的协调的移动管理功能。BSC275还将接收到的数据路由到MSC280,其提供用于与PSTN290形成接口的额外的路由服务。类似地,PSTN290与MSC280形成接口,MSC与BSC275形成接口,并且BSC275相应地控制BS270以将正向链路信号发送到移动终端100。As a typical operation of a wireless communication system, BS 270 receives reverse link signals from various mobile terminals 100. Mobile terminal 100 typically participates in calls, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within a particular BS 270. The obtained data is forwarded to the relevant BSC 275. The BSC provides call resource allocation and coordinated mobility management functions including a soft handoff procedure between the BSs 270. The BSC 275 also routes the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, PSTN 290 interfaces with MSC 280, which forms an interface with BSC 275, and BSC 275 controls BS 270 accordingly to transmit forward link signals to mobile terminal 100.
基于上述移动终端硬件结构以及通信系统,提出本发明方法各个实施例。Based on the above-described mobile terminal hardware structure and communication system, various embodiments of the method of the present invention are proposed.
手机自拍已经逐步成为人们的一种生活习惯,而照片中人物的整体效果是关注的重点。因此对于照片的前期或者后期的美化是不可缺少的步骤。人物图片的美化主要包括:磨皮、美白和肤色调节。然而在不同环境下像机容易受到环境光照的影响,获取的人物图像对比度较差,特别在自拍时人物处于背光、暗光等场景中,单一的磨皮算法无法适应这类复杂场景。Mobile phone selfies have gradually become a living habit of people, and the overall effect of the characters in the photos is the focus of attention. Therefore, the pre- or post-beautification of photos is an indispensable step. The beautification of the characters' pictures mainly includes: microdermabrasion, whitening and skin tone adjustment. However, in different environments, the camera is susceptible to ambient lighting, and the acquired image of the character is poorly contrasted, especially in the scenes of backlights and dark lights during self-timer. A single dermabrasion algorithm cannot adapt to such complex scenes.
本文提出了一种基于自适应图像增强的人物磨皮算法,首先对目标图片进行对比度和光照参数的提取并给出相关的评价;接着根据当前获取的目标图像的对比度和光照参数进行图像预处理;然后对预处理后的目标图像进行磨皮处理;最后对目标图像进行后处理并输出最后结果。In this paper, a character dermabrasion algorithm based on adaptive image enhancement is proposed. Firstly, the contrast and illumination parameters of the target image are extracted and the relevant evaluation is given. Then the image preprocessing is performed according to the contrast and illumination parameters of the currently acquired target image. Then, the pre-processed target image is subjected to dermabrasion processing; finally, the target image is post-processed and the final result is output.
如图3所示,可选地,本发明第一实施例提出一种图像处理系统01,如图1所示,该系统包括:提取模块02、计算模块03、分配模块04、映射模块05和磨皮处理模块06。As shown in FIG. 3, the first embodiment of the present invention provides an image processing system 01. As shown in FIG. 1, the system includes: an extraction module 02, a calculation module 03, an allocation module 04, a mapping module 05, and Microdermabrasion treatment module 06.
提取模块02,设置为提取目标图像的对比度和光照参数。The extraction module 02 is arranged to extract the contrast and illumination parameters of the target image.
在本发明实施例中,对于需要处理的目标图像,我们可获取该目标图像的对比度与光照参数。In the embodiment of the present invention, for the target image that needs to be processed, we can obtain the contrast and illumination parameters of the target image.
对比度指的是一幅图像中明暗区域最亮的白和最暗的黑之间不同亮度层级的测量,差异范围越大代表对比越大,差异范围越小代表对比越小,好的 对比率120:1就可容易地显示生动、丰富的色彩,当对比率高达300:1时,可以支持各阶的颜色。Contrast refers to the measurement of different brightness levels between the brightest white and the darkest black in the dark and dark areas of an image. The larger the difference range is, the larger the contrast is. The smaller the difference range is, the smaller the contrast is, the better. The contrast ratio of 120:1 makes it easy to display vivid, rich colors, and when the contrast ratio is as high as 300:1, it can support the colors of each order.
对比度为在暗室中白色画面(最亮时)下的亮度除以黑色画面(最暗时)下的亮度。更精准地说,对比度就是把白色信号在100%和0%的饱和度相减,再除以用Lux(光照度,即勒克斯,每平方米的流明值)为计量单位下0%的白色值(0%的白色信号实际上就是黑色),所得到的数值。对比度是最白与最黑亮度单位的相除值。因此白色越亮、黑色越暗,对比度就越高。严格来讲我们指的对比度是屏幕上同一点最亮时(白色)与最暗时(黑色)的亮度的比值,不过通常产品的对比度指标是就整个屏幕而言的,例如一个屏幕在全白屏状态时候亮度为500cd/m2,全黑屏状态亮度为0.5cd/m2,这样屏幕的对比度就是1000:1。或者比如一台显示器在显示全白画面(255)时实测亮度值为200cd/㎡,全黑画面实测亮度为0.5cd/㎡,那么它的对比度就是400:1。The contrast is the brightness at the white screen (the brightest) in the darkroom divided by the black screen (the darkest). More precisely, contrast is the subtraction of the white signal between 100% and 0% saturation, divided by the white value of 0% (in illuminance, ie lux, lumens per square meter). The 0% white signal is actually black), the value obtained. Contrast is the division of the whitest and darkest luminance units. Therefore, the brighter the white, the darker the black, the higher the contrast. Strictly speaking, the contrast we refer to is the ratio of the brightness of the brightest point (white) to the darkest (black) at the same point on the screen, but usually the contrast indicator of the product is for the entire screen, for example, a screen is all white. The brightness of the screen is 500 cd/m2, and the brightness of the black screen is 0.5 cd/m2, so the contrast of the screen is 1000:1. Or, for example, if a monitor displays a full white screen (255) with a measured luminance value of 200 cd/m2 and a full black screen with a measured luminance of 0.5 cd/m2, then its contrast ratio is 400:1.
对比度对视觉效果的影响非常关键,一般来说对比度越大,图像越清晰醒目,色彩也越鲜明艳丽;而对比度小,则会让整个画面都灰蒙蒙的。高对比度对于图像的清晰度、细节表现、灰度层次表现都有很大帮助。在一些黑白反差较大的文本显示、计算机辅助设计CAD显示和黑白照片显示等方面,高对比度产品在黑白反差、清晰度、完整性等方面都具有优势。The effect of contrast on the visual effect is very important. Generally speaking, the contrast is larger, the image is more clear and conspicuous, and the color is more vivid and bright; while the contrast is small, the whole picture will be grayed out. High contrast is very helpful for image sharpness, detail performance, and gray level performance. In some black and white contrast text display, computer-aided design CAD display and black-and-white photo display, high-contrast products have advantages in black and white contrast, clarity and integrity.
光照参数是反映目标图像整体的亮度特性的参数,该参数越大表明目标图像越亮,相反该参数越小表明目标图像则越暗。亮度(lightness)是颜色的一种性质,或与颜色多明亮有关系的色彩空间的一个维度。在Lab色彩空间中,亮度被定义来反映人类的主观明亮感觉。亮度的单位为坎德拉每平方米或称平方烛光cd/m2。亮度是衡量电视屏幕或电脑显示器发光强度的重要指标。构成图像色彩的三要素:明度(亮度)、彩度(饱和度)、色相。对比度指明度差异的程度,对比度大也就是说“明的逾明,暗的逾暗”。亮度则就是图片的明暗程度。The illumination parameter is a parameter that reflects the brightness characteristic of the target image as a whole. The larger the parameter, the brighter the target image, and the smaller the parameter, the darker the target image. Lightness is a property of color, or a dimension of a color space that is related to how bright a color is. In the Lab color space, brightness is defined to reflect the subjective bright feelings of humans. The unit of brightness is candela per square meter or square candle light cd/m2. Brightness is an important indicator of the luminous intensity of a TV screen or computer monitor. The three elements that make up the color of the image: brightness (brightness), saturation (saturation), and hue. Contrast indicates the degree of difference in degree, and the contrast is large, that is, "bright over, dark, dark". Brightness is the brightness of the picture.
可选地,Optionally,
提取模块02提取目标图像的对比度包括:The extraction module 02 extracts the contrast of the target image including:
提取目标图像上每个坐标位置上像素的灰度值; Extracting a gray value of a pixel at each coordinate position on the target image;
根据提取的每个坐标位置上像素的灰度值计算每个相邻的坐标位置上像素的灰度值差;Calculating a gray value difference of pixels on each adjacent coordinate position according to the gray value of the pixel at each of the extracted coordinate positions;
将计算出的每个相邻的坐标位置上像素的灰度值差的绝对值与预设的经验值相比较;Comparing the calculated absolute value of the gray value difference of the pixel at each adjacent coordinate position with a preset empirical value;
根据比较结果获取一个或多个大于预设的经验值的灰度值差的绝对值;Obtaining one or more absolute values of gray value differences greater than a preset empirical value according to the comparison result;
计算一个或多个大于所述预设的经验值的灰度值差的绝对值的平方和;Calculating a sum of squares of absolute values of one or more gray value differences greater than the preset empirical value;
将计算出的平方和的数值除以预先统计的目标图像的像素总量,并将相除获得的商作为目标图像的对比度。The calculated squared value is divided by the total number of pixels of the target image measured in advance, and the quotient obtained by dividing is taken as the contrast of the target image.
可选地,可以根据以下等式提取目标图像的对比度:Alternatively, the contrast of the target image can be extracted according to the following equation:
Figure PCTCN2016113745-appb-000009
Figure PCTCN2016113745-appb-000009
Figure PCTCN2016113745-appb-000010
Figure PCTCN2016113745-appb-000010
其中,Pi为相邻像素的绝对值差,grayi为坐标i位置处像素的灰度值,i为正整数;grayj为坐标j位置处像素的灰度值,j为正整数,i与j为相邻坐标;threshold为预先获得的经验值;M为预先统计的所述目标图像的像素总量;C为所述目标图像的对比度;C越大表明目标图像的对比度越高,C越小表明目标图像的对比度越低。Where P i is the absolute value difference of adjacent pixels, gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer; gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate; threshold is a previously obtained empirical value; M is a total amount of pixels of the target image that is pre-stated; C is a contrast of the target image; a larger C indicates a higher contrast of the target image, C The smaller the value, the lower the contrast of the target image.
提取模块02提取目标图像的光照参数包括:The extraction module 02 extracts the illumination parameters of the target image, including:
计算目标图像上每个坐标位置上像素的灰度值的和;Calculating a sum of gray values of pixels at each coordinate position on the target image;
将计算出的灰度值的和除以预先统计的目标图像的像素总量,并将相除获得的商作为目标图像的光照参数。The sum of the calculated gradation values is divided by the total number of pixels of the target image that is pre-stated, and the quotient obtained by the division is taken as the illumination parameter of the target image.
可选地,可以根据以下等式提取目标图像的光照参数:Alternatively, the illumination parameters of the target image may be extracted according to the following equation:
Figure PCTCN2016113745-appb-000011
Figure PCTCN2016113745-appb-000011
其中,grayi为坐标i位置处像素的灰度值,i为正整数;M为预先统计的目标图像的像素总量;l为目标图像的光照参数,l∈[0,255]。 Where, gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image measured in advance; l is the illumination parameter of the target image, l∈[0, 255].
计算模块03,设置为根据提取出的对比度和光照参数计算目标图像的裁剪系数。The calculation module 03 is configured to calculate a clipping coefficient of the target image according to the extracted contrast and illumination parameters.
在本发明实施例中,本文采用与局部限制对比度直方图CLAHE(Contrast Limited Adaptive histgram equalization,全称为:对比度受限自适应直方图均衡算法)类似的思想,在全局范围内实现对目标图像的对比度和光照的调整。下面我们将对CLAHE算法做详细介绍。In the embodiment of the present invention, the contrast of the target image is realized in a global scope, similar to the concept of Contrast Limited Adaptive histgram equalization (CLAHE). And lighting adjustments. Below we will introduce the CLAHE algorithm in detail.
CLAHE算法通过将图像分为多个子区域,然后对每个子区域进行直方图均衡,再对每个像素通过插值运算得到变换后的灰度值,从而实现对比度受限自适应图像增强。The CLAHE algorithm achieves contrast-limited adaptive image enhancement by dividing the image into multiple sub-regions, then performing histogram equalization on each sub-region, and then interpolating each pixel to obtain the transformed gray value.
CLAHE同普通的自适应直方图均衡不同的地方主要是其对比度限幅。这个特性也可以应用到全局直方图均衡化中,即构成所谓的限制对比度直方图均衡(CLHE),但这在实际中很少使用。在CLAHE中,每个小区域都使用对比度限幅。CLAHE主要是用来克服AHE(Adaptive histgram equalization自适应直方图均衡化)的过度放大噪音的问题。The difference between CLAHE and ordinary adaptive histogram equalization is mainly its contrast limiting. This feature can also be applied to global histogram equalization, which is the so-called Limit Contrast Histogram Equalization (CLHE), but this is rarely used in practice. In CLAHE, contrast is limited for each small area. CLAHE is mainly used to overcome the problem of excessively amplified noise of AHE (Adaptive histgram equalization).
这主要是通过限制AHE算法的对比提高程度来达到的。在指定的像素值周边的对比度放大主要是由变换函数的斜度决定的。这个斜度和领域的累积直方图的斜度成比例。CLAHE通过在计算CDF(累积直方图函数)前用预先定义的阈值来裁剪直方图以达到限制放大幅度的目的。这限制了CDF的斜度,因此,也限制了变换函数的斜度。直方图被裁剪的值,也就是所谓的裁剪限幅或裁剪高度,取决于直方图的分布,因此也取决于领域大小的取值。This is mainly achieved by limiting the degree of contrast improvement of the AHE algorithm. The contrast magnification around the specified pixel value is primarily determined by the slope of the transform function. This slope is proportional to the slope of the cumulative histogram of the field. The CLAHE achieves the purpose of limiting the amplification by cropping the histogram with a predefined threshold before calculating the CDF (cumulative histogram function). This limits the slope of the CDF and therefore limits the slope of the transformation function. The value that the histogram is cropped, also known as clipping clipping or clipping height, depends on the distribution of the histogram and therefore on the size of the field.
通常,直接忽略掉那些超出直方图裁剪限幅的部分是不好的,可将这些裁剪掉的部分均匀的分布到直方图的其他部分。如图4所示。这个重分布的过程可能会导致那些被裁剪掉的部分又重新超过了裁剪值(如图4所示)。如果这不是所希望的,可以采用重复裁剪以达到期望的效果。In general, it is not good to simply ignore the parts that are beyond the clipping limit of the histogram. You can evenly distribute these cropped parts to other parts of the histogram. As shown in Figure 4. This redistribution process may cause those parts that have been cropped to again exceed the crop value (as shown in Figure 4). If this is not desired, repeated cropping can be employed to achieve the desired effect.
CLAHE中对直方图的裁剪可通过人工手动的调整裁剪系数,以得到合适的裁剪高度,这里,裁剪系数的大小决定了用于调整目标图像的调整曲线的斜率。并且CLAHE为局部调整,局部调整可以较好的突出图像的细节信息,但是由于需要多次计算每个图像块(block)的直方图,使得算法计算量较大。本文首先通过提取模块02提取出目标图像的对比度C和光照参数l, 然后通过获得的对比度C和光照参数l自动计算出裁剪系数,大大减小了计算量。The cropping of the histogram in CLAHE can be manually adjusted by hand to obtain a suitable clipping height. Here, the size of the clipping factor determines the slope of the adjustment curve used to adjust the target image. And the CLAHE is a local adjustment, and the local adjustment can better highlight the detailed information of the image, but since the histogram of each image block needs to be calculated multiple times, the calculation amount of the algorithm is large. This paper first extracts the contrast C and illumination parameters l of the target image through the extraction module 02. Then, the clipping coefficient is automatically calculated by the obtained contrast C and illumination parameter l, which greatly reduces the amount of calculation.
可选地,计算模块03根据提取出的对比度和光照参数计算目标图像的裁剪系数包括:Optionally, the calculating module 03 calculates the clipping coefficient of the target image according to the extracted contrast and illumination parameters, including:
将提取的目标图像的光照参数除以预设的归一化系数,将相除获得的商作为对比度进行归一化以后的对比度系数;Dividing the illumination parameter of the extracted target image by a preset normalization coefficient, and comparing the obtained quotient as a contrast coefficient after normalizing the contrast;
计算对比度系数与提取出的目标图像的对比度的乘积,将计算出的积作为目标图像的裁剪系数。The product of the contrast coefficient and the contrast of the extracted target image is calculated, and the calculated product is used as the cropping coefficient of the target image.
可选地,可以根据以下等式计算对比度进行归一化以后的对比度系数:Alternatively, the contrast ratio after the normalization of the contrast can be calculated according to the following equation:
Figure PCTCN2016113745-appb-000012
Figure PCTCN2016113745-appb-000012
其中,L为对比度进行归一化以后的对比度系数;l为目标图像的光照参数;a为预设的归一化系数。Where L is the contrast coefficient after normalization of contrast; l is the illumination parameter of the target image; a is the preset normalization coefficient.
根据以下等式计算目标图像的裁剪系数:Calculate the clipping factor of the target image according to the following equation:
cp=C*L,Cp=C*L,
其中,cp为剪裁系数;C为目标图像的对比度;L为对比度进行归一化以后的对比度系数。Where cp is the clipping factor; C is the contrast of the target image; and L is the contrast coefficient after normalization of the contrast.
分配模块04,设置为根据计算出的裁剪系数重新分配目标图像的直方图。The assignment module 04 is arranged to redistribute the histogram of the target image based on the calculated crop coefficients.
直方图是一种二维统计图表,它的两个坐标分别是统计样本和该样本对应的属性的度量。可选地,图像的直方图横坐标为像素值,纵坐标为每个像素值所对应的像素数量的二维统计图表。A histogram is a two-dimensional statistical graph whose two coordinates are a measure of the statistical sample and the corresponding attribute of the sample. Optionally, the histogram abscissa of the image is a pixel value, and the ordinate is a two-dimensional statistical graph of the number of pixels corresponding to each pixel value.
在本发明实施例中,通过上述的计算模块03计算出直方图的裁剪系数以后,可根据计算出的裁剪系数重新分配目标图像的直方图,即预先根据计算出的裁剪系数计算出直方图的裁剪高度,通过该裁剪高度来裁剪直方图实现对直方图的重新分配,以达到限制放大幅度的目的。In the embodiment of the present invention, after the clipping coefficient of the histogram is calculated by the calculation module 03, the histogram of the target image may be re-allocated according to the calculated clipping coefficient, that is, the histogram is calculated according to the calculated clipping coefficient in advance. The height is cut, and the histogram is cropped by the crop height to realize the redistribution of the histogram to achieve the purpose of limiting the magnification.
可选地,计算模块03还设置为:Optionally, the calculation module 03 is further configured to:
在根据直方图估计目标图像的调整曲线之前,通过以下步骤计算直方图 的裁剪高度:计算剪裁系数与直方图中的像素值所对应的像素个数最大值的乘积,将计算出的积作为直方图的裁剪高度。Before estimating the adjustment curve of the target image from the histogram, calculate the histogram by the following steps Crop height: Calculate the product of the clipping factor and the maximum number of pixels corresponding to the pixel value in the histogram, and use the calculated product as the crop height of the histogram.
可选地,可以通过以下等式计算直方图的裁剪高度:Alternatively, the crop height of the histogram can be calculated by the following equation:
cpCountNum=cp*countNum,cpCountNum=cp*countNum,
其中,cp为剪裁系数;countNum为直方图中的像素值所对应的像素个数最大值;cpCountNum为直方图的裁剪高度。Where cp is the clipping coefficient; countNum is the maximum number of pixels corresponding to the pixel value in the histogram; cpCountNum is the clipping height of the histogram.
映射模块05,设置为根据重新分配后的直方图估计出目标图像的调整曲线,并根据调整曲线对目标图像进行全局色调映射。The mapping module 05 is configured to estimate an adjustment curve of the target image according to the re-allocated histogram, and perform global tone mapping on the target image according to the adjustment curve.
色调映射,是在有限动态范围媒介上近似显示高动态范围图像的一项计算机图形学技术。打印结果、CRT或者LCD显示器以及投影仪等都只有有限的动态范围。本质上来讲,色调映射要解决的问题是进行大幅度的对比度衰减将场景亮度变换到可以显示的范围,同时要保持图像细节与颜色等对于表现原始场景非常重要的信息。Tone mapping is a computer graphics technique that approximates high dynamic range images on a finite dynamic range medium. Print results, CRT or LCD displays, and projectors all have a limited dynamic range. Essentially, the problem with tone mapping is to make a large contrast reduction to change the brightness of the scene to a displayable range, while maintaining image detail and color information that is important for the original scene.
在本发明实施例中,对于调整曲线的拟合方法和目标图像的色调映射方法不做限制,可以采用任何可实施的拟合方法和映射方法实现直方图到调整曲线的拟合以及目标图像的全局映射。In the embodiment of the present invention, the fitting method of the adjustment curve and the tone mapping method of the target image are not limited, and any fitting method and mapping method that can be implemented are used to realize the fitting of the histogram to the adjustment curve and the target image. Global mapping.
磨皮处理模块06,设置为根据预设的磨皮算法对进行全局色调映射后的目标图像进行磨皮处理。The dermabrasion processing module 06 is configured to perform dermabrasion processing on the target image subjected to global tone mapping according to a preset dermabrasion algorithm.
在本发明实施例中,通过映射模块05对目标图像的全局映射以后便完成了对目标图像的预处理过程,通过本发明实施例的磨皮处理模块06就可以对预处理后的图像进行磨皮处理了。In the embodiment of the present invention, the pre-processing of the target image is completed by the global mapping of the target image by the mapping module 05, and the pre-processed image can be ground by the dermabrasion processing module 06 of the embodiment of the present invention. The skin was processed.
磨皮,即使用PS软件中的图层、蒙版、通道、工具,滤镜或其它软件给图片中的人物消除皮肤部分的斑点、瑕疵,杂色等。用photoshop为人物脸部磨皮,能够使得人物脸部更加细腻、光滑,轮廓更加清晰。Microdermabrasion, which uses layers, masks, channels, tools, filters, or other software in the PS software to remove spots, blemishes, and mottled parts of the skin from the characters in the image. Using photoshop to polish the face of a person can make the face of the character more delicate, smooth, and the outline is clearer.
可选地,预设的磨皮算法包括:单通道磨皮算法和基于保边滤波器的三通道磨皮算法。Optionally, the preset dermabrasion algorithm comprises: a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on the edge-preserving filter.
在本发明实施例中,通道磨皮算法包括以下步骤:In an embodiment of the invention, the channel dermabrasion algorithm comprises the following steps:
1、打开图像,进入通道调板,复制蓝通道; 1. Open the image, enter the channel palette, and copy the blue channel;
2、对蓝通道副本执行滤镜\其它\高反差保留;2. Perform filter \ other \ high contrast retention on the blue channel copy;
3、用吸管工具吸取邻近的色,然后用画笔覆盖要保护的部分,包括眼、鼻、眉、嘴、发丝的阴影细节;3. Use a straw tool to absorb the adjacent color, and then cover the part to be protected with a brush, including the shadows of the eyes, nose, eyebrows, mouth, and hair;
4、图像\调整\计算,生成Alpha1通道,并在该通道进行参数设置;4, image \ adjust \ calculation, generate Alpha1 channel, and set parameters in the channel;
5、通过预设操作(按住Ctrl键用鼠标点击Alpha1通道)载入选区,并通过预设操作(如Shift+Ctrl+I)反选,返回到图层调板点击激活背景层,然后建立一个曲线调整层,调整曲线,边观察图像的变化;此时不急于完全去掉斑点,只是将它们大幅度减弱,因为下面还要重复一次前面的操作;5. Load the selection by default operation (hold down the Ctrl key and click the Alpha1 channel with the mouse), and reverse the selection by default operation (such as Shift+Ctrl+I), return to the layer palette, click to activate the background layer, and then create a Curve the adjustment layer, adjust the curve, and observe the change of the image; at this time, do not rush to completely remove the spots, but greatly reduce them, because the previous operation is repeated below;
6、通过预设操作(按Shift+Ctrl+Alt+E组合键)盖印可见图层,对它重复一遍前面的操作;后面的操作参数凭自已的观察来进行;把握的原则是全部进行微量的调整,达到保持图像影调色调平衡,去斑效果更好的目的,例如,若发现暗处有些黄色的色斑,包括脸上的发丝,在工具箱中取海绵工具,模式选项为去色,设一个较小的数值小心擦拭色斑,然后用画笔工具,选取邻近的颜色上色(画笔用颜色模式)。6. By stamping the visible layer by pressing the preset operation (press Shift+Ctrl+Alt+E), repeat the previous operation for it; the following operating parameters are performed by own observation; the principle of grasping is to carry out all traces. The adjustment is to achieve the purpose of maintaining the balance of the image tone and the effect of removing the spot. For example, if you find some yellow spots in the dark, including the hair on the face, take the sponge tool in the toolbox, the mode option is to go Color, set a small value to carefully wipe the stain, then use the brush tool to select the adjacent color to paint (the brush uses color mode).
在本发明实施例中,对磨皮后的图像进行了后期的处理,该步骤主要进行图像肤色、以及图像锐化等一系列操作,该步骤主要是为了使图像中人物的整体风格更加的自然,同时提升图像的整体视觉效果。例如可以采用如下方式进行实现:示例一:肤色调节、锐化;示例二:美白、锐化。In the embodiment of the present invention, the post-skinned image is subjected to post-processing, which mainly performs a series of operations such as image skin color and image sharpening, and the steps are mainly to make the overall style of the characters in the image more natural. At the same time, improve the overall visual effect of the image. For example, it can be implemented in the following manner: Example 1: skin color adjustment, sharpening; example two: whitening, sharpening.
可选的,上述图像处理系统可设置在移动终端中。Optionally, the above image processing system may be disposed in the mobile terminal.
其中,可以将提取模块02、计算模块03、分配模块04、映射模块05和磨皮处理模块06设置在图1中的控制器180中。The extraction module 02, the calculation module 03, the distribution module 04, the mapping module 05, and the dermabrasion processing module 06 may be disposed in the controller 180 in FIG.
至此,已经介绍了本发明实施例方案的全部基本特征,需要说明的是,上述内容仅是本发明的具体实施例,不能作为本发明的最终方案,在其他实施例中,还可以采用其他的实施方式,凡是与本发明的实施例相同或相似的实施方式,以及本发明方案基本特征的任意组合都在本发明的保护范围之内。 At this point, all the basic features of the solution of the embodiment of the present invention have been described. It should be noted that the above content is only a specific embodiment of the present invention, and may not be the final solution of the present invention. In other embodiments, other The embodiments are the same or similar to the embodiments of the present invention, and any combination of the essential features of the present invention is within the scope of the present invention.
此外,本发明实施例还提出了一种图像处理方法,如图5所示,该方法包括步骤:In addition, an embodiment of the present invention further provides an image processing method. As shown in FIG. 5, the method includes the following steps:
S101、提取目标图像的对比度和光照参数。S101. Extract contrast and illumination parameters of the target image.
可选地,Optionally,
提取目标图像的对比度包括:The contrast of the extracted target image includes:
提取目标图像上每个坐标位置上像素的灰度值;Extracting a gray value of a pixel at each coordinate position on the target image;
根据提取的每个坐标位置上像素的灰度值计算每个相邻的坐标位置上像素的灰度值差;Calculating a gray value difference of pixels on each adjacent coordinate position according to the gray value of the pixel at each of the extracted coordinate positions;
将计算出的每个相邻的坐标位置上像素的灰度值差的绝对值与预设的经验值相比较;Comparing the calculated absolute value of the gray value difference of the pixel at each adjacent coordinate position with a preset empirical value;
根据比较结果获取一个或多个大于预设的经验值的灰度值差的绝对值;Obtaining one or more absolute values of gray value differences greater than a preset empirical value according to the comparison result;
计算一个或多个大于预设的经验值的灰度值差的绝对值的平方和;Calculating a sum of squares of absolute values of one or more gray value differences greater than a preset empirical value;
将计算出的平方和的数值除以预先统计的目标图像的像素总量,并将相除获得的商作为目标图像的对比度。The calculated squared value is divided by the total number of pixels of the target image measured in advance, and the quotient obtained by dividing is taken as the contrast of the target image.
可选地,可以根据以下等式提取目标图像的对比度:Alternatively, the contrast of the target image can be extracted according to the following equation:
Figure PCTCN2016113745-appb-000013
Figure PCTCN2016113745-appb-000013
Figure PCTCN2016113745-appb-000014
Figure PCTCN2016113745-appb-000014
其中,Pi为相邻像素的绝对值差,grayi为坐标i位置处像素的灰度值,i为正整数;grayj为坐标j位置处像素的灰度值,j为正整数,i与j为相邻坐标;threshold为预先获得的经验值;M为预先统计的所述目标图像的像素总量;C为目标图像的对比度。Where P i is the absolute value difference of adjacent pixels, gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer; gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate; threshold is a previously obtained empirical value; M is a total amount of pixels of the target image that is pre-stated; C is a contrast of the target image.
提取目标图像的光照参数包括:The lighting parameters for extracting the target image include:
计算目标图像上每个坐标位置上像素的灰度值的和;Calculating a sum of gray values of pixels at each coordinate position on the target image;
将计算出的灰度值的和除以预先统计的目标图像的像素总量,并将相除获得的商作为目标图像的光照参数。 The sum of the calculated gradation values is divided by the total number of pixels of the target image that is pre-stated, and the quotient obtained by the division is taken as the illumination parameter of the target image.
可选地,可以根据以下等式提取目标图像的光照参数:Alternatively, the illumination parameters of the target image may be extracted according to the following equation:
Figure PCTCN2016113745-appb-000015
Figure PCTCN2016113745-appb-000015
其中,grayi为坐标i位置处像素的灰度值,i为正整数;M为预先统计的目标图像的像素总量;l为目标图像的光照参数。Where gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image that is pre-stated; l is the illumination parameter of the target image.
S102、根据提取出的对比度和光照参数计算目标图像的裁剪系数。S102. Calculate a clipping coefficient of the target image according to the extracted contrast and illumination parameters.
可选地,根据提取出的对比度和光照参数计算目标图像的裁剪系数包括:将提取的目标图像的光照参数除以预设的归一化系数,将相除获得的商作为对比度进行归一化以后的对比度系数。Optionally, calculating the cropping coefficient of the target image according to the extracted contrast and illumination parameters includes: dividing the illumination parameter of the extracted target image by a preset normalization coefficient, and normalizing the quotient obtained by dividing the contrast as a contrast Contrast factor in the future.
可选地,可以根据以下等式计算对比度进行归一化以后的对比度系数:Alternatively, the contrast ratio after the normalization of the contrast can be calculated according to the following equation:
Figure PCTCN2016113745-appb-000016
Figure PCTCN2016113745-appb-000016
其中,L为对比度进行归一化以后的对比度系数;l为目标图像的光照参数;a为预设的归一化系数。Where L is the contrast coefficient after normalization of contrast; l is the illumination parameter of the target image; a is the preset normalization coefficient.
根据以下等式计算目标图像的裁剪系数:Calculate the clipping factor of the target image according to the following equation:
cp=C*LCp=C*L
其中,cp为剪裁系数;C为目标图像的对比度;L为对比度进行归一化以后的对比度系数。Where cp is the clipping factor; C is the contrast of the target image; and L is the contrast coefficient after normalization of the contrast.
可选地,该方法还包括:Optionally, the method further includes:
在根据直方图估计目标图像的调整曲线之前,通过以下步骤计算直方图的裁剪高度:Before estimating the adjustment curve of the target image from the histogram, calculate the clipping height of the histogram by the following steps:
计算剪裁系数与直方图中的像素值所对应的像素个数最大值的乘积,将计算出的积作为直方图的裁剪高度。The product of the clipping coefficient and the maximum number of pixels corresponding to the pixel value in the histogram is calculated, and the calculated product is taken as the clipping height of the histogram.
可选地,可以通过以下等式计算直方图的裁剪高度:Alternatively, the crop height of the histogram can be calculated by the following equation:
cpCountNum=cp*countNumcpCountNum=cp*countNum
其中,cp为剪裁系数;countNum为直方图中的像素值所对应的像素个数最大值;cpCountNum为直方图的裁剪高度。 Where cp is the clipping coefficient; countNum is the maximum number of pixels corresponding to the pixel value in the histogram; cpCountNum is the clipping height of the histogram.
S103、根据计算出的裁剪系数重新分配目标图像的直方图。S103. Re-allocate a histogram of the target image according to the calculated clipping coefficient.
S104、根据重新分配后的直方图估计出目标图像的调整曲线,并根据调整曲线对目标图像进行全局色调映射。S104. Estimate an adjustment curve of the target image according to the re-allocated histogram, and perform global tone mapping on the target image according to the adjustment curve.
S105、根据预设的磨皮算法对进行全局色调映射后的目标图像进行磨皮处理。S105. Perform dermabrasion processing on the target image subjected to global tone mapping according to a preset dermabrasion algorithm.
可选地,预设的磨皮算法包括:单通道磨皮算法和基于保边滤波器的三通道磨皮算法。Optionally, the preset dermabrasion algorithm comprises: a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on the edge-preserving filter.
通过本发明实施例的方案能够克服当前单一磨皮技术无法适应复杂场景的缺点,改善用户对相机的体验感,能有效的提高便携式设备相机的产品竞争力。The solution of the embodiment of the present invention can overcome the shortcomings that the current single dermabrasion technology cannot adapt to complex scenes, improve the user experience of the camera, and effectively improve the product competitiveness of the portable device camera.
本发明实施例还提供了一种计算机存储介质,所述计算机存储介质中存储有计算机可执行指令,所述计算机可执行指令用于执行上述实施例所述的方法。The embodiment of the invention further provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used to execute the method described in the foregoing embodiments.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.
本领域普通技术人员可以理解,上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中,在以上描述中提及的功能模块/单元之间的划分不一定对应于物理单元的划分;例如,一个物理组件可以具有多个功 能,或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器,如数字信号处理器或微处理器执行的软件,或者被实施为硬件,或者被实施为集成电路,如专用集成电路。这样的软件可以分布在计算机可读介质上,计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的,术语计算机存储介质包括用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何话方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外,本领域技术人员公知的是,通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据,并且可包括任何信息递送介质。Those of ordinary skill in the art will appreciate that all or some of the steps, systems, and functional blocks/units of the methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical units; for example, one physical component may have multiple functions Yes, or a function or step can be performed cooperatively by several physical components. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on a computer readable medium, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and nonvolatile implemented in any method or technique for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer. Moreover, it is well known to those skilled in the art that communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media.
以上仅为本发明的可选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above is only an alternative embodiment of the present invention, and thus does not limit the scope of the invention, and the equivalent structure or equivalent process transformation made by using the specification and the drawings of the present invention, or directly or indirectly applied to other related technologies. The fields are all included in the scope of patent protection of the present invention.
工业实用性Industrial applicability
上述技术方案能够克服当前移动终端中单一磨皮技术无法适应复杂场景的缺点,特别是人物自拍时处于背光、暗光等场景中,能够对拍摄人物进行美化,改善用户对相机的体验感,能有效的提高便携式设备相机的产品竞争力。 The above technical solution can overcome the shortcomings that the single microdermabrasion technology in the current mobile terminal cannot adapt to a complicated scene, especially in a scene such as backlight and dark light when the character is self-photographed, which can beautify the photographed person and improve the user experience of the camera, and can Effectively improve the competitiveness of portable device cameras.

Claims (20)

  1. 一种图像处理系统(01),所述系统(01)包括:提取模块(02)、计算模块(03)、分配模块(04)、映射模块(05)和磨皮处理模块(06);An image processing system (01), the system (01) comprising: an extraction module (02), a calculation module (03), an allocation module (04), a mapping module (05), and a dermabrasion processing module (06);
    所述提取模块(02),设置为提取目标图像的对比度和光照参数;The extraction module (02) is configured to extract contrast and illumination parameters of the target image;
    所述计算模块(03),设置为根据提取出的对比度和光照参数计算所述目标图像的裁剪系数;The calculating module (03) is configured to calculate a clipping coefficient of the target image according to the extracted contrast and illumination parameters;
    所述分配模块(04),设置为根据计算出的裁剪系数重新分配所述目标图像的直方图;The distribution module (04) is configured to reallocate a histogram of the target image according to the calculated clipping coefficient;
    所述映射模块(05),设置为根据重新分配后的直方图估计出所述目标图像的调整曲线,并根据所述调整曲线对所述目标图像进行全局色调映射;The mapping module (05) is configured to estimate an adjustment curve of the target image according to the re-allocated histogram, and perform global tone mapping on the target image according to the adjustment curve;
    所述磨皮处理模块(06),设置为根据预设的磨皮算法对进行所述全局色调映射后的目标图像进行磨皮处理。The dermabrasion processing module (06) is configured to perform dermabrasion processing on the target image subjected to the global tone mapping according to a preset dermabrasion algorithm.
  2. 如权利要求1所述的图像处理系统(01),其中,所述提取模块(02)是设置为通过如下方式实现提取目标图像的对比度:The image processing system (01) of claim 1 wherein said extraction module (02) is arranged to achieve contrast of the extracted target image by:
    提取所述目标图像上每个坐标位置上像素的灰度值;Extracting a gray value of a pixel at each coordinate position on the target image;
    根据提取的每个坐标位置上像素的灰度值计算每个相邻的坐标位置上像素的灰度值差;Calculating a gray value difference of pixels on each adjacent coordinate position according to the gray value of the pixel at each of the extracted coordinate positions;
    将计算出的每个相邻的坐标位置上像素的灰度值差的绝对值与预设的经验值相比较;Comparing the calculated absolute value of the gray value difference of the pixel at each adjacent coordinate position with a preset empirical value;
    根据比较结果获取一个或多个大于所述预设的经验值的灰度值差的绝对值;Acquiring one or more absolute values of gray value differences greater than the preset empirical value according to the comparison result;
    计算所述一个或多个大于所述预设的经验值的灰度值差的绝对值的平方和;Calculating a sum of squares of absolute values of the one or more gray value differences greater than the preset empirical value;
    将计算出的平方和的数值除以预先统计的所述目标图像的像素总量,并将相除获得的商作为所述目标图像的对比度。The calculated value of the sum of squares is divided by the total number of pixels of the target image counted in advance, and the quotient obtained by dividing is used as the contrast of the target image.
  3. 如权利要求1所述的图像处理系统(01),其中,所述提取模块(02)是设置为通过如下方式实现提取目标图像的光照参数: The image processing system (01) according to claim 1, wherein said extraction module (02) is configured to implement an illumination parameter of the extraction target image by:
    计算所述目标图像上每个坐标位置上像素的灰度值的和;Calculating a sum of gray values of pixels at each coordinate position on the target image;
    将计算出的灰度值的和除以预先统计的所述目标图像的像素总量,并将相除获得的商作为所述目标图像的光照参数。The sum of the calculated gradation values is divided by the total number of pixels of the target image counted in advance, and the quotient obtained by dividing is used as the illumination parameter of the target image.
  4. 如权利要求2或3所述的图像处理系统(01),其中,所述计算模块(03)是设置为通过如下方式实现根据提取出的对比度和光照参数计算所述目标图像的裁剪系数:The image processing system (01) according to claim 2 or 3, wherein said calculation module (03) is arranged to calculate a cropping coefficient of said target image based on the extracted contrast and illumination parameters by:
    将提取的所述目标图像的光照参数除以预设的归一化系数,将相除获得的商作为所述对比度进行归一化以后的对比度系数;Dividing the extracted illumination parameter of the target image by a preset normalization coefficient, and comparing the obtained quotient as a contrast coefficient after normalizing the contrast;
    计算所述对比度系数与提取出的所述目标图像的对比度的乘积,将计算出的积作为所述目标图像的裁剪系数。A product of the contrast coefficient and the contrast of the extracted target image is calculated, and the calculated product is used as a clipping coefficient of the target image.
  5. 如权利要求4所述的图像处理系统(01),The image processing system (01) of claim 4,
    所述计算模块(03),还设置为分配模块(04)根据所述直方图估计所述目标图像的调整曲线之前,计算所述直方图的裁剪高度,包括:The calculation module (03) is further configured to calculate, before the adjustment module (04) estimates the adjustment curve of the target image according to the histogram, the clipping height of the histogram, including:
    计算所述剪裁系数与所述直方图中的像素值所对应的像素个数最大值的乘积,将计算出的积作为所述直方图的裁剪高度。A product of the clipping coefficient and the maximum number of pixels corresponding to the pixel value in the histogram is calculated, and the calculated product is used as the clipping height of the histogram.
  6. 如权利要求1所述的图像处理系统(01),其中,The image processing system (01) according to claim 1, wherein
    所述预设的磨皮算法包括:单通道磨皮算法和基于保边滤波器的三通道磨皮算法。The preset dermabrasion algorithm includes: a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on a ridge filter.
  7. 如权利要求5所述的图像处理系统(01),其中,The image processing system (01) according to claim 5, wherein
    所述图像的直方图横坐标为像素值,纵坐标为每个像素值所对应的像素数量的二维统计图表。The histogram abscissa of the image is a pixel value, and the ordinate is a two-dimensional statistical chart of the number of pixels corresponding to each pixel value.
  8. 如权利要求2所述的图像处理系统(01),其中,所述提取模块(02)是设置为通过如下方式实现提取目标图像的对比度:The image processing system (01) according to claim 2, wherein said extraction module (02) is arranged to achieve contrast of the extracted target image by:
    Figure PCTCN2016113745-appb-100001
    Figure PCTCN2016113745-appb-100001
    Figure PCTCN2016113745-appb-100002
    Figure PCTCN2016113745-appb-100002
    其中,Pi为相邻像素的绝对值差,grayi为坐标i位置处像素的灰度值,i为正整数;grayj为坐标j位置处像素的灰度值,j为正整数,i与j为相邻坐标;threshold为预先获得的经验值;M为预先统计的所述目标图像的像素总量;C为所述目标图像的对比度。Where P i is the absolute value difference of adjacent pixels, gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer; gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate; threshold is a previously obtained empirical value; M is a total amount of pixels of the target image that is pre-stated; C is a contrast of the target image.
  9. 如权利要求3所述的图像处理系统(01),其中,所述提取模块(02)是设置为通过如下方式实现提取目标图像的光照参数:The image processing system (01) according to claim 3, wherein said extraction module (02) is configured to implement an illumination parameter of the extraction target image by:
    Figure PCTCN2016113745-appb-100003
    Figure PCTCN2016113745-appb-100003
    其中,grayi为坐标i位置处像素的灰度值,i为正整数;M为预先统计的目标图像的像素总量;l为目标图像的光照参数,l∈[0,255]。Where, gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image measured in advance; l is the illumination parameter of the target image, l∈[0, 255].
  10. 如权利要求4所述的图像处理系统(01),其中,所述计算模块(03)是设置为通过如下方式实现根据提取出的对比度和光照参数计算所述目标图像的裁剪系数:The image processing system (01) according to claim 4, wherein said calculation module (03) is arranged to calculate a cropping coefficient of said target image based on the extracted contrast and illumination parameters by:
    Figure PCTCN2016113745-appb-100004
    Figure PCTCN2016113745-appb-100004
    L为对比度进行归一化以后的对比度系数;l为目标图像的光照参数;a为预设的归一化系数;L is the contrast coefficient after normalization of contrast; l is the illumination parameter of the target image; a is the preset normalization coefficient;
    cp=C*LCp=C*L
    cp为剪裁系数;C为目标图像的对比度;L为对比度进行归一化以后的对比度系数。Cp is the clipping factor; C is the contrast of the target image; L is the contrast factor after the normalization of the contrast.
  11. 一种图像处理方法,所述方法包括步骤:An image processing method, the method comprising the steps of:
    提取目标图像的对比度和光照参数(S101);Extracting contrast and illumination parameters of the target image (S101);
    根据提取出的对比度和光照参数计算所述目标图像的裁剪系数(S102);Calculating a clipping coefficient of the target image according to the extracted contrast and illumination parameters (S102);
    根据计算出的裁剪系数重新分配所述目标图像的直方图(S103);Re-allocating a histogram of the target image according to the calculated clipping coefficient (S103);
    根据重新分配后的直方图估计出所述目标图像的调整曲线,并根据所述调整曲线对所述目标图像进行全局色调映射(S104);Estimating an adjustment curve of the target image according to the re-allocated histogram, and performing global tone mapping on the target image according to the adjustment curve (S104);
    根据预设的磨皮算法对进行所述全局色调映射后的目标图像进行磨皮处理(S105)。The target image subjected to the global tone mapping is subjected to a dermabrasion process according to a preset dermabrasion algorithm (S105).
  12. 如权利要求11所述的图像处理方法,其中, The image processing method according to claim 11, wherein
    所述提取目标图像的对比度包括:The contrast of the extraction target image includes:
    提取所述目标图像上每个坐标位置上像素的灰度值;Extracting a gray value of a pixel at each coordinate position on the target image;
    根据提取的每个坐标位置上像素的灰度值计算每个相邻的坐标位置上像素的灰度值差;Calculating a gray value difference of pixels on each adjacent coordinate position according to the gray value of the pixel at each of the extracted coordinate positions;
    将计算出的每个相邻的坐标位置上像素的灰度值差的绝对值与预设的经验值相比较;Comparing the calculated absolute value of the gray value difference of the pixel at each adjacent coordinate position with a preset empirical value;
    根据比较结果获取一个或多个大于所述预设的经验值的灰度值差的绝对值;Acquiring one or more absolute values of gray value differences greater than the preset empirical value according to the comparison result;
    计算所述一个或多个大于所述预设的经验值的灰度值差的绝对值的平方和;Calculating a sum of squares of absolute values of the one or more gray value differences greater than the preset empirical value;
    将计算出的平方和的数值除以预先统计的所述目标图像的像素总量,并将相除获得的商作为所述目标图像的对比度。The calculated value of the sum of squares is divided by the total number of pixels of the target image counted in advance, and the quotient obtained by dividing is used as the contrast of the target image.
  13. 如权利要求11所述的图像处理方法,其中,The image processing method according to claim 11, wherein
    所述提取目标图像的光照参数包括:The illumination parameters of the extraction target image include:
    计算所述目标图像上每个坐标位置上像素的灰度值的和;Calculating a sum of gray values of pixels at each coordinate position on the target image;
    将计算出的灰度值的和除以预先统计的所述目标图像的像素总量,并将相除获得的商作为所述目标图像的光照参数。The sum of the calculated gradation values is divided by the total number of pixels of the target image counted in advance, and the quotient obtained by dividing is used as the illumination parameter of the target image.
  14. 如权利要求12或13所述的图像处理方法,其中,所述根据提取出的对比度和光照参数计算所述目标图像的裁剪系数包括:The image processing method according to claim 12 or 13, wherein the calculating the cropping coefficient of the target image based on the extracted contrast and illumination parameters comprises:
    将提取的所述目标图像的光照参数除以预设的归一化系数,将相除获得的商作为所述对比度进行归一化以后的对比度系数;Dividing the extracted illumination parameter of the target image by a preset normalization coefficient, and comparing the obtained quotient as a contrast coefficient after normalizing the contrast;
    计算所述对比度系数与提取出的所述目标图像的对比度的乘积,将计算出的积作为所述目标图像的裁剪系数。A product of the contrast coefficient and the contrast of the extracted target image is calculated, and the calculated product is used as a clipping coefficient of the target image.
  15. 如权利要求14所述的图像处理方法,所述方法还包括:The image processing method according to claim 14, further comprising:
    在根据所述直方图估计所述目标图像的调整曲线之前,通过以下步骤计算所述直方图的裁剪高度:Before estimating the adjustment curve of the target image according to the histogram, the clipping height of the histogram is calculated by the following steps:
    计算所述剪裁系数与所述直方图中的像素值所对应的像素个数最大值 的乘积,将计算出的积作为所述直方图的裁剪高度。Calculating a maximum number of pixels corresponding to the clipping coefficient and the pixel value in the histogram The product of which is the calculated product as the crop height of the histogram.
  16. 如权利要求11所述的图像处理方法,其中,The image processing method according to claim 11, wherein
    所述预设的磨皮算法包括:单通道磨皮算法和基于保边滤波器的三通道磨皮算法。The preset dermabrasion algorithm includes: a single channel dermabrasion algorithm and a three-channel dermabrasion algorithm based on a ridge filter.
  17. 如权利要求15所述的图像处理方法,其中,The image processing method according to claim 15, wherein
    所述图像的直方图横坐标为像素值,纵坐标为每个像素值所对应的像素数量的二维统计图表。The histogram abscissa of the image is a pixel value, and the ordinate is a two-dimensional statistical chart of the number of pixels corresponding to each pixel value.
  18. 如权利要求12所述的图像处理方法,其中,The image processing method according to claim 12, wherein
    所述提取目标图像的对比度包括:The contrast of the extraction target image includes:
    Figure PCTCN2016113745-appb-100005
    Figure PCTCN2016113745-appb-100005
    Figure PCTCN2016113745-appb-100006
    Figure PCTCN2016113745-appb-100006
    其中,Pi为相邻像素的绝对值差,grayi为坐标i位置处像素的灰度值,i为正整数;grayj为坐标j位置处像素的灰度值,j为正整数,i与j为相邻坐标;threshold为预先获得的经验值;M为预先统计的所述目标图像的像素总量;C为所述目标图像的对比度。Where P i is the absolute value difference of adjacent pixels, gray i is the gray value of the pixel at the position of coordinate i, i is a positive integer; gray j is the gray value of the pixel at the position of coordinate j, j is a positive integer, i And j is an adjacent coordinate; threshold is a previously obtained empirical value; M is a total amount of pixels of the target image that is pre-stated; C is a contrast of the target image.
  19. 如权利要求13所述的图像处理方法,其中,The image processing method according to claim 13, wherein
    所述提取目标图像的光照参数包括:The illumination parameters of the extraction target image include:
    Figure PCTCN2016113745-appb-100007
    Figure PCTCN2016113745-appb-100007
    其中,grayi为坐标i位置处像素的灰度值,i为正整数;M为预先统计的目标图像的像素总量;l为目标图像的光照参数,l∈[0,255]。Where, gray i is the gray value of the pixel at the position of the coordinate i, i is a positive integer; M is the total number of pixels of the target image measured in advance; l is the illumination parameter of the target image, l∈[0, 255].
  20. 如权利要求14所述的图像处理方法,其中,The image processing method according to claim 14, wherein
    根据提取出的对比度和光照参数计算所述目标图像的裁剪系数包括:Calculating the cropping coefficients of the target image according to the extracted contrast and illumination parameters includes:
    Figure PCTCN2016113745-appb-100008
    Figure PCTCN2016113745-appb-100008
    L为对比度进行归一化以后的对比度系数;l为目标图像的光照参数;a为预设的归一化系数; L is the contrast coefficient after normalization of contrast; l is the illumination parameter of the target image; a is the preset normalization coefficient;
    cp=C*LCp=C*L
    cp为剪裁系数;C为目标图像的对比度;L为对比度进行归一化以后的对比度系数。 Cp is the clipping factor; C is the contrast of the target image; L is the contrast factor after the normalization of the contrast.
PCT/CN2016/113745 2016-03-30 2016-12-30 Image processing system and method WO2017166886A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610191959.7 2016-03-30
CN201610191959.7A CN105825485B (en) 2016-03-30 2016-03-30 A kind of image processing system and method

Publications (1)

Publication Number Publication Date
WO2017166886A1 true WO2017166886A1 (en) 2017-10-05

Family

ID=56523647

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/113745 WO2017166886A1 (en) 2016-03-30 2016-12-30 Image processing system and method

Country Status (2)

Country Link
CN (1) CN105825485B (en)
WO (1) WO2017166886A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111062897A (en) * 2019-12-06 2020-04-24 Oppo广东移动通信有限公司 Image equalization method, terminal and storage medium
CN112561906A (en) * 2020-12-24 2021-03-26 百果园技术(新加坡)有限公司 Image processing method, device, equipment and medium
CN113744145A (en) * 2021-08-20 2021-12-03 武汉瓯越网视有限公司 Method for improving image definition, storage medium, electronic device and system
CN113989137A (en) * 2021-10-21 2022-01-28 武汉博视电子有限公司 Method for extracting pigmentation of facial skin image and forming spectrum of brown region
CN116342440A (en) * 2023-05-26 2023-06-27 山东广汇安通物联科技有限公司 Vehicle-mounted video monitoring management system based on artificial intelligence
CN116363148A (en) * 2022-06-21 2023-06-30 上海玄戒技术有限公司 Image processing method, device, chip and storage medium
CN117152029A (en) * 2023-10-30 2023-12-01 浦江三思光电技术有限公司 CLAHE image enhancement real-time processing method and system based on FPGA

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105825485B (en) * 2016-03-30 2018-12-21 努比亚技术有限公司 A kind of image processing system and method
CN106682278B (en) * 2016-12-06 2019-11-08 西安交通大学 Supersonic flow field prediction accuracy decision maker and method based on image procossing
CN108280836B (en) * 2018-01-24 2020-08-28 中科创达软件股份有限公司 Image processing method and device
CN110502961B (en) * 2018-05-16 2022-10-21 腾讯科技(深圳)有限公司 Face image detection method and device
CN110060217A (en) * 2019-04-22 2019-07-26 杨勇 A kind of image processing method that noise is effectively reduced
CN111127341A (en) * 2019-12-05 2020-05-08 Oppo广东移动通信有限公司 Image processing method and apparatus, and storage medium
CN111028185B (en) * 2019-12-06 2023-01-24 Oppo广东移动通信有限公司 Histogram equalization method, device, equipment and storage medium
CN110927706B (en) * 2019-12-10 2022-05-24 电子科技大学 Convolutional neural network-based radar interference detection and identification method
CN113256503B (en) * 2020-02-13 2024-03-08 北京小米移动软件有限公司 Image optimization method and device, mobile terminal and storage medium
CN111639708B (en) * 2020-05-29 2023-05-09 深圳市燕麦科技股份有限公司 Image processing method, device, storage medium and equipment
CN112233036B (en) * 2020-10-21 2021-06-08 哈尔滨市科佳通用机电股份有限公司 Image enhancement method and system based on high contrast retention algorithm

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103767698A (en) * 2014-01-22 2014-05-07 中国科学院合肥物质科学研究院 Vein dynamic characteristic analysis device based on near-infrared spectrum technique and analysis method thereof
WO2015085130A2 (en) * 2013-12-07 2015-06-11 Razzor Technologies Inc. Adaptive contrast in image processing and display
CN104794705A (en) * 2015-03-27 2015-07-22 努比亚技术有限公司 Image defogging method and method based on image partial content characteristics
CN104966272A (en) * 2015-05-29 2015-10-07 中国农业大学 Underwater sea cucumber image processing method and system
CN105225210A (en) * 2015-10-14 2016-01-06 南京第五十五所技术开发有限公司 A kind of self-adapting histogram based on dark strengthens defogging method capable
CN105825485A (en) * 2016-03-30 2016-08-03 努比亚技术有限公司 Image processing system and method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8958658B1 (en) * 2013-09-10 2015-02-17 Apple Inc. Image tone adjustment using local tone curve computation
CN103440635B (en) * 2013-09-17 2016-06-22 厦门美图网科技有限公司 A kind of contrast limited adaptive histogram equalization method based on study
CN104318262A (en) * 2014-09-12 2015-01-28 上海明穆电子科技有限公司 Method and system for replacing skin through human face photos
CN104754221B (en) * 2015-03-11 2018-11-16 广东欧珀移动通信有限公司 A kind of photographic method and mobile terminal

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015085130A2 (en) * 2013-12-07 2015-06-11 Razzor Technologies Inc. Adaptive contrast in image processing and display
CN103767698A (en) * 2014-01-22 2014-05-07 中国科学院合肥物质科学研究院 Vein dynamic characteristic analysis device based on near-infrared spectrum technique and analysis method thereof
CN104794705A (en) * 2015-03-27 2015-07-22 努比亚技术有限公司 Image defogging method and method based on image partial content characteristics
CN104966272A (en) * 2015-05-29 2015-10-07 中国农业大学 Underwater sea cucumber image processing method and system
CN105225210A (en) * 2015-10-14 2016-01-06 南京第五十五所技术开发有限公司 A kind of self-adapting histogram based on dark strengthens defogging method capable
CN105825485A (en) * 2016-03-30 2016-08-03 努比亚技术有限公司 Image processing system and method

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111062897A (en) * 2019-12-06 2020-04-24 Oppo广东移动通信有限公司 Image equalization method, terminal and storage medium
CN111062897B (en) * 2019-12-06 2023-09-29 Oppo广东移动通信有限公司 Image equalization method, terminal and storage medium
CN112561906A (en) * 2020-12-24 2021-03-26 百果园技术(新加坡)有限公司 Image processing method, device, equipment and medium
CN113744145A (en) * 2021-08-20 2021-12-03 武汉瓯越网视有限公司 Method for improving image definition, storage medium, electronic device and system
CN113744145B (en) * 2021-08-20 2024-05-10 武汉瓯越网视有限公司 Method, storage medium, electronic device and system for improving image definition
CN113989137A (en) * 2021-10-21 2022-01-28 武汉博视电子有限公司 Method for extracting pigmentation of facial skin image and forming spectrum of brown region
CN116363148A (en) * 2022-06-21 2023-06-30 上海玄戒技术有限公司 Image processing method, device, chip and storage medium
CN116363148B (en) * 2022-06-21 2024-04-02 上海玄戒技术有限公司 Image processing method, device, chip and storage medium
CN116342440A (en) * 2023-05-26 2023-06-27 山东广汇安通物联科技有限公司 Vehicle-mounted video monitoring management system based on artificial intelligence
CN117152029A (en) * 2023-10-30 2023-12-01 浦江三思光电技术有限公司 CLAHE image enhancement real-time processing method and system based on FPGA
CN117152029B (en) * 2023-10-30 2024-03-08 浦江三思光电技术有限公司 CLAHE image enhancement real-time processing method and system based on FPGA

Also Published As

Publication number Publication date
CN105825485B (en) 2018-12-21
CN105825485A (en) 2016-08-03

Similar Documents

Publication Publication Date Title
WO2017166886A1 (en) Image processing system and method
WO2017140182A1 (en) Image synthesis method and apparatus, and storage medium
CN107172364B (en) Image exposure compensation method and device and computer readable storage medium
WO2017050115A1 (en) Image synthesis method
WO2017067526A1 (en) Image enhancement method and mobile terminal
CN106131450B (en) Image processing method and device and terminal
WO2021036715A1 (en) Image-text fusion method and apparatus, and electronic device
US10863077B2 (en) Image photographing method, apparatus, and terminal
WO2017071475A1 (en) Image processing method, and terminal and storage medium
JP5697802B2 (en) Image processing apparatus and image processing method
US9672414B2 (en) Enhancement of skin, including faces, in photographs
US20150063694A1 (en) Techniques for combining images with varying brightness degrees
CN108200352B (en) Method, terminal and storage medium for adjusting picture brightness
CN106534619A (en) Method and apparatus for adjusting focusing area, and terminal
WO2019101005A1 (en) Pixel compensation method and apparatus, and terminal device
CN105528765B (en) Method and device for processing image
WO2017071542A1 (en) Image processing method and apparatus
US20150063718A1 (en) Techniques for enhancing low-light images
CN105095903A (en) Electronic equipment and image processing method
CN111625213A (en) Picture display method, device and storage medium
KR20210077579A (en) Electronic device and operating method for generating high dynamic range image
WO2018040751A1 (en) Image generation apparatus and method therefor, and image processing device and storage medium
CN106855997A (en) The processing method and processing device of picture
KR101750058B1 (en) Apparatus and method for generating high dynamic range image
CN107730443B (en) Image processing method and device and user equipment

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16896654

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 15/03/2019)

122 Ep: pct application non-entry in european phase

Ref document number: 16896654

Country of ref document: EP

Kind code of ref document: A1