CN105491358A

CN105491358A - Image processing method, device and terminal

Info

Publication number: CN105491358A
Application number: CN201510843465.8A
Authority: CN
Inventors: 朱德志
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2015-11-26
Filing date: 2015-11-26
Publication date: 2016-04-13
Anticipated expiration: 2035-11-26
Also published as: CN105491358B; WO2017088564A1

Abstract

The invention discloses an image processing method, device and a terminal. The method comprises: obtaining N continuous frames of images, wherein N is an integer more than or equal to 3; determining one frame in the N frames of images as a reference frame, determining the rest (N-1) frames of images as comparison frames; comparing the pixel value Q1 (i, j) of the first pixel on the first colour component of the reference frame with the pixel values Q0 (i, j) of the first pixels on the first colour components of the comparison frames, obtaining comparison results, wherein the first pixels are the pixels in the N frames of images with coordinates (i, j), the first colour component is any one component in M colour components; determining the pixel values of the first pixels on the first colour components according to the comparison results, in turn obtaining the pixel values of all the rest pixels on the first colour components; obtaining the pixel values of all pixels on other colour components except the first colour components by the mode of obtaining the pixel values on the first colour components; and usingthe pixel values of all pixels on the M colour components to form one image frame.

Description

A kind of image processing method and device, terminal

Technical field

The present invention relates to image processing techniques, particularly relate to a kind of image processing method and device, terminal.

Background technology

Nowadays, science and technology is at a tremendous pace, and the camera function of electronic equipment as mobile phone, panel computer etc. is more and more perfect.The characteristic such as be easy to carry because its volume is little, and increasing people more hankers after using electronic equipment if photographing function of mobile phone is to record the fine moment in life, and the image quality requirements that people take mobile phone is also more and more higher.But disgusting, in the occasion that brightness is inadequate, often can with some noises (brightness noise adds chrominance noise) in image, and brightness more low noise is larger.The visual quality of the effect diagram picture that the existence of these noises is serious.

Summary of the invention

In view of this, the embodiment of the present invention provides a kind of image processing method and device, terminal for solving in prior art at least one problem of existing, denoising effect can be improved, and the shortcomings such as the loss easily causing edge details can be overcome, making finally takes pictures obtains picture better visual effect.

The technical scheme of the embodiment of the present invention is achieved in that

First aspect, the embodiment of the present invention provides a kind of image processing method, and described method comprises:

Obtain continuous print N two field picture, described N be more than or equal to 3 integer, the data acquisition of described N two field picture represents with color model, and described color model comprises M color component, described M be more than or equal to 1 integer;

From described N two field picture, determine that a frame is as reference frame, (N-1) two field picture except described reference frame is defined as contrast frame;

The pixel value Q1 (i, j) of described reference frame first pixel on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are contrasted, obtains comparing result; Described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one color component of a described M color component;

Determine the pixel value of the first pixel on the first color component according to described comparing result, obtain the pixel value of remaining whole pixel on the first color component according to this;

To obtain the mode of pixel value on the first color component, obtain the pixel value of the whole pixels on other color components except described first color component;

The pixel value of pixel whole on a described M color component is formed a two field picture.

Alternatively, for same target, shooting N two field picture continuously.

Alternatively, the described pixel value Q0 (i, j) by the first pixel in the pixel value Q1 (i, j) of described reference frame first pixel on the first color component and contrast frame on the first color component contrasts, and obtains comparing result, comprising:

The pixel value Q1 (i, j) of first pixel of reference frame on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are carried out doing difference, obtains difference z (i, j);

Judge described difference z (i, j) whether within the scope of the first threshold preset, obtain judged result.

Alternatively, determine the pixel value of the first pixel on the first color component according to described comparing result, comprising:

When described judged result shows to have a described difference z (i at least, j) time within the scope of the first threshold preset, determine the first sets of pixel values, described first set of pixels is combined into described difference z (i, j) Q0 (i, j) corresponding time within the scope of the first threshold preset;

Described Q1 (i, j) and the first sets of pixel values are carried out arithmetic average, obtains the pixel value Q (i, j) of the first pixel on the first color component.

When described judged result shows to have at least a described difference z (i, j) within the scope of the first threshold preset, Q1 (i, j) is chosen an image block as central point;

In described image block, determine the second sets of pixel values, described second sets of pixel values is the pixel meeting the pixel value within the scope of default Second Threshold in image block;

Described Q1 (i, j) and the second sets of pixel values are carried out arithmetic average, obtains the pixel value Q (i, j) of the first pixel on the first color component.

Alternatively, described image block is one of following:

3 pixel × 3 pixels, 5 pixel × 5 pixels, 7 pixel × 7 pixel, 9 pixel × 9 pixels.

Alternatively, described N is 4.

Second aspect, the embodiment of the present invention provides a kind of image processing apparatus, and described device comprises acquiring unit, the first determining unit, contrast unit, the second determining unit, the first processing unit, the second processing unit and component units, wherein:

Described acquiring unit, for obtaining continuous print N two field picture, described N be more than or equal to 3 integer, the data acquisition of described N two field picture represents with color model, and described color model comprises M color component, described M be more than or equal to 1 integer;

Described first determining unit, for determining that from described N two field picture a frame is as reference frame, is defined as (N-1) two field picture except described reference frame contrasting frame;

Described contrast unit, for the pixel value Q1 (i by described reference frame first pixel on the first color component, j) contrast with the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component, obtain comparing result; Described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one color component of a described M color component;

Described second determining unit, for determining the pixel value of the first pixel on the first color component according to described comparing result;

Described first processing unit, for the processing procedure according to described contrast unit and described second determining unit, obtains the pixel value of remaining whole pixel on the first color component;

Described second processing unit, for the processing procedure according to described contrast unit, described second determining unit and the first processing unit, obtains the pixel value of the whole pixels on other color components except described first color component;

Described component units, for forming a two field picture by the pixel value of pixel whole on the pixel value of pixel whole on the first color component and other color components.

Alternatively, described contrast unit comprises and does differential mode block and judge module, wherein:

Describedly do differential mode block, for the pixel value Q1 (i, j) of first pixel of reference frame on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are carried out doing difference, obtain difference z (i, j);

Described judge module, for judging described difference z (i, j) whether within the scope of the first threshold preset, obtains judged result.

The third aspect, the embodiment of the present invention provides a kind of terminal, and described terminal comprises memory and processor, wherein:

Described memory, for storing continuous print N two field picture;

Described processor, for obtaining continuous print N two field picture, described N be more than or equal to 3 integer, the data acquisition of described N two field picture represents with color model, and described color model comprises M color component, described M be more than or equal to 1 integer; From described N two field picture, determine that a frame is as reference frame, (N-1) two field picture except described reference frame is defined as contrast frame; The pixel value Q1 (i, j) of described reference frame first pixel on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are contrasted, obtains comparing result; Described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one component of a described M color component; Determine the pixel value of the first pixel on the first color component according to described comparing result, obtain the pixel value of remaining whole pixel on the first color component according to this; Analogize in the mode obtaining pixel value on the first color component, obtain the pixel value of the whole pixels on other color components except described first color component; The pixel value of pixel whole on a described M color component is formed a two field picture.

The embodiment of the present invention provides a kind of image processing method and device, terminal, wherein, obtains continuous print N two field picture, described N be more than or equal to 3 integer, the data acquisition of described N two field picture represents with color model, and described color model comprises M color component, described M be more than or equal to 1 integer; From described N two field picture, determine that a frame is as reference frame, (N-1) two field picture except described reference frame is defined as contrast frame; The pixel value Q1 (i, j) of described reference frame first pixel on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are contrasted, obtains comparing result; Described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one color component of a described M color component; Determine the pixel value of the first pixel on the first color component according to described comparing result, obtain the pixel value of remaining whole pixel on the first color component according to this; To obtain the mode of pixel value on the first color component, obtain the pixel value of the whole pixels on other color components except described first color component; The pixel value of pixel whole on a described M color component is formed a two field picture; So, can improve denoising effect, and can overcome the shortcomings such as the loss easily causing edge details, making finally takes pictures obtains picture better visual effect.

Accompanying drawing explanation

Fig. 1-1 is for realizing the hardware configuration schematic diagram of an optional mobile terminal in each embodiment of the present invention;

Fig. 1-2 is the composition structural representation of phtographic lens in mobile terminal as Figure 1-1;

Fig. 1-3 is the realization flow schematic diagram of the embodiment of the present invention one image processing method;

Fig. 2 is the realization flow schematic diagram of the embodiment of the present invention two image processing method;

Fig. 3 is the schematic diagram of the embodiment of the present invention three block of pixels;

Fig. 4 is the pixel value of the block of pixels shown in Fig. 3;

Fig. 5 is the realization flow schematic diagram of the embodiment of the present invention four image processing apparatus.

Embodiment

Should be appreciated that specific embodiment described herein only in order to explain technical scheme of the present invention, the protection range be not intended to limit the present invention.The mobile terminal realizing each embodiment of the present invention is described referring now to accompanying drawing.In follow-up description, use the suffix of such as " module ", " parts " or " unit " for representing element only in order to be conducive to explanation of the present invention, itself is specific meaning not.Therefore, " module " and " parts " can mixedly use.

Mobile terminal can be implemented in a variety of manners.Such as, the terminal described in the present invention can comprise the such as mobile terminal of mobile phone, smart phone, notebook computer, digit broadcasting receiver, PDA (personal digital assistant), PAD (panel computer), PMP (portable media player), guider etc. and the fixed terminal of such as digital TV, desktop computer etc.Below, suppose that terminal is mobile terminal.But it will be appreciated by those skilled in the art that except the element except being used in particular for mobile object, structure according to the embodiment of the present invention also can be applied to the terminal of fixed type.

Fig. 1-1 is for realizing the hardware configuration schematic diagram of an optional mobile terminal in each embodiment of the present invention, as Figure 1-1, mobile terminal 100 can comprise wireless communication unit 110, A/V (audio/video) input unit 120, user input unit 130, output unit 150, memory 160, interface unit 170, controller 180 and power subsystem 190 etc.Fig. 1-1 shows the mobile terminal with various assembly, it should be understood that, does not require to implement all assemblies illustrated.Can alternatively implement more or less assembly.Will be discussed in more detail below the element of mobile terminal.

Wireless communication unit 110 generally includes one or more assembly, and it allows the radio communication between mobile terminal 100 and wireless communication system or network.Such as, wireless communication unit can comprise at least one in mobile communication module 112, wireless Internet module 113 and short range communication module 114.

Radio signal is sent at least one in base station (such as, access point, Node B etc.), exterior terminal and server and/or receives radio signals from it by mobile communication module 112.Various types of data that such radio signal can comprise voice call signal, video calling signal or send according to text and/or Multimedia Message and/or receive.

Wireless Internet module 113 supports the Wi-Fi (Wireless Internet Access) of mobile terminal.This module can be inner or be externally couple to terminal.Wi-Fi (Wireless Internet Access) technology involved by this module can comprise WLAN (WLAN) (Wi-Fi), Wibro (WiMAX), Wimax (worldwide interoperability for microwave access), HSDPA (high-speed downlink packet access) etc.

Short range communication module 114 is the modules for supporting junction service.Some examples of short-range communication technology comprise bluetooth ^tM, radio-frequency (RF) identification (RFID), Infrared Data Association (IrDA), ultra broadband (UWB), purple honeybee ^tMetc..

A/V input unit 120 is for audio reception or vision signal.A/V input unit 120 can comprise camera 121 and microphone 1220, and the view data of camera 121 to the still image obtained by image capture apparatus in Video Capture pattern or image capture mode or video processes.Picture frame after process may be displayed on display unit 151.Picture frame after camera 121 processes can be stored in memory 160 (or other storage medium) or via wireless communication unit 110 and send, and can provide two or more cameras 121 according to the structure of mobile terminal.Such acoustic processing can via microphones sound (voice data) in telephone calling model, logging mode, speech recognition mode etc. operational mode, and can be voice data by microphone 122.Audio frequency (voice) data after process can be converted to the formatted output that can be sent to mobile communication base station via mobile communication module 112 when telephone calling model.Microphone 122 can be implemented various types of noise and eliminate (or suppress) algorithm and receiving and sending to eliminate (or suppression) noise or interference that produce in the process of audio signal.

User input unit 130 can generate key input data to control the various operations of mobile terminal according to the order of user's input.User input unit 130 allows user to input various types of information, and keyboard, the young sheet of pot, touch pad (such as, detecting the touch-sensitive assembly of the change of the resistance, pressure, electric capacity etc. that cause owing to being touched), roller, rocking bar etc. can be comprised.Especially, when touch pad is superimposed upon on display unit 151 as a layer, touch-screen can be formed.

Interface unit 170 is used as at least one external device (ED) and is connected the interface that can pass through with mobile terminal 100.Such as, external device (ED) can comprise wired or wireless head-band earphone port, external power source (or battery charger) port, wired or wireless FPDP, memory card port, for connecting the port, audio frequency I/O (I/O) port, video i/o port, ear port etc. of the device with identification module.Identification module can be that storage uses the various information of mobile terminal 100 for authentication of users and can comprise subscriber identification module (UIM), client identification module (SIM), Universal Subscriber identification module (USIM) etc.In addition, the device (hereinafter referred to " recognition device ") with identification module can take the form of smart card, and therefore, recognition device can be connected with mobile terminal 100 via port or other jockey.Interface unit 170 may be used for receive from external device (ED) input (such as, data message, electric power etc.) and the input received be transferred to the one or more element in mobile terminal 100 or may be used for transmitting data between mobile terminal and external device (ED).

In addition, when mobile terminal 100 is connected with external base, interface unit 170 can be used as to allow by it electric power to be provided to the path of mobile terminal 100 from base or can be used as the path that allows to be transferred to mobile terminal by it from the various command signals of base input.The various command signal inputted from base or electric power can be used as and identify whether mobile terminal is arranged on the signal base exactly.Output unit 150 is constructed to provide output signal (such as, audio signal, vision signal, alarm signal, vibration signal etc.) with vision, audio frequency and/or tactile manner.Output unit 150 can comprise display unit 151, dio Output Modules 152 etc.

Display unit 151 may be displayed on the information of process in mobile terminal 100.Such as, when mobile terminal 100 is in telephone calling model, display unit 151 can show with call or other communicate (such as, text messaging, multimedia file are downloaded etc.) be correlated with user interface (UI) or graphic user interface (GUI).When mobile terminal 100 is in video calling pattern or image capture mode, display unit 151 can the image of display capture and/or the image of reception, UI or GUI that video or image and correlation function are shown etc.

Meanwhile, when display unit 151 and touch pad as a layer superposed on one another to form touch-screen time, display unit 151 can be used as input unit and output device.Display unit 151 can comprise at least one in liquid crystal display (LCD), thin-film transistor LCD (TFT-LCD), Organic Light Emitting Diode (OLED) display, flexible display, three-dimensional (3D) display etc.Some in these displays can be constructed to transparence and watch from outside to allow user, and this can be called transparent display, and typical transparent display can be such as TOLED (transparent organic light emitting diode) display etc.According to the specific execution mode wanted, mobile terminal 100 can comprise two or more display units (or other display unit), such as, mobile terminal can comprise outernal display unit (not shown) and inner display unit (not shown).Touch-screen can be used for detecting touch input pressure and touch input position and touch and inputs area.

When dio Output Modules 152 can be under the isotypes such as call signal receiving mode, call mode, logging mode, speech recognition mode, broadcast reception mode at mobile terminal, voice data convert audio signals that is that wireless communication unit 110 is received or that store in memory 160 and exporting as sound.And dio Output Modules 152 can provide the audio frequency relevant to the specific function that mobile terminal 100 performs to export (such as, call signal receives sound, message sink sound etc.).Dio Output Modules 152 can comprise loud speaker, buzzer etc.

Memory 160 software program that can store process and the control operation performed by controller 180 etc., or temporarily can store oneself through exporting the data (such as, telephone directory, message, still image, video etc.) that maybe will export.And, memory 160 can store about when touch be applied to touch-screen time the vibration of various modes that exports and the data of audio signal.

Memory 160 can comprise the storage medium of at least one type, described storage medium comprises flash memory, hard disk, multimedia card, card-type memory (such as, SD or DX memory etc.), random access storage device (RAM), static random-access memory (SRAM), read-only memory (ROM), Electrically Erasable Read Only Memory (EEPROM), programmable read only memory (PROM), magnetic storage, disk, CD etc.And mobile terminal 100 can be connected the memory function of execute store 160 network storage device with by network cooperates.

Controller 180 controls the overall operation of mobile terminal usually.Such as, controller 180 performs the control relevant to voice call, data communication, video calling etc. and process.In addition, controller 180 can comprise for reproducing or the multi-media module 181 of multimedia playback data, and multi-media module 181 can be configured in controller 180, or can be configured to be separated with controller 180.Controller 180 can pattern recognition process, so that the handwriting input performed on the touchscreen or Image Rendering input are identified as character or image.

Power subsystem 190 receives external power or internal power and provides each element of operation and the suitable electric power needed for assembly under the control of controller 180.

Various execution mode described herein can to use such as computer software, the computer-readable medium of hardware or its any combination implements.For hardware implementation, execution mode described herein can by using application-specific IC (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, being designed at least one performed in the electronic unit of function described herein and implementing, in some cases, such execution mode can be implemented in controller 180.For implement software, the execution mode of such as process or function can be implemented with allowing the independent software module performing at least one function or operation.Software code can be implemented by the software application (or program) write with any suitable programming language, and software code can be stored in memory 160 and to be performed by controller 180.

So far, oneself is through the mobile terminal according to its functional description.Below, for the sake of brevity, by the slide type mobile terminal that describes in various types of mobile terminals of such as folded form, board-type, oscillating-type, slide type mobile terminal etc. exemplarily.Therefore, the present invention can be applied to the mobile terminal of any type, and is not limited to slide type mobile terminal.

Described in the embodiment of the present invention, mobile terminal also comprises phtographic lens, and shown in Fig. 1-2, phtographic lens 1211 is made up of the multiple optical lens for the formation of shot object image, is single-focus lens or zoom lens.Phtographic lens 1211 can move in the direction of the optical axis under the control of lens driver 1221, lens driver 1221 is according to the control signal from lens driving control circuit 1222, control the focal position of phtographic lens 1211, when zoom lens, also can control focal length.Lens driving control circuit 1222 carries out the drived control of lens driver 1221 according to the control command from microcomputer 1217.

Imaging apparatus 1212 is configured with near the position of the shot object image formed on the optical axis of phtographic lens 1211, by phtographic lens 1211.Imaging apparatus 1212 is for making a video recording to shot object image and obtaining image data.On imaging apparatus 1212 two dimension and be arranged in a matrix the photodiode forming each pixel.Each photodiode produces the opto-electronic conversion electric current corresponding with light income, and this opto-electronic conversion electric current carries out charge accumulation by the capacitor be connected with each photodiode.The front surface of each pixel is configured with the RGB colour filter of Bayer arrangement.

Imaging apparatus 1212 is connected with imaging circuit 1213, this imaging circuit 1213 carries out charge accumulation and controls and picture signal reading control in imaging apparatus 1212, to the picture signal (analog picture signal) of this reading reduce reset noise after carry out waveform shaping, and then carry out gain raising etc. to become suitable signal level.Imaging circuit 1213 is connected with A/D converter 1214, and this A/D converter 1214 pairs of analog picture signals carry out analog-to-digital conversion, to bus 1227 output digital image signal (hereinafter referred to as view data).

Bus 1227 is the transfer paths of the various data that the inside for being transmitted in camera reads or generates.Above-mentioned A/D converter 1214 is connected in bus 1227, be connected to image processor 1215, jpeg processor 1216, microcomputer 1217, SDRAM (SynchronousDynamicrandomaccessmemory in addition, SDRAM) 1218, memory interface (hereinafter referred to as memory I/F) 1219, LCD (LiquidCrystalDisplay, liquid crystal display) driver 1220.

Image processor 1215 carries out OB to the view data of the output based on imaging apparatus 1212 and subtracts each other process, blank level adjustment, color matrix computing, gamma conversion, color difference signal process, noise removal process, changes the various image procossing such as process, edge treated simultaneously.Jpeg processor 1216 by Imagery Data Recording in recording medium 1225 time, according to JPEG compress mode compression from SDRAM1218 read view data.In addition, jpeg processor 1216 carries out the decompression of jpeg image data in order to carry out image reproducing display.When decompressing, read the file that is recorded in recording medium 1225, implement decompression in jpeg processor 1216 after, the view data of decompression to be temporarily stored in SDRAM1218 and to show on LCD1226.H.264 in addition, in the present embodiment, what adopt as image compression decompression mode is JPEG mode, but compressed and decompressed mode is not limited thereto, and certainly can adopt MPEG, TIFF, other the compressed and decompressed mode such as.

Microcomputer 1217 plays the function of the control part as this camera entirety, the unified various process sequences controlling camera.Microcomputer 1217 is connected to operating unit 1223 and flash memory 1224.

Operating unit 1223 includes but not limited to physical button or virtual key, this entity or virtual key can be the operational controls such as various load button and various enter keies such as power knob, key of taking pictures, edit key, dynamic image button, reproduction button, menu button, cross key, OK button, delete button, large buttons, detect the mode of operation of these operational controls.

Testing result is exported to microcomputer 1217.In addition, be provided with touch panel at the front surface of the LCD1226 as display, detect the touch location of user, this touch location is exported to microcomputer 1217.Microcomputer 1217, according to the testing result of the operating position from operating unit 1223, performs the various process sequences corresponding with the operation of user.

Flash memory 1224 stores the program of the various process sequences for performing microcomputer 1217.Microcomputer 1217 carries out the control of camera entirety according to this program.In addition, flash memory 1224 stores the various adjusted values of camera, and microcomputer 1217 reads adjusted value, carries out the control of camera according to this adjusted value.

SDRAM1218 is can the electricity volatile memory of rewriting for what carry out view data etc. temporarily storing.This SDRAM1218 temporarily stores the view data that exports from A/D converter 1214 and image processor 1215, jpeg processor 1216 etc., to have carried out the view data after processing.

Memory interface 1219 is connected with recording medium 1225, carries out the control by view data and the first-class data writing recording medium 1225 of file be attached in view data and reading from recording medium 1225.Recording medium 1225 be such as can on camera main-body the recording medium such as memory card of disassembled and assembled freely, but being not limited thereto, also can be the hard disk etc. be built in camera main-body.

Lcd driver 1210 is connected with LCD1226, view data after being processed by image processor 1215 is stored in SDRAM1218, when needing display, read the view data that SDRAM1218 stores also to show on LCD1226, or the compressed view data of jpeg processor 1216 is stored in SDRAM1218, when needs show, jpeg processor 1216 reads the compressed view data of SDRAM1218, then decompresses, and the view data after decompressing is shown by LCD1226.

Image display is carried out at the back side that LCD1226 is configured in camera main-body.This LCD1226LCD, but be not limited thereto, also can adopt the various display floaters (LCD1226) such as organic EL, but be not limited thereto, also can adopt the various display floaters such as organic EL.

Based on above-mentioned mobile terminal hardware configuration and phtographic lens, each embodiment of the inventive method is proposed.In order to solve the technical problem existed in background technology, the embodiment of the present invention provides a kind of image processing method, the method of new three-dimensional (3D) filtering is have employed in this image processing method, for current electronic equipment as mobile phone photograph system, well can not only remove noise, and well can keep image border, greatly improve the quality of photo.Three-dimensional (3D) filtering method is in fact actual in 3D (interframe) image processing method, by contrasting each two field picture opposite position pixel value difference, judges whether to carry out 3D noise reduction; Compared to denoising method and the 3D noise-reduction method of existing mobile phone, the embodiment of the present invention does not need to carry out estimation to image, has that amount of calculation is little, cost is low and algorithm is a little understandable, and process of taking pictures in real time on mobile phone.

Below in conjunction with the drawings and specific embodiments, the technical solution of the present invention is further elaborated.

Embodiment one

In order to solve aforesaid technical problem, the embodiment of the present invention provides a kind of image processing method, this image processing method is applied to terminal, the function that the method realizes can be realized by the processor caller code in terminal, certain program code can be kept in computer-readable storage medium, visible, this terminal at least comprises processor and storage medium.

Fig. 1-3 is the realization flow schematic diagram of the embodiment of the present invention one image processing method, and as Figure 1-3, this image processing method comprises:

Step S101, obtains continuous print N two field picture;

Here, described N be more than or equal to 3 integer, the data acquisition of described N two field picture represents with color model, and described color model comprises M color component, described M be more than or equal to 1 integer;

Here, described terminal comprises the electronic equipment such as mobile phone, panel computer;

Here, described N two field picture is for the N frame captured by same target, is need environmental condition to be more or less the same in this implied condition, be such as identical place with for identical object, described N two field picture can be the shooting of other electronic equipments, stores on the terminal.Certainly can also be the image acquisition units of this terminal oneself captured by camera, therefore, before step S101, described method also comprises: for same target, continuously shooting N two field picture.

Step S102, determines that from described N two field picture a frame is as reference frame, is defined as by (N-1) two field picture except described reference frame contrasting frame;

Step S103, contrasts the pixel value Q1 (i, j) of described reference frame first pixel on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component, obtains comparing result;

Here, described first pixel (i, j) is any one pixel, and described first color component is any one color component of a described M color component, and for YUV colour model, the first color component can be Y-component or U component or V component.

Step S104, determines the pixel value of the first pixel on the first color component according to described comparing result, obtain the pixel value of remaining whole pixel on the first color component according to this;

Step S105, analogizes in the mode obtaining pixel value on the first color component, obtains the pixel value of the whole pixels on other color components except described first color component;

Step S106, forms a two field picture by the pixel value of pixel whole on a described M color component.

In the embodiment of the present invention, step S103, described by the pixel value Q1 (i of described reference frame first pixel on the first color component, pixel value Q0 (the i of the first pixel j) and in contrast frame on the first color component, j) contrast, obtain comparing result, comprising:

Step S131, the pixel value Q1 (i, j) of first pixel of reference frame on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component carry out doing difference by step, obtain difference z (i, j);

Step S132, judges described difference z (i, j) whether within the scope of the first threshold preset, obtains judged result.

Step S133, when described judged result shows to have at least a described difference z (i, j) within the scope of the first threshold preset, determines the first sets of pixel values;

Here, described first set of pixels be combined into described difference z (i, j) within the scope of the first threshold preset time corresponding Q0 (i, j); The pixel value of the pixel of a two field picture in described N two field picture is at least comprised in described first sets of pixel values.

Step S134, carries out arithmetic average by described Q1 (i, j) and the first sets of pixel values, obtains the pixel value Q (i, j) of the first pixel on the first color component.

In the embodiment of the present invention, as a kind of preferred embodiment mode, described N is 4, when N equals 4, do sums average in, calculate than being easier to because 4 be just in time 2 square, so arithmetic average only needs mobile two.As N=8, also can to bring in this calculating easy, but the comparison of 8 two field pictures is cumbersome, and amount of calculation also can be multiplied simultaneously.

Embodiment two

This image processing method comprises:

Step S201, obtains continuous print N two field picture;

Step S202, determines that from described N two field picture a frame is as reference frame, is defined as by (N-1) two field picture except described reference frame contrasting frame;

Step S203, the pixel value Q1 (i, j) of first pixel of reference frame on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are carried out doing difference, obtain difference z (i, j);

Step S204, judges described difference z (i, j) whether within the scope of the first threshold preset, obtains judged result.

Step S205, when described judged result shows to have at least a described difference z (i, j) within the scope of the first threshold preset, chooses an image block using Q1 (i, j) as central point;

Here, described image block is one of following:

Step S206, determines the second sets of pixel values in described image block, and described second sets of pixel values is the pixel meeting the pixel value within the scope of default Second Threshold in image block;

Step S207, described Q1 (i, j) and the second sets of pixel values are carried out arithmetic average, obtains the pixel value Q (i of the first pixel on the first color component, j), the pixel value of remaining whole pixel on the first color component is obtained according to this;

Step S208, analogizes in the mode obtaining pixel value on the first color component, obtains the pixel value of the whole pixels on other color components except described first color component;

Step S209, forms a two field picture by the pixel value of pixel whole on a described M color component.

Embodiment three

Based on aforesaid embodiment, the embodiment of the present invention provides a kind of image processing method, and Fig. 2 is the realization flow schematic diagram of the embodiment of the present invention three image processing method, and as shown in Figure 2, the method comprises the following steps:

Step S301, obtains continuous print four two field picture yuv data from mobile phone EMS memory;

Here, in general, in mobile phone, the storage of image adopts YUV model, for yuv data in the embodiment of the present invention, for other colour model, with YUV model class seemingly, therefore repeat no more.Yuv data is a kind of colour coding method, in modern color television system, usual employing three pipe colour camera or colored CCD video camera carry out capture, then the color picture signal obtained is obtained RGB (RGB) after color separation, respectively amplification correction, brightness signal Y and two color difference signal B-Y (i.e. U), R-Y (i.e. V) is obtained again through matrixer, brightness and aberration three signals are encoded by last transmitting terminal respectively, send with same channel.The method for expressing of this color is exactly that so-called YUV color space represents.The importance of YUV color space is adopted to be that its brightness signal Y is separated with carrier chrominance signal U, V.

Here, to handset image yuv data stream, obtain adjacent four frames continuously and lock.

Step S302, utilizes four two field pictures to carry out YUV denoising;

Here, tradition Denoising Algorithm comprises 3D noise reduction etc. the Denoising Algorithm of average, intermediate value, Gauss, bilateral filtering, band estimation, wherein bilateral filtering can removal noise while good preserving edge, but when noise ratio is larger, filter effect is not obvious, and amount of calculation is very large; When filter window increases, be difficult to accomplish real-time process; Average, intermediate value and Gauss can filtering noises preferably, but be easy to fuzzy fall edge, and along with the increase of filter window, be also difficult to accomplish real-time process.The 3D noise reduction of existing band estimation, first will carry out estimation, is then carrying out 3D denoising, and estimation needs very large amount of calculation, and can not ensure absolutely accuracy.3D Denoising Algorithm used in this step has effectively evaded estimation, thus makes the little and easy to understand of amount of calculation.

Step S303, yuv data denoising obtained exports, image as a result;

Be specifically described above-mentioned step S302 below, step S302 comprises:

Step S321, to the continuous print four frame YUV image obtained, is encoded to img1, img2, img3 and img4 respectively.

Step S322, using in four two field pictures any one as benchmark image, for example, using img1 as benchmark image, then utilize img2, img3 and img4 to carry out noise reduction process to img1.

Here, the essence of 3D noise reduction is same pixel, be not subject to noise pollution degree varies sample in the same time, and noise generally obeys the Gaussian noise that average is zero, therefore to a pixel not value be in the same time averaged operation, result will trend towards the actual value of this pixel.But due to mobile phone take pictures time, movement is more or less had between four two field pictures, namely such as the first pixel p 1 at img1 mid point (3,3) place, and it may will be (3,4) or (2 in img2,3) or other positions, its in img3 and img4 position too, all likely no longer position (3,3); Like this, if no longer same position, directly carry out being averaged operation, image border will certainly be caused to misplace; And if not only amount of calculation is large directly to use estimation, and estimation also has deviation in the scene that details is a lot.And a kind of noise-reduction method of the present embodiment proposition below, walk around traditional estimation, adopt a kind of new determination methods to carry out alternative estimation, carry out denoising according to judged result.

Step S323, travels through the Y-component of four two field pictures, U component and V component information respectively, judges, then determine filtering mode to each respective pixel of four two field pictures.

Here, be all similar because these three components calculate process, therefore in the following embodiments, be described for Y-component, for U component and V component, refer to Y-component.Below with pixel (i, j) for example is described, as pixel (i, j) after having processed, can the whole view data of searching loop, each pixel can carry out denoising according to the mode of pixel (i, j), using final denoising result as exporting.Introduce the processing procedure of pixel (i, j) below:

1) if reference frame pixel Y1 is (i, j) with Y2 (i, j), Y3 (i, j), Y4 (i, in absolute value three value of difference j), all in some scopes, then in result images, the value of current pixel point just equals the average of four two field picture corresponding pixel points; Wherein, Y1 (i, j) represents the pixel (i of img1, j) Y-component, Y2 (i, j) represents the Y-component of the pixel (i, j) of img2, Y3 (i, j) Y-component of the pixel (i, j) of img3 is represented, Y4 (i, j) Y-component of the pixel (i, j) of img4 is represented.

2) if reference frame pixel Y1 is (i, j) with Y2 (i, j), Y3 (i, j), Y4 (i, in absolute value three value of difference j), only have certain two in a certain scope, then in result images, the value of current pixel point just equals two frames within the scope of this and reference frame, the average of three frame corresponding pixel points.Such as Y1 (i, j) with Y2 (i, j), Y3 (i, j) absolute difference in certain scope, and Y1 (i, j) with Y4 (i, j) absolute difference is not in this scope, and in result images, the value of current pixel point just equals Y1 (i, j) and Y2 (i, j), the average of Y3 (i, j).If is Y2 (i, j) and Y3 (i, j) not within the scope of one, processing method is the same.

3) if reference frame pixel Y1 is (i, j) with Y2 (i, j), Y3 (i, j), Y4 (i, in absolute value three value of difference j), only have one in a certain scope, then in result images, the value of current pixel point just equals frame within the scope of this and reference frame, the average of two frame corresponding pixel points.Such as Y1 (i, j) with Y2 (i, j) absolute difference is in certain scope, and Y1 (i, j) and Y3 (i, j), Y4 (i, j) absolute difference is not in this scope, in result images, the value of current pixel point just equals the average of Y1 (i, j) and Y2 (i, j).Other are similar.

4) if reference frame pixel Y1 is (i, j) with Y2 (i, j) during, the absolute value three of the difference of Y3 (i, j), Y4 (i, j) is worth, neither one is in preset range, then in the following method filtering is carried out to Y1 (i, j), namely choose Y1 (i, j) a certain size region around, as 3 × 3 or 5 × 5 or 7 × 7 etc.

Explain for 3 × 3 size area: as shown in Figure 3, P22 is band filtered pixel point Y1 (i, j), and other are the value around it.Choose in these nine values and participate in filtering with the absolute value of P22 difference at the original value that the value of some scopes is corresponding, these values are averaged as final filter value, as shown in Figure 4, in Fig. 4, pending point is 5, if the absolute value range of difference is set as 2, namely absolute difference is less than or equal to the numerical value participation calculating of 2 correspondences, and namely 3,4,5,6 and 7 five numerical value participate in calculating, and then ask the average of this 5 number as final result.

As can be seen from above description, the technical scheme of the embodiment of the present invention can be eliminated existing denoising effect difference and easily cause the shortcoming such as loss of edge details, and making finally takes pictures obtains picture better visual effect.

In the embodiment of the present invention, first from mobile phone EMS memory, obtain four two field picture yuv datas continuously; Four two field pictures are utilized to carry out YUV denoising; Yuv data denoising obtained exports, image as a result.Wherein, focus on to a pixel not value be in the same time averaged operation, walk around traditional estimation, avoid the problem of traditional method for estimating " not only amount of calculation is large, and estimation also has deviation in the scene that details is a lot ".In the process of denoising, by contrasting each two field picture opposite position pixel value difference, judge whether to carry out 3D noise reduction; Compared to existing mobile phone denoising method and 3D noise-reduction method, this method does not need to carry out estimation to image, and amount of calculation is little, cost is low, algorithm easy to understand, and process of taking pictures in real time on mobile phone.

Embodiment four

Based on aforesaid embodiment, the embodiment of the present invention provides a kind of image processing apparatus, each unit included by this device, and each module included by each unit, can be realized by the processor in terminal, certainly also realizes by concrete logical circuit; In the process of specific embodiment, processor can be central processing unit (CPU), microprocessor (MPU), digital signal processor (DSP) or field programmable gate array (FPGA) etc.

Fig. 5 is the composition structural representation of the embodiment of the present invention four image processing apparatus, as shown in Figure 5, this device 400 comprises acquiring unit 401, first determining unit 402, contrast unit 403, second determining unit 404, first processing unit 405, second processing unit 406 and component units 407, wherein:

Described acquiring unit 401, for obtaining continuous print N two field picture, described N be more than or equal to 3 integer, the data acquisition of described N two field picture represents with color model, and described color model comprises M color component, described M be more than or equal to 1 integer;

Described first determining unit 402, for determining that from described N two field picture a frame is as reference frame, is defined as (N-1) two field picture except described reference frame contrasting frame;

Described contrast unit 403, for the pixel value Q1 (i by described reference frame first pixel on the first color component, j) contrast with the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component, obtain comparing result; Described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one color component of a described M color component;

Described second determining unit 404, for determining the pixel value of the first pixel on the first color component according to described comparing result;

Described first processing unit 405, for the processing procedure according to described contrast unit and described second determining unit, obtains the pixel value of remaining whole pixel on the first color component;

Described second processing unit 406, for the processing procedure according to described contrast unit, described second determining unit and the first processing unit, obtains the pixel value of the whole pixels on other color components except described first color component;

Described component units 407, for forming a two field picture by the pixel value of pixel whole on the pixel value of pixel whole on the first color component and other color components.

In the embodiment of the present invention, described device also comprises shooting unit, for for same target, takes N two field picture continuously.

Embodiment five

This device 400 comprises acquiring unit 401, first determining unit 402, contrast unit 403, second determining unit 404, first processing unit 405, second processing unit 406 and component units 407, wherein contrasted unit 403 comprises and does differential mode block 431 and judge module 432, described second determining unit 404 comprises the first determination module 441 and the first averaging module 442, wherein:

Describedly do differential mode block 431, for the pixel value Q1 (i, j) of first pixel of reference frame on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are carried out doing difference, obtain difference z (i, j);

Here, described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one color component of a described M color component; Wherein i and j be more than or equal to 0 integer;

Described judge module 432, for judging described difference z (i, j) whether within the scope of the first threshold preset, obtains judged result.

Described first determination module 441, for showing to have a described difference z (i at least when described judged result, j) time within the scope of the first threshold preset, determine the first sets of pixel values, described first set of pixels is combined into described difference z (i, j) Q0 (i, j) corresponding time within the scope of the first threshold preset;

Described first averaging module 442, for described Q1 (i, j) and the first sets of pixel values are carried out arithmetic average, obtains the pixel value Q (i, j) of the first pixel on the first color component.

Described first processing unit 405, for the processing procedure according to each module in described contrast unit and described second determining unit, obtains the pixel value of remaining whole pixel on the first color component;

Described second processing unit 406, for the processing procedure according to each module in described contrast unit, described second determining unit and the first processing unit, obtains the pixel value of the whole pixels on other color components except described first color component;

Embodiment four

This device 400 comprises acquiring unit 401, first determining unit 402, contrast unit 403, second determining unit 404, first processing unit 405, second processing unit 406 and component units 407, wherein contrasted unit 403 comprises and does differential mode block 431 and judge module 432, described second determining unit 404 comprises chooses module 443, first determination module 444 and the first averaging module 445, wherein:

Here, described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one color component of a described M color component;

Describedly choose module 443, during for showing to have at least a described difference z (i, j) within the scope of the first threshold preset when described judged result, Q1 (i, j) is chosen an image block as central point;

Described second determination module 444, for determining the second sets of pixel values in described image block, described second sets of pixel values is the pixel meeting the pixel value within the scope of default Second Threshold in image block;

Described second averaging module 445, for described Q1 (i, j) and the second sets of pixel values are carried out arithmetic average, obtains the pixel value Q (i, j) of the first pixel on the first color component.

In the embodiment of the present invention, described image block is one of following:

In the embodiment of the present invention, described N is 4.

Here it is to be noted: the description of above device embodiment is similar with the description of said method embodiment, has the beneficial effect that same embodiment of the method is similar, does not therefore repeat.For the ins and outs do not disclosed in apparatus of the present invention embodiment, please refer to the description of the inventive method embodiment and understand, for saving length, therefore repeating no more.

Embodiment six

Based on aforesaid embodiment, the embodiment of the present invention reoffers a kind of terminal, and this terminal comprises image acquisition units, memory and processor, wherein:

Image acquisition units, for for same target, takes N two field picture, continuously to obtain continuous print N two field picture;

Described memory, for storing continuous print N two field picture;

Described processor, for for same target, calls image acquisition units and takes N two field picture continuously; Obtain continuous print N two field picture from memory, described N be more than or equal to 3 integer, the data acquisition of described N two field picture represents with color model, and described color model comprises M color component, described M be more than or equal to 1 integer; From described N two field picture, determine that a frame is as reference frame, (N-1) two field picture except described reference frame is defined as contrast frame; The pixel value Q1 (i, j) of described reference frame first pixel on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are contrasted, obtains comparing result; Described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one color component of a described M color component; Determine the pixel value of the first pixel on the first color component according to described comparing result, obtain the pixel value of remaining whole pixel on the first color component according to this; Analogize in the mode obtaining pixel value on the first color component, obtain the pixel value of the whole pixels on other color components except described first color component; The pixel value of pixel whole on a described M color component is formed a two field picture.

Here it is to be noted: the description of above electronic equipment embodiment item, it is similar for describing with said method, has the beneficial effect that same embodiment of the method is identical, does not therefore repeat.For the ins and outs do not disclosed in electronic equipment embodiment of the present invention, those skilled in the art please refer to the description of the inventive method embodiment and understands, and for saving length, repeats no more here.

Should be understood that during specification in the whole text that " embodiment " or " embodiment " mentioned means that the special characteristic relevant with embodiment, structure or characteristic comprise at least one embodiment of the present invention.Therefore, " in one embodiment " or " in one embodiment " that occur everywhere at whole specification does not necessarily refer to identical embodiment.In addition, these specific feature, structure or characteristics can combine in one or more embodiments in any suitable manner.Should understand, in various embodiments of the present invention, the size of the sequence number of above-mentioned each process does not also mean that the priority of execution sequence, and the execution sequence of each process should be determined with its function and internal logic, and should not form any restriction to the implementation process of the embodiment of the present invention.The invention described above embodiment sequence number, just to describing, does not represent the quality of embodiment.

It should be noted that, in this article, term " comprises ", " comprising " or its any other variant are intended to contain comprising of nonexcludability, thus make to comprise the process of a series of key element, method, article or device and not only comprise those key elements, but also comprise other key elements clearly do not listed, or also comprise by the intrinsic key element of this process, method, article or device.When not more restrictions, the key element limited by statement " comprising ... ", and be not precluded within process, method, article or the device comprising this key element and also there is other identical element.

In several embodiments that the application provides, should be understood that disclosed equipment and method can realize by another way.Apparatus embodiments described above is only schematic, such as, the division of described unit, be only a kind of logic function to divide, actual can have other dividing mode when realizing, and as: multiple unit or assembly can be in conjunction with, maybe can be integrated into another system, or some features can be ignored, or do not perform.In addition, the coupling each other of shown or discussed each part or direct-coupling or communication connection can be by some interfaces, and the indirect coupling of equipment or unit or communication connection can be electrical, machinery or other form.

The above-mentioned unit illustrated as separating component or can may not be and physically separates, and the parts as unit display can be or may not be physical location; Both can be positioned at a place, also can be distributed in multiple network element; Part or all of unit wherein can be selected according to the actual needs to realize the object of the present embodiment scheme.

In addition, each functional unit in various embodiments of the present invention can all be integrated in a processing unit, also can be each unit individually as a unit, also can two or more unit in a unit integrated; Above-mentioned integrated unit both can adopt the form of hardware to realize, and the form that hardware also can be adopted to add SFU software functional unit realizes.

One of ordinary skill in the art will appreciate that: all or part of step realizing said method embodiment can have been come by the hardware that program command is relevant, aforesaid program can be stored in computer read/write memory medium, this program, when performing, performs the step comprising said method embodiment; And aforesaid storage medium comprises: movable storage device, read-only memory (ReadOnlyMemory, ROM), magnetic disc or CD etc. various can be program code stored medium.

Or, if the above-mentioned integrated unit of the present invention using the form of software function module realize and as independently production marketing or use time, also can be stored in a computer read/write memory medium.Based on such understanding, the technical scheme of the embodiment of the present invention can embody with the form of software product the part that prior art contributes in essence in other words, this computer software product is stored in a storage medium, comprises some instructions and performs all or part of of method described in each embodiment of the present invention in order to make a computer equipment (can be personal computer, server or the network equipment etc.).And aforesaid storage medium comprises: movable storage device, ROM, magnetic disc or CD etc. various can be program code stored medium.

The above; be only the specific embodiment of the present invention, but protection scope of the present invention is not limited thereto, is anyly familiar with those skilled in the art in the technical scope that the present invention discloses; change can be expected easily or replace, all should be encompassed within protection scope of the present invention.Therefore, protection scope of the present invention should be as the criterion with the protection range of described claim.

Claims

1. an image processing method, is characterized in that, described method comprises:

The pixel value of the whole pixels on other color components obtaining except described first color component in the mode obtaining pixel value on the first color component;

2. method according to claim 1, is characterized in that, described method also comprises:

For same target, shooting N two field picture continuously.

3. method according to claim 1 and 2, it is characterized in that, described by the pixel value Q1 (i of described reference frame first pixel on the first color component, pixel value Q0 (the i of the first pixel j) and in contrast frame on the first color component, j) contrast, obtain comparing result, comprising:

4. method according to claim 3, is characterized in that, determines the pixel value of the first pixel on the first color component, comprising according to described comparing result:

5. method according to claim 4, is characterized in that, determines the pixel value of the first pixel on the first color component, comprising according to described comparing result:

6. method according to claim 5, is characterized in that, described image block is one of following:

7. the method according to any one of claim 1 to 6, is characterized in that, described N is 4.

8. an image processing apparatus, is characterized in that, described device comprises acquiring unit, the first determining unit, contrast unit, the second determining unit, the first processing unit, the second processing unit and component units, wherein:

Described second processing unit, for the processing procedure according to described contrast unit, described second determining unit and the first processing unit, obtains the pixel value of the whole pixels on other components except described first color component;

9. device according to claim 8, is characterized in that, described contrast unit comprises and does differential mode block and judge module, wherein:

10. a terminal, is characterized in that, described terminal comprises memory and processor, wherein:

Described memory, for storing continuous print N two field picture;

Described processor, for obtaining continuous print N two field picture, described N be more than or equal to 3 integer, the data acquisition of described N two field picture represents with color model, and described color model comprises M color component, described M be more than or equal to 1 integer; From described N two field picture, determine that a frame is as reference frame, (N-1) two field picture except described reference frame is defined as contrast frame; The pixel value Q1 (i, j) of described reference frame first pixel on the first color component and the pixel value Q0 (i, j) of the first pixel contrasted in frame on the first color component are contrasted, obtains comparing result; Described first pixel is that in described N two field picture, coordinate is the pixel of (i, j), and described first color component is any one color component of a described M color component; Determine the pixel value of the first pixel on the first color component according to described comparing result, obtain the pixel value of remaining whole pixel on the first color component according to this; Analogize in the mode obtaining pixel value on the first color component, obtain the pixel value of the whole pixels on other color components except described first color component; The pixel value of pixel whole on a described M color component is formed a two field picture.