CN107222681B - A kind of processing method and mobile terminal of image data - Google Patents
A kind of processing method and mobile terminal of image data Download PDFInfo
- Publication number
- CN107222681B CN107222681B CN201710528150.3A CN201710528150A CN107222681B CN 107222681 B CN107222681 B CN 107222681B CN 201710528150 A CN201710528150 A CN 201710528150A CN 107222681 B CN107222681 B CN 107222681B
- Authority
- CN
- China
- Prior art keywords
- image
- region
- dsp
- isp
- zoom request
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the invention provides a kind of processing method of image data and mobile terminal, the mobile terminal includes the digital signal processor DSP being connected with camera and image-signal processor ISP, the method includes：The DSP obtains the image data of the camera output；Receive zoom request；Determine image-region corresponding to the zoom request；Determine the corresponding penalty coefficient in described image region；Lens Shading Compensation is carried out to described image region using the penalty coefficient；Image-region after the progress Lens Shading Compensation is sent to ISP.The embodiment of the present invention carries out Lens Shading Compensation in DSP in advance, so that not having to carry out Lens Shading Compensation in ISP platform, solves the problems, such as overcompensation.
Description
Technical field
The present invention relates to fields of communication technology, more particularly to the processing method and mobile terminal of a kind of image data.
Background technique
Existing mobile terminal increasingly values camera and takes pictures the performance of imaging effect, the noise of image and clarity, this
The prime competing factor of businessman is also increasingly becomed a bit.
The image processing techniques of the platform processor manufacturer of mobile terminal is different in detail at present, but general place
Reason method is：By ISP (Image Signal Processing, image signal process) carry out image procossing obtain RGB,
After the image data of the formats such as YUV, the denoising of image data and the promotion of clarity are then carried out.
Although image data, can be by Gauss-Poisson model after sensor (sensor) output in camera module
Carry out data description, but after ISP carries out image procossing, the noise characteristic of image data becomes more complicated, it is difficult to
Processing, influences final image quality.
Summary of the invention
The embodiment of the present invention provides the method and mobile terminal of a kind of image data, and to solve image data, only ISP is handled,
The noise characteristic of image data is complicated, leads to the problem that final image is of low quality.
In a first aspect, providing a kind of processing method of image data, it is applied to mobile terminal, the mobile terminal includes
The digital signal processor DSP being connected with camera and image-signal processor ISP, the method includes：
The DSP obtains the image data of the camera output；
Receive zoom request；
Determine image-region corresponding to the zoom request；
Determine the corresponding penalty coefficient in described image region；
Lens Shading Compensation is carried out to described image region using the penalty coefficient；
Image-region after the progress Lens Shading Compensation is sent to ISP.
Second aspect, provides a kind of mobile terminal, and the mobile terminal includes and camera and image-signal processor
The digital signal processor DSP that ISP is connected, the mobile terminal include：
Image data acquisition module, for obtaining the image data of the camera output in the DSP；
Zoom request receiving module, for receiving zoom request；
Image-region mould determines block, for determining image-region corresponding to the zoom request；
Penalty coefficient determining module, for determining the corresponding penalty coefficient in described image region；
Lens Shading Compensation module, for carrying out Lens Shading Compensation to described image region using the penalty coefficient；
Image-region sending module, for the image-region after the progress Lens Shading Compensation to be sent to ISP.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
If embodiment receives the zoom request of user when DSP platform receives the image data of camera output, it can be based on
Then the zoomed image region of zoom request image data removes the penalty coefficient for determining image-region again, and is based on penalty coefficient
For image-region carry out Lens Shading Compensation, finally export to ISP and be further processed, the embodiment of the present invention in advance DSP into
Row Lens Shading Compensation solves the problems, such as overcompensation so that not having to carry out Lens Shading Compensation in ISP platform.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention
Example, for those of ordinary skill in the art, without any creative labor, can also be according to these attached drawings
Obtain other attached drawings.
Fig. 1 is a kind of step flow chart of the processing method embodiment of image data of the embodiment of the present invention one；
Fig. 2 is a kind of image processing flow figure based on DSP and ISP of the invention；
Fig. 3 is a kind of structural block diagram of mobile terminal embodiment of the embodiment of the present invention two；
Fig. 4 is the block diagram of the mobile terminal of another embodiment of the present invention；
Fig. 5 is the structural schematic diagram of the mobile terminal of another embodiment of the invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
The embodiment of the present invention adds DSP (Digital Signal on the basis of the hardware frame of original mobile terminal
Processing, digital signal processor) so that image data is entering ISP (Image Signal Processing, image
Signal processing) before, it can be realized more image processing functions, promote the picture quality of image data.Specifically, camera
Camera module in there is sensor (sensor), be provided in mobile terminal and be connected with the sensor of camera and ISP
DSP.In general, the unit that ISP is used as the sensor output signal of camera to handle in the terminal, to match different vendor
sensor。
Wherein, between DSP, sensor and ISP, MIPI (Mobile Industry Processor can be passed through
Interface, mobile industry processor interface) connection, MIPI by the interface of interior of mobile phone such as camera, display screen interface, penetrate
The standardization such as frequently/baseband interface, it is possible to reduce the complexity and increase design flexibility of Cell Phone Design.Certainly, DSP,
It can also be attached by other interfaces between sensor and ISP, the embodiment of the present invention need not be limit to this.
The DSP hardware module of the embodiment of the present invention, be the section RAW (such as to for the formats such as Bayer format RAW figure
As being handled, RAW image is converted into the formats such as YUV due to not carrying out in ISP, and data volume is more, and detailed information is rich
It is rich) image data carry out the operation such as denoising, allow image data before entering ISP, just there is relatively good noise to show, and
Handle image data by DSP, relative to for ISP is handled speed it is fast, and DSP can also use many algorithms realize it is more
Kind function.By pre-processing in DSP for image data, reduction reduces back-end processing difficulty in ISP treatment process,
Finally obtain better image quality.
ISP is can integrate in AP (Application Processor, application processor), is also possible to independent
Chip, the embodiment of the present invention need not be limit to this, retransmits and is carried out at ISP after the RAW image that DSP obtains result
Reason, so that image data is more clear, nature and beauty.
In summary, the embodiment of the present invention is added in mobile phone to improve the performances of the mobile terminal cameras such as mobile phone
DSP, substitution part is using the algorithm of software processing image, so that processing speed be made more to accelerate, use is more smooth.Wherein, it wraps
It includes and carrys out alternate process image zoom using DSP (zoom refers to scaling, i.e., image is zoomed in or out, the effect of generation
Be allow user feel push towards or zoom out focal length when taking pictures) enhancing software approach, be also related to other software processing figure certainly
Image space method.But accompanying problem is that, if DSP is in platform ISP leading portion, inevitably lead to the lsc of image
(Lens Shading Correction, Lens Shading Compensation) problem, surrounding brightness is partially bright, and compensation is excessive.
Specifically, the reason that surrounding brightness is partially bright, compensation is excessive is caused to be described below：
First, since the imaging of CCM (CMOS Camera Module, complementary metal oxide semiconductor camera module) is held
The principle of camera lens surrounding brightness decay is easily led to, and the brightness that sensor imaging will lead among the brightness ratio image of surrounding is low.
And the prior art passes through ISP mostly and compensates image surrounding.
Second, if being zoom at the end DSP, image is amplified, and then screenshot obtains defeated with original image image of the same size
Out, the enhancing coefficient of the corresponding enhancing degree of the image surrounding and ISP is not just mutually corresponding.This method will lead to originally need compared with
The image-region of small enhancing coefficient, the biggish enhancing coefficient of practical application, and four weekly assembly of image became bright, led to figure
Image brightness is abnormal.
To solve the above-mentioned problems, the embodiment of the present invention introduces lsc algorithm at the end DSP, according to different zoom ratio
(scaling), modifies the calibration table of lsc, to avoid being lsc in platform end i.e. ISP, causes image surrounding is partially bright to ask
Topic.
Embodiment one
Referring to Fig.1, a kind of step flow chart of the processing method embodiment of image data of the invention is shown, is applied to
Mobile terminal, the mobile terminal include the digital signal processor being connected with camera and image-signal processor ISP
DSP, the method can specifically include following steps：
Step 101, the DSP obtains the image data of the camera output；
In embodiments of the present invention, the available image data to camera output of DSP.Enter ISP in image data
Before, instructions or requests can be in advance based on to handle image data.
Step 102, zoom request is received；
User for the ease of watch image data some part when, can choose scaling appropriate and carry out enlarged drawing
Picture will generate zoom request based on scaling at this time, it will image data is zoomed in or out based on scaling
Operation.
Step 103, image-region corresponding to the zoom request is determined；
It, can be based on corresponding image-region in zoom request interception image data in the embodiment of the present invention.Image four at this time
Week corresponding enhancing degree and different in the enhancing coefficient of ISP in the past, no longer reciprocal correspondence.For example, it may be possible to need originally
Want the region of lesser enhancing coefficient (penalty coefficient), the biggish enhancing coefficient of practical application；Four weekly assembly of image became bright,
Cause brightness of image abnormal.So the present invention needs to further determine that the penalty coefficient of the brightness of image-region at DSP.
Step 104, the corresponding penalty coefficient in described image region is determined；
When DPS determines penalty coefficient again, it can be based on image-region and adjust determination, be also possible to based on default
Lens Shading Compensation numerical value adjust determination.
In one preferred embodiment of the invention, the step 104 may include：
Scaling is extracted from the zoom request；
The default Lens Shading Compensation numerical value is adjusted according to the scaling；
It is sub-image area by described image region division；
Obtain the corresponding penalty coefficient in the sub-image area respectively from default Lens Shading Compensation numerical value.
Above-mentioned Lens Shading Compensation numerical value is embodied in lsc table (Lens Shading Compensation table), is a table,
Each piece of zonule in each of table penalty coefficient correspondence image.It, correspondingly, can also be with if image scales
Each penalty coefficient in lsc table is also scaled, in this way image-region or one corresponding to each penalty coefficient
Sample.This corresponding relationship does not change, then image surrounding would not be caused partially bright, the problem of overcompensation.
Step 105, Lens Shading Compensation is carried out to described image region using the penalty coefficient；
After the penalty coefficient of image-region has been determined in DSP, so that it may image-region be carried out based on penalty coefficient
Lens Shading Compensation, i.e. promotion brightness of image.
Step 106, the image-region after the progress Lens Shading Compensation is sent to ISP.
After DSP completion handles to obtain original data, which is sent by MIPI interface
It is handled in next step to ISP progress.
It should be noted that due to having completed Lens Shading Compensation in DSP in the embodiment of the present invention, so, ISP is not necessarily to
Lens Shading Compensation is carried out to the image-region after DSP adjusts brightness.
In order to preferably show that the embodiment of the present invention carries out the difference of lsc, Ke Yican in DSP progress lsc, and in ISP
According to Fig. 2.
General image processing method, i.e., ISP carry out lsc process be：Sensor exports image data extremely
Image data is exported to ISP carry out lsc again by DSP, DSP.The improved image processing method of the embodiment of the present invention, that is, exist
DSP carry out lsc process be：Sensor, which exports image data, can adaptively adjust lsc according to zoom ratio to DSP, DSP
The lsc penalty coefficient of table simultaneously completes Lens Shading Compensation based on penalty coefficient, then does not need to carry out camera lens shade benefit in ISP
It repays.Using the new method of the embodiment of the present invention, avoid after finishing scaling at DSP, after ISP platform end carries out lsc calibration,
Cause image surrounding partially bright, the problem of overcompensation.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
If embodiment receives the zoom request of user when DSP platform receives the image data of camera output, it can be based on
Then the zoomed image region of zoom request image data removes the penalty coefficient for determining image-region again, and is based on penalty coefficient
For image-region carry out Lens Shading Compensation, finally export to ISP and be further processed, the embodiment of the present invention in advance DSP into
Row Lens Shading Compensation solves the problems, such as overcompensation so that not having to carry out Lens Shading Compensation in ISP platform.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to
According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented
Necessary to example.
Referring to Fig. 3, show a kind of structural block diagram of mobile terminal embodiment of the invention, the mobile terminal include with
The digital signal processor DSP that camera is connected with image-signal processor ISP, the mobile terminal can specifically include as
Lower module：
Image data acquisition module 201, for obtaining the image data of the camera output in the DSP；
Zoom request receiving module 202, for receiving zoom request；
Image-region mould determines block 203, for determining image-region corresponding to the zoom request；
Penalty coefficient determining module 204, for determining the corresponding penalty coefficient in described image region；
Lens Shading Compensation module 205, for carrying out camera lens shade benefit to described image region using the penalty coefficient
It repays；
Image-region sending module 206, for the image-region after the progress Lens Shading Compensation to be sent to ISP.
In one preferred embodiment of the invention, the penalty coefficient determining module 204 includes：
Sub-image area divides submodule, for being sub-image area by described image region division；
Penalty coefficient acquisition submodule, for obtaining the sub-image area respectively from default Lens Shading Compensation numerical value
Corresponding penalty coefficient.
In one preferred embodiment of the invention, further include：
Scaling extracting sub-module, for extracting scaling from the zoom request；
Default Lens Shading Compensation numerical value adjusting submodule, for according to the scaling adjustment default camera lens yin
Shadow compensates numerical value.
In one preferred embodiment of the invention, the zoom request receiving module includes：
Zoom request generates submodule, for being based on the contracting when user's selection is directed to the scaling of image data
It puts ratio and generates zoom request；
Zoom request sending submodule, for the zoom request to be sent in the DSP.
In one preferred embodiment of the invention, the DSP is connected to institute by Mobile Industry Processor Interface MIPI
It states between camera and the ISP.
For mobile terminal embodiment, since it is basically similar to the method embodiment, so be described relatively simple,
The relevent part can refer to the partial explaination of embodiments of method.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
If embodiment receives the zoom request of user when DSP platform receives the image data of camera output, it can be based on
Then the zoomed image region of zoom request image data removes the penalty coefficient for determining image-region again, and is based on penalty coefficient
For image-region carry out Lens Shading Compensation, finally export to ISP and be further processed, the embodiment of the present invention in advance DSP into
Row Lens Shading Compensation solves the problems, such as overcompensation so that not having to carry out Lens Shading Compensation in ISP platform.
Embodiment three
Fig. 4 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 700 shown in Fig. 4 includes：At least
One processor 701, memory 702, at least one network interface 704 and other users interface 703.In mobile terminal 700
Various components are coupled by bus system 705.It is understood that bus system 705 is for realizing the company between these components
Connect letter.Bus system 705 further includes power bus, control bus and status signal bus in addition in addition to including data/address bus.But
It is that various buses are all designated as bus system 705 in Fig. 4 for the sake of clear explanation.
Wherein, user interface 703 may include display, keyboard or pointing device (for example, mouse, trace ball
(trackball), touch-sensitive plate or touch screen etc..
It is appreciated that the memory 702 in the embodiment of the present invention can be volatile memory or nonvolatile memory,
It or may include both volatile and non-volatile memories.Wherein, nonvolatile memory can be read-only memory (Read-
OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), Erasable Programmable Read Only Memory EPROM
(ErasablePROM, EPROM), electrically erasable programmable read-only memory (ElectricallyEPROM, EEPROM) dodge
It deposits.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is slow to be used as external high speed
It deposits.By exemplary but be not restricted explanation, the RAM of many forms is available, such as static random access memory
(StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory
(SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate
SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links
Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory
(DirectRambusRAM, DRRAM).The memory 702 of the system and method for description of the embodiment of the present invention is intended to include but unlimited
In the memory of these and any other suitable type.
In some embodiments, memory 702 stores following element, executable modules or data structures, or
Their subset of person or their superset：Operating system 7021 and application program 7022.
Wherein, operating system 7021 include various system programs, such as ccf layer, core library layer, driving layer etc., are used for
Realize various basic businesses and the hardware based task of processing.Application program 7022 includes various application programs, such as media
Player (MediaPlayer), browser (Browser) etc., for realizing various applied business.Realize embodiment of the present invention side
The program of method may be embodied in application program 7022.
In embodiments of the present invention, by the program or instruction of calling memory 702 to store, specifically, can be application
The program or instruction stored in program 7022, processor 701 are used to obtain the picture number of the camera output in the DSP
According to；Receive zoom request；Determine image-region corresponding to the zoom request；Determine the corresponding compensation system in described image region
Number；Lens Shading Compensation is carried out to described image region using the penalty coefficient；After the progress Lens Shading Compensation
Image-region is sent to ISP.
The method that the embodiments of the present invention disclose can be applied in processor 701, or be realized by processor 701.
Processor 701 may be a kind of IC chip, the processing capacity with signal.During realization, the above method it is each
Step can be completed by the integrated logic circuit of the hardware in processor 701 or the instruction of software form.Above-mentioned processing
Device 701 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), specific integrated circuit
(ApplicationSpecific IntegratedCircuit, ASIC), ready-made programmable gate array
(FieldProgrammableGateArray, FPGA) either other programmable logic device, discrete gate or transistor logic
Device, discrete hardware components.It may be implemented or execute disclosed each method, step and the logical box in the embodiment of the present invention
Figure.General processor can be microprocessor or the processor is also possible to any conventional processor etc..In conjunction with the present invention
The step of method disclosed in embodiment, can be embodied directly in hardware decoding processor and execute completion, or use decoding processor
In hardware and software module combination execute completion.Software module can be located at random access memory, and flash memory, read-only memory can
In the storage medium of this fields such as program read-only memory or electrically erasable programmable memory, register maturation.The storage
Medium is located at memory 702, and processor 701 reads the information in memory 702, and the step of the above method is completed in conjunction with its hardware
Suddenly.
It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware,
Microcode or combinations thereof is realized.For hardware realization, processing unit be may be implemented in one or more specific integrated circuits
(ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor
(DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device
(ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray,
FPGA), general processor, controller, microcontroller, microprocessor, other electronics lists for executing herein described function
In member or combinations thereof.
For software implementations, can by execute the embodiment of the present invention described in function module (such as process, function etc.) come
Realize technology described in the embodiment of the present invention.Software code is storable in memory and is executed by processor.Memory can
With portion realizes in the processor or outside the processor.
Optionally, processor 701 is also used to：It is sub-image area by described image region division；From default camera lens shade
The corresponding penalty coefficient in the sub-image area is obtained respectively in compensation numerical value.
Optionally, processor 701 is also used to：When user's selection is directed to the scaling of image data, it is based on the contracting
It puts ratio and generates zoom request；The zoom request is sent in the DSP.
Optionally, processor 701 is also used to：Scaling is extracted from the zoom request；According to the pantograph ratio
Example adjusts the default Lens Shading Compensation numerical value.
Mobile terminal 700 can be realized each process that mobile terminal is realized in previous embodiment, to avoid repeating, here
It repeats no more.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
If embodiment receives the zoom request of user when DSP platform receives the image data of camera output, it can be based on
Then the zoomed image region of zoom request image data removes the penalty coefficient for determining image-region again, and is based on penalty coefficient
For image-region carry out Lens Shading Compensation, finally export to ISP and be further processed, the embodiment of the present invention in advance DSP into
Row Lens Shading Compensation solves the problems, such as overcompensation so that not having to carry out Lens Shading Compensation in ISP platform.
Example IV
Fig. 5 is the structural schematic diagram of the mobile terminal of another embodiment of the present invention.Specifically, the mobile terminal in Fig. 5
800 can be mobile phone, tablet computer, personal digital assistant (PersonalDigital Assistant, PDA) or vehicle-mounted computer
Deng.
Mobile terminal 800 in Fig. 5 includes radio frequency (RadioFrequency, RF) circuit 810, memory 820, input list
Member 830, display unit 840, processor 860, voicefrequency circuit 870, WiFi (WirelessFidelity) module 880 and power supply
890。
Wherein, input unit 830 can be used for receiving the number or character information of user's input, and generation and mobile terminal
The related signal input of 800 user setting and function control.Specifically, in the embodiment of the present invention, which can
To include touch panel 831.Touch panel 831, also referred to as touch screen collect the touch operation of user on it or nearby
(for example user uses the operations of any suitable object or attachment on touch panel 831 such as finger, stylus), and according to preparatory
The formula of setting drives corresponding attachment device.Optionally, touch panel 831 may include touch detecting apparatus and touch controller
Two parts.Wherein, the touch orientation of touch detecting apparatus detection user, and touch operation bring signal is detected, by signal
Send touch controller to；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate,
The processor 860 is given again, and can be received order that processor 860 is sent and be executed.Furthermore, it is possible to using resistance-type,
The multiple types such as condenser type, infrared ray and surface acoustic wave realize touch panel 831.In addition to touch panel 831, input unit
830 can also include other input equipments 832, other input equipments 832 can include but is not limited to physical keyboard, function key
One of (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. are a variety of.
Wherein, display unit 840 can be used for showing information input by user or be supplied to the information and movement of user
The various menu interfaces of terminal 800.Display unit 840 may include display panel 841, optionally, can use LCD or organic hair
The forms such as optical diode (OrganicLight-EmittingDiode, OLED) configure display panel 841.
It should be noted that touch panel 831 can cover display panel 841, touch display screen is formed, when the touch display screen is examined
After measuring touch operation on it or nearby, processor 860 is sent to determine the type of touch event, is followed by subsequent processing device
860 provide corresponding visual output according to the type of touch event in touch display screen.
Touch display screen includes Application Program Interface viewing area and common control viewing area.The Application Program Interface viewing area
And arrangement mode of the common control viewing area does not limit, can be arranged above and below, left-right situs etc. can distinguish two it is aobvious
Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with
The interface elements such as the icon comprising at least one application program and/or widget desktop control.The Application Program Interface viewing area
Or the empty interface not comprising any content.This commonly uses control viewing area for showing the higher control of utilization rate, for example,
Application icons such as button, interface number, scroll bar, phone directory icon etc. are set.
Wherein processor 860 is the control centre of mobile terminal 800, utilizes various interfaces and connection whole mobile phone
Various pieces, by running or executing the software program and/or module that are stored in first memory 821, and calling storage
Data in second memory 822 execute the various functions and processing data of mobile terminal 800, thus to mobile terminal 800
Carry out integral monitoring.Optionally, processor 860 may include one or more processing units.
In embodiments of the present invention, by call store the first memory 821 in software program and/or module and/
Or the data in the second memory 822, processor 860 are used to obtain the image data of the camera output in the DSP；
Receive zoom request；Determine image-region corresponding to the zoom request；Determine the corresponding penalty coefficient in described image region；
Lens Shading Compensation is carried out to described image region using the penalty coefficient；By the image after the progress Lens Shading Compensation
Region is sent to ISP.
Optionally, the processor 860 is also used to, and is sub-image area by described image region division；From default camera lens
The corresponding penalty coefficient in the sub-image area is obtained in shadow compensation numerical value respectively.
Optionally, the processor 860 is also used to, and extracts scaling from the zoom request；According to the contracting
It puts ratio and adjusts the default Lens Shading Compensation numerical value.
Optionally, the processor 860 is also used to, and when user's selection is directed to the scaling of image data, is based on institute
It states scaling and generates zoom request；The zoom request is sent in the DSP.
For 800 embodiment of mobile terminal, since it is basically similar to the method embodiment, so the comparison of description is simple
Single, the relevent part can refer to the partial explaination of embodiments of method.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
If embodiment receives the zoom request of user when DSP platform receives the image data of camera output, it can be based on
Then the zoomed image region of zoom request image data removes the penalty coefficient for determining image-region again, and is based on penalty coefficient
For image-region carry out Lens Shading Compensation, finally export to ISP and be further processed, the embodiment of the present invention in advance DSP into
Row Lens Shading Compensation solves the problems, such as overcompensation so that not having to carry out Lens Shading Compensation in ISP platform.
Those of ordinary skill in the art may be aware that the embodiment in conjunction with disclosed in the embodiment of the present invention describe it is each
Exemplary unit and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In embodiment provided herein, it should be understood that disclosed device and method can pass through others
Mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the unit, only
A kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or components can combine or
Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual
Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of device or unit
It connects, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
And storage medium above-mentioned includes：USB flash disk, mobile hard disk, ROM, RAM, magnetic or disk etc. are various to can store program code
Medium.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.
Claims (8)
1. a kind of processing method of image data, it is applied to mobile terminal, which is characterized in that the mobile terminal includes and camera shooting
The digital signal processor DSP that head is connected with image-signal processor ISP, the method includes：
The DSP obtains the image data of the camera output；
Receive zoom request；
Determine image-region corresponding to the zoom request；
Determine the corresponding penalty coefficient in described image region；
Lens Shading Compensation is carried out to described image region using the penalty coefficient；
Image-region after the progress Lens Shading Compensation is sent to ISP；
Wherein, the step of reception zoom request includes：
When user's selection is directed to the scaling of image data, zoom request is generated based on the scaling；
The zoom request is sent in the DSP.
2. the method according to claim 1, wherein the determining described image region corresponding penalty coefficient
Step includes：
It is sub-image area by described image region division；
Obtain the corresponding penalty coefficient in the sub-image area respectively from default Lens Shading Compensation numerical value.
3. according to the method described in claim 2, it is characterized in that, it is described by described image region division be sub-image area
The step of before, further include：
Scaling is extracted from the zoom request；
The default Lens Shading Compensation numerical value is adjusted according to the scaling.
4. method according to claim 1 or 2 or 3, which is characterized in that the DSP passes through Mobile Industry Processor Interface
MIPI is connected between the camera and the ISP.
5. a kind of mobile terminal, which is characterized in that the mobile terminal includes being connected with camera and image-signal processor ISP
The digital signal processor DSP connect, the mobile terminal include：
Image data acquisition module, for obtaining the image data of the camera output in the DSP；
Zoom request receiving module, for receiving zoom request；
Image-region mould determines block, for determining image-region corresponding to the zoom request；
Penalty coefficient determining module, for determining the corresponding penalty coefficient in described image region；
Lens Shading Compensation module, for carrying out Lens Shading Compensation to described image region using the penalty coefficient；
Image-region sending module, for the image-region after the progress Lens Shading Compensation to be sent to ISP；
The zoom request receiving module includes：
Zoom request generates submodule, for being based on the pantograph ratio when user's selection is directed to the scaling of image data
Example generates zoom request；
Zoom request sending submodule, for the zoom request to be sent in the DSP.
6. mobile terminal according to claim 5, which is characterized in that the penalty coefficient determining module includes：
Sub-image area divides submodule, for being sub-image area by described image region division；
Penalty coefficient acquisition submodule, it is corresponding for obtaining the sub-image area respectively from default Lens Shading Compensation numerical value
Penalty coefficient.
7. mobile terminal according to claim 6, which is characterized in that further include：
Scaling extracting sub-module, for extracting scaling from the zoom request；
Default Lens Shading Compensation numerical value adjusting submodule, for being mended according to the scaling adjustment default camera lens shade
Repay numerical value.
8. according to mobile terminal described in claim 5 or 6 or 7, which is characterized in that the DSP passes through mobile Industry Processor
Interface MIPI is connected between the camera and the ISP.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710528150.3A CN107222681B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710528150.3A CN107222681B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107222681A CN107222681A (en) | 2017-09-29 |
| CN107222681B true CN107222681B (en) | 2018-11-30 |
Family
ID=59951674
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710528150.3A Active CN107222681B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107222681B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107846583B (en) * | 2017-10-27 | 2020-09-01 | 维沃移动通信有限公司 | Image shadow compensation method and mobile terminal |
| CN110363729B (en) * | 2019-07-30 | 2021-07-20 | 维沃移动通信有限公司 | Image processing method, terminal equipment and computer readable storage medium |
| CN112449085A (en) * | 2019-08-30 | 2021-03-05 | 北京小米移动软件有限公司 | Image processing method and device, electronic equipment and readable storage medium |
| CN111372014B (en) * | 2020-03-17 | 2022-04-22 | 展讯通信（上海）有限公司 | Lens shadow compensation method and device, storage medium and terminal |
| CN113744119A (en) * | 2020-05-29 | 2021-12-03 | Oppo广东移动通信有限公司 | Multimedia processing chip and electronic equipment |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102281389A (en) * | 2010-06-11 | 2011-12-14 | 三星电子株式会社 | Apparatus and method for creating lens shading compensation table suitable for photography environment |
| CN105812553A (en) * | 2015-09-24 | 2016-07-27 | 维沃移动通信有限公司 | Rapid shooting method and mobile terminal |
| CN106412407A (en) * | 2016-11-29 | 2017-02-15 | 广东欧珀移动通信有限公司 | Control method, control device and electronic device |
| CN106686305A (en) * | 2016-12-22 | 2017-05-17 | 深圳众思科技有限公司 | Image processing method of electronic equipment and the electronic equipment |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3680827B2 (en) * | 2002-08-27 | 2005-08-10 | コニカミノルタフォトイメージング株式会社 | Digital camera |
| EP1946542A4 (en) * | 2005-10-13 | 2010-08-11 | Nokia Corp | Method and system for vignetting elimination in digital image |
| JP4301308B2 (en) * | 2007-03-02 | 2009-07-22 | ソニー株式会社 | Imaging apparatus and image processing method |
| KR102045957B1 (en) * | 2013-01-18 | 2019-11-18 | 삼성전자 주식회사 | Method and apparatus for photographing of a portable terminal |
| US9432647B2 (en) * | 2013-09-09 | 2016-08-30 | Apple Inc. | Adaptive auto exposure and dynamic range compensation |
| CN106506905B (en) * | 2016-10-20 | 2019-07-16 | 湖南国科微电子股份有限公司 | Camera lens shadow correction method |
| CN106506960B (en) * | 2016-11-29 | 2019-06-07 | 维沃移动通信有限公司 | A kind of processing method and mobile terminal of image data |
-
2017
- 2017-06-30 CN CN201710528150.3A patent/CN107222681B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102281389A (en) * | 2010-06-11 | 2011-12-14 | 三星电子株式会社 | Apparatus and method for creating lens shading compensation table suitable for photography environment |
| CN105812553A (en) * | 2015-09-24 | 2016-07-27 | 维沃移动通信有限公司 | Rapid shooting method and mobile terminal |
| CN106412407A (en) * | 2016-11-29 | 2017-02-15 | 广东欧珀移动通信有限公司 | Control method, control device and electronic device |
| CN106686305A (en) * | 2016-12-22 | 2017-05-17 | 深圳众思科技有限公司 | Image processing method of electronic equipment and the electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107222681A (en) | 2017-09-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107222681B (en) | A kind of processing method and mobile terminal of image data | |
| CN105872148B (en) | A kind of generation method and mobile terminal of high dynamic range images | |
| CN106791400B (en) | A kind of image display method and mobile terminal | |
| CN105827754B (en) | A kind of generation method and mobile terminal of high dynamic range images | |
| CN107205119B (en) | A kind for the treatment of method and apparatus of image data | |
| CN105959544B (en) | A kind of image processing method and mobile terminal of mobile terminal | |
| CN106791450B (en) | A kind of photographic method and mobile terminal | |
| CN107395976B (en) | A kind of acquisition parameters setting method and mobile terminal | |
| CN107231530B (en) | A kind of photographic method and mobile terminal | |
| CN105827965A (en) | Image processing method based on mobile terminal and mobile terminal | |
| CN106506960B (en) | A kind of processing method and mobile terminal of image data | |
| CN106101545B (en) | A kind of image processing method and mobile terminal | |
| CN107277351A (en) | The processing method and mobile terminal of a kind of view data | |
| CN106780685B (en) | A kind of generation method and terminal of dynamic picture | |
| CN106126108B (en) | A kind of generation method and mobile terminal of thumbnail | |
| CN106657806B (en) | A kind of exposure method and mobile terminal | |
| CN105827971A (en) | Image processing method and mobile terminal | |
| CN107395898A (en) | A kind of image pickup method and mobile terminal | |
| CN105959574B (en) | A kind of photographic method and mobile terminal | |
| CN106952235B (en) | A kind of image processing method and mobile terminal | |
| CN107147837A (en) | The method to set up and mobile terminal of a kind of acquisition parameters | |
| CN105827963B (en) | Scene-change detecting method and mobile terminal during one kind is taken pictures | |
| CN106097398B (en) | A kind of detection method and mobile terminal of Moving Objects | |
| CN107222679B (en) | A kind of processing method and mobile terminal of image data | |
| CN107172346A (en) | A kind of weakening method and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |