CN107222681A - The processing method and mobile terminal of a kind of view data - Google Patents
The processing method and mobile terminal of a kind of view data Download PDFInfo
- Publication number
- CN107222681A CN107222681A CN201710528150.3A CN201710528150A CN107222681A CN 107222681 A CN107222681 A CN 107222681A CN 201710528150 A CN201710528150 A CN 201710528150A CN 107222681 A CN107222681 A CN 107222681A
- Authority
- CN
- China
- Prior art keywords
- image
- dsp
- mobile terminal
- region
- isp
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/81—Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
Abstract
The embodiments of the invention provide a kind of processing method of view data and mobile terminal, the mobile terminal includes the digital signal processor DSP being connected with camera and image-signal processor ISP, and methods described includes：The DSP obtains the view data of the camera output；Receive zoom request；Determine the image-region corresponding to the zoom request；Determine the corresponding penalty coefficient in described image region；Lens Shading Compensation is carried out to described image region using the penalty coefficient；Image-region after the progress Lens Shading Compensation is sent to ISP.The embodiment of the present invention carries out Lens Shading Compensation in DSP in advance so that is not used in ISP platforms and carries out Lens Shading Compensation, the problem of efficiently solving overcompensation.
Description
Technical field
The present invention relates to communication technical field, the processing method and mobile terminal of more particularly to a kind of view data.
Background technology
Existing mobile terminal is increasingly valued camera and taken pictures the performance of imaging effect, the noise of image and definition, this
A little prime competing factors for also increasingly becoming businessman.
The different in detail but general place of the image processing techniques of the platform processor manufacturer of current mobile terminal
Reason method is：By ISP (Image Signal Processing, picture signal processing) carry out image procossing obtain RGB,
After the view data of the forms such as YUV, the denoising of view data and the lifting of definition are then carried out.
Although view data, can be by Gauss-Poisson model after sensor (sensor) outputs in camera module
To carry out data description, but after image procossing is carried out by ISP, the noise characteristic of view data becomes more complicated, it is difficult to
Processing, influences final image quality.
The content of the invention
The embodiment of the present invention provides the method and mobile terminal of a kind of view data, to solve view data only ISP processing,
The noise characteristic of view data is complicated, causes the problem of final image is of low quality.
First aspect is there is provided a kind of processing method of view data, applied to mobile terminal, and the mobile terminal includes
The digital signal processor DSP being connected with camera and image-signal processor ISP, methods described includes：
The DSP obtains the view data of the camera output；
Receive zoom request；
Determine the image-region corresponding to the zoom request；
Determine the corresponding penalty coefficient in described image region；
Lens Shading Compensation is carried out to described image region using the penalty coefficient；
Image-region after the progress Lens Shading Compensation is sent to ISP.
Second aspect includes and camera and image-signal processor there is provided a kind of mobile terminal, the mobile terminal
The digital signal processor DSP that ISP is connected, the mobile terminal includes：
Image data acquisition module, the view data for obtaining the camera output in the DSP；
Zoom request receiving module, for receiving zoom request；
Image-region mould determines block, for determining the image-region corresponding to the zoom request；
Penalty coefficient determining module, for determining the corresponding penalty coefficient in described image region；
Lens Shading Compensation module, for carrying out Lens Shading Compensation to described image region using the penalty coefficient；
Image-region sending module, for the image-region after the progress Lens Shading Compensation to be sent to ISP.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Rear end ISP is then forwarded to after processing, the original data for obtaining more preferable quality to be further processed.Specifically, it is of the invention
If embodiment receives the zoom request of user when DSP platform receives the view data of camera output, it can be based on
The zoomed image region of zoom request view data, then goes to determine the penalty coefficient of image-region again, and based on penalty coefficient
Lens Shading Compensation is carried out for image-region, finally exports to ISP and further handles, the embodiment of the present invention is entered in DSP in advance
Row Lens Shading Compensation so that be not used in ISP platforms and carry out Lens Shading Compensation, the problem of efficiently solving overcompensation.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
The accompanying drawing needed to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the present invention
Example, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is a kind of step flow chart of the processing method embodiment of view data of the embodiment of the present invention one；
Fig. 2 is a kind of image processing flow figure based on DSP and ISP of the present invention；
Fig. 3 is a kind of structured flowchart of mobile terminal embodiment of the embodiment of the present invention two；
Fig. 4 is the block diagram of the mobile terminal of another embodiment of the present invention；
Fig. 5 is the structural representation of the mobile terminal of another embodiment of the invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is a part of embodiment of the invention, rather than whole embodiments.Based on this hair
Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example, belongs to the scope of protection of the invention.
The embodiment of the present invention adds DSP (Digital Signal on the basis of the hardware frame of original mobile terminal
Processing, digital signal processor) so that view data is entering ISP (Image Signal Processing, image
Signal transacting) before, more image processing functions can be realized, the picture quality of view data is lifted.Specifically, camera
Camera module in have sensor (sensor), mobile terminal is provided with what is be connected with the sensor and ISP of camera
DSP.Generally, the unit that ISP is handled as the sensor output signals of camera in the terminal, to match different vendor
sensor。
Wherein, DSP, between sensor and ISP, can pass through MIPI (Mobile Industry Processor
Interface, mobile Industry Processor Interface) connection, MIPI by the interface of interior of mobile phone such as camera, display screen interface, penetrate
Frequently/baseband interface etc. is standardized, it is possible to reduce the complexity and increase design flexibility of Cell Phone Design.Certainly, DSP,
It can also be attached between sensor and ISP by other interfaces, the embodiment of the present invention need not be any limitation as to this.
The DSP hardware module of the embodiment of the present invention, is interval (such as the RAW figures to the form for Bayer format in RAW
As being handled, RAW image does not carry out being converted into the forms such as YUV due in ISP, therefore data volume is more, and detailed information is rich
It is rich) view data carry out the operation such as denoising, allow view data before ISP is entered, just there is relatively good noise performance, and
View data is handled by DSP, speed is fast for being handled in ISP, and in DSP many algorithms realization can also be used many
Plant function.By being pre-processed in DSP for view data, reduce in ISP processing procedures, reduce back-end processing difficulty,
Finally give better image quality.
ISP be can be integrated in it is in AP (Application Processor, application processor) or independent
Chip, the embodiment of the present invention need not be any limitation as to this, be retransmited after DSP obtains the RAW image of result at progress ISP
Reason so that view data becomes apparent from, natural and attractive in appearance.
In summary, the embodiment of the present invention adds to improve the performance of the mobile terminal cameras such as mobile phone in mobile phone
DSP, substitutes algorithm of the part using software processing image, so that processing speed is more accelerated, use is more smooth.Wherein, wrap
Include using DSP come alternate process image zoom (zoom refer to scaling, i.e., zoomed in or out for image, the effect of generation
Be allow user feel when taking pictures push away near or zoom out focal length) enhanced software approach, other software processing figure is directed to certainly
Image space method.But, accompanying problem is that, if DSP is in platform ISP leading portions, inevitably cause the lsc of image
(Lens Shading Correction, Lens Shading Compensation) problem, surrounding brightness is partially bright, and compensation is excessive.
Specifically, the reason for surrounding brightness is partially bright, compensation is excessive is caused to be described below：
First, because CCM (CMOS Camera Module, complementary metal oxide semiconductor camera module) imaging is held
The principle of camera lens surrounding brightness decay is easily caused, and sensor imagings can cause the brightness in the middle of the brightness ratio image of surrounding low.
And prior art is compensated image surrounding by ISP mostly.
Second, if being zoom at DSP ends, image is exaggerated, and then sectional drawing obtains defeated with artwork image of the same size
Go out, the corresponding enhancing degree of the image surrounding and ISP enhancing coefficient are not just corresponded to mutually.This method can cause originally needs compared with
The image-region of small enhancing coefficient, the larger enhancing coefficient of practical application, and the weekly assembly of image four became bright, caused figure
Image brightness is abnormal.
In order to solve the above problems, the embodiment of the present invention introduces lsc algorithms at DSP ends, according to different zoom ratio
(scaling), changes lsc calibration table, so as to avoid being lsc in platform end i.e. ISP, causes image surrounding is partially bright to ask
Topic.
Embodiment one
Reference picture 1, shows a kind of step flow chart of the processing method embodiment of view data of the present invention, is applied to
Mobile terminal, the mobile terminal includes the digital signal processor being connected with camera and image-signal processor ISP
DSP, methods described specifically may include steps of：
Step 101, the DSP obtains the view data of the camera output；
In embodiments of the present invention, DSP can get the view data of camera output.Enter ISP in view data
Before, it can be in advance based on instructing or ask to handle for view data.
Step 102, zoom request is received；
User for the ease of watch view data some part when, appropriate scaling can be selected to carry out enlarged drawing
Picture, now will generate zoom request, it will zoomed in or out for view data based on scaling based on scaling
Operation.
Step 103, the image-region corresponding to the zoom request is determined；
In the embodiment of the present invention, corresponding image-region in zoom request interception image data can be based on.Now image four
All corresponding enhancing degree and the former enhancing coefficient in ISP are different, no longer mutually corresponding.For example, it may be possible to need originally
Want the region of less enhancing coefficient (penalty coefficient), the larger enhancing coefficient of practical application；The weekly assembly of image four became bright,
Cause brightness of image abnormal.So the present invention needs to further determine that the penalty coefficient of the brightness of image-region at DSP.
Step 104, the corresponding penalty coefficient in described image region is determined；
Can be determined or based on default based on image-region to adjust when DPS determines penalty coefficient again
Lens Shading Compensation numerical value adjust determination.
In one preferred embodiment of the invention, the step 104 can include：
Scaling is extracted from the zoom request；
The default Lens Shading Compensation numerical value is adjusted according to the scaling；
It is sub-image area by described image region division；
Obtain the corresponding penalty coefficient in the sub-image area respectively from default Lens Shading Compensation numerical value.
Above-mentioned Lens Shading Compensation numerical value is embodied in lsc table (Lens Shading Compensation table), and it is a form,
Each piece of zonule in each penalty coefficient correspondence image in form., correspondingly, can also if image is scaled
Each penalty coefficient in lsc table is also scaled, so the image-region corresponding to each penalty coefficient or one
Sample.This corresponding relation does not change, then image surrounding would not be caused partially bright, the problem of overcompensation.
Step 105, Lens Shading Compensation is carried out to described image region using the penalty coefficient；
After the penalty coefficient of image-region is determined in DSP, it is possible to carried out based on penalty coefficient for image-region
Lens Shading Compensation, that is, lift brightness of image.
Step 106, the image-region after the progress Lens Shading Compensation is sent to ISP.
After original data is obtained in DSP completions processing, the original data is sent by MIPI interfaces
Handled with carrying out next step to ISP.
It should be noted that due to having completed Lens Shading Compensation in DSP in the embodiment of the present invention, so, ISP need not
Image-region after to adjusting brightness through DSP carries out Lens Shading Compensation.
In order to preferably show that the embodiment of the present invention carries out lsc in DSP, and lsc difference, Ke Yican are carried out in ISP
According to Fig. 2.
General image processing method, i.e., be in the ISP processes for carrying out lsc：Sensor output images data are extremely
View data is exported to ISP carry out lsc again by DSP, DSP.Image processing method after improvement of the embodiment of the present invention, that is, exist
DSP carry out lsc process be：Sensor output images data can adaptively adjust lsc to DSP, DSP according to zoom ratio
Table lsc penalty coefficients simultaneously complete Lens Shading Compensation based on penalty coefficient, then need not carry out camera lens shade benefit in ISP
Repay.Using the new method of the embodiment of the present invention, it is to avoid finished at DSP after scaling, ISP platforms end is carried out after lsc calibrations,
Cause image surrounding partially bright, the problem of overcompensation.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Rear end ISP is then forwarded to after processing, the original data for obtaining more preferable quality to be further processed.Specifically, it is of the invention
If embodiment receives the zoom request of user when DSP platform receives the view data of camera output, it can be based on
The zoomed image region of zoom request view data, then goes to determine the penalty coefficient of image-region again, and based on penalty coefficient
Lens Shading Compensation is carried out for image-region, finally exports to ISP and further handles, the embodiment of the present invention is entered in DSP in advance
Row Lens Shading Compensation so that be not used in ISP platforms and carry out Lens Shading Compensation, the problem of efficiently solving overcompensation.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it to be all expressed as to a series of action group
Close, but those skilled in the art should know, the embodiment of the present invention is not limited by described sequence of movement, because according to
According to the embodiment of the present invention, some steps can be carried out sequentially or simultaneously using other.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, the involved action not necessarily present invention is implemented
Necessary to example.
Reference picture 3, show the present invention a kind of mobile terminal embodiment structured flowchart, the mobile terminal include with
The digital signal processor DSP that camera is connected with image-signal processor ISP, the mobile terminal can specifically be included such as
Lower module：
Image data acquisition module 201, the view data for obtaining the camera output in the DSP；
Zoom request receiving module 202, for receiving zoom request；
Image-region mould determines block 203, for determining the image-region corresponding to the zoom request；
Penalty coefficient determining module 204, for determining the corresponding penalty coefficient in described image region；
Lens Shading Compensation module 205, for carrying out camera lens shade benefit to described image region using the penalty coefficient
Repay；
Image-region sending module 206, for the image-region after the progress Lens Shading Compensation to be sent to ISP.
In one preferred embodiment of the invention, the penalty coefficient determining module 204 includes：
Sub-image area divides submodule, for being sub-image area by described image region division；
Penalty coefficient acquisition submodule, for obtaining the sub-image area respectively from default Lens Shading Compensation numerical value
Corresponding penalty coefficient.
In one preferred embodiment of the invention, in addition to：
Scaling extracting sub-module, for extracting scaling from the zoom request；
Default Lens Shading Compensation numerical value adjustment submodule, for cloudy according to the scaling adjustment default camera lens
Shadow compensates numerical value.
In one preferred embodiment of the invention, the zoom request receiving module includes：
Zoom request generates submodule, for being selected as user during the scaling for view data, based on the contracting
Put ratio generation zoom request；
Zoom request sending submodule, for the zoom request to be sent into the DSP.
In one preferred embodiment of the invention, the DSP is connected to institute by mobile Industry Processor Interface MIPI
State between camera and the ISP.
For mobile terminal embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple,
The relevent part can refer to the partial explaination of embodiments of method.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Rear end ISP is then forwarded to after processing, the original data for obtaining more preferable quality to be further processed.Specifically, it is of the invention
If embodiment receives the zoom request of user when DSP platform receives the view data of camera output, it can be based on
The zoomed image region of zoom request view data, then goes to determine the penalty coefficient of image-region again, and based on penalty coefficient
Lens Shading Compensation is carried out for image-region, finally exports to ISP and further handles, the embodiment of the present invention is entered in DSP in advance
Row Lens Shading Compensation so that be not used in ISP platforms and carry out Lens Shading Compensation, the problem of efficiently solving overcompensation.
Embodiment three
Fig. 4 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 700 shown in Fig. 4 includes：At least
One processor 701, memory 702, at least one network interface 704 and other users interface 703.In mobile terminal 700
Each component is coupled by bus system 705.It is understood that bus system 705 is used to realize the company between these components
Connect letter.Bus system 705 is in addition to including data/address bus, in addition to power bus, controlling bus and status signal bus in addition.But
It is that for the sake of clear explanation, various buses are all designated as bus system 705 in Fig. 4.
Wherein, user interface 703 can include display, keyboard or pointing device (for example, mouse, trace ball
(trackball), touch-sensitive plate or touch-screen etc..
It is appreciated that the memory 702 in the embodiment of the present invention can be volatile memory or nonvolatile memory,
Or may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage (Read-
OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), Erasable Programmable Read Only Memory EPROM
(ErasablePROM, EPROM), Electrically Erasable Read Only Memory (ElectricallyEPROM, EEPROM) dodge
Deposit.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is used as outside slow at a high speed
Deposit.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM
(StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory
(SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate
SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links
Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory
(DirectRambusRAM, DRRAM).The memory 702 of the system and method for description of the embodiment of the present invention is intended to include but not limited
In these memories with any other suitable type.
In some embodiments, memory 702 stores following element, can perform module or data structure, or
Their subset of person, or their superset：Operating system 7021 and application program 7022.
Wherein, operating system 7021, comprising various system programs, such as ccf layer, core library layer, driving layer, are used for
Realize various basic businesses and handle hardware based task.Application program 7022, includes various application programs, such as media
Player (MediaPlayer), browser (Browser) etc., for realizing various applied business.Realize embodiment of the present invention side
The program of method may be embodied in application program 7022.
In embodiments of the present invention, by calling program or the instruction of the storage of memory 702, specifically, can be application
The program stored in program 7022 or instruction, processor 701 are used for the picture number that the camera output is obtained in the DSP
According to；Receive zoom request；Determine the image-region corresponding to the zoom request；Determine the corresponding compensation system in described image region
Number；Lens Shading Compensation is carried out to described image region using the penalty coefficient；After the progress Lens Shading Compensation
Image-region is sent to ISP.
The method that the embodiments of the present invention are disclosed can apply in processor 701, or be realized by processor 701.
Processor 701 is probably a kind of IC chip, the disposal ability with signal.In implementation process, the above method it is each
Step can be completed by the integrated logic circuit of the hardware in processor 701 or the instruction of software form.Above-mentioned processing
Device 701 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), application specific integrated circuit
(ApplicationSpecific IntegratedCircuit, ASIC), ready-made programmable gate array
(FieldProgrammableGateArray, FPGA) or other PLDs, discrete gate or transistor logic
Device, discrete hardware components.It can realize or perform disclosed each method, step and the box in the embodiment of the present invention
Figure.General processor can be microprocessor or the processor can also be any conventional processor etc..With reference to the present invention
The step of method disclosed in embodiment, can be embodied directly in hardware decoding processor and perform completion, or use decoding processor
In hardware and software module combination perform completion.Software module can be located at random access memory, and flash memory, read-only storage can
In the ripe storage medium in this area such as program read-only memory or electrically erasable programmable memory, register.The storage
Medium is located at memory 702, and processor 701 reads the information in memory 702, and the step of the above method is completed with reference to its hardware
Suddenly.
It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware,
Microcode or its combination are realized.Realized for hardware, processing unit can be realized in one or more application specific integrated circuits
(ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor
(DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device
(ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray,
FPGA), general processor, controller, microcontroller, microprocessor, other electronics lists for performing herein described function
In member or its combination.
For software realize, can by perform the module (such as process, function) of function described in the embodiment of the present invention come
Realize the technology described in the embodiment of the present invention.Software code is storable in memory and by computing device.Memory can
To realize within a processor or outside processor.
Alternatively, processor 701 is additionally operable to：It is sub-image area by described image region division；From default camera lens shade
The corresponding penalty coefficient in the sub-image area is obtained respectively in compensation numerical value.
Alternatively, processor 701 is additionally operable to：When user selects the scaling for view data, based on the contracting
Put ratio generation zoom request；The zoom request is sent into the DSP.
Alternatively, processor 701 is additionally operable to：Scaling is extracted from the zoom request；According to the pantograph ratio
The example adjustment default Lens Shading Compensation numerical value.
Mobile terminal 700 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, here
Repeat no more.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Rear end ISP is then forwarded to after processing, the original data for obtaining more preferable quality to be further processed.Specifically, it is of the invention
If embodiment receives the zoom request of user when DSP platform receives the view data of camera output, it can be based on
The zoomed image region of zoom request view data, then goes to determine the penalty coefficient of image-region again, and based on penalty coefficient
Lens Shading Compensation is carried out for image-region, finally exports to ISP and further handles, the embodiment of the present invention is entered in DSP in advance
Row Lens Shading Compensation so that be not used in ISP platforms and carry out Lens Shading Compensation, the problem of efficiently solving overcompensation.
Example IV
Fig. 5 is the structural representation of the mobile terminal of another embodiment of the present invention.Specifically, the mobile terminal in Fig. 5
800 can be mobile phone, tablet personal computer, personal digital assistant (PersonalDigital Assistant, PDA) or vehicle-mounted computer
Deng.
Mobile terminal 800 in Fig. 5 includes radio frequency (RadioFrequency, RF) circuit 810, memory 820, input list
Member 830, display unit 840, processor 860, voicefrequency circuit 870, WiFi (WirelessFidelity) module 880 and power supply
890。
Wherein, input block 830 can be used for the numeral or character information for receiving user's input, and produce and mobile terminal
The signal input that 800 user is set and function control is relevant.Specifically, in the embodiment of the present invention, the input block 830 can
With including contact panel 831.Contact panel 831, also referred to as touch-screen, collect touch operation of the user on or near it
(such as user uses the operations of any suitable object or annex on contact panel 831 such as finger, stylus), and according to advance
The formula of setting drives corresponding attachment means.Optionally, contact panel 831 may include touch detecting apparatus and touch controller
Two parts.Wherein, touch detecting apparatus detects the touch orientation of user, and detects the signal that touch operation is brought, by signal
Send touch controller to；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate,
Give the processor 860 again, and the order sent of reception processing device 860 and can be performed.Furthermore, it is possible to using resistance-type,
The polytypes such as condenser type, infrared ray and surface acoustic wave realize contact panel 831.Except contact panel 831, input block
830 can also include other input equipments 832, and other input equipments 832 can include but is not limited to physical keyboard, function key
One or more in (such as volume control button, switch key etc.), trace ball, mouse, action bars etc..
Wherein, display unit 840 can be used for information and the movement for showing the information inputted by user or being supplied to user
The various menu interfaces of terminal 800.Display unit 840 may include display panel 841, optionally, can use LCD or organic hairs
The forms such as optical diode (OrganicLight-EmittingDiode, OLED) configure display panel 841.
It should be noted that contact panel 831 can cover display panel 841, touch display screen is formed, when touch display screen inspection
Measure after the touch operation on or near it, processor 860 is sent to determine the type of touch event, with preprocessor
860 provide corresponding visual output according to the type of touch event in touch display screen.
Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area
And arrangement mode of the conventional control viewing area is not limited, can be arranged above and below, left-right situs etc. can distinguish two and show
Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with
The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area
It can also be the empty interface not comprising any content.The conventional control viewing area is used to show the higher control of utilization rate, for example,
Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..
Wherein processor 860 is the control centre of mobile terminal 800, utilizes various interfaces and connection whole mobile phone
Various pieces, software program and/or module in first memory 821 are stored in by operation or execution, and call storage
Data in second memory 822, perform the various functions and processing data of mobile terminal 800, so as to mobile terminal 800
Carry out integral monitoring.Optionally, processor 860 may include one or more processing units.
In embodiments of the present invention, by call store the first memory 821 in software program and/or module and/
Or the data in the second memory 822, view data of the processor 860 for obtaining the camera output in the DSP；
Receive zoom request；Determine the image-region corresponding to the zoom request；Determine the corresponding penalty coefficient in described image region；
Lens Shading Compensation is carried out to described image region using the penalty coefficient；By the image after the progress Lens Shading Compensation
Region is sent to ISP.
Alternatively, the processor 860 is additionally operable to, and is sub-image area by described image region division；From default camera lens
The corresponding penalty coefficient in the sub-image area is obtained in shadow compensation numerical value respectively.
Alternatively, the processor 860 is additionally operable to, and scaling is extracted from the zoom request；According to the contracting
Put ratio and adjust the default Lens Shading Compensation numerical value.
Alternatively, the processor 860 is additionally operable to, when user selects the scaling for view data, based on institute
State scaling generation zoom request；The zoom request is sent into the DSP.
For the embodiment of mobile terminal 800, because it is substantially similar to embodiment of the method, so the comparison of description is simple
Single, the relevent part can refer to the partial explaination of embodiments of method.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Rear end ISP is then forwarded to after processing, the original data for obtaining more preferable quality to be further processed.Specifically, it is of the invention
If embodiment receives the zoom request of user when DSP platform receives the view data of camera output, it can be based on
The zoomed image region of zoom request view data, then goes to determine the penalty coefficient of image-region again, and based on penalty coefficient
Lens Shading Compensation is carried out for image-region, finally exports to ISP and further handles, the embodiment of the present invention is entered in DSP in advance
Row Lens Shading Compensation so that be not used in ISP platforms and carry out Lens Shading Compensation, the problem of efficiently solving overcompensation.
Those of ordinary skill in the art it is to be appreciated that with reference to disclosed in the embodiment of the present invention embodiment description it is each
The unit and algorithm steps of example, can be realized with the combination of electronic hardware or computer software and electronic hardware.These
Function is performed with hardware or software mode actually, depending on the application-specific and design constraint of technical scheme.Specialty
Technical staff can realize described function to each specific application using distinct methods, but this realization should not
Think beyond the scope of this invention.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, may be referred to the corresponding process in preceding method embodiment, will not be repeated here.
In embodiment provided herein, it should be understood that disclosed apparatus and method, others can be passed through
Mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, is only
A kind of division of logic function, can there is other dividing mode when actually realizing, such as multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual
Between coupling or direct-coupling or communication connection can be the INDIRECT COUPLING or communication link of device or unit by some interfaces
Connect, can be electrical, machinery or other forms.
The unit illustrated as separating component can be or may not be it is physically separate, it is aobvious as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized using in the form of SFU software functional unit and is used as independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Understood based on such, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are to cause a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each of the invention embodiment methods described.
And foregoing storage medium includes：USB flash disk, mobile hard disk, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes
Medium.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.
Claims (10)
1. a kind of processing method of view data, applied to mobile terminal, it is characterised in that the mobile terminal includes and shooting
The digital signal processor DSP that head is connected with image-signal processor ISP, methods described includes：
The DSP obtains the view data of the camera output；
Receive zoom request；
Determine the image-region corresponding to the zoom request；
Determine the corresponding penalty coefficient in described image region；
Lens Shading Compensation is carried out to described image region using the penalty coefficient；
Image-region after the progress Lens Shading Compensation is sent to ISP.
2. according to the method described in claim 1, it is characterised in that the described image region corresponding penalty coefficient of determining
Step includes：
It is sub-image area by described image region division；
Obtain the corresponding penalty coefficient in the sub-image area respectively from default Lens Shading Compensation numerical value.
3. method according to claim 2, it is characterised in that it is described by described image region division be sub-image area
The step of before, in addition to：
Scaling is extracted from the zoom request；
The default Lens Shading Compensation numerical value is adjusted according to the scaling.
4. according to the method described in claim 1, it is characterised in that include the step of the reception zoom request：
When user selects the scaling for view data, zoom request is generated based on the scaling；
The zoom request is sent into the DSP.
5. the method according to claim 1 or 2 or 3 or 4, it is characterised in that the DSP is connect by mobile Industry Processor
Mouth MIPI is connected between the camera and the ISP.
6. a kind of mobile terminal, it is characterised in that the mobile terminal includes being connected with camera and image-signal processor ISP
The digital signal processor DSP connect, the mobile terminal includes：
Image data acquisition module, the view data for obtaining the camera output in the DSP；
Zoom request receiving module, for receiving zoom request；
Image-region mould determines block, for determining the image-region corresponding to the zoom request；
Penalty coefficient determining module, for determining the corresponding penalty coefficient in described image region；
Lens Shading Compensation module, for carrying out Lens Shading Compensation to described image region using the penalty coefficient；
Image-region sending module, for the image-region after the progress Lens Shading Compensation to be sent to ISP.
7. mobile terminal according to claim 6, it is characterised in that the penalty coefficient determining module includes：
Sub-image area divides submodule, for being sub-image area by described image region division；
Penalty coefficient acquisition submodule, for obtaining the sub-image area correspondence respectively from default Lens Shading Compensation numerical value
Penalty coefficient.
8. mobile terminal according to claim 7, it is characterised in that also include：
Scaling extracting sub-module, for extracting scaling from the zoom request；
Default Lens Shading Compensation numerical value adjustment submodule, for being mended according to the scaling adjustment default camera lens shade
Repay numerical value.
9. mobile terminal according to claim 6, it is characterised in that the zoom request receiving module includes：
Zoom request generates submodule, for being selected as user during the scaling for view data, based on the pantograph ratio
Example generation zoom request；
Zoom request sending submodule, for the zoom request to be sent into the DSP.
10. the mobile terminal according to claim 6 or 7 or 8 or 9, it is characterised in that the DSP is by moving at industry
Reason device interface MIPI is connected between the camera and the ISP.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710528150.3A CN107222681B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710528150.3A CN107222681B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107222681A true CN107222681A (en) | 2017-09-29 |
| CN107222681B CN107222681B (en) | 2018-11-30 |
Family
ID=59951674
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710528150.3A Active CN107222681B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107222681B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107846583A (en) * | 2017-10-27 | 2018-03-27 | 维沃移动通信有限公司 | A kind of image shadow compensating method and mobile terminal |
| CN110363729A (en) * | 2019-07-30 | 2019-10-22 | 维沃移动通信有限公司 | A kind of image processing method, terminal device and computer readable storage medium |
| CN111372014A (en) * | 2020-03-17 | 2020-07-03 | 展讯通信（上海）有限公司 | Lens shadow compensation method and device, storage medium and terminal |
| CN112449085A (en) * | 2019-08-30 | 2021-03-05 | 北京小米移动软件有限公司 | Image processing method and device, electronic equipment and readable storage medium |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040041919A1 (en) * | 2002-08-27 | 2004-03-04 | Mutsuhiro Yamanaka | Digital camera |
| CN101257577A (en) * | 2007-03-02 | 2008-09-03 | 索尼株式会社 | Image-capturing apparatus and image processing method |
| CN101292519A (en) * | 2005-10-13 | 2008-10-22 | 诺基亚公司 | Dark corner eliminating method and system in digital image |
| CN102281389A (en) * | 2010-06-11 | 2011-12-14 | 三星电子株式会社 | Apparatus and method for creating lens shading compensation table suitable for photography environment |
| CN103945113A (en) * | 2013-01-18 | 2014-07-23 | 三星电子株式会社 | Method and apparatus for photographing in portable terminal |
| US20150070537A1 (en) * | 2013-09-09 | 2015-03-12 | Apple Inc. | Lens Shading Modulation |
| CN105812553A (en) * | 2015-09-24 | 2016-07-27 | 维沃移动通信有限公司 | Rapid shooting method and mobile terminal |
| CN106412407A (en) * | 2016-11-29 | 2017-02-15 | 广东欧珀移动通信有限公司 | Control method, control device and electronic device |
| CN106506905A (en) * | 2016-10-20 | 2017-03-15 | 湖南国科微电子股份有限公司 | Camera lens shadow correction method |
| CN106506960A (en) * | 2016-11-29 | 2017-03-15 | 维沃移动通信有限公司 | A kind of processing method of view data and mobile terminal |
| CN106686305A (en) * | 2016-12-22 | 2017-05-17 | 深圳众思科技有限公司 | Image processing method of electronic equipment and the electronic equipment |
-
2017
- 2017-06-30 CN CN201710528150.3A patent/CN107222681B/en active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040041919A1 (en) * | 2002-08-27 | 2004-03-04 | Mutsuhiro Yamanaka | Digital camera |
| CN101292519A (en) * | 2005-10-13 | 2008-10-22 | 诺基亚公司 | Dark corner eliminating method and system in digital image |
| CN101257577A (en) * | 2007-03-02 | 2008-09-03 | 索尼株式会社 | Image-capturing apparatus and image processing method |
| CN102281389A (en) * | 2010-06-11 | 2011-12-14 | 三星电子株式会社 | Apparatus and method for creating lens shading compensation table suitable for photography environment |
| CN103945113A (en) * | 2013-01-18 | 2014-07-23 | 三星电子株式会社 | Method and apparatus for photographing in portable terminal |
| US20150070537A1 (en) * | 2013-09-09 | 2015-03-12 | Apple Inc. | Lens Shading Modulation |
| CN105812553A (en) * | 2015-09-24 | 2016-07-27 | 维沃移动通信有限公司 | Rapid shooting method and mobile terminal |
| CN106506905A (en) * | 2016-10-20 | 2017-03-15 | 湖南国科微电子股份有限公司 | Camera lens shadow correction method |
| CN106412407A (en) * | 2016-11-29 | 2017-02-15 | 广东欧珀移动通信有限公司 | Control method, control device and electronic device |
| CN106506960A (en) * | 2016-11-29 | 2017-03-15 | 维沃移动通信有限公司 | A kind of processing method of view data and mobile terminal |
| CN106686305A (en) * | 2016-12-22 | 2017-05-17 | 深圳众思科技有限公司 | Image processing method of electronic equipment and the electronic equipment |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107846583A (en) * | 2017-10-27 | 2018-03-27 | 维沃移动通信有限公司 | A kind of image shadow compensating method and mobile terminal |
| CN107846583B (en) * | 2017-10-27 | 2020-09-01 | 维沃移动通信有限公司 | Image shadow compensation method and mobile terminal |
| CN110363729A (en) * | 2019-07-30 | 2019-10-22 | 维沃移动通信有限公司 | A kind of image processing method, terminal device and computer readable storage medium |
| CN112449085A (en) * | 2019-08-30 | 2021-03-05 | 北京小米移动软件有限公司 | Image processing method and device, electronic equipment and readable storage medium |
| CN111372014A (en) * | 2020-03-17 | 2020-07-03 | 展讯通信（上海）有限公司 | Lens shadow compensation method and device, storage medium and terminal |
| CN111372014B (en) * | 2020-03-17 | 2022-04-22 | 展讯通信（上海）有限公司 | Lens shadow compensation method and device, storage medium and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107222681B (en) | 2018-11-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105827971B (en) | A kind of image processing method and mobile terminal | |
| CN107205119B (en) | A kind for the treatment of method and apparatus of image data | |
| CN105827754B (en) | A kind of generation method and mobile terminal of high dynamic range images | |
| CN107147837A (en) | The method to set up and mobile terminal of a kind of acquisition parameters | |
| CN107222686A (en) | A kind for the treatment of method and apparatus of view data | |
| CN107257439A (en) | A kind of image pickup method and mobile terminal | |
| CN107222681A (en) | The processing method and mobile terminal of a kind of view data | |
| CN107277351A (en) | The processing method and mobile terminal of a kind of view data | |
| CN107277387A (en) | High dynamic range images image pickup method, terminal and computer-readable recording medium | |
| CN107222680A (en) | The image pickup method and mobile terminal of a kind of panoramic picture | |
| CN107197169A (en) | A kind of high dynamic range images image pickup method and mobile terminal | |
| CN105827965A (en) | Image processing method based on mobile terminal and mobile terminal | |
| CN106998428A (en) | The image pickup method and mobile terminal of a kind of mobile terminal | |
| CN107395976B (en) | A kind of acquisition parameters setting method and mobile terminal | |
| CN107222679A (en) | The processing method and mobile terminal of a kind of view data | |
| CN107172346A (en) | A kind of weakening method and mobile terminal | |
| CN107390990A (en) | The method of adjustment and mobile terminal of a kind of image | |
| CN107026982B (en) | A kind of photographic method and mobile terminal of mobile terminal | |
| CN107395978A (en) | The control method and mobile terminal of a kind of camera module | |
| CN107222669B (en) | A kind of method and mobile terminal of shooting | |
| CN107277353A (en) | A kind of method taken pictures and mobile terminal | |
| CN106973233A (en) | A kind of camera, mobile terminal and processing method of taking pictures | |
| CN106097398B (en) | A kind of detection method and mobile terminal of Moving Objects | |
| CN107360345A (en) | The processing method and mobile terminal of a kind of view data | |
| CN107343120A (en) | The processing method and mobile terminal of a kind of view data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |