CN107347139A - The processing method and mobile terminal of a kind of view data - Google Patents
The processing method and mobile terminal of a kind of view data Download PDFInfo
- Publication number
- CN107347139A CN107347139A CN201710528159.4A CN201710528159A CN107347139A CN 107347139 A CN107347139 A CN 107347139A CN 201710528159 A CN201710528159 A CN 201710528159A CN 107347139 A CN107347139 A CN 107347139A
- Authority
- CN
- China
- Prior art keywords
- view data
- pixel
- data
- image
- camera
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Abstract
The embodiments of the invention provide a kind of processing method of view data and mobile terminal, the mobile terminal includes the digital signal processor DSP being connected with camera and image-signal processor ISP, the mobile terminal has the first camera and second camera, first camera configures with the first pixel, the second camera configures with the second pixel, the first pixel configuration configures higher than second pixel, and methods described includes：The DSP obtains first view data of first camera based on the configuration output of the first pixel, and, second view data of the second camera based on the configuration output of the second pixel；Configured based on second pixel from described first image data and extract processing view data；Using the processing view data and second view data synthesis destination image data；The destination image data is sent to ISP.The embodiment of the present invention solve thes problems, such as ISP platform processes scarce capacities.
Description
Technical field
The present invention relates to communication technical field, more particularly to the processing method and mobile terminal of a kind of view data.
Background technology
Existing mobile terminal is increasingly valued camera and taken pictures the performance of imaging effect, the noise of image and definition, this
A little prime competing factors for also increasingly becoming businessman.
The image processing techniques of the platform processor manufacturer of mobile terminal is different in detail, but in general method
It is：The lattice such as RGB, YUV are obtained carrying out image procossing by ISP (Image Signal Processing, picture signal processing)
The view data of formula and then the denoising of progress view data and the lifting of definition.
In ISP platforms, can also realize it is double take the photograph super clear zoom enhanced schemes, wherein, zoom refers to scale, i.e., for scheming
As zooming in or out, caused effect is to allow user to feel the push away near when taking pictures or zoom out focal length.Specifically, Yi Zhongshi
Now scheme is：Two camera output images for the configuration of 12M+20M pixels are used, image co-registration is then carried out, finally exports
12M images, reach high resolution in the zoom effects of single camera output 12M images.
However, the scheme of this super clear zoom enhancing, run into platform processes ability not enough, 12M+ can not be received simultaneously
During the dual camera output data of 20M configurations, then it can not implement.But if 12M resolution ratio and point higher than 12M are not used
The camera of resolution, the effect of super clear zoom enhancings can not be reached again, i.e., be still super clear image in zoomed image.
The content of the invention
The embodiment of the present invention provides a kind of method and mobile terminal of view data, to solve view data in ISP processing,
The problem of platform processes scarce capacity.
First aspect, there is provided a kind of processing method of view data, applied to mobile terminal, the mobile terminal includes
The digital signal processor DSP being connected with camera and image-signal processor ISP, the mobile terminal have the first shooting
Head and second camera, first camera configure with the first pixel, and the second camera configures with the second pixel,
The first pixel configuration configures higher than second pixel, and methods described includes：
The DSP obtains first view data of first camera based on the configuration output of the first pixel, and, it is described
Second view data of the second camera based on the configuration output of the second pixel；
Configured based on second pixel from described first image data and extract processing view data；
Using the processing view data and second view data synthesis destination image data；
The destination image data is sent to ISP.
Second aspect, there is provided a kind of mobile terminal, the mobile terminal include and camera and image-signal processor
The digital signal processor DSP that ISP is connected, the mobile terminal have the first camera and a second camera, and described first
Camera configures with the first pixel, and the second camera configures with the second pixel, and the first pixel configuration is higher than institute
The configuration of the second pixel is stated, the mobile terminal includes：
Image data acquisition module, the configuration output of the first pixel is based on for obtaining first camera in the DSP
The first view data, and, the second camera based on the second pixel configuration output the second view data；
Image data extraction module, processing is extracted for being configured based on second pixel from described first image data
View data；
Destination image data synthesis module, for using the processing view data and second view data synthesis mesh
Logo image data；
Destination image data sending module, for the destination image data to be sent to ISP.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, it is of the invention
Embodiment can be based on relatively low picture in DSP platform for the view data of the camera output configured with different pixels
The view data of element configuration from the camera output of higher pixel configuration is handled to obtain processing view data, is finally based on place
Reason view data and the view data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance so that without in ISP platform processes, efficiently solving ISP and putting down
The problem of platform disposal ability deficiency.
Brief description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
The accompanying drawing needed to use is briefly described, it should be apparent that, drawings in the following description are only some implementations of the present invention
Example, for those of ordinary skill in the art, without having to pay creative labor, can also be according to these accompanying drawings
Obtain other accompanying drawings.
Fig. 1 is a kind of step flow chart of the processing method embodiment of view data of the embodiment of the present invention one；
Fig. 2 is a kind of image procossing schematic diagram of view data of the present invention；
Fig. 3 is a kind of structured flowchart of mobile terminal embodiment of the embodiment of the present invention two；
Fig. 4 is the block diagram of the mobile terminal of another embodiment of the present invention；
Fig. 5 is the structural representation of the mobile terminal of another embodiment of the invention.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation describes, it is clear that described embodiment is part of the embodiment of the present invention, rather than whole embodiments.Based on this hair
Embodiment in bright, the every other implementation that those of ordinary skill in the art are obtained under the premise of creative work is not made
Example, belongs to the scope of protection of the invention.
Embodiment one
Reference picture 1, a kind of step flow chart of the processing method embodiment of view data of the present invention is shown, is applied to
Mobile terminal, the mobile terminal include the digital signal processor being connected with camera and image-signal processor ISP
DSP, the mobile terminal have the first camera and second camera, and first camera configures with the first pixel, institute
State second camera to configure with the second pixel, the first pixel configuration configures higher than second pixel, methods described tool
Body may include steps of：
Step 101, the DSP obtains first view data of first camera based on the configuration output of the first pixel,
And second view data of the second camera based on the configuration output of the second pixel；
In the specific implementation, having camera on mobile terminals, the quantity of camera can be two, naturally it is also possible to
It is three or more than three.The embodiment of the present invention adds DSP on the basis of the hardware frame of original mobile terminal
(Digital Signal Processing, digital signal processor) so that view data can be carried out before ISP is entered
More image procossings, lift the picture quality of view data.
It should be noted that the embodiment of the present invention on the basis of the hardware frame of original mobile terminal, adds DSP
(Digital Signal Processing, digital signal processor) so that view data is entering ISP (Image Signal
Processing, picture signal processing) before, more image processing functions can be realized, lift the image matter of view data
Amount.Specifically, there is sensor (sensor) in the camera module of camera, be provided with and camera in mobile terminal
The DSP that sensor is connected with ISP.Generally, the list that ISP is handled as the sensor output signals of camera in the terminal
Member, to match the sensor of different vendor.
Wherein, between DSP, sensor and ISP, MIPI (Mobile Industry Processor can be passed through
Interface, mobile Industry Processor Interface) connection, MIPI by the interface of interior of mobile phone such as camera, display screen interface, penetrate
Frequently/baseband interface etc. standardizes, it is possible to reduce the complexity and increase design flexibility of Cell Phone Design.Certainly, DSP,
It can also be attached between sensor and ISP by other interfaces, the embodiment of the present invention need not be any limitation as to this.
The DSP hardware module of the embodiment of the present invention, be RAW sections (such as to for the forms such as Bayer format RAW figure
As being handled, RAW image does not carry out being converted into the forms such as YUV due in ISP, therefore data volume is more, and detailed information is rich
It is rich) view data carry out the operation such as denoising, allow view data before ISP is entered, just there is relatively good noise performance, and
View data is handled by DSP, speed is fast for being handled in ISP, and in DSP many algorithms realization can also be used more
Kind function.By being pre-processed in DSP for view data, reduce in ISP processing procedures, reduce back-end processing difficulty,
Finally give better image quality.
ISP be can be integrated in it is in AP (Application Processor, application processor) or independent
Chip, the embodiment of the present invention need not be any limitation as to this, retransmited and carried out at ISP after DSP obtains the RAW image of result
Reason so that view data becomes apparent from, be natural and attractive in appearance.
In embodiments of the present invention, each camera has its corresponding pixel configuration, such as 12M or 20M respectively, this
In pixel configuration be refer to output resolution ratio be 12M or 20M view data.
Step 102, configured based on second pixel from described first image data and extract processing view data；
In the specific implementation, because some DSP and ISP disposal ability is inadequate, i.e., it can not handle high-resolution
View data.If platform maximum can only support 12M data, i.e., it can only handle 12M view data, it is impossible to handle 20M's
View data, then need to anticipate for view data so that 20M view data can be in DSP and ISP processing.
In one preferred embodiment of the invention, the step of step 102 includes：
Determine the central area of described first image data；
Based on the central area, go out what is be adapted with second pixel configuration from described first image extracting data
View data is as processing view data.
Specifically, it is assumed that the first view data is 20M, and its resolution ratio is 5000*4000, then need the first picture number
According to being converted to 12M；Assuming that be that resolution ratio is 4000*3000, then be from resolution ratio just 5000*4000 view data in, will
The 4000*3000 of central area view data takes out can.Now the first view data is converted into and the second figure
As the consistent resolution ratio of Data Representation.
Wherein, resolution ratio refers to image resolution ratio, i.e., the information content stored in image, is that how many is individual in per inch image
Pixel, the unit of resolution ratio is PPI (Pixels Per Inch), is generally termed：Pixel per inch.
It should be noted that processing view data and the described first image data show that resolution ratio is identical.Although carry
What is taken is the 12M view data in 20M view data, but is the equal of 20M view data in the performance of this 12M resolution ratio.
So subsequently carrying out the target image that image co-registration obtains, resolution ratio is above the result of single 12M image appearances.
Step 103, destination image data is synthesized using the processing view data and second view data；
After obtaining the first view data and the second view data, the first view data can be dissolved into second as far as possible
In view data, destination image data is generated, gives user more natural more excellent experience.
Understand shown in reference picture 2, held in the embodiment of the present invention for the view data that camera is 20M sensor outputs
Row Crop to 12M sensor are operated.Specifically, 12M view data is exactly extracted from 20M view data, for
Camera be 12M sensor output view data can not then do above-mentioned process operation, be then based on after working process by
Former 20M is converted to 12M view data and 12M view data is merged to obtain destination image data.Certainly, it is necessary to pay attention to
It is that the image data resolution now extracted will not change.
In summary, although being truncated to 12M view data from 20M view data, this 12M image resolution ratio table
On now, it is comparable to 20M's.So final composograph, is above the result of single 12M image appearances.
In one preferred embodiment of the invention, the step 103 may include steps of：Identify the processing figure
As the characteristic information in data；Extract the characteristic information；Processing is adjusted to the characteristic information；The adjustment is handled
Characteristic information afterwards is added to the designated area of second view data, synthesizes destination image data.
In the specific implementation, user can preassign the characteristic information that needs in the first image to identify.Due to the first figure
Image as generally including who object, therefore, this feature information preferably can be person characteristic information.Identify that feature is believed
After breath, further this feature information can be extracted, the follow-up basis for adjusting or merging is used as using this feature information.
In a kind of embodiment, processing is adjusted to characteristic information, can be the pixel and resolution ratio for improving characteristic information, make picture
Matter and the second image match as far as possible.
In addition, being adjusted processing to characteristic information, can also be：Automatic or manual to the visual angle of characteristic information, size,
Ratio, color, sensitivity, time for exposure and/or acutance etc. are adjusted processing, and can be cut, and are obtained more certainly with this
So satisfied effect.
In a kind of preferred embodiment of the present invention, processing can also be adjusted to second view data.For example, institute
State and processing is adjusted to the second image can include：Automatic detection identification is carried out to the photographed scene of the second image, identification is clapped
The scene taken the photograph, such as landscape, personage, motion, night scene etc..
In order that the image after merging is more naturally, the embodiment of the present invention is adjusted processing to the second image to wrap
The field depth for reducing the second image is included, to reach background blurring effect.
After characteristic information and/or the second image are adjusted into processing, characteristic information after can adjustment be handled as
Foreground information, second image are added to the specified area of the second image using characteristic information as new figure layer as background information
In domain, target image is generated.In the specific implementation, the designated area of the second image can be in the field depth of the second image
Region.Or the designated area can also be the region that user specifies in the second image manually.
, in actual applications, can also be it should be noted that above-mentioned image synthesis is merely possible to a kind of example just
DSP is synthesized using other modes, and, carry out other image processing operations.
Step 104, the destination image data is sent to ISP.
After handling to obtain original data in DSP completions, the original data is sent by MIPI interfaces
To ISP handle in next step.
In one preferred embodiment of the invention, methods described can also comprise the following steps：
Receive zoom request；
Determine the image-region for the view data that the zoom request is asked；
Zoom in or out the image-region of described image data.
Due to the destination image data that finally synthesizes of present invention implementation, the result of single 12M image appearances is above.Therefore
It is still super clear when especially amplification when carrying out image scaling.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, it is of the invention
Embodiment can be based on relatively low picture in DSP platform for the view data of the camera output configured with different pixels
The view data of element configuration from the camera output of higher pixel configuration is handled to obtain processing view data, is finally based on place
Reason view data and the view data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance so that without in ISP platform processes, efficiently solving ISP and putting down
The problem of platform disposal ability deficiency.
It should be noted that for embodiment of the method, in order to be briefly described, therefore it is all expressed as to a series of action group
Close, but those skilled in the art should know, the embodiment of the present invention is not limited by described sequence of movement, because according to
According to the embodiment of the present invention, some steps can use other orders or carry out simultaneously.Secondly, those skilled in the art also should
Know, embodiment described in this description belongs to preferred embodiment, and the involved action not necessarily present invention is implemented
Necessary to example.
Embodiment two
Reference picture 3, show the present invention a kind of mobile terminal embodiment structured flowchart, the mobile terminal include with
The digital signal processor DSP that camera is connected with image-signal processor ISP, the mobile terminal have the first camera
And second camera, first camera configure with the first pixel, the second camera configures with the second pixel, institute
State the configuration of the first pixel to configure higher than second pixel, the mobile terminal can specifically include following module：
Image data acquisition module 201, obtain first camera for the DSP and be based on the configuration output of the first pixel
The first view data, and, the second camera based on the second pixel configuration output the second view data；
Image data extraction module 202, extracted for being configured based on second pixel from described first image data
Handle view data；
Destination image data synthesis module 203, for being closed using the processing view data and second view data
Into destination image data；
Destination image data sending module 204, for the destination image data to be sent to ISP.
In one preferred embodiment of the invention, described image data extraction module 202 includes：
Central area determination sub-module, for determining the central area of described first image data；
Image data extraction submodule is handled, for based on the central area, from described first image extracting data
Go out and be used as processing view data for the view data being adapted with second pixel configuration size.
In one preferred embodiment of the invention, the destination image data synthesis module 203 includes：
Characteristic information identifies submodule, for identifying the characteristic information in the processing view data；
Feature information extraction submodule, for extracting the characteristic information；
Characteristic information adjustment processing submodule, for being adjusted processing to the characteristic information；
Destination image data synthesizes submodule, is added to second figure for the characteristic information after the adjustment is handled
As the designated area of data, destination image data is synthesized.
In one preferred embodiment of the invention, implementing mobile terminal also includes：
Zoom request receiving module, for receiving zoom request；
Image-region determining module, the image-region for the view data asked for determining the zoom request；
Image-region Zoom module, for zooming in or out the image-region of described image data.
For mobile terminal embodiment, because it is substantially similar to embodiment of the method, so description is fairly simple,
The relevent part can refer to the partial explaination of embodiments of method.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, it is of the invention
Embodiment can be based on relatively low picture in DSP platform for the view data of the camera output configured with different pixels
The view data of element configuration from the camera output of higher pixel configuration is handled to obtain processing view data, is finally based on place
Reason view data and the view data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance so that without in ISP platform processes, efficiently solving ISP and putting down
The problem of platform disposal ability deficiency.
Embodiment three
Fig. 4 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 700 shown in Fig. 4 includes：At least
One processor 701, memory 702, at least one network interface 704 and other users interface 703.In mobile terminal 700
Each component is coupled by bus system 705.It is understood that bus system 705 is used to realize the company between these components
Connect letter.Bus system 705 is in addition to including data/address bus, in addition to power bus, controlling bus and status signal bus in addition.But
It is for the sake of clear explanation, various buses is all designated as bus system 705 in Fig. 4.
Wherein, user interface 703 can include display, keyboard or pointing device (for example, mouse, trace ball
(trackball), touch-sensitive plate or touch-screen etc..
It is appreciated that the memory 702 in the embodiment of the present invention can be volatile memory or nonvolatile memory,
Or it may include both volatibility and nonvolatile memory.Wherein, nonvolatile memory can be read-only storage (Read-
OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), Erasable Programmable Read Only Memory EPROM
(ErasablePROM, EPROM), Electrically Erasable Read Only Memory (ElectricallyEPROM, EEPROM) dodge
Deposit.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is used as outside slow at a high speed
Deposit.By exemplary but be not restricted explanation, the RAM of many forms can use, such as static RAM
(StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory
(SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate
SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links
Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory
(DirectRambusRAM, DRRAM).The memory 702 of the system and method for description of the embodiment of the present invention is intended to include but unlimited
In these memories with any other suitable type.
In some embodiments, memory 702 stores following element, can perform module or data structure, or
Their subset of person, or their superset：Operating system 7021 and application program 7022.
Wherein, operating system 7021, comprising various system programs, such as ccf layer, core library layer, driving layer etc., it is used for
Realize various basic businesses and the hardware based task of processing.Application program 7022, include various application programs, such as media
Player (MediaPlayer), browser (Browser) etc., for realizing various applied business.Realize embodiment of the present invention side
The program of method may be embodied in application program 7022.
In embodiments of the present invention, by calling program or the instruction of the storage of memory 702, specifically, can be application
The program stored in program 7022 or instruction, processor 701 are used to be based on the first picture in DSP acquisitions first camera
First view data of element configuration output, and, second picture number of the second camera based on the configuration output of the second pixel
According to；Configured based on second pixel from described first image data and extract processing view data；Using the processing image
Data and second view data synthesis destination image data；The destination image data is sent to ISP.
The method that the embodiments of the present invention disclose can apply in processor 701, or be realized by processor 701.
Processor 701 is probably a kind of IC chip, has the disposal ability of signal.In implementation process, the above method it is each
Step can be completed by the integrated logic circuit of the hardware in processor 701 or the instruction of software form.Above-mentioned processing
Device 701 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), application specific integrated circuit
(ApplicationSpecific IntegratedCircuit, ASIC), ready-made programmable gate array
(FieldProgrammableGateArray, FPGA) either other PLDs, discrete gate or transistor logic
Device, discrete hardware components.It can realize or perform disclosed each method, step and the box in the embodiment of the present invention
Figure.General processor can be microprocessor or the processor can also be any conventional processor etc..With reference to the present invention
The step of method disclosed in embodiment, can be embodied directly in hardware decoding processor and perform completion, or use decoding processor
In hardware and software module combination perform completion.Software module can be located at random access memory, and flash memory, read-only storage can
In the ripe storage medium in this area such as program read-only memory or electrically erasable programmable memory, register.The storage
Medium is located at memory 702, and processor 701 reads the information in memory 702, and the step of the above method is completed with reference to its hardware
Suddenly.
It is understood that the embodiment of the present invention description these embodiments can use hardware, software, firmware, middleware,
Microcode or its combination are realized.Realized for hardware, processing unit can be realized in one or more application specific integrated circuits
(ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor
(DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device
(ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray,
FPGA), general processor, controller, microcontroller, microprocessor, other electronics lists for performing herein described function
In member or its combination.
For software realize, can by perform the module (such as process, function etc.) of function described in the embodiment of the present invention come
Realize the technology described in the embodiment of the present invention.Software code is storable in memory and passes through computing device.Memory can
To realize within a processor or outside processor.
Alternatively, processor 701 is additionally operable to：Determine the central area of described first image data；Based on the center
Domain, the view data for being to be adapted with second pixel configuration size is gone out from described first image extracting data and is used as processing
View data.
Alternatively, processor 701 is additionally operable to：Identify the characteristic information in the processing view data；Extract the feature
Information；Processing is adjusted to the characteristic information；Characteristic information after the adjustment is handled is added to second image
The designated area of data, synthesize destination image data.
Alternatively, processor 701 is additionally operable to：Receive zoom request；Determine the view data that the zoom request is asked
Image-region；Zoom in or out the image-region of described image data.
Mobile terminal 700 can realize each process that mobile terminal is realized in previous embodiment, to avoid repeating, here
Repeat no more.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, it is of the invention
Embodiment can be based on relatively low picture in DSP platform for the view data of the camera output configured with different pixels
The view data of element configuration from the camera output of higher pixel configuration is handled to obtain processing view data, is finally based on place
Reason view data and the view data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance so that without in ISP platform processes, efficiently solving ISP and putting down
The problem of platform disposal ability deficiency.
Example IV
Fig. 5 is the structural representation of the mobile terminal of another embodiment of the present invention.Specifically, the mobile terminal in Fig. 5
800 can be mobile phone, tablet personal computer, personal digital assistant (PersonalDigital Assistant, PDA) or vehicle-mounted computer
Deng.
Mobile terminal 800 in Fig. 5 includes radio frequency (RadioFrequency, RF) circuit 810, memory 820, input list
Member 830, display unit 840, processor 860, voicefrequency circuit 870, WiFi (WirelessFidelity) module 880 and power supply
890。
Wherein, input block 830 can be used for the numeral or character information for receiving user's input, and generation and mobile terminal
The signal input that 800 user is set and function control is relevant.Specifically, in the embodiment of the present invention, the input block 830 can
With including contact panel 831.Contact panel 831, also referred to as touch-screen, collect touch operation of the user on or near it
(for example user uses the operations of any suitable object or annex on contact panel 831 such as finger, stylus), and according to advance
The formula of setting drives corresponding attachment means.Optionally, contact panel 831 may include touch detecting apparatus and touch controller
Two parts.Wherein, the touch orientation of touch detecting apparatus detection user, and the signal that touch operation is brought is detected, by signal
Send touch controller to；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate,
Give the processor 860 again, and the order sent of reception processing device 860 and can be performed.Furthermore, it is possible to using resistance-type,
The polytypes such as condenser type, infrared ray and surface acoustic wave realize contact panel 831.Except contact panel 831, input block
830 can also include other input equipments 832, and other input equipments 832 can include but is not limited to physical keyboard, function key
One or more in (such as volume control button, switch key etc.), trace ball, mouse, action bars etc..
Wherein, display unit 840 can be used for display by the information of user's input or be supplied to information and the movement of user
The various menu interfaces of terminal 800.Display unit 840 may include display panel 841, optionally, can use LCD or organic hairs
The forms such as optical diode (OrganicLight-EmittingDiode, OLED) configure display panel 841.
It should be noted that contact panel 831 can cover display panel 841, touch display screen is formed, when the touch display screen is examined
After measuring the touch operation on or near it, processor 860 is sent to determine the type of touch event, is followed by subsequent processing device
860 provide corresponding visual output according to the type of touch event in touch display screen.
Touch display screen includes Application Program Interface viewing area and conventional control viewing area.The Application Program Interface viewing area
And arrangement mode of the conventional control viewing area does not limit, can be arranged above and below, left-right situs etc. can distinguish two it is aobvious
Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with
The interface element such as the icon comprising at least one application program and/or widget desktop controls.The Application Program Interface viewing area
It can also be the empty interface not comprising any content.The conventional control viewing area is used to show the higher control of utilization rate, for example,
Application icons such as settings button, interface numbering, scroll bar, phone directory icon etc..
Wherein processor 860 is the control centre of mobile terminal 800, utilizes various interfaces and connection whole mobile phone
Various pieces, by running or performing the software program and/or module that are stored in first memory 821, and call storage
Data in second memory 822, the various functions and processing data of mobile terminal 800 are performed, so as to mobile terminal 800
Carry out integral monitoring.Optionally, processor 860 may include one or more processing units.
In embodiments of the present invention, by call store the first memory 821 in software program and/or module and/
Or the data in the second memory 822, processor 860 are used to be based on the first picture in DSP acquisitions first camera
First view data of element configuration output, and, second picture number of the second camera based on the configuration output of the second pixel
According to；Configured based on second pixel from described first image data and extract processing view data；Using the processing image
Data and second view data synthesis destination image data；The destination image data is sent to ISP.
Alternatively, the processor 860 is additionally operable to, and determines the central area of described first image data；In described
Heart district domain, go out the view data conduct to be adapted with second pixel configuration size from described first image extracting data
Handle view data.
Alternatively, the processor 860 is additionally operable to, and identifies the characteristic information in the processing view data；Described in extraction
Characteristic information；Processing is adjusted to the characteristic information；Characteristic information after the adjustment is handled is added to described second
The designated area of view data, synthesize destination image data.
Alternatively, the processor 860 is additionally operable to, and receives zoom request；Determine the image that the zoom request is asked
The image-region of data；Zoom in or out the image-region of described image data.
For the embodiment of mobile terminal 800, because it is substantially similar to embodiment of the method, so the comparison of description is simple
Single, the relevent part can refer to the partial explaination of embodiments of method.
So, in the embodiment of the present invention, by increasing DSP hardware module on the original hardware frame of mobile terminal, make
The image that front end carries out view data can one step ahead be carried out before view data enters ISP by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, it is of the invention
Embodiment can be based on relatively low picture in DSP platform for the view data of the camera output configured with different pixels
The view data of element configuration from the camera output of higher pixel configuration is handled to obtain processing view data, is finally based on place
Reason view data and the view data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance so that without in ISP platform processes, efficiently solving ISP and putting down
The problem of platform disposal ability deficiency.
Those of ordinary skill in the art it is to be appreciated that with reference to disclosed in the embodiment of the present invention embodiment description it is each
The unit and algorithm steps of example, it can be realized with the combination of electronic hardware or computer software and electronic hardware.These
Function is performed with hardware or software mode actually, application-specific and design constraint depending on technical scheme.Specialty
Technical staff can realize described function using distinct methods to each specific application, but this realization should not
Think beyond the scope of this invention.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
In embodiment provided herein, it should be understood that disclosed apparatus and method, others can be passed through
Mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, is only
A kind of division of logic function, can there is an other dividing mode when actually realizing, for example, multiple units or component can combine or
Person is desirably integrated into another system, or some features can be ignored, or does not perform.Another, shown or discussed is mutual
Between coupling or direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, device or unit
Connect, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit
The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple
On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs
's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also
That unit is individually physically present, can also two or more units it is integrated in a unit.
If the function is realized in the form of SFU software functional unit and is used as independent production marketing or in use, can be with
It is stored in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part to be contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are causing a computer equipment (can be
People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the present invention.
And foregoing storage medium includes：USB flash disk, mobile hard disk, ROM, RAM, magnetic disc or CD etc. are various can be with store program codes
Medium.
The foregoing is only a specific embodiment of the invention, but protection scope of the present invention is not limited thereto, any
Those familiar with the art the invention discloses technical scope in, change or replacement can be readily occurred in, should all be contained
Cover within protection scope of the present invention.Therefore, protection scope of the present invention should be defined by scope of the claims.
Claims (10)
1. a kind of processing method of view data, applied to mobile terminal, it is characterised in that the mobile terminal includes and shooting
The digital signal processor DSP that is connected with image-signal processor ISP of head, the mobile terminal is with the first camera and the
Two cameras, first camera configure with the first pixel, and the second camera has a configuration of the second pixel, and described the
The configuration of one pixel configures higher than second pixel, and methods described includes：
The DSP obtains first view data of first camera based on the configuration output of the first pixel, and, described second
Second view data of the camera based on the configuration output of the second pixel；
Configured based on second pixel from described first image data and extract processing view data；
Using the processing view data and second view data synthesis destination image data；
The destination image data is sent to ISP.
2. according to the method for claim 1, it is characterised in that described to be configured based on second pixel from first figure
The step of extracting processing view data as data includes：
Determine the central area of described first image data；
Based on the central area, go out what is be adapted with second pixel configuration size from described first image extracting data
View data is as processing view data.
3. according to the method for claim 2, it is characterised in that the processing view data and described first image data
Show that resolution ratio is identical.
4. according to the method for claim 2, it is characterised in that described using the processing view data and second figure
As the step of Data Synthesis destination image data includes：
Identify the characteristic information in the processing view data；
Extract the characteristic information；
Processing is adjusted to the characteristic information；
Characteristic information after the adjustment is handled is added to the designated area of second view data, synthesizes target image number
According to.
5. according to the method for claim 1, it is characterised in that send the destination image data to ISP's described
After step, in addition to：
Receive zoom request；
Determine the image-region for the view data that the zoom request is asked；
Zoom in or out the image-region of described image data.
6. according to the method described in claim 1 or 2 or 3 or 4 or 5, it is characterised in that the DSP is based on mobile industry and handled
Device interface MIPI is connected between the camera and the ISP.
7. a kind of mobile terminal, it is characterised in that the mobile terminal includes being connected with camera and image-signal processor ISP
The digital signal processor DSP connect, the mobile terminal have the first camera and second camera, the first camera tool
There is the configuration of the first pixel, the second camera configures with the second pixel, and the first pixel configuration is higher than second picture
Element configuration, the mobile terminal include：
Image data acquisition module, for obtaining the of first camera based on the configuration output of the first pixel in the DSP
One view data, and, second view data of the second camera based on the configuration output of the second pixel；
Image data extraction module, processing image is extracted for being configured based on second pixel from described first image data
Data；
Destination image data synthesis module, for using the processing view data and second view data synthesis target figure
As data；
Destination image data sending module, for the destination image data to be sent to ISP.
8. mobile terminal according to claim 7, it is characterised in that described image data extraction module includes：
Central area determination sub-module, for determining the central area of described first image data；
Handle image data extraction submodule, for based on the central area, from described first image extracting data go out for
With the view data that second pixel configuration size is adapted as processing view data.
9. mobile terminal according to claim 7, it is characterised in that the destination image data synthesis module includes：
Characteristic information identifies submodule, for identifying the characteristic information in the processing view data；
Feature information extraction submodule, for extracting the characteristic information；
Characteristic information adjustment processing submodule, for being adjusted processing to the characteristic information；
Destination image data synthesizes submodule, is added to second picture number for the characteristic information after the adjustment is handled
According to designated area, synthesize destination image data.
10. mobile terminal according to claim 7, it is characterised in that also include：
Zoom request receiving module, for receiving zoom request；
Image-region determining module, the image-region for the view data asked for determining the zoom request；
Image-region Zoom module, for zooming in or out the image-region of described image data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710528159.4A CN107347139B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710528159.4A CN107347139B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107347139A true CN107347139A (en) | 2017-11-14 |
| CN107347139B CN107347139B (en) | 2019-01-29 |
Family
ID=60257310
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710528159.4A Active CN107347139B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107347139B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110013028A1 (en) * | 2009-07-17 | 2011-01-20 | Jie Zhou | Video stabilizing method and system using dual-camera system |
| CN103685951A (en) * | 2013-12-06 | 2014-03-26 | 华为终端有限公司 | Image processing method and device and terminal |
| WO2014069228A1 (en) * | 2012-11-05 | 2014-05-08 | 富士フイルム株式会社 | Image processing device, imaging device, image processing method, and program |
| CN103841326A (en) * | 2014-02-26 | 2014-06-04 | 宇龙计算机通信科技(深圳)有限公司 | Video recording method and device |
| CN104869320A (en) * | 2014-02-21 | 2015-08-26 | 三星电子株式会社 | Electronic device and control method of the same |
| CN105721841A (en) * | 2014-12-18 | 2016-06-29 | 全视科技有限公司 | High resolution array camera |
| CN105827965A (en) * | 2016-03-25 | 2016-08-03 | 维沃移动通信有限公司 | Image processing method based on mobile terminal and mobile terminal |
| CN106254780A (en) * | 2016-08-31 | 2016-12-21 | 宇龙计算机通信科技(深圳)有限公司 | A kind of dual camera camera control method, photographing control device and terminal |
-
2017
- 2017-06-30 CN CN201710528159.4A patent/CN107347139B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110013028A1 (en) * | 2009-07-17 | 2011-01-20 | Jie Zhou | Video stabilizing method and system using dual-camera system |
| WO2014069228A1 (en) * | 2012-11-05 | 2014-05-08 | 富士フイルム株式会社 | Image processing device, imaging device, image processing method, and program |
| CN103685951A (en) * | 2013-12-06 | 2014-03-26 | 华为终端有限公司 | Image processing method and device and terminal |
| CN104869320A (en) * | 2014-02-21 | 2015-08-26 | 三星电子株式会社 | Electronic device and control method of the same |
| CN103841326A (en) * | 2014-02-26 | 2014-06-04 | 宇龙计算机通信科技(深圳)有限公司 | Video recording method and device |
| CN105721841A (en) * | 2014-12-18 | 2016-06-29 | 全视科技有限公司 | High resolution array camera |
| CN105827965A (en) * | 2016-03-25 | 2016-08-03 | 维沃移动通信有限公司 | Image processing method based on mobile terminal and mobile terminal |
| CN106254780A (en) * | 2016-08-31 | 2016-12-21 | 宇龙计算机通信科技(深圳)有限公司 | A kind of dual camera camera control method, photographing control device and terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107347139B (en) | 2019-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105872148B (en) | A kind of generation method and mobile terminal of high dynamic range images | |
| CN107277387B (en) | High dynamic range images image pickup method, terminal and computer readable storage medium | |
| CN106791400B (en) | A kind of image display method and mobile terminal | |
| CN105827971B (en) | A kind of image processing method and mobile terminal | |
| CN105847674B (en) | A kind of preview image processing method and mobile terminal based on mobile terminal | |
| CN106060406B (en) | Photographing method and mobile terminal | |
| CN105827754B (en) | A kind of generation method and mobile terminal of high dynamic range images | |
| CN107222680A (en) | The image pickup method and mobile terminal of a kind of panoramic picture | |
| CN107197169A (en) | A kind of high dynamic range images image pickup method and mobile terminal | |
| CN107205119B (en) | A kind for the treatment of method and apparatus of image data | |
| CN107395898A (en) | A kind of image pickup method and mobile terminal | |
| CN105959544B (en) | A kind of image processing method and mobile terminal of mobile terminal | |
| CN107277351A (en) | The processing method and mobile terminal of a kind of view data | |
| CN107395976B (en) | A kind of acquisition parameters setting method and mobile terminal | |
| CN105827965A (en) | Image processing method based on mobile terminal and mobile terminal | |
| CN107147837A (en) | The method to set up and mobile terminal of a kind of acquisition parameters | |
| CN106126108B (en) | A kind of generation method and mobile terminal of thumbnail | |
| CN107395997A (en) | A kind of image pickup method and mobile terminal | |
| CN106101545A (en) | A kind of image processing method and mobile terminal | |
| CN107155064B (en) | A kind of image pickup method and mobile terminal | |
| CN107317993A (en) | A kind of video call method and mobile terminal | |
| CN107026982B (en) | A kind of photographic method and mobile terminal of mobile terminal | |
| CN107172346A (en) | A kind of weakening method and mobile terminal | |
| CN105959574B (en) | A kind of photographic method and mobile terminal | |
| CN105827963B (en) | Scene-change detecting method and mobile terminal during one kind is taken pictures |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |