CN107347139B - A kind of processing method and mobile terminal of image data - Google Patents
A kind of processing method and mobile terminal of image data Download PDFInfo
- Publication number
- CN107347139B CN107347139B CN201710528159.4A CN201710528159A CN107347139B CN 107347139 B CN107347139 B CN 107347139B CN 201710528159 A CN201710528159 A CN 201710528159A CN 107347139 B CN107347139 B CN 107347139B
- Authority
- CN
- China
- Prior art keywords
- image data
- pixel configuration
- camera
- processing
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/95—Computational photography systems, e.g. light-field imaging systems
- H04N23/951—Computational photography systems, e.g. light-field imaging systems by using two or more images to influence resolution, frame rate or aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
Abstract
The embodiment of the invention provides a kind of processing method of image data and mobile terminals, the mobile terminal includes the digital signal processor DSP being connected with camera and image-signal processor ISP, the mobile terminal has the first camera and second camera, first camera has the first pixel configuration, the second camera has the second pixel configuration, first pixel configuration is higher than second pixel configuration, the described method includes: the DSP obtains the first image data that first camera is exported based on the first pixel configuration, and, the second image data that the second camera is exported based on the second pixel configuration；Processing image data is extracted from the first image data based on second pixel configuration；Destination image data is synthesized using the processing image data and second image data；The destination image data is sent to ISP.The embodiment of the present invention solves the problems, such as ISP platform processes scarce capacity.
Description
Technical field
The present invention relates to fields of communication technology, more particularly to the processing method and mobile terminal of a kind of image data.
Background technique
Existing mobile terminal increasingly values camera and takes pictures the performance of imaging effect, the noise of image and clarity, this
The prime competing factor of businessman is also increasingly becomed a bit.
The image processing techniques of the platform processor manufacturer of mobile terminal is different in detail, but general method
It is: obtains the lattice such as RGB, YUV carrying out image procossing by ISP (Image Signal Processing, image signal process)
The denoising of the image data and then progress image data of formula and the promotion of clarity.
In ISP platform, it can also realize and double take the photograph super clear zoom enhanced scheme, wherein zoom refers to scaling, i.e., for scheming
As zooming in or out, the effect of generation is that user is allowed to feel to push towards or zoom out focal length when taking pictures.Specifically, Yi Zhongshi
Existing scheme is: using two to export image for the camera of 12M+20M pixel configuration, then carries out image co-registration, finally export
12M image reaches high resolution in the zoom effect of single camera output 12M image.
However, the scheme of this super clear zoom enhancing, encounter platform processes ability not enough, 12M+ cannot be received simultaneously
When the dual camera output data of 20M configuration, then it cannot implement.But if the resolution ratio of 12M and point higher than 12M are not used
The camera of resolution, and cannot achieve the effect that super clear zoom enhancing, i.e., it is still super clear image in zoomed image.
Summary of the invention
The embodiment of the present invention provides the method and mobile terminal of a kind of image data, is handled with solving image data in ISP,
The problem of platform processes scarce capacity.
In a first aspect, providing a kind of processing method of image data, it is applied to mobile terminal, the mobile terminal includes
The digital signal processor DSP being connected with camera and image-signal processor ISP, the mobile terminal have the first camera shooting
Head and second camera, first camera have the first pixel configuration, and the second camera has the second pixel configuration,
First pixel configuration is higher than second pixel configuration, which comprises
The DSP obtains the first image data that first camera is exported based on the first pixel configuration, and, it is described
The second image data that second camera is exported based on the second pixel configuration；
Processing image data is extracted from the first image data based on second pixel configuration；
Destination image data is synthesized using the processing image data and second image data；
The destination image data is sent to ISP.
Second aspect, provides a kind of mobile terminal, and the mobile terminal includes and camera and image-signal processor
The digital signal processor DSP that ISP is connected, the mobile terminal have the first camera and second camera, described first
Camera has the first pixel configuration, and the second camera has the second pixel configuration, and first pixel configuration is higher than institute
The second pixel configuration is stated, the mobile terminal includes:
Image data acquisition module is exported for obtaining first camera in the DSP based on the first pixel configuration
The first image data, and, the second image data that the second camera is exported based on the second pixel configuration；
Image data extraction module, for extracting processing from the first image data based on second pixel configuration
Image data；
Destination image data synthesis module, for synthesizing mesh using the processing image data and second image data
Logo image data；
Destination image data sending module, for the destination image data to be sent to ISP.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
Embodiment can be based on lower picture in DSP platform for the image data of the camera output configured with different pixels
The image data for the camera output that element configuration is configured from higher pixel is handled to obtain processing image data, finally based on place
Reason image data and the image data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance, so that not having to that it is flat to efficiently solve ISP in ISP platform processes
The problem of platform processing capacity deficiency.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention
Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention
Example, for those of ordinary skill in the art, without any creative labor, can also be according to these attached drawings
Obtain other attached drawings.
Fig. 1 is a kind of step flow chart of the processing method embodiment of image data of the embodiment of the present invention one；
Fig. 2 is a kind of image procossing schematic diagram of image data of the invention；
Fig. 3 is a kind of structural block diagram of mobile terminal embodiment of the embodiment of the present invention two；
Fig. 4 is the block diagram of the mobile terminal of another embodiment of the present invention；
Fig. 5 is the structural schematic diagram of the mobile terminal of another embodiment of the invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
Embodiment one
Referring to Fig.1, a kind of step flow chart of the processing method embodiment of image data of the invention is shown, is applied to
Mobile terminal, the mobile terminal include the digital signal processor being connected with camera and image-signal processor ISP
DSP, the mobile terminal have the first camera and second camera, and first camera has the first pixel configuration, institute
Second camera is stated with the second pixel configuration, first pixel configuration is higher than second pixel configuration, the method tool
Body may include steps of:
Step 101, the DSP obtains the first image data that first camera is exported based on the first pixel configuration,
And the second image data that the second camera is exported based on the second pixel configuration；
In the concrete realization, there is camera on mobile terminals, the quantity of camera can be two, naturally it is also possible to
It is three or three or more.The embodiment of the present invention adds DSP on the basis of the hardware frame of original mobile terminal
(Digital Signal Processing, digital signal processor), so that image data is able to carry out before entering ISP
More image procossings promote the picture quality of image data.
It should be noted that the embodiment of the present invention on the basis of hardware frame of original mobile terminal, adds DSP
(Digital Signal Processing, digital signal processor), so that image data is entering ISP (Image Signal
Processing, image signal process) before, it can be realized more image processing functions, promote the image matter of image data
Amount.Specifically, there is sensor (sensor) in the camera module of camera, is provided with and camera in mobile terminal
The DSP that sensor is connected with ISP.In general, the list that ISP is used as the sensor output signal of camera to handle in the terminal
Member, to match the sensor of different vendor.
Wherein, between DSP, sensor and ISP, MIPI (Mobile Industry Processor can be passed through
Interface, mobile industry processor interface) connection, MIPI by the interface of interior of mobile phone such as camera, display screen interface, penetrate
The standardization such as frequently/baseband interface, it is possible to reduce the complexity and increase design flexibility of Cell Phone Design.Certainly, DSP,
It can also be attached by other interfaces between sensor and ISP, the embodiment of the present invention need not be limit to this.
The DSP hardware module of the embodiment of the present invention, be the section RAW (such as to for the formats such as Bayer format RAW figure
As being handled, RAW image is converted into the formats such as YUV due to not carrying out in ISP, and data volume is more, and detailed information is rich
It is rich) image data carry out the operation such as denoising, allow image data before entering ISP, just there is relatively good noise to show, and
Handle image data by DSP, relative to for ISP is handled speed it is fast, and DSP can also use many algorithms realize it is more
Kind function.By pre-processing in DSP for image data, reduction reduces back-end processing difficulty in ISP treatment process,
Finally obtain better image quality.
ISP is can integrate in AP (Application Processor, application processor), is also possible to independent
Chip, the embodiment of the present invention need not be limit to this, retransmits and is carried out at ISP after the RAW image that DSP obtains result
Reason, so that image data is more clear, nature and beauty.
In embodiments of the present invention, each camera is respectively provided with its corresponding pixel configuration, such as 12M or 20M, this
In pixel configuration be refer to output resolution ratio be 12M or 20M image data.
Step 102, processing image data is extracted from the first image data based on second pixel configuration；
In the concrete realization, since the processing capacity of certain DSP and ISP is inadequate, i.e., high-resolution can not be handled
Image data.If platform maximum can only support the data of 12M, i.e., the image data of 12M can only be handled, cannot handle 20M's
Image data then needs to pre-process image data, and the image data of 20M is handled in DSP and ISP.
In one preferred embodiment of the invention, the step of step 102 includes:
Determine the central area of the first image data；
Based on the central area, extracted from the first image data compatible with second pixel configuration
Image data is as processing image data.
Specifically, it is assumed that the first image data is 20M, and resolution ratio is 5000*4000, then needing the first picture number
According to being converted to 12M；Assuming that be resolution ratio be 4000*3000, then be in the image data of 5000*4000 from resolution ratio just, it will
The image data of the 4000*3000 of central area is taken out can.The first image data is converted into and the second figure at this time
As the consistent resolution ratio of Data Representation.
Wherein, resolution ratio refers to that image resolution ratio, i.e., the information content stored in image are that how many is a in per inch image
The unit of pixel, resolution ratio is PPI (Pixels Per Inch), is generally termed: pixel per inch.
It should be noted that processing image data and the first image data show that resolution ratio is identical.Although mentioning
What is taken is the 12M image data in 20M image data, but is the equal of 20M image data in the performance of this 12M resolution ratio.
So the subsequent target image for carrying out image co-registration and obtaining, resolution ratio are above the result of single 12M image appearance.
Step 103, destination image data is synthesized using the processing image data and second image data；
After obtaining the first image data and the second image data, the first image data can be dissolved into second as far as possible
In image data, destination image data is generated, gives user more natural more excellent experience.
It is found that being held in the embodiment of the present invention for the image data that camera is 20M sensor output referring to shown in Fig. 2
Row Crop to 12M sensor operation.Specifically, 12M image data is exactly extracted from 20M image data, for
Camera be 12M sensor output image data can not then do above-mentioned process operation, after being then based on working process by
Former 20M is converted to 12M image data and 12M image data is merged to obtain destination image data.Certainly, it should be noted that
It is that the image data resolution extracted at this time will not change.
In summary, although being truncated to 12M image data from 20M image data, this 12M image resolution ratio table
On now, it is comparable to 20M's.So final composograph, is above the result of single 12M image appearance.
In one preferred embodiment of the invention, the step 103 may include steps of: the identification processing figure
As the characteristic information in data；Extract the characteristic information；Processing is adjusted to the characteristic information；The adjustment is handled
Characteristic information afterwards is added to the specified region of second image data, synthesizes destination image data.
In the concrete realization, user can preassign the characteristic information for needing to identify in the first image.Due to the first figure
As generally comprising the image of who object, therefore, this feature information preferably can be person characteristic information.Identify that feature is believed
After breath, further this feature information can be extracted, using this feature information as subsequent adjustment or combined basis.?
In a kind of embodiment, processing is adjusted to characteristic information, can be the pixel and resolution ratio for improving characteristic information, make picture
Matter and the second image match as far as possible.
, can be in addition, be adjusted processing to characteristic information are as follows: automatic or manual to the visual angle of characteristic information, size,
Ratio, color, sensitivity, time for exposure and/or acutance etc. are adjusted processing, and can be carried out cutting, are obtained more certainly with this
So satisfied effect.
In a kind of preferred embodiment of the present invention, processing can also be adjusted to second image data.For example, institute
Stating and being adjusted processing to the second image may include: to carry out automatic detection identification to the photographed scene of the second image, and identification is clapped
The scene taken the photograph, such as landscape, personage, movement, night scene etc..
In order to make the image after merging more naturally, the embodiment of the present invention is adjusted processing to the second image to wrap
The field depth for reducing the second image is included, it is background blurring to achieve the effect that.
After characteristic information and/or the second image are adjusted processing, can will adjustment treated characteristic information as
Foreground information, second image are added to the specified area of the second image using characteristic information as new figure layer as background information
In domain, target image is generated.In the concrete realization, the specified region of the second image can be in the field depth of the second image
Region.Alternatively, the region that the specified region can also specify in the second image manually for user.
It, in practical applications, can also be it should be noted that above-mentioned image synthesis is merely possible to a kind of example just
DSP is synthesized using other modes, and, carry out other image processing operations.
Step 104, the destination image data is sent to ISP.
After DSP completion handles to obtain original data, which is sent by MIPI interface
It is handled in next step to ISP progress.
In one preferred embodiment of the invention, the method can also include the following steps:
Receive zoom request；
Determine the image-region of the requested image data of the zoom request；
Zoom in or out the image-region of described image data.
Due to the destination image data that present invention implementation finally synthesizes, it is above the result of single 12M image appearance.Therefore
It is still super clear when especially amplification when carrying out image scaling.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
Embodiment can be based on lower picture in DSP platform for the image data of the camera output configured with different pixels
The image data for the camera output that element configuration is configured from higher pixel is handled to obtain processing image data, finally based on place
Reason image data and the image data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance, so that not having to that it is flat to efficiently solve ISP in ISP platform processes
The problem of platform processing capacity deficiency.
It should be noted that for simple description, therefore, it is stated as a series of action groups for embodiment of the method
It closes, but those skilled in the art should understand that, embodiment of that present invention are not limited by the describe sequence of actions, because according to
According to the embodiment of the present invention, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art also should
Know, the embodiments described in the specification are all preferred embodiments, and the related movement not necessarily present invention is implemented
Necessary to example.
Embodiment two
Referring to Fig. 3, show a kind of structural block diagram of mobile terminal embodiment of the invention, the mobile terminal include with
The digital signal processor DSP that camera is connected with image-signal processor ISP, the mobile terminal have the first camera
And second camera, first camera have the first pixel configuration, the second camera has the second pixel configuration, institute
The first pixel configuration is stated higher than second pixel configuration, the mobile terminal can specifically include following module:
Image data acquisition module 201 is obtained first camera for the DSP and is exported based on the first pixel configuration
The first image data, and, the second image data that the second camera is exported based on the second pixel configuration；
Image data extraction module 202, for being extracted based on second pixel configuration from the first image data
Handle image data；
Destination image data synthesis module 203, for being closed using the processing image data and second image data
At destination image data；
Destination image data sending module 204, for the destination image data to be sent to ISP.
In one preferred embodiment of the invention, described image data extraction module 202 includes:
Central area determines submodule, for determining the central area of the first image data；
Image data extraction submodule is handled, for being based on the central area, is extracted from the first image data
It is out image data compatible with the second pixel configuration size as processing image data.
In one preferred embodiment of the invention, the destination image data synthesis module 203 includes:
Characteristic information identifies submodule, for identification the characteristic information in the processing image data；
Feature information extraction submodule, for extracting the characteristic information；
Characteristic information adjustment processing submodule, for being adjusted processing to the characteristic information；
Destination image data synthesizes submodule, for by the adjustment, treated that characteristic information is added to second figure
As the specified region of data, destination image data is synthesized.
In one preferred embodiment of the invention, implement mobile terminal further include:
Zoom request receiving module, for receiving zoom request；
Image-region determining module, for determining the image-region of the requested image data of the zoom request；
Image-region Zoom module, for zooming in or out the image-region of described image data.
For mobile terminal embodiment, since it is basically similar to the method embodiment, so be described relatively simple,
The relevent part can refer to the partial explaination of embodiments of method.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
Embodiment can be based on lower picture in DSP platform for the image data of the camera output configured with different pixels
The image data for the camera output that element configuration is configured from higher pixel is handled to obtain processing image data, finally based on place
Reason image data and the image data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance, so that not having to that it is flat to efficiently solve ISP in ISP platform processes
The problem of platform processing capacity deficiency.
Embodiment three
Fig. 4 is the block diagram of the mobile terminal of another embodiment of the present invention.Mobile terminal 700 shown in Fig. 4 includes: at least
One processor 701, memory 702, at least one network interface 704 and other users interface 703.In mobile terminal 700
Various components are coupled by bus system 705.It is understood that bus system 705 is for realizing the company between these components
Connect letter.Bus system 705 further includes power bus, control bus and status signal bus in addition in addition to including data/address bus.But
It is that various buses are all designated as bus system 705 in Fig. 4 for the sake of clear explanation.
Wherein, user interface 703 may include display, keyboard or pointing device (for example, mouse, trace ball
(trackball), touch-sensitive plate or touch screen etc..
It is appreciated that the memory 702 in the embodiment of the present invention can be volatile memory or nonvolatile memory,
It or may include both volatile and non-volatile memories.Wherein, nonvolatile memory can be read-only memory (Read-
OnlyMemory, ROM), programmable read only memory (ProgrammableROM, PROM), Erasable Programmable Read Only Memory EPROM
(ErasablePROM, EPROM), electrically erasable programmable read-only memory (ElectricallyEPROM, EEPROM) dodge
It deposits.Volatile memory can be random access memory (RandomAccessMemory, RAM), and it is slow to be used as external high speed
It deposits.By exemplary but be not restricted explanation, the RAM of many forms is available, such as static random access memory
(StaticRAM, SRAM), dynamic random access memory (DynamicRAM, DRAM), Synchronous Dynamic Random Access Memory
(SynchronousDRAM, SDRAM), double data speed synchronous dynamic RAM (DoubleDataRate
SDRAM, DDRSDRAM), enhanced Synchronous Dynamic Random Access Memory (Enhanced SDRAM, ESDRAM), synchronized links
Dynamic random access memory (SynchlinkDRAM, SLDRAM) and direct rambus random access memory
(DirectRambusRAM, DRRAM).The memory 702 of the system and method for description of the embodiment of the present invention is intended to include but unlimited
In the memory of these and any other suitable type.
In some embodiments, memory 702 stores following element, executable modules or data structures, or
Their subset of person or their superset: operating system 7021 and application program 7022.
Wherein, operating system 7021 include various system programs, such as ccf layer, core library layer, driving layer etc., are used for
Realize various basic businesses and the hardware based task of processing.Application program 7022 includes various application programs, such as media
Player (MediaPlayer), browser (Browser) etc., for realizing various applied business.Realize embodiment of the present invention side
The program of method may be embodied in application program 7022.
In embodiments of the present invention, by the program or instruction of calling memory 702 to store, specifically, can be application
The program or instruction stored in program 7022, processor 701, which is used to obtain first camera in the DSP, is based on the first picture
First image data of element configuration output, and, the second picture number that the second camera is exported based on the second pixel configuration
According to；Processing image data is extracted from the first image data based on second pixel configuration；Using the processing image
Data and second image data synthesize destination image data；The destination image data is sent to ISP.
The method that the embodiments of the present invention disclose can be applied in processor 701, or be realized by processor 701.
Processor 701 may be a kind of IC chip, the processing capacity with signal.During realization, the above method it is each
Step can be completed by the integrated logic circuit of the hardware in processor 701 or the instruction of software form.Above-mentioned processing
Device 701 can be general processor, digital signal processor (DigitalSignalProcessor, DSP), specific integrated circuit
(ApplicationSpecific IntegratedCircuit, ASIC), ready-made programmable gate array
(FieldProgrammableGateArray, FPGA) either other programmable logic device, discrete gate or transistor logic
Device, discrete hardware components.It may be implemented or execute disclosed each method, step and the logical box in the embodiment of the present invention
Figure.General processor can be microprocessor or the processor is also possible to any conventional processor etc..In conjunction with the present invention
The step of method disclosed in embodiment, can be embodied directly in hardware decoding processor and execute completion, or use decoding processor
In hardware and software module combination execute completion.Software module can be located at random access memory, and flash memory, read-only memory can
In the storage medium of this fields such as program read-only memory or electrically erasable programmable memory, register maturation.The storage
Medium is located at memory 702, and processor 701 reads the information in memory 702, and the step of the above method is completed in conjunction with its hardware
Suddenly.
It is understood that the embodiment of the present invention description these embodiments can with hardware, software, firmware, middleware,
Microcode or combinations thereof is realized.For hardware realization, processing unit be may be implemented in one or more specific integrated circuits
(ApplicationSpecificIntegratedCircuits, ASIC), digital signal processor
(DigitalSignalProcessing, DSP), digital signal processing appts (DSPDevice, DSPD), programmable logic device
(ProgrammableLogicDevice, PLD), field programmable gate array (Field-ProgrammableGateArray,
FPGA), general processor, controller, microcontroller, microprocessor, other electronics lists for executing herein described function
In member or combinations thereof.
For software implementations, can by execute the embodiment of the present invention described in function module (such as process, function etc.) come
Realize technology described in the embodiment of the present invention.Software code is storable in memory and is executed by processor.Memory can
With portion realizes in the processor or outside the processor.
Optionally, processor 701 is also used to: determining the central area of the first image data；Based on the center
Domain is extracted as image data compatible with the second pixel configuration size from the first image data as processing
Image data.
Optionally, processor 701 is also used to: the characteristic information in the identification processing image data；Extract the feature
Information；Processing is adjusted to the characteristic information；By the adjustment, treated that characteristic information is added to second image
The specified region of data synthesizes destination image data.
Optionally, processor 701 is also used to: receiving zoom request；Determine the requested image data of the zoom request
Image-region；Zoom in or out the image-region of described image data.
Mobile terminal 700 can be realized each process that mobile terminal is realized in previous embodiment, to avoid repeating, here
It repeats no more.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
Embodiment can be based on lower picture in DSP platform for the image data of the camera output configured with different pixels
The image data for the camera output that element configuration is configured from higher pixel is handled to obtain processing image data, finally based on place
Reason image data and the image data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance, so that not having to that it is flat to efficiently solve ISP in ISP platform processes
The problem of platform processing capacity deficiency.
Example IV
Fig. 5 is the structural schematic diagram of the mobile terminal of another embodiment of the present invention.Specifically, the mobile terminal in Fig. 5
800 can be mobile phone, tablet computer, personal digital assistant (PersonalDigital Assistant, PDA) or vehicle-mounted computer
Deng.
Mobile terminal 800 in Fig. 5 includes radio frequency (RadioFrequency, RF) circuit 810, memory 820, input list
Member 830, display unit 840, processor 860, voicefrequency circuit 870, WiFi (WirelessFidelity) module 880 and power supply
890。
Wherein, input unit 830 can be used for receiving the number or character information of user's input, and generation and mobile terminal
The related signal input of 800 user setting and function control.Specifically, in the embodiment of the present invention, which can
To include touch panel 831.Touch panel 831, also referred to as touch screen collect the touch operation of user on it or nearby
(for example user uses the operations of any suitable object or attachment on touch panel 831 such as finger, stylus), and according to preparatory
The formula of setting drives corresponding attachment device.Optionally, touch panel 831 may include touch detecting apparatus and touch controller
Two parts.Wherein, the touch orientation of touch detecting apparatus detection user, and touch operation bring signal is detected, by signal
Send touch controller to；Touch controller receives touch information from touch detecting apparatus, and is converted into contact coordinate,
The processor 860 is given again, and can be received order that processor 860 is sent and be executed.Furthermore, it is possible to using resistance-type,
The multiple types such as condenser type, infrared ray and surface acoustic wave realize touch panel 831.In addition to touch panel 831, input unit
830 can also include other input equipments 832, other input equipments 832 can include but is not limited to physical keyboard, function key
One of (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. are a variety of.
Wherein, display unit 840 can be used for showing information input by user or be supplied to the information and movement of user
The various menu interfaces of terminal 800.Display unit 840 may include display panel 841, optionally, can use LCD or organic hair
The forms such as optical diode (OrganicLight-EmittingDiode, OLED) configure display panel 841.
It should be noted that touch panel 831 can cover display panel 841, touch display screen is formed, when the touch display screen is examined
After measuring touch operation on it or nearby, processor 860 is sent to determine the type of touch event, is followed by subsequent processing device
860 provide corresponding visual output according to the type of touch event in touch display screen.
Touch display screen includes Application Program Interface viewing area and common control viewing area.The Application Program Interface viewing area
And arrangement mode of the common control viewing area does not limit, can be arranged above and below, left-right situs etc. can distinguish two it is aobvious
Show the arrangement mode in area.The Application Program Interface viewing area is displayed for the interface of application program.Each interface can be with
The interface elements such as the icon comprising at least one application program and/or widget desktop control.The Application Program Interface viewing area
Or the empty interface not comprising any content.This commonly uses control viewing area for showing the higher control of utilization rate, for example,
Application icons such as button, interface number, scroll bar, phone directory icon etc. are set.
Wherein processor 860 is the control centre of mobile terminal 800, utilizes various interfaces and connection whole mobile phone
Various pieces, by running or executing the software program and/or module that are stored in first memory 821, and calling storage
Data in second memory 822 execute the various functions and processing data of mobile terminal 800, thus to mobile terminal 800
Carry out integral monitoring.Optionally, processor 860 may include one or more processing units.
In embodiments of the present invention, by call store the first memory 821 in software program and/or module and/
Or the data in the second memory 822, processor 860, which is used to obtain first camera in the DSP, is based on the first picture
First image data of element configuration output, and, the second picture number that the second camera is exported based on the second pixel configuration
According to；Processing image data is extracted from the first image data based on second pixel configuration；Using the processing image
Data and second image data synthesize destination image data；The destination image data is sent to ISP.
Optionally, the processor 860 is also used to, and determines the central area of the first image data；In described
Heart district domain is extracted from the first image data as image data conduct compatible with the second pixel configuration size
Handle image data.
Optionally, the processor 860 is also used to, and identifies the characteristic information in the processing image data；Described in extraction
Characteristic information；Processing is adjusted to the characteristic information；By the adjustment, treated that characteristic information is added to described second
The specified region of image data synthesizes destination image data.
Optionally, the processor 860 is also used to, and receives zoom request；Determine the requested image of the zoom request
The image-region of data；Zoom in or out the image-region of described image data.
For 800 embodiment of mobile terminal, since it is basically similar to the method embodiment, so the comparison of description is simple
Single, the relevent part can refer to the partial explaination of embodiments of method.
In this way, by increasing DSP hardware module on the original hardware frame of mobile terminal, making in the embodiment of the present invention
The image that front end carries out image data can be carried out before image data enters ISP one step ahead by obtaining the embodiment of the present invention
Processing, obtains being then forwarded to rear end ISP after the original data of more preferable quality and is further processed.Specifically, of the invention
Embodiment can be based on lower picture in DSP platform for the image data of the camera output configured with different pixels
The image data for the camera output that element configuration is configured from higher pixel is handled to obtain processing image data, finally based on place
Reason image data and the image data of higher pixel configuration output merged to obtain destination image data export it is further to ISP
Processing, the embodiment of the present invention carry out fusion treatment in DSP in advance, so that not having to that it is flat to efficiently solve ISP in ISP platform processes
The problem of platform processing capacity deficiency.
Those of ordinary skill in the art may be aware that the embodiment in conjunction with disclosed in the embodiment of the present invention describe it is each
Exemplary unit and algorithm steps can be realized with the combination of electronic hardware or computer software and electronic hardware.These
Function is implemented in hardware or software actually, the specific application and design constraint depending on technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and unit, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In embodiment provided herein, it should be understood that disclosed device and method can pass through others
Mode is realized.For example, the apparatus embodiments described above are merely exemplary, for example, the division of the unit, only
A kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or components can combine or
Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual
Between coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING or communication link of device or unit
It connects, can be electrical property, mechanical or other forms.
The unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, the functional units in various embodiments of the present invention may be integrated into one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product
It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words
The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a
People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention.
And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, ROM, RAM, magnetic or disk etc. are various can store program code
Medium.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.
Claims (8)
1. a kind of processing method of image data, it is applied to mobile terminal, which is characterized in that the mobile terminal includes and camera shooting
The digital signal processor DSP that is connected with image-signal processor ISP of head, the mobile terminal is with the first camera and the
Two cameras, first camera have the first pixel configuration, and the second camera has the second pixel configuration, and described the
One pixel configuration is higher than second pixel configuration, which comprises
The DSP obtains the first image data that first camera is exported based on the first pixel configuration, and, described second
The second image data that camera is exported based on the second pixel configuration；
Processing image data is extracted from the first image data based on second pixel configuration；
Destination image data is synthesized using the processing image data and second image data；
The destination image data is sent to ISP；
Wherein, the step of processing image data is extracted from the first image data based on second pixel configuration packet
It includes:
Determine the central area of the first image data；
Based on the central area, extracted from the first image data compatible with the second pixel configuration size
Image data is as processing image data；
Wherein, first pixel configuration refers to the image data of output first resolution；Second pixel configuration refers to defeated
The image data of second resolution out.
2. the method according to claim 1, wherein the processing image data and the first image data
Resolution ratio is identical.
3. the method according to claim 1, wherein described use the processing image data and second figure
As the step of Data Synthesis destination image data includes:
Identify the characteristic information in the processing image data；
Extract the characteristic information；
Processing is adjusted to the characteristic information；
By the specified region of the adjustment treated characteristic information is added to second image data, target image number is synthesized
According to.
4. the method according to claim 1, wherein the destination image data is sent to ISP's described
After step, further includes:
Receive zoom request；
Determine the image-region of the requested image data of the zoom request；
Zoom in or out the image-region of described image data.
5. method according to claim 1 or 2 or 3 or 4, which is characterized in that the DSP is based on mobile Industry Processor and connects
Mouth MIPI is connected between the camera and the ISP.
6. a kind of mobile terminal, which is characterized in that the mobile terminal includes being connected with camera and image-signal processor ISP
The digital signal processor DSP connect, the mobile terminal have the first camera and second camera, the first camera tool
There is the first pixel configuration, the second camera has the second pixel configuration, and first pixel configuration is higher than second picture
Element configuration, the mobile terminal include:
Image data acquisition module, for obtaining that first camera is exported based on the first pixel configuration in the DSP
One image data, and, the second image data that the second camera is exported based on the second pixel configuration；
Image data extraction module, for extracting processing image from the first image data based on second pixel configuration
Data；
Destination image data synthesis module, for synthesizing target figure using the processing image data and second image data
As data；
Destination image data sending module, for the destination image data to be sent to ISP；
Wherein, described image data extraction module includes:
Central area determines submodule, for determining the central area of the first image data；
Handle image data extraction submodule, for be based on the central area, extracted from the first image data for
Image data compatible with the second pixel configuration size is as processing image data；
Wherein, first pixel configuration refers to the image data of output first resolution；Second pixel configuration refers to defeated
The image data of second resolution out.
7. mobile terminal according to claim 6, which is characterized in that the destination image data synthesis module includes:
Characteristic information identifies submodule, for identification the characteristic information in the processing image data；
Feature information extraction submodule, for extracting the characteristic information；
Characteristic information adjustment processing submodule, for being adjusted processing to the characteristic information；
Destination image data synthesizes submodule, for by the adjustment, treated that characteristic information is added to second picture number
According to specified region, synthesize destination image data.
8. mobile terminal according to claim 6, which is characterized in that further include:
Zoom request receiving module, for receiving zoom request；
Image-region determining module, for determining the image-region of the requested image data of the zoom request；
Image-region Zoom module, for zooming in or out the image-region of described image data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710528159.4A CN107347139B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710528159.4A CN107347139B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107347139A CN107347139A (en) | 2017-11-14 |
| CN107347139B true CN107347139B (en) | 2019-01-29 |
Family
ID=60257310
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710528159.4A Active CN107347139B (en) | 2017-06-30 | 2017-06-30 | A kind of processing method and mobile terminal of image data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107347139B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103685951A (en) * | 2013-12-06 | 2014-03-26 | 华为终端有限公司 | Image processing method and device and terminal |
| WO2014069228A1 (en) * | 2012-11-05 | 2014-05-08 | 富士フイルム株式会社 | Image processing device, imaging device, image processing method, and program |
| CN103841326A (en) * | 2014-02-26 | 2014-06-04 | 宇龙计算机通信科技(深圳)有限公司 | Video recording method and device |
| CN104869320A (en) * | 2014-02-21 | 2015-08-26 | 三星电子株式会社 | Electronic device and control method of the same |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101616310B (en) * | 2009-07-17 | 2011-05-11 | 清华大学 | Target image stabilizing method of binocular vision system with variable visual angle and resolution ratio |
| US9319585B1 (en) * | 2014-12-18 | 2016-04-19 | Omnivision Technologies, Inc. | High resolution array camera |
| CN105827965B (en) * | 2016-03-25 | 2019-04-12 | 维沃移动通信有限公司 | A kind of image processing method and mobile terminal based on mobile terminal |
| CN106254780A (en) * | 2016-08-31 | 2016-12-21 | 宇龙计算机通信科技(深圳)有限公司 | A kind of dual camera camera control method, photographing control device and terminal |
-
2017
- 2017-06-30 CN CN201710528159.4A patent/CN107347139B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2014069228A1 (en) * | 2012-11-05 | 2014-05-08 | 富士フイルム株式会社 | Image processing device, imaging device, image processing method, and program |
| CN103685951A (en) * | 2013-12-06 | 2014-03-26 | 华为终端有限公司 | Image processing method and device and terminal |
| CN104869320A (en) * | 2014-02-21 | 2015-08-26 | 三星电子株式会社 | Electronic device and control method of the same |
| CN103841326A (en) * | 2014-02-26 | 2014-06-04 | 宇龙计算机通信科技(深圳)有限公司 | Video recording method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107347139A (en) | 2017-11-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105872148B (en) | A kind of generation method and mobile terminal of high dynamic range images | |
| CN105827971B (en) | A kind of image processing method and mobile terminal | |
| CN107277387B (en) | High dynamic range images image pickup method, terminal and computer readable storage medium | |
| CN106791400B (en) | A kind of image display method and mobile terminal | |
| CN105827964B (en) | A kind of image processing method and mobile terminal | |
| CN105827754B (en) | A kind of generation method and mobile terminal of high dynamic range images | |
| CN105827965B (en) | A kind of image processing method and mobile terminal based on mobile terminal | |
| CN105847674B (en) | A kind of preview image processing method and mobile terminal based on mobile terminal | |
| CN107205120B (en) | A kind of processing method and mobile terminal of image | |
| CN106101545B (en) | A kind of image processing method and mobile terminal | |
| CN106060406B (en) | Photographing method and mobile terminal | |
| CN107205119B (en) | A kind for the treatment of method and apparatus of image data | |
| CN107395898B (en) | Shooting method and mobile terminal | |
| CN107222680A (en) | The image pickup method and mobile terminal of a kind of panoramic picture | |
| CN107317993B (en) | A kind of video call method and mobile terminal | |
| CN107395976B (en) | A kind of acquisition parameters setting method and mobile terminal | |
| CN105959544B (en) | A kind of image processing method and mobile terminal of mobile terminal | |
| CN107277351A (en) | The processing method and mobile terminal of a kind of view data | |
| CN107197169A (en) | A kind of high dynamic range images image pickup method and mobile terminal | |
| CN105827970B (en) | A kind of image processing method and mobile terminal | |
| CN107172361B (en) | A kind of method and mobile terminal of pan-shot | |
| CN106126108B (en) | A kind of generation method and mobile terminal of thumbnail | |
| CN106454085B (en) | A kind of image processing method and mobile terminal | |
| CN106454086B (en) | Image processing method and mobile terminal | |
| CN107222681B (en) | A kind of processing method and mobile terminal of image data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |