Embodiment
Embodiment one
The image split screen process flow figure of the portable terminal that Fig. 1 provides for the embodiment of the invention one.As shown in Figure 1, the image split screen processing method of the portable terminal that present embodiment provides specifically can be applied to the real-time processing procedure of the video flowing that portable terminal gathers camera module, and is user's demonstration through display module.This portable terminal specifically can be mobile devices such as smart mobile phone, panel computer, and camera module and display module can be integrated on this portable terminal, also can be provided with separately.
The image split screen processing method of the portable terminal that present embodiment provides specifically comprises:
Step 10, image processing module obtain the video flowing that camera module collects in real time;
Step 20, image processing module are confirmed span mode according to the split screen indication information that receives; Confirm the video flowing that each split screen is corresponding respectively according to span mode and video flowing; Wherein, span mode is divided at least two split screens in order to indicate the viewing area with display module;
Particularly; Image processing module can be through central processing unit (the Central Processing Unit of portable terminal; Be called for short CPU) or microcontroller (Micro Control Unit; Be called for short MCU) realize, also can cooperate and realize through CPU and graphic process unit (Graphic Processing Unit is called for short GPU).
The split screen indication information specifically can be the indication information in order to definite span mode of user through the input module input of portable terminal.Portable terminal can be selected the interface for the user provides, and carries out the selection of span mode with the guiding user.If the display module of portable terminal realizes through touch-screen, but the operational controls that then can provide touch-control to select for the user, and operational controls specifically can realize through the Widget technology.Span mode is divided at least two split screens in order to indicate the viewing area with display module; Span mode specifically can comprise left and right sides 2 panes, 2 panes, 3 panes, four split screens, six split screens and eight split screens etc. up and down, can the span mode that can supply the user to select be set in advance according to the demonstration needs.Confirm the video flowing that each split screen is corresponding, the video source that each split screen is corresponding is identical, and promptly this video flowing is all collected by camera module in real time.
Step 30, image processing module are handled the image of the corresponding video flowing of each split screen respectively according to the processing indication information that receives, and the image mosaic composition screen image after each is handled also sends to display module.
Handle indication information and specifically can handle the concrete parameter information that can comprise image processing in the indication information for the indication information in order to image is handled of user through the input module input of portable terminal.The operation interface that portable terminal also can provide for the user carries out image processing operations with the guiding user.This processing indication information can also can be the processing indication information to all split screens for being directed to the processing indication information of certain split screen.Particularly; Each split screen all is assigned the split screen sign; When the user need handle the corresponding video flowing of certain split screen; Processing indication information to this split screen carries the split screen sign corresponding to this split screen, and then image processing module is confirmed split screen according to this sign, and the corresponding video flowing of this split screen is correspondingly handled.Video flowing specifically is made up of the image of a frame frame, then to the processing procedure of video flowing for each two field picture of video flowing is handled, with the image mosaic composition screen image after each split screen corresponding processing, show to realize split screen.For example span mode is a 3 panes, and then the split screen image comprises three split screens, shows the image after the corresponding processing separately in each split screen respectively.If the user indicates the corresponding video flowing of certain split screen is not handled, then images displayed is the image of the video flowing that gets access to from camera module in this split screen.
In practical application, the user is when using portable terminal to take, at first through display module preview image to be taken; Can select span mode that the viewing area of display module is divided into a plurality of split screens this moment; The image of the corresponding video flowing of each split screen is handled, each split screen institute images displayed has different effects again, and the user can take under present mode; The user contrasts the split screen that the most satisfied treatment effect is selected in the back; Can the shooting of image be carried out in this split screen full screen display under this effect, the image that the image that photographs arrives with preview is identical.The user also can import this split screen indication information and handle indication information in the shooting process, and then split screen effect and image processing effect are all recorded.The user just can accomplish the interpolation to shooting effect in shooting process, need not to carry out later stage complex video editing and processing.
The image split screen process flow figure of the portable terminal that present embodiment provides; Image processing module obtains the video flowing that camera module collects in real time; Split screen indication information according to receiving is confirmed span mode, confirms the video flowing that each split screen is corresponding respectively according to span mode and video flowing, according to the processing indication information that receives; Respectively the image of the corresponding video flowing of each split screen is handled, the image mosaic composition screen image after each is handled also sends to display module.Not only realized the split screen processing of the video flowing that portable terminal collects in real time; And can handle respectively the image of the corresponding video flowing of each split screen according to the processing indication information that receives; To show different treatment effects, improved the split screen treatment effect of portable terminal to image.
Embodiment two
The image split screen process flow figure of the portable terminal that Fig. 2 provides for the embodiment of the invention two.As shown in Figure 2; The image split screen processing method of the portable terminal that present embodiment provides is on basis embodiment illustrated in fig. 1; Step 30, image processing module are handled the image of the corresponding video flowing of each split screen respectively according to the processing indication information that receives; Image mosaic composition screen image after each is handled also sends to display module, specifically can comprise the steps:
The CPU of step 301, image processing module generates parameter matrix according to handling indication information; According to the split screen sign of handling in the indication information; Confirm pending video flowing; Image according to pending video flowing generates texture, parameter matrix, texture and span mode is sent to the GPU of image processing module;
Step 302, GPU are handled texture according to parameter matrix;
Step 303, GPU are with each split screen image mosaic composition screen image after the corresponding processing and send to display module respectively.
Particularly, image processing module comprises CPU and GPU, and CPU can realize that GPU can be realized through GPU through CPU or MCU.CPU is confirmed pending video flowing according to the split screen sign of handling in the indication information; Obtain each two field picture of this video flowing, can confirm the size of each split screen earlier according to span mode, image is adjusted to the image that adapts to this split screen size; Generate texture according to this adjusted image again; The texture that is generated can be one, also can be for a plurality of, and its quantity is provided with according to the processing needs of scene.Particularly, graphics processing unit can be based on open graphic library (Open Graphics Library is called for short OpenGL) technology, and then texture can be the OpenGL texture.This processing indication information can comprise that specifically Nonlinear Processing indication information, colour temperature are handled indication information, brightness processed indication information, contrast processing indication information, exposure processing indication information, saturation handles indication information and form and aspect are handled indication information etc.CPU generates and this processing indication information corresponding parameters matrix according to handling indication information, and this parameter matrix can be resolved and carry out by GPU.This handles indication information can be above-mentioned a kind of processing indication information, combination that also can multiple processing indication information.
CPU realizes split screen control; Coordinating resource handles the corresponding video flowing of each split screen respectively; The processing indication information that receives is changed integration, and GPU is correspondingly handled texture, through the cooperation of CPU and GPU; Realized processing, can make this processing procedure more efficient and smooth the video flowing that obtains in real time.
Further, in the present embodiment, step 30, image processing module are handled the image of the corresponding video flowing of each split screen respectively according to the processing indication information that receives, and can comprise the steps:
Image processing module calls the thread that corresponds respectively to each split screen, and the image of the corresponding video flowing of each split screen is handled.
Respectively video flowing is handled through calling different threads, can be avoided the interference between each video flowing, further improved split screen treatment effect video flowing.
In the present embodiment; Handling indication information specifically can comprise following at least a: Nonlinear Processing indication information, colour temperature are handled indication information, and brightness processed indication information, contrast processing indication information, saturation processing indication information, form and aspect processing indication information, exposure are handled indication information, masking-out is handled indication information and frame processing indication information.
Can a plurality of masking-outs be set in advance and frame is selected for the user.Handling indication information and can indicate certain specific processing, also can be the combination of multiple processing.This processing indication information can also like photo studio style, the style of missing old times or old friends, european style etc., then can comprise in this processing indication information cooperating all processing parameters of realizing this specific style in order to indicate certain specific style.Handling indication information can be provided with according to the image processing needs of reality, does not exceed with present embodiment.
Embodiment three
The image split screen process flow figure of the portable terminal that Fig. 3 provides for the embodiment of the invention three.As shown in Figure 3; The image split screen processing method of the portable terminal that present embodiment provides is on the basis of embodiment as shown in Figure 1; Image processing module in the step 20 is confirmed before the span mode according to the split screen indication information that receives, specifically can also be comprised the steps:
Step 40, image processing module are with Preset Time interval receiving mode indication message, and wherein, the mode switch indication information comprises the split screen indication information and handles indication information.
Particularly, portable terminal can be preset a plurality of span mode, and between each span mode, switches at interval with Preset Time.The mode switch indication information comprises the split screen indication information and handles indication information, this split screen indication information with handle span mode that indication information will switch in order to indication and the processing indication of the corresponding video flowing of each split screen under this span mode.Span mode, this span mode corresponding processing indication information and all can be provided with in advance and store switching time.Also can the interface is set be provided with for the user provides for the user.
Then the user is in the process through the portable terminal shooting; Can one key shoot function be provided for the user; When the user has selected this key shoot function; Just can be implemented in the shooting process and between different span mode, switch at interval, and the treatment effect of each split screen is different in the different span mode with Preset Time.Therefore, also just comprised above-mentioned effect in the video of shooting.The user need not to carry out post-processed just can shoot personalized video work, has improved user experience.
In the present embodiment, step 40, image processing module is with after the receiving mode indication message of Preset Time interval, and the image processing module in the step 30 will divide screen image to send to before the display module, specifically can also comprise the steps:
Step 50, image processing module will be preset the transition animation and send to display module.
When under the control of the mode switch indication information that image processing module is receiving or the control of the mode switch indication information that regularly triggers when carrying out mode switch; Can between two patterns, insert preset transition animation; To realize the level and smooth gradual transition of two patterns, give the user to experience smoothly.
In the present embodiment, after the image mosaic composition screen image after the image processing module in the step 30 is handled each, specifically can also comprise the steps:
Step 60, image processing module are stored to memory module after with the split screen image encoding.
The user is when taking, and image processing module can be encoded the back storage to form video file to a minute screen image through preset encryption algorithm.In actual process, can carry out simultaneously to the code storage process of image with to the procedure for displaying of image.Image processing module also can call two threads and respectively preview process and storing process handled, and to avoid the interference of two processing procedures, especially in the HD video recording process of big resolution, can guarantee the smooth and easy of user real time preview video.
In the present embodiment, image processing module can also be realized the shooting of HD video, obtains HD video, like 720p/1080p.
Embodiment four
The mobile terminal structure sketch map that Fig. 4 provides for the embodiment of the invention four.As shown in Figure 4, the portable terminal that present embodiment provides specifically can be realized each step of the image split screen processing method of the portable terminal that any embodiment of the present invention provides, and this repeats no more.
The portable terminal that present embodiment provides; Comprise camera module 11 and display module 12; This portable terminal specifically also comprises image processing module 13, and image processing module 13 comprises that video flowing obtains submodule 131, split screen submodule 132 and image processing submodule 133.Video flowing obtains submodule 131 and is used to obtain the video flowing that camera module 11 collects in real time.Split screen submodule 132 is used for confirming span mode according to the split screen indication information that receives; Confirm the video flowing that each split screen is corresponding respectively according to span mode and video flowing; Wherein, span mode is divided at least two split screens in order to indicate the viewing area with display module 12.Image processing submodule 133 is used for according to the processing indication information that receives, and respectively the image of the corresponding video flowing of each split screen is handled, and the image mosaic composition screen image after each is handled also sends to display module 12.
The portable terminal that present embodiment provides; Video flowing obtains submodule 131 and obtains the video flowing that camera module 11 collects in real time; Split screen submodule 132 is confirmed span mode according to the split screen indication information that receives; Confirm the video flowing that each split screen is corresponding respectively according to span mode and video flowing; Image processing submodule 133 is handled the image of the corresponding video flowing of each split screen respectively according to the processing indication information that receives, and the image mosaic composition screen image after each is handled also sends to display module 12.Not only realized the split screen processing of the video flowing that portable terminal collects in real time; And can handle respectively the image of the corresponding video flowing of each split screen according to the processing indication information that receives; To show different treatment effects, improved the split screen treatment effect of portable terminal to image.
Embodiment five
The mobile terminal structure sketch map that Fig. 5 provides for the embodiment of the invention five.As shown in Figure 5, the portable terminal that present embodiment provides is on basis embodiment illustrated in fig. 4, and preferably, image processing submodule 133 comprises CPU 21 and GPU 22.CPU 21 is used for generating parameter matrix according to handling indication information; According to the split screen sign of handling in the indication information; Confirm pending video flowing; Image according to pending video flowing generates texture, parameter matrix, texture and span mode is sent to the GPU 22 of image processing module 13.GPU 22 is used for according to parameter matrix texture being handled, with each split screen image mosaic composition screen image after the corresponding processing and send to display module 12 respectively.CPU 21 can realize that GPU 22 can be realized through GPU through CPU or MCU.CPU 21 realizes split screen control; Coordinating resource handles the corresponding video flowing of each split screen respectively; The processing indication information that receives is changed integration, and 22 pairs of textures of GPU are correspondingly handled, through the cooperation of CPU 21 and GPU 22; Realized processing, improved the high efficiency and the fluency of processing procedure the video flowing that obtains in real time.
In the present embodiment, image processing submodule 133 specifically can also be used to call the thread that corresponds respectively to each split screen, and the image of the corresponding video flowing of each split screen is handled.Respectively video flowing is handled through calling different threads, can be avoided the interference between each video flowing, further improved split screen treatment effect video flowing.
Further; In the present embodiment, image processing module 13 can also comprise mode switch submodule 134, and mode switch submodule 134 is used for Preset Time interval receiving mode indication message; Wherein, the mode switch indication information comprises the split screen indication information and handles indication information.Through the setting of mode switch submodule 134, can be implemented in the shooting process and between different span mode, switch at interval, and the treatment effect of each split screen is different in the different span mode with Preset Time.Therefore, also just comprised above-mentioned effect in the video of shooting.The user need not to carry out post-processed just can shoot personalized video work, has improved user experience.
Preferably, in the present embodiment, image processing module 13 can also comprise transition processing sub 135, and transition processing sub 135 is used for preset transition animation is sent to display module 12.Through the setting of transition processing sub 135, the level and smooth gradual transition when can implementation pattern switching has further improved user experience.
In the present embodiment, this portable terminal also comprises memory module 14, and correspondingly, image processing module 13 specifically can also comprise takes submodule 136, takes submodule 136 and is used for being stored to memory module 14 after the split screen image encoding.
Portable terminal provided by the invention and image split screen processing method thereof provide extendible split screen model, and the user can easily be clicked, the multi-screen combined effect that need take time and effort very much in the PC the inside before can accomplishing.Let user's live preview before shooting select, and disposable shooting promptly accomplishes HD video, and need not the later stage video editing making work of follow-up complicacy.And under intelligent screening-mode, domestic consumer only needs a key to click, and also can take out very personalized high-quality video works.Under professional screening-mode, can there be the very abundant various fine granularity mediation function options relevant with graph image in advanced level user, fully excavates the possibility of video capture, carries out in post-production and need not wait.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be accomplished through the relevant hardware of program command; Aforesaid program can be stored in the computer read/write memory medium; This program the step that comprises said method embodiment when carrying out; And aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
What should explain at last is: above embodiment is only in order to explaining technical scheme of the present invention, but not to its restriction; Although with reference to previous embodiment the present invention has been carried out detailed explanation, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these are revised or replacement, do not make the scope of the essence disengaging various embodiments of the present invention technical scheme of relevant art scheme.